Skip to content

add network_fuzz test case to the test suite#1097

Open
joej164 wants to merge 6 commits intosonic-net:masterfrom
IGNW:lafe-78-final-review-of-network-fuzz-pr
Open

add network_fuzz test case to the test suite#1097
joej164 wants to merge 6 commits intosonic-net:masterfrom
IGNW:lafe-78-final-review-of-network-fuzz-pr

Conversation

@joej164
Copy link
Contributor

@joej164 joej164 commented Sep 4, 2019

network_fuzz_t1_eight_output.log
network_fuzz_t0_eight_output.log

Description of PR

Summary:
Adds a network fuzz test to the group of tests. The test will send invalid packets to the DUT and verify the system does not become unstable.

Type of change

  • [] Bug fix
  • [] Testbed and Framework(new/improvement)
  • Test case(new/improvement)

Approach

How did you do it?

Used the PTF and the scapy.py library to send bogus packets

How did you verify/test it?

Used loganalyzer and base_sanity to verify system operation

Any platform specific information?

Requires the use of a PTF

Supported testbed topology if it's a new test case?

Should work on t0 and t1 based topologies

Documentation

Updated the inline documentation with an example of how to run the test

Test Results

Pylint Results:
Pylint found no errors and the python file is python3 compatible. Ran pylint with `pylint -E --py3k'

Command: ansible-playbook -i lab test_sonic.yml -e testbed_name=t0-eight -e testcase_name=network_fuzz

Results:
"PLAY RECAP *********************************************************************
lab-ignw-seastone-dut-li1 : ok=309 changed=70 unreachable=0 failed=0

Monday 02 September 2019 20:35:58 +0000 (0:00:00.076) 0:05:05.496 ******

TASK: test : command --------------------------------------------------- 22.97s
TASK: test : command --------------------------------------------------- 22.73s
TASK: test : command --------------------------------------------------- 20.65s
TASK: test : command --------------------------------------------------- 10.40s
TASK: test : Copy loganalyzer common match and ignore files to switch --- 4.10s
TASK: test : Copy tests to the PTF container ---------------------------- 3.99s
TASK: test : Verify port channel interfaces are up correctly ------------ 3.67s
TASK: test : Verify port channel interfaces are up correctly ------------ 3.48s
TASK: test : Verify port channel interfaces are up correctly ------------ 3.41s
TASK: test : Verify port channel interfaces are up correctly ------------ 3.30s
TASK: test : Verify port channel interfaces are up correctly ------------ 3.28s
TASK: test : Copy loganalyzer common match and ignore files to switch --- 3.24s
TASK: test : Store the indices for the ports that operationally 'up' ---- 3.17s
TASK: test : Copy loganalyzer common match and ignore files to switch --- 3.16s
TASK: test : Copy loganalyzer common match and ignore files to switch --- 2.99s
TASK: test : Validate all interfaces are still up ----------------------- 2.93s
TASK: test : Get the interface name that is connect to the first BGP neighbor --- 2.90s
TASK: test : command ---------------------------------------------------- 2.67s
TASK: test : Validate all interfaces are still up ----------------------- 2.65s
TASK: test : Validate all interfaces are still up ----------------------- 2.65s"

Command: ansible-playbook -i lab test_sonic.yml -e testbed_name=t1-eight -e testcase_name=network_fuzz

Results:
"PLAY RECAP *********************************************************************
lab-ignw-seastone-dut-li1 : ok=295 changed=69 unreachable=0 failed=0

Monday 02 September 2019 19:42:32 +0000 (0:00:00.088) 0:04:26.754 ******

TASK: test : command --------------------------------------------------- 22.83s
TASK: test : command --------------------------------------------------- 16.22s
TASK: test : command --------------------------------------------------- 14.79s
TASK: test : command ---------------------------------------------------- 8.24s
TASK: test : Get the interface name that is connect to the first BGP neighbor --- 5.56s
TASK: test : Copy loganalyzer common match and ignore files to switch --- 4.19s
TASK: test : Copy tests to the PTF container ---------------------------- 3.98s
TASK: test : Store the indices for the ports that operationally 'up' ---- 3.29s
TASK: test : Copy loganalyzer common match and ignore files to switch --- 3.27s
TASK: test : Copy loganalyzer common match and ignore files to switch --- 2.97s
TASK: test : Validate all interfaces are still up ----------------------- 2.85s
TASK: test : Validate all interfaces are still up ----------------------- 2.73s
TASK: test : Copy loganalyzer common match and ignore files to switch --- 2.70s
TASK: test : command ---------------------------------------------------- 2.65s
TASK: test : Validate all interfaces are still up ----------------------- 2.59s
TASK: test : Validate all interfaces are still up ----------------------- 2.58s
TASK: test : Validate all interfaces are still up ----------------------- 2.58s
TASK: test : Copy loganalyzer common match and ignore files to switch --- 2.54s
TASK: test : debug ------------------------------------------------------ 1.90s
TASK: test : Fetch result files from switch to ansible machine ---------- 1.89s"

Joe Lazaro and others added 4 commits July 25, 2019 15:52
Merge Azure Master into IGNW Master
Update master from Azure/Sonic - August 12th, 2019
Merge latest copy of azure master into ignw master
@joej164
Copy link
Contributor Author

joej164 commented Sep 5, 2019

closing to fix some issues, will reopen when fixed

@joej164 joej164 closed this Sep 5, 2019
@joej164
Copy link
Contributor Author

joej164 commented Sep 6, 2019

files fixed, reopening

@joej164 joej164 reopened this Sep 6, 2019
Copy link
Member

@praveen-li praveen-li left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me.

@joej164 joej164 requested a review from a team as a code owner March 2, 2022 17:37
kazinator-arista pushed a commit to kazinator-arista/sonic-mgmt that referenced this pull request Mar 4, 2026
update the environment variable in the teardown (sonic-net#1101)
Fix for show interface portchannel now working on 201911 (sonic-net#1105)
Revert "Pfcstat (sonic-net#1097)"
Revert " [201911]show interface counters for multi ASIC devices
      (sonic-net#1104)"

Signed-off-by: Abhishek Dosi <[email protected]>
kazinator-arista pushed a commit to kazinator-arista/sonic-mgmt that referenced this pull request Mar 4, 2026
Revert "Revert " [201911]show interface counters for multi ASIC devices
(sonic-net#1104)""
 Revert "Revert "Pfcstat (sonic-net#1097)""
  [show] Fix 'show int neighbor expected' (sonic-net#1106)
   Update argument for docker exec it->i (sonic-net#1118)
     Update to make config load/reload backward compatible. (sonic-net#1115)
     Handling deletion of Port Channel before deletion of its members
     (sonic-net#1062)
    Skip default route present in ASIC-DB but not in APP-DB. (sonic-net#1107)
     [CLI][PFCWD][Multi-ASIC] Added multi ASIC support to 'pfcwd' CLI
     (sonic-net#1102)
       [201911]  Multi asic platform config interface portchannel, show
       transceiver  (sonic-net#1087)
       [drop counters] Fix configuration for counters with lowercase
       names (sonic-net#1103)

Signed-off-by: Abhishek Dosi <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants