Skip to content

Degrade PFC storm detection in PFCWD all ports storm test#13976

Merged
bingwang-ms merged 5 commits intosonic-net:masterfrom
bingwang-ms:degrade_pfcwd_detection_in_all_storm_test
Aug 13, 2024
Merged

Degrade PFC storm detection in PFCWD all ports storm test#13976
bingwang-ms merged 5 commits intosonic-net:masterfrom
bingwang-ms:degrade_pfcwd_detection_in_all_storm_test

Conversation

@bingwang-ms
Copy link
Copy Markdown
Collaborator

Description of PR

Summary:
This PR is to degrade the PFC storm detection logic on Mellanox platform to workaround the performance issue of leaf-fanout switch.

The test_pfcwd_all_port_storm.py is failing because leaf fanout switch can't send enough PFC pause frames to trigger PFC storm after PR sonic-net/sonic-swss#3036 .
There are different workaround method on Onyx and Mellanox-SONiC leaf-fanout, but there is no workaround for DUT that is not connected to Mellanox leaf-fanout switch.
This PR workaround the issue by copying the old pfc_detect_mellanox.lua to degrade the PFC storm detection logic to make PFC storm easier to be triggered.
As the test is to verify there is no issue when PFCWD is firing on all ports, this change doesn't change the coverage of test.

Type of change

  • Bug fix
  • Testbed and Framework(new/improvement)
  • Test case(new/improvement)

Back port request

  • 202012
  • 202205
  • 202305
  • 202311
  • 202405

Approach

What is the motivation for this PR?

This PR workaround the issue by copying the old pfc_detect_mellanox.lua to degrade the PFC storm detection logic to make PFC storm easier to be triggered.

How did you do it?

Cppy the old pfc_detect_mellanox.lua to degrade the PFC storm detection logic.

How did you verify/test it?

The change is verified on a Mellanox DUT.

collected 1 item                                                                                                                                                                                      

pfcwd/test_pfcwd_all_port_storm.py::TestPfcwdAllPortStorm::test_all_port_storm_restore[str-msn2700-22]  ^HPASSED                                                                                   [100%]

Any platform specific information?

Mellanox platform specific.

Supported testbed topology if it's a new test case?

Not a new test case.

Documentation

Copy link
Copy Markdown
Contributor

@nhe-NV nhe-NV left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

As this solution is to workaround the fanout which is not using the mellanox switch, suggest only apply this solution when the fanout is not mellanox switch(onxy or sonic)

@bingwang-ms
Copy link
Copy Markdown
Collaborator Author

As this solution is to workaround the fanout which is not using the mellanox switch, suggest only apply this solution when the fanout is not mellanox switch(onxy or sonic)

Added a skip statement for Mellanox leaf fanout.

@bingwang-ms
Copy link
Copy Markdown
Collaborator Author

@nhe-NV Can you help review again? Thanks

@bingwang-ms bingwang-ms merged commit 6e6e772 into sonic-net:master Aug 13, 2024
mssonicbld pushed a commit to mssonicbld/sonic-mgmt that referenced this pull request Aug 13, 2024
…13976)

* Degrade PFC storm detection logic in pfcwd_all_port_storm test
mssonicbld pushed a commit to mssonicbld/sonic-mgmt that referenced this pull request Aug 13, 2024
…13976)

* Degrade PFC storm detection logic in pfcwd_all_port_storm test
@mssonicbld
Copy link
Copy Markdown
Collaborator

Cherry-pick PR to 202311: #14093

@mssonicbld
Copy link
Copy Markdown
Collaborator

Cherry-pick PR to 202405: #14092

mssonicbld pushed a commit that referenced this pull request Aug 13, 2024
* Degrade PFC storm detection logic in pfcwd_all_port_storm test
bingwang-ms added a commit that referenced this pull request Sep 13, 2024
…14092)

* Degrade PFC storm detection logic in pfcwd_all_port_storm test

Co-authored-by: bingwang-ms <[email protected]>
arista-hpandya pushed a commit to arista-hpandya/sonic-mgmt that referenced this pull request Oct 2, 2024
…13976)

* Degrade PFC storm detection logic in pfcwd_all_port_storm test
vikshaw-Nokia pushed a commit to vikshaw-Nokia/sonic-mgmt that referenced this pull request Oct 23, 2024
…13976)

* Degrade PFC storm detection logic in pfcwd_all_port_storm test
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants