Skip to content

update skip condition for cisco T2#11553

Merged
abdosi merged 2 commits intosonic-net:masterfrom
zhixzhu:t2_skip_case_master
Feb 6, 2024
Merged

update skip condition for cisco T2#11553
abdosi merged 2 commits intosonic-net:masterfrom
zhixzhu:t2_skip_case_master

Conversation

@zhixzhu
Copy link
Copy Markdown
Contributor

@zhixzhu zhixzhu commented Feb 1, 2024

Description of PR

1, testQosSaiLosslessVoq requires split-voq or fair-voq, skip vanguard(cisco Q200 longlink) since it uses default-voq.
2. testQosSaiSharedReservationSize, skip gibraltar(cisco Q200 linecard) since not enough ports.
Skip shared_res_size_2 for pacific(cisco Q100 linecard) since on pacific, SQG thresholds have no impact on XOFF thresholds.

Summary:
Fixes # (issue)

Type of change

  • Bug fix
  • Testbed and Framework(new/improvement)
  • Test case(new/improvement)

Back port request

  • 201911
  • 202012
  • 202205
  • 202305
  • 202311

Approach

What is the motivation for this PR?

How did you do it?

How did you verify/test it?

Vanguard:
---------------------------- generated xml file: /tmp/qos/test_qos_sai.py::TestQosSai::testQosSaiLosslessVoq_2024-02-03-00-37-06.xml -----------------------------
INFO:root:Can not get Allure report URL. Please check logs
--------------------------------------------------------------------- live log sessionfinish ---------------------------------------------------------------------
00:40:50 init.pytest_terminal_summary L0064 INFO | Can not get Allure report URL. Please check logs
==================================================================== short test summary info =====================================================================
SKIPPED [1] qos/qos_sai_base.py:2179: This test is skipped for longlink.
=========================================================== 1 skipped, 1 warning in 222.65s (0:03:42) ============================================================

----------------------- generated xml file: /tmp/qos/test_qos_sai.py::TestQosSai::testQosSaiSharedReservationSize_2024-02-03-00-44-40.xml ------------------------
INFO:root:Can not get Allure report URL. Please check logs
--------------------------------------------------------------------- live log sessionfinish ---------------------------------------------------------------------
00:48:24 init.pytest_terminal_summary L0064 INFO | Can not get Allure report URL. Please check logs
==================================================================== short test summary info =====================================================================
SKIPPED [1] qos/test_qos_sai.py:100: This test cannot be run since there are not enough ports. Pls see qos.yaml for the port idx's that are needed.
=========================================================== 1 skipped, 1 warning in 222.69s (0:03:42) ============================================================

Any platform specific information?

Supported testbed topology if it's a new test case?

Documentation

@zhixzhu zhixzhu marked this pull request as draft February 1, 2024 23:15
@mssonicbld
Copy link
Copy Markdown
Collaborator

The pre-commit check detected issues in the files touched by this pull request.
The pre-commit check is a mandatory check, please fix detected issues.

Detailed pre-commit check results:
trim trailing whitespace.................................................Passed
fix end of files.........................................................Passed
check yaml...........................................(no files to check)Skipped
check for added large files..............................................Passed
check python ast.........................................................Passed
flake8...................................................................Failed
- hook id: flake8
- exit code: 1

tests/qos/test_qos_sai.py:899:13: E125 continuation line with same indent as next logical line
tests/qos/test_qos_sai.py:900:17: E117 over-indented

flake8...............................................(no files to check)Skipped
check conditional mark sort..........................(no files to check)Skipped

To run the pre-commit checks locally, you can follow below steps:

  1. Ensure that default python is python3. In sonic-mgmt docker container, default python is python2. You can run
    the check by activating the python3 virtual environment in sonic-mgmt docker container or outside of sonic-mgmt
    docker container.
  2. Ensure that the pre-commit package is installed:
sudo pip install pre-commit
  1. Go to repository root folder
  2. Install the pre-commit hooks:
pre-commit install
  1. Use pre-commit to check staged file:
pre-commit
  1. Alternatively, you can check committed files using:
pre-commit run --from-ref <commit_id> --to-ref <commit_id>

@mssonicbld
Copy link
Copy Markdown
Collaborator

The pre-commit check detected issues in the files touched by this pull request.
The pre-commit check is a mandatory check, please fix detected issues.

Detailed pre-commit check results:
trim trailing whitespace.................................................Passed
fix end of files.........................................................Passed
check yaml...........................................(no files to check)Skipped
check for added large files..............................................Passed
check python ast.........................................................Passed
flake8...................................................................Failed
- hook id: flake8
- exit code: 1

tests/qos/test_qos_sai.py:899:11: E127 continuation line over-indented for visual indent

flake8...............................................(no files to check)Skipped
check conditional mark sort..........................(no files to check)Skipped

To run the pre-commit checks locally, you can follow below steps:

  1. Ensure that default python is python3. In sonic-mgmt docker container, default python is python2. You can run
    the check by activating the python3 virtual environment in sonic-mgmt docker container or outside of sonic-mgmt
    docker container.
  2. Ensure that the pre-commit package is installed:
sudo pip install pre-commit
  1. Go to repository root folder
  2. Install the pre-commit hooks:
pre-commit install
  1. Use pre-commit to check staged file:
pre-commit
  1. Alternatively, you can check committed files using:
pre-commit run --from-ref <commit_id> --to-ref <commit_id>

@mssonicbld
Copy link
Copy Markdown
Collaborator

The pre-commit check detected issues in the files touched by this pull request.
The pre-commit check is a mandatory check, please fix detected issues.

Detailed pre-commit check results:
trim trailing whitespace.................................................Passed
fix end of files.........................................................Passed
check yaml...........................................(no files to check)Skipped
check for added large files..............................................Passed
check python ast.........................................................Passed
flake8...................................................................Failed
- hook id: flake8
- exit code: 1

tests/qos/test_qos_sai.py:899:9: E122 continuation line missing indentation or outdented

flake8...............................................(no files to check)Skipped
check conditional mark sort..........................(no files to check)Skipped

To run the pre-commit checks locally, you can follow below steps:

  1. Ensure that default python is python3. In sonic-mgmt docker container, default python is python2. You can run
    the check by activating the python3 virtual environment in sonic-mgmt docker container or outside of sonic-mgmt
    docker container.
  2. Ensure that the pre-commit package is installed:
sudo pip install pre-commit
  1. Go to repository root folder
  2. Install the pre-commit hooks:
pre-commit install
  1. Use pre-commit to check staged file:
pre-commit
  1. Alternatively, you can check committed files using:
pre-commit run --from-ref <commit_id> --to-ref <commit_id>

@zhixzhu zhixzhu force-pushed the t2_skip_case_master branch from 41de0ef to 24ad77d Compare February 1, 2024 23:35
@mssonicbld
Copy link
Copy Markdown
Collaborator

The pre-commit check detected issues in the files touched by this pull request.
The pre-commit check is a mandatory check, please fix detected issues.

Detailed pre-commit check results:
trim trailing whitespace.................................................Passed
fix end of files.........................................................Passed
check yaml...........................................(no files to check)Skipped
check for added large files..............................................Passed
check python ast.........................................................Passed
flake8...................................................................Failed
- hook id: flake8
- exit code: 1

tests/qos/test_qos_sai.py:899:13: E129 visually indented line with same indent as next logical line

flake8...............................................(no files to check)Skipped
check conditional mark sort..........................(no files to check)Skipped

To run the pre-commit checks locally, you can follow below steps:

  1. Ensure that default python is python3. In sonic-mgmt docker container, default python is python2. You can run
    the check by activating the python3 virtual environment in sonic-mgmt docker container or outside of sonic-mgmt
    docker container.
  2. Ensure that the pre-commit package is installed:
sudo pip install pre-commit
  1. Go to repository root folder
  2. Install the pre-commit hooks:
pre-commit install
  1. Use pre-commit to check staged file:
pre-commit
  1. Alternatively, you can check committed files using:
pre-commit run --from-ref <commit_id> --to-ref <commit_id>

Signed-off-by: Zhixin Zhu <zhixzhu@cisco.com>
@zhixzhu zhixzhu force-pushed the t2_skip_case_master branch from 24ad77d to e478d46 Compare February 1, 2024 23:39
Signed-off-by: Zhixin Zhu <zhixzhu@cisco.com>
@zhixzhu zhixzhu marked this pull request as ready for review February 3, 2024 01:02
@abdosi abdosi merged commit fb92b91 into sonic-net:master Feb 6, 2024
mssonicbld pushed a commit to mssonicbld/sonic-mgmt that referenced this pull request Feb 6, 2024
1, testQosSaiLosslessVoq requires split-voq or fair-voq, skip vanguard(cisco Q200 longlink) since it uses default-voq.
2. testQosSaiSharedReservationSize, skip gibraltar(cisco Q200 linecard) since not enough ports.
Skip shared_res_size_2 for pacific(cisco Q100 linecard) since on pacific, SQG thresholds have no impact on XOFF thresholds.
@mssonicbld
Copy link
Copy Markdown
Collaborator

Cherry-pick PR to 202305: #11646

mssonicbld pushed a commit that referenced this pull request Feb 6, 2024
1, testQosSaiLosslessVoq requires split-voq or fair-voq, skip vanguard(cisco Q200 longlink) since it uses default-voq.
2. testQosSaiSharedReservationSize, skip gibraltar(cisco Q200 linecard) since not enough ports.
Skip shared_res_size_2 for pacific(cisco Q100 linecard) since on pacific, SQG thresholds have no impact on XOFF thresholds.
@XuChen-MSFT XuChen-MSFT mentioned this pull request Feb 19, 2024
8 tasks
StormLiangMS pushed a commit that referenced this pull request Feb 20, 2024
What is the motivation for this PR?
PR #10382 caused below two KeyError:

    @pytest.fixture(scope="function", autouse=False)
    def skip_pacific_dst_asic(self, dutConfig):
>       if dutConfig['dstDutAsic'] == "pac":
E       KeyError: 'dstDutAsic'
        if "wm_pg_shared_lossless" in pgProfile:
            pktsNumFillShared = qosConfig[pgProfile]["pkts_num_trig_pfc"]
        elif "wm_pg_shared_lossy" in pgProfile:
>           if dutConfig['dstDutAsic'] == "pac":
E           KeyError: 'dstDutAsic'
and remove duplicated code in PR #11553 and PR #10838, it will cause pre-commit failure

    @pytest.fixture(scope="function", autouse=False)
    def skip_longlink(self, dutQosConfig):
        portSpeedCableLength = dutQosConfig["portSpeedCableLength"]
        match = re.search("_([0-9]*)m", portSpeedCableLength)
        if match and int(match.group(1)) > 2000:
            pytest.skip(
                "This test is skipped for longlink.")
        yield
        return
How did you do it?
fix keyerror and remove duplicated code
mssonicbld pushed a commit to mssonicbld/sonic-mgmt that referenced this pull request Feb 20, 2024
What is the motivation for this PR?
PR sonic-net#10382 caused below two KeyError:

    @pytest.fixture(scope="function", autouse=False)
    def skip_pacific_dst_asic(self, dutConfig):
>       if dutConfig['dstDutAsic'] == "pac":
E       KeyError: 'dstDutAsic'
        if "wm_pg_shared_lossless" in pgProfile:
            pktsNumFillShared = qosConfig[pgProfile]["pkts_num_trig_pfc"]
        elif "wm_pg_shared_lossy" in pgProfile:
>           if dutConfig['dstDutAsic'] == "pac":
E           KeyError: 'dstDutAsic'
and remove duplicated code in PR sonic-net#11553 and PR sonic-net#10838, it will cause pre-commit failure

    @pytest.fixture(scope="function", autouse=False)
    def skip_longlink(self, dutQosConfig):
        portSpeedCableLength = dutQosConfig["portSpeedCableLength"]
        match = re.search("_([0-9]*)m", portSpeedCableLength)
        if match and int(match.group(1)) > 2000:
            pytest.skip(
                "This test is skipped for longlink.")
        yield
        return
How did you do it?
fix keyerror and remove duplicated code
mssonicbld pushed a commit to mssonicbld/sonic-mgmt that referenced this pull request Feb 20, 2024
What is the motivation for this PR?
PR sonic-net#10382 caused below two KeyError:

    @pytest.fixture(scope="function", autouse=False)
    def skip_pacific_dst_asic(self, dutConfig):
>       if dutConfig['dstDutAsic'] == "pac":
E       KeyError: 'dstDutAsic'
        if "wm_pg_shared_lossless" in pgProfile:
            pktsNumFillShared = qosConfig[pgProfile]["pkts_num_trig_pfc"]
        elif "wm_pg_shared_lossy" in pgProfile:
>           if dutConfig['dstDutAsic'] == "pac":
E           KeyError: 'dstDutAsic'
and remove duplicated code in PR sonic-net#11553 and PR sonic-net#10838, it will cause pre-commit failure

    @pytest.fixture(scope="function", autouse=False)
    def skip_longlink(self, dutQosConfig):
        portSpeedCableLength = dutQosConfig["portSpeedCableLength"]
        match = re.search("_([0-9]*)m", portSpeedCableLength)
        if match and int(match.group(1)) > 2000:
            pytest.skip(
                "This test is skipped for longlink.")
        yield
        return
How did you do it?
fix keyerror and remove duplicated code
mssonicbld pushed a commit that referenced this pull request Feb 20, 2024
What is the motivation for this PR?
PR #10382 caused below two KeyError:

    @pytest.fixture(scope="function", autouse=False)
    def skip_pacific_dst_asic(self, dutConfig):
>       if dutConfig['dstDutAsic'] == "pac":
E       KeyError: 'dstDutAsic'
        if "wm_pg_shared_lossless" in pgProfile:
            pktsNumFillShared = qosConfig[pgProfile]["pkts_num_trig_pfc"]
        elif "wm_pg_shared_lossy" in pgProfile:
>           if dutConfig['dstDutAsic'] == "pac":
E           KeyError: 'dstDutAsic'
and remove duplicated code in PR #11553 and PR #10838, it will cause pre-commit failure

    @pytest.fixture(scope="function", autouse=False)
    def skip_longlink(self, dutQosConfig):
        portSpeedCableLength = dutQosConfig["portSpeedCableLength"]
        match = re.search("_([0-9]*)m", portSpeedCableLength)
        if match and int(match.group(1)) > 2000:
            pytest.skip(
                "This test is skipped for longlink.")
        yield
        return
How did you do it?
fix keyerror and remove duplicated code
mssonicbld pushed a commit that referenced this pull request Feb 20, 2024
What is the motivation for this PR?
PR #10382 caused below two KeyError:

    @pytest.fixture(scope="function", autouse=False)
    def skip_pacific_dst_asic(self, dutConfig):
>       if dutConfig['dstDutAsic'] == "pac":
E       KeyError: 'dstDutAsic'
        if "wm_pg_shared_lossless" in pgProfile:
            pktsNumFillShared = qosConfig[pgProfile]["pkts_num_trig_pfc"]
        elif "wm_pg_shared_lossy" in pgProfile:
>           if dutConfig['dstDutAsic'] == "pac":
E           KeyError: 'dstDutAsic'
and remove duplicated code in PR #11553 and PR #10838, it will cause pre-commit failure

    @pytest.fixture(scope="function", autouse=False)
    def skip_longlink(self, dutQosConfig):
        portSpeedCableLength = dutQosConfig["portSpeedCableLength"]
        match = re.search("_([0-9]*)m", portSpeedCableLength)
        if match and int(match.group(1)) > 2000:
            pytest.skip(
                "This test is skipped for longlink.")
        yield
        return
How did you do it?
fix keyerror and remove duplicated code
@XuChen-MSFT
Copy link
Copy Markdown
Contributor

have duplicated impl for function "skip_longlink" in both PR #11553 and PR #10838,
already fixed in master branch, please remove duplicated code when cherry pick

mssonicbld pushed a commit to mssonicbld/sonic-mgmt that referenced this pull request Mar 22, 2024
1, testQosSaiLosslessVoq requires split-voq or fair-voq, skip vanguard(cisco Q200 longlink) since it uses default-voq.
2. testQosSaiSharedReservationSize, skip gibraltar(cisco Q200 linecard) since not enough ports.
Skip shared_res_size_2 for pacific(cisco Q100 linecard) since on pacific, SQG thresholds have no impact on XOFF thresholds.
@mssonicbld
Copy link
Copy Markdown
Collaborator

Cherry-pick PR to 202311: #12090

mssonicbld pushed a commit that referenced this pull request Mar 22, 2024
1, testQosSaiLosslessVoq requires split-voq or fair-voq, skip vanguard(cisco Q200 longlink) since it uses default-voq.
2. testQosSaiSharedReservationSize, skip gibraltar(cisco Q200 linecard) since not enough ports.
Skip shared_res_size_2 for pacific(cisco Q100 linecard) since on pacific, SQG thresholds have no impact on XOFF thresholds.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants