Skip to content

xfail decap related cases for 202412#22831

Merged
StormLiangMS merged 2 commits intosonic-net:masterfrom
sdszhang:skip_decap_srv6
Mar 13, 2026
Merged

xfail decap related cases for 202412#22831
StormLiangMS merged 2 commits intosonic-net:masterfrom
sdszhang:skip_decap_srv6

Conversation

@sdszhang
Copy link
Copy Markdown
Contributor

@sdszhang sdszhang commented Mar 10, 2026

Description of PR

Summary:
subnet decap tunnel is disabled on 202412 in Azure/sonic-swss.msft#209. xfail related cases.

qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping[uniform]
srv6/test_srv6_dataplane:py::TestSRv6DataPlaneBase::test_srv6_full_func

Type of change

  • Bug fix
  • Testbed and Framework(new/improvement)
  • New Test case
    • Skipped for non-supported platforms
  • Test case improvement

Back port request

  • 202205
  • 202305
  • 202311
  • 202405
  • 202411
  • 202505
  • 202511

Approach

What is the motivation for this PR?

xfail decap related cases in 202412.

How did you do it?

add marked condition

How did you verify/test it?

Any platform specific information?

Supported testbed topology if it's a new test case?

Documentation

@mssonicbld
Copy link
Copy Markdown
Collaborator

/azp run

@azure-pipelines
Copy link
Copy Markdown

Azure Pipelines successfully started running 1 pipeline(s).

Signed-off-by: Dashuai Zhang <[email protected]>
@mssonicbld
Copy link
Copy Markdown
Collaborator

/azp run

@azure-pipelines
Copy link
Copy Markdown

Azure Pipelines successfully started running 1 pipeline(s).

Copy link
Copy Markdown

@banidoru banidoru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One blocking issue: typo in test case key uses : instead of ., which will silently prevent the xfail from matching. The rest looks correct.

Copy link
Copy Markdown

@banidoru banidoru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One bug: typo :py instead of .py on the new srv6/test_srv6_dataplane entry (line 4732) — will silently prevent the xfail from matching. Already noted inline. Rest of the changes look correct: YAML structure is valid, conditions_logical_operator: or is appropriate for the multi-condition xfail, and condition expressions are consistent with existing patterns.

Copy link
Copy Markdown

@banidoru banidoru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One blocking issue (already noted by others): srv6/test_srv6_dataplane:py has a colon instead of a dot — must be srv6/test_srv6_dataplane.py or the xfail will never match.

Otherwise the changes look correct:

  • conditions_logical_operator: or is properly added for the first hunk since the two conditions are independent.
  • The condition expressions are syntactically valid and consistent with existing entries.
  • Minor suggestion: consider referencing a tracking issue in the xfail reasons so it's clear when these can be removed.

@linux-foundation-easycla
Copy link
Copy Markdown

linux-foundation-easycla bot commented Mar 10, 2026

CLA Signed

The committers listed above are authorized under a signed CLA.

@mssonicbld
Copy link
Copy Markdown
Collaborator

/azp run

@azure-pipelines
Copy link
Copy Markdown

Azure Pipelines successfully started running 1 pipeline(s).

@mssonicbld
Copy link
Copy Markdown
Collaborator

/azp run

@azure-pipelines
Copy link
Copy Markdown

Azure Pipelines successfully started running 1 pipeline(s).

Signed-off-by: Dashuai Zhang <[email protected]>
@mssonicbld
Copy link
Copy Markdown
Collaborator

/azp run

@azure-pipelines
Copy link
Copy Markdown

Azure Pipelines successfully started running 1 pipeline(s).

Copy link
Copy Markdown

@banidoru banidoru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Iteration 2: The :py typo is fixed. Changes look correct — conditions_logical_operator: or is properly added for the QoS test (two independent conditions), and the new SRv6 xfail block is well-formed. No further issues found.

Copy link
Copy Markdown

@banidoru banidoru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM. The colon typo (:py.py) from the first iteration is fixed. Both xfail entries correctly target the 202412 release on isolated topologies with appropriate conditions. Minor nit: the reason string says "vlan decap" for SRv6 but "decap tunnel" for QoS — consider aligning terminology, but not blocking.

Copy link
Copy Markdown

@banidoru banidoru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The :py typo on srv6/test_srv6_dataplane:py (should be .py) flagged in the previous iteration is still unfixed. This will silently prevent the xfail from matching. Please fix before merge.

Otherwise the changes are correct: the conditions_logical_operator: or addition for the QoS test and the new 202412 isolated-topo conditions are appropriate.

@sdszhang
Copy link
Copy Markdown
Contributor Author

test log:

XFAIL qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping_uniform_mode - Test case has issue on the 202412 branch as decap tunnel is disabled.

XPASS srv6/test_srv6_dataplane.py::TestSRv6DataPlaneBase::test_srv6_full_func[pipe-srh-None] vlan decap is disabled in 202412 image, which causes the test case failure.
XPASS srv6/test_srv6_dataplane.py::TestSRv6DataPlaneBase::test_srv6_full_func[pipe-no_srh-None] vlan decap is disabled in 202412 image, which causes the test case failure.

@r12f r12f mentioned this pull request Mar 11, 2026
12 tasks
Copy link
Copy Markdown

@banidoru banidoru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Iteration 3 review: All previous concerns addressed. The :py typo is fixed. Both xfail entries correctly target 202412 release on isolated topologies with appropriate reasons. conditions_logical_operator: or is properly added for the QoS test case (two independent conditions). Minor nit: the PR description still references test_srv6_dataplane:py with a colon instead of .py, but this is cosmetic only — the actual YAML is correct. LGTM.

Copy link
Copy Markdown

@banidoru banidoru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This PR cannot be approved. The change is intended to xfail two tests, but it has multiple issues that prevent it from working correctly:

  1. Typo in Test Path: The path for the SRv6 test contains a typo (:py instead of .py). This will cause the xfail condition to be ignored, and the test will continue to fail. This was pointed out in a previous review comment but has not been addressed.
  2. Missing Test Case: The PR description mentions xfail-ing qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping[uniform], but the corresponding entry is missing from tests_mark_conditions.yaml.

These issues must be fixed before the PR can be merged.

Copy link
Copy Markdown

@banidoru banidoru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Iteration 3: All previous concerns are addressed — the :py typo is fixed, and both xfail entries are correct.

Verdict: LGTM

  • YAML is syntactically valid.
  • conditions_logical_operator: or is correctly added to the QoS xfail (two independent conditions that should be OR'd).
  • The new SRv6 xfail block is well-structured with a single condition (no conditions_logical_operator needed).
  • Condition expressions ('isolated' in topo_name and release in ['202412']) follow established patterns in this file.
  • Reason strings are clear and descriptive.
  • Minor cosmetic note: the PR description still references test_srv6_dataplane:py with a colon, but the actual YAML is correct — not blocking.

Copy link
Copy Markdown

@banidoru banidoru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The changes look reasonable to temporarily unblock CI by xfailing tests that are failing due to disabled features in the 202412 release.

Copy link
Copy Markdown

@banidoru banidoru left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

All reviewers approved. LGTM.

Copy link
Copy Markdown
Collaborator

@r12f r12f left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm!

@r12f r12f added the Request for 202511 branch Request to backport a change to 202511 branch label Mar 11, 2026
Copy link
Copy Markdown
Collaborator

@StormLiangMS StormLiangMS left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@StormLiangMS StormLiangMS merged commit ac79ea9 into sonic-net:master Mar 13, 2026
22 of 23 checks passed
@mssonicbld
Copy link
Copy Markdown
Collaborator

Cherry-pick PR to msft-202412: Azure/sonic-mgmt.msft#1069

mssonicbld pushed a commit to mssonicbld/sonic-mgmt that referenced this pull request Mar 13, 2026
Description of PR
Summary:
subnet decap tunnel is disabled on 202412 in Azure/sonic-swss.msft#209. xfail related cases.

qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping[uniform]
srv6/test_srv6_dataplane:py::TestSRv6DataPlaneBase::test_srv6_full_func

Signed-off-by: Dashuai Zhang <[email protected]>

---------

Signed-off-by: Dashuai Zhang <[email protected]>
Signed-off-by: mssonicbld <[email protected]>
@mssonicbld
Copy link
Copy Markdown
Collaborator

Cherry-pick PR to 202511: #22955

mssonicbld pushed a commit that referenced this pull request Mar 14, 2026
Description of PR
Summary:
subnet decap tunnel is disabled on 202412 in Azure/sonic-swss.msft#209. xfail related cases.

qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping[uniform]
srv6/test_srv6_dataplane:py::TestSRv6DataPlaneBase::test_srv6_full_func

Signed-off-by: Dashuai Zhang <[email protected]>

---------

Signed-off-by: Dashuai Zhang <[email protected]>
Signed-off-by: mssonicbld <[email protected]>
selldinesh pushed a commit to selldinesh/sonic-mgmt that referenced this pull request Mar 16, 2026
Description of PR
Summary:
subnet decap tunnel is disabled on 202412 in Azure/sonic-swss.msft#209. xfail related cases.

qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping[uniform]
srv6/test_srv6_dataplane:py::TestSRv6DataPlaneBase::test_srv6_full_func

Signed-off-by: Dashuai Zhang <[email protected]>

---------

Signed-off-by: Dashuai Zhang <[email protected]>
Signed-off-by: selldinesh <[email protected]>
abhishek-nexthop pushed a commit to nexthop-ai/sonic-mgmt that referenced this pull request Mar 17, 2026
Description of PR
Summary:
subnet decap tunnel is disabled on 202412 in Azure/sonic-swss.msft#209. xfail related cases.

qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping[uniform]
srv6/test_srv6_dataplane:py::TestSRv6DataPlaneBase::test_srv6_full_func

Signed-off-by: Dashuai Zhang <[email protected]>

---------

Signed-off-by: Dashuai Zhang <[email protected]>
Signed-off-by: Abhishek <[email protected]>
vrajeshe pushed a commit to vrajeshe/sonic-mgmt that referenced this pull request Mar 23, 2026
Description of PR
Summary:
subnet decap tunnel is disabled on 202412 in Azure/sonic-swss.msft#209. xfail related cases.

qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping[uniform]
srv6/test_srv6_dataplane:py::TestSRv6DataPlaneBase::test_srv6_full_func

Signed-off-by: Dashuai Zhang <[email protected]>

---------

Signed-off-by: Dashuai Zhang <[email protected]>
Signed-off-by: Venkata Gouri Rajesh Etla <[email protected]>
ravaliyel pushed a commit to ravaliyel/sonic-mgmt that referenced this pull request Mar 27, 2026
Description of PR
Summary:
subnet decap tunnel is disabled on 202412 in Azure/sonic-swss.msft#209. xfail related cases.

qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping[uniform]
srv6/test_srv6_dataplane:py::TestSRv6DataPlaneBase::test_srv6_full_func

Signed-off-by: Dashuai Zhang <[email protected]>

---------

Signed-off-by: Dashuai Zhang <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants