xfail decap related cases for 202412#22831
Conversation
|
/azp run |
|
Azure Pipelines successfully started running 1 pipeline(s). |
Signed-off-by: Dashuai Zhang <[email protected]>
9871048 to
03caf74
Compare
|
/azp run |
|
Azure Pipelines successfully started running 1 pipeline(s). |
banidoru
left a comment
There was a problem hiding this comment.
One blocking issue: typo in test case key uses : instead of ., which will silently prevent the xfail from matching. The rest looks correct.
tests/common/plugins/conditional_mark/tests_mark_conditions.yaml
Outdated
Show resolved
Hide resolved
banidoru
left a comment
There was a problem hiding this comment.
One bug: typo :py instead of .py on the new srv6/test_srv6_dataplane entry (line 4732) — will silently prevent the xfail from matching. Already noted inline. Rest of the changes look correct: YAML structure is valid, conditions_logical_operator: or is appropriate for the multi-condition xfail, and condition expressions are consistent with existing patterns.
tests/common/plugins/conditional_mark/tests_mark_conditions.yaml
Outdated
Show resolved
Hide resolved
banidoru
left a comment
There was a problem hiding this comment.
One blocking issue (already noted by others): srv6/test_srv6_dataplane:py has a colon instead of a dot — must be srv6/test_srv6_dataplane.py or the xfail will never match.
Otherwise the changes look correct:
conditions_logical_operator: oris properly added for the first hunk since the two conditions are independent.- The condition expressions are syntactically valid and consistent with existing entries.
- Minor suggestion: consider referencing a tracking issue in the xfail reasons so it's clear when these can be removed.
|
/azp run |
|
Azure Pipelines successfully started running 1 pipeline(s). |
7880e8d to
28710d2
Compare
|
/azp run |
|
Azure Pipelines successfully started running 1 pipeline(s). |
Signed-off-by: Dashuai Zhang <[email protected]>
28710d2 to
7c512c3
Compare
|
/azp run |
|
Azure Pipelines successfully started running 1 pipeline(s). |
banidoru
left a comment
There was a problem hiding this comment.
Iteration 2: The :py typo is fixed. Changes look correct — conditions_logical_operator: or is properly added for the QoS test (two independent conditions), and the new SRv6 xfail block is well-formed. No further issues found.
banidoru
left a comment
There was a problem hiding this comment.
LGTM. The colon typo (:py → .py) from the first iteration is fixed. Both xfail entries correctly target the 202412 release on isolated topologies with appropriate conditions. Minor nit: the reason string says "vlan decap" for SRv6 but "decap tunnel" for QoS — consider aligning terminology, but not blocking.
banidoru
left a comment
There was a problem hiding this comment.
The :py typo on srv6/test_srv6_dataplane:py (should be .py) flagged in the previous iteration is still unfixed. This will silently prevent the xfail from matching. Please fix before merge.
Otherwise the changes are correct: the conditions_logical_operator: or addition for the QoS test and the new 202412 isolated-topo conditions are appropriate.
|
test log: |
banidoru
left a comment
There was a problem hiding this comment.
Iteration 3 review: All previous concerns addressed. The :py typo is fixed. Both xfail entries correctly target 202412 release on isolated topologies with appropriate reasons. conditions_logical_operator: or is properly added for the QoS test case (two independent conditions). Minor nit: the PR description still references test_srv6_dataplane:py with a colon instead of .py, but this is cosmetic only — the actual YAML is correct. LGTM.
banidoru
left a comment
There was a problem hiding this comment.
This PR cannot be approved. The change is intended to xfail two tests, but it has multiple issues that prevent it from working correctly:
- Typo in Test Path: The path for the SRv6 test contains a typo (
:pyinstead of.py). This will cause thexfailcondition to be ignored, and the test will continue to fail. This was pointed out in a previous review comment but has not been addressed. - Missing Test Case: The PR description mentions
xfail-ingqos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping[uniform], but the corresponding entry is missing fromtests_mark_conditions.yaml.
These issues must be fixed before the PR can be merged.
banidoru
left a comment
There was a problem hiding this comment.
Iteration 3: All previous concerns are addressed — the :py typo is fixed, and both xfail entries are correct.
Verdict: LGTM
- YAML is syntactically valid.
conditions_logical_operator: oris correctly added to the QoS xfail (two independent conditions that should be OR'd).- The new SRv6 xfail block is well-structured with a single condition (no
conditions_logical_operatorneeded). - Condition expressions (
'isolated' in topo_name and release in ['202412']) follow established patterns in this file. - Reason strings are clear and descriptive.
- Minor cosmetic note: the PR description still references
test_srv6_dataplane:pywith a colon, but the actual YAML is correct — not blocking.
banidoru
left a comment
There was a problem hiding this comment.
The changes look reasonable to temporarily unblock CI by xfailing tests that are failing due to disabled features in the 202412 release.
|
Cherry-pick PR to msft-202412: Azure/sonic-mgmt.msft#1069 |
Description of PR Summary: subnet decap tunnel is disabled on 202412 in Azure/sonic-swss.msft#209. xfail related cases. qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping[uniform] srv6/test_srv6_dataplane:py::TestSRv6DataPlaneBase::test_srv6_full_func Signed-off-by: Dashuai Zhang <[email protected]> --------- Signed-off-by: Dashuai Zhang <[email protected]> Signed-off-by: mssonicbld <[email protected]>
|
Cherry-pick PR to 202511: #22955 |
Description of PR Summary: subnet decap tunnel is disabled on 202412 in Azure/sonic-swss.msft#209. xfail related cases. qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping[uniform] srv6/test_srv6_dataplane:py::TestSRv6DataPlaneBase::test_srv6_full_func Signed-off-by: Dashuai Zhang <[email protected]> --------- Signed-off-by: Dashuai Zhang <[email protected]> Signed-off-by: mssonicbld <[email protected]>
Description of PR Summary: subnet decap tunnel is disabled on 202412 in Azure/sonic-swss.msft#209. xfail related cases. qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping[uniform] srv6/test_srv6_dataplane:py::TestSRv6DataPlaneBase::test_srv6_full_func Signed-off-by: Dashuai Zhang <[email protected]> --------- Signed-off-by: Dashuai Zhang <[email protected]> Signed-off-by: selldinesh <[email protected]>
Description of PR Summary: subnet decap tunnel is disabled on 202412 in Azure/sonic-swss.msft#209. xfail related cases. qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping[uniform] srv6/test_srv6_dataplane:py::TestSRv6DataPlaneBase::test_srv6_full_func Signed-off-by: Dashuai Zhang <[email protected]> --------- Signed-off-by: Dashuai Zhang <[email protected]> Signed-off-by: Abhishek <[email protected]>
Description of PR Summary: subnet decap tunnel is disabled on 202412 in Azure/sonic-swss.msft#209. xfail related cases. qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping[uniform] srv6/test_srv6_dataplane:py::TestSRv6DataPlaneBase::test_srv6_full_func Signed-off-by: Dashuai Zhang <[email protected]> --------- Signed-off-by: Dashuai Zhang <[email protected]> Signed-off-by: Venkata Gouri Rajesh Etla <[email protected]>
Description of PR Summary: subnet decap tunnel is disabled on 202412 in Azure/sonic-swss.msft#209. xfail related cases. qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping[uniform] srv6/test_srv6_dataplane:py::TestSRv6DataPlaneBase::test_srv6_full_func Signed-off-by: Dashuai Zhang <[email protected]> --------- Signed-off-by: Dashuai Zhang <[email protected]>
Description of PR
Summary:
subnet decap tunnel is disabled on 202412 in Azure/sonic-swss.msft#209. xfail related cases.
qos/test_qos_dscp_mapping.py::TestQoSSaiDSCPQueueMapping_IPIP_Base::test_dscp_to_queue_mapping[uniform]srv6/test_srv6_dataplane:py::TestSRv6DataPlaneBase::test_srv6_full_funcType of change
Back port request
Approach
What is the motivation for this PR?
xfail decap related cases in 202412.
How did you do it?
add marked condition
How did you verify/test it?
Any platform specific information?
Supported testbed topology if it's a new test case?
Documentation