Skip to content

Update ignore_regex in test_duplicate_route to support bulk update mode#20357

Merged
rlhui merged 1 commit intosonic-net:masterfrom
eswaran-nexthop:eswaran-20231-2
Aug 27, 2025
Merged

Update ignore_regex in test_duplicate_route to support bulk update mode#20357
rlhui merged 1 commit intosonic-net:masterfrom
eswaran-nexthop:eswaran-20231-2

Conversation

@eswaran-nexthop
Copy link
Contributor

Description of PR

The sonic-sairedis change from sonic-net/sonic-sairedis#1613 modified the behavior of BULK operations which resulted in the log spew looking different before and after on API failures. This impacts test_duplicate_route.py. As this test is failing with the above sonic-sairedis change included, sonic-buildimage PRs that bump up the submodule reference fail pipeline checks.

The fix is to move all regexes to the ignore list so that the test can continue to pass with and without this sonic-sairedis change. Once the sairedis change merges, we can change the ignore list to the expect list.

Summary:
Fixes # 20231

Type of change

  • Bug fix
  • Testbed and Framework(new/improvement)
  • New Test case
    • Skipped for non-supported platforms
  • Test case improvement

Back port request

  • 202205
  • 202305
  • 202311
  • 202405
  • 202411
  • 202505

Approach

What is the motivation for this PR?

The sonic-sairedis change from sonic-net/sonic-sairedis#1613 modified the behavior of BULK operations which resulted in the log spew looking different before and after. This impacts test_duplicate_route.py. As this test is failing with the above sonic-sairedis change included, sonic-buildimage PRs that bump up the submodule reference fail pipeline checks.

How did you do it?

Some of the message format has slightly changed even though the meaning itself remains the same. I moved the regex to the ignore list so that the check will pass with both versions of sairedis.

How did you verify/test it?

I validated the changes by running test_duplicate_route.py with the new image and with the old image.

Any platform specific information?

Supported testbed topology if it's a new test case?

Documentation

@eswaran-nexthop eswaran-nexthop marked this pull request as ready for review August 21, 2025 20:41
@mssonicbld
Copy link
Collaborator

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@eswaran-nexthop
Copy link
Contributor Author

Checks seem to be failing due to some interaction with this commit - 5f017fe

Needs more investigation

@eswaran-nexthop
Copy link
Contributor Author

@Ndancejic @prsunny I suspect the checks failing here are unrelated.

From the test runs, I see PR_CHECKERS are set correctly

+ PR_CHECKERS='["t0_checker","t1-multi-asic_checker","t1_checker","t2_checker"]'

But I see the other checkers are running and failing as we would expect. I think the recent commit to this area c08ca93 could be causing it? After the template change, the condition

condition: contains(dependencies.get_impacted_area.outputs['SetVariableTask.PR_CHECKERS']

is not applied for each checker correctly. We should not expect the dpu, dualtor, etc checkers to run for this PR.

Any suggestions on how we can get this fixed?

@Ndancejic
Copy link
Contributor

/azpw run

@mssonicbld
Copy link
Collaborator

/AzurePipelines run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@Ndancejic
Copy link
Contributor

@Ndancejic @prsunny I suspect the checks failing here are unrelated.

From the test runs, I see PR_CHECKERS are set correctly

+ PR_CHECKERS='["t0_checker","t1-multi-asic_checker","t1_checker","t2_checker"]'

But I see the other checkers are running and failing as we would expect. I think the recent commit to this area c08ca93 could be causing it? After the template change, the condition

condition: contains(dependencies.get_impacted_area.outputs['SetVariableTask.PR_CHECKERS']

is not applied for each checker correctly. We should not expect the dpu, dualtor, etc checkers to run for this PR.

Any suggestions on how we can get this fixed?

Looks like there was an update that was merged afterwards: #20335 reran the pipeline to try it out

@mssonicbld
Copy link
Collaborator

/azp run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@eswaran-nexthop
Copy link
Contributor Author

/azp run

@azure-pipelines
Copy link

Commenter does not have sufficient privileges for PR 20357 in repo sonic-net/sonic-mgmt

@eswaran-nexthop
Copy link
Contributor Author

The kvmtest-t2 check failed because of testbed availability

Error type: LOCK_TESTBED_FAILED
Error message: Lock testbed wait timeout: 7200s

Needs a re-run

@rlhui
Copy link

rlhui commented Aug 26, 2025

/azpw run

@mssonicbld
Copy link
Collaborator

/AzurePipelines run

@azure-pipelines
Copy link

Azure Pipelines successfully started running 1 pipeline(s).

@rlhui rlhui merged commit d93cb89 into sonic-net:master Aug 27, 2025
18 of 20 checks passed
xixuej pushed a commit to xixuej/sonic-mgmt that referenced this pull request Sep 17, 2025
…de (sonic-net#20357)

The sonic-sairedis change from sonic-net/sonic-sairedis#1613 modified the behavior of BULK operations which resulted in the log spew looking different before and after on API failures. This impacts test_duplicate_route.py. As this test is failing with the above sonic-sairedis change included, sonic-buildimage PRs that bump up the submodule reference fail pipeline checks.

The fix is to move all regexes to the ignore list so that the test can continue to pass with and without this sonic-sairedis change. Once the sairedis change merges, we can change the ignore list to the expect list.
lizhijianrd pushed a commit to lizhijianrd/sonic-mgmt that referenced this pull request Oct 20, 2025
…de (sonic-net#20357)

The sonic-sairedis change from sonic-net/sonic-sairedis#1613 modified the behavior of BULK operations which resulted in the log spew looking different before and after on API failures. This impacts test_duplicate_route.py. As this test is failing with the above sonic-sairedis change included, sonic-buildimage PRs that bump up the submodule reference fail pipeline checks.

The fix is to move all regexes to the ignore list so that the test can continue to pass with and without this sonic-sairedis change. Once the sairedis change merges, we can change the ignore list to the expect list.
@mssonicbld
Copy link
Collaborator

@eswaran-nexthop PR conflicts with 202505 branch

@lizhijianrd
Copy link
Contributor

Backport 202505: #21030

@mssonicbld
Copy link
Collaborator

Cherry-pick PR to msft-202509: Azure/sonic-mgmt.msft#769

yejianquan pushed a commit that referenced this pull request Oct 23, 2025
…cate_routes (#21030)

Description of PR
Summary:
test_duplicate_routes is expected to run and pass on 202505 branch

Backport PR Revert "Update expect_regex in test_duplicate_route to support bulk update mode" #20334 and Update ignore_regex in test_duplicate_route to support bulk update mode #20357
Update skip condition to Regression: test_duplicate_route.py failing log checks after sairedis update #20231

Co-authored-by: xwjiang-ms <[email protected]>
Co-authored-by: eswaran-nexthop <[email protected]>
vidyac86 pushed a commit to vidyac86/sonic-mgmt that referenced this pull request Oct 23, 2025
…de (sonic-net#20357)

The sonic-sairedis change from sonic-net/sonic-sairedis#1613 modified the behavior of BULK operations which resulted in the log spew looking different before and after on API failures. This impacts test_duplicate_route.py. As this test is failing with the above sonic-sairedis change included, sonic-buildimage PRs that bump up the submodule reference fail pipeline checks.

The fix is to move all regexes to the ignore list so that the test can continue to pass with and without this sonic-sairedis change. Once the sairedis change merges, we can change the ignore list to the expect list.
opcoder0 pushed a commit to opcoder0/sonic-mgmt that referenced this pull request Dec 8, 2025
…de (sonic-net#20357)

The sonic-sairedis change from sonic-net/sonic-sairedis#1613 modified the behavior of BULK operations which resulted in the log spew looking different before and after on API failures. This impacts test_duplicate_route.py. As this test is failing with the above sonic-sairedis change included, sonic-buildimage PRs that bump up the submodule reference fail pipeline checks.

The fix is to move all regexes to the ignore list so that the test can continue to pass with and without this sonic-sairedis change. Once the sairedis change merges, we can change the ignore list to the expect list.

Signed-off-by: opcoder0 <[email protected]>
gshemesh2 pushed a commit to gshemesh2/sonic-mgmt that referenced this pull request Dec 16, 2025
…de (sonic-net#20357)

The sonic-sairedis change from sonic-net/sonic-sairedis#1613 modified the behavior of BULK operations which resulted in the log spew looking different before and after on API failures. This impacts test_duplicate_route.py. As this test is failing with the above sonic-sairedis change included, sonic-buildimage PRs that bump up the submodule reference fail pipeline checks.

The fix is to move all regexes to the ignore list so that the test can continue to pass with and without this sonic-sairedis change. Once the sairedis change merges, we can change the ignore list to the expect list.

Signed-off-by: Guy Shemesh <[email protected]>
AharonMalkin pushed a commit to AharonMalkin/sonic-mgmt that referenced this pull request Dec 16, 2025
…de (sonic-net#20357)

The sonic-sairedis change from sonic-net/sonic-sairedis#1613 modified the behavior of BULK operations which resulted in the log spew looking different before and after on API failures. This impacts test_duplicate_route.py. As this test is failing with the above sonic-sairedis change included, sonic-buildimage PRs that bump up the submodule reference fail pipeline checks.

The fix is to move all regexes to the ignore list so that the test can continue to pass with and without this sonic-sairedis change. Once the sairedis change merges, we can change the ignore list to the expect list.

Signed-off-by: Aharon Malkin <[email protected]>
gshemesh2 pushed a commit to gshemesh2/sonic-mgmt that referenced this pull request Dec 21, 2025
…de (sonic-net#20357)

The sonic-sairedis change from sonic-net/sonic-sairedis#1613 modified the behavior of BULK operations which resulted in the log spew looking different before and after on API failures. This impacts test_duplicate_route.py. As this test is failing with the above sonic-sairedis change included, sonic-buildimage PRs that bump up the submodule reference fail pipeline checks.

The fix is to move all regexes to the ignore list so that the test can continue to pass with and without this sonic-sairedis change. Once the sairedis change merges, we can change the ignore list to the expect list.

Signed-off-by: Guy Shemesh <[email protected]>
venu-nexthop pushed a commit to venu-nexthop/sonic-mgmt that referenced this pull request Jan 13, 2026
…de (sonic-net#20357)

The sonic-sairedis change from sonic-net/sonic-sairedis#1613 modified the behavior of BULK operations which resulted in the log spew looking different before and after on API failures. This impacts test_duplicate_route.py. As this test is failing with the above sonic-sairedis change included, sonic-buildimage PRs that bump up the submodule reference fail pipeline checks.

The fix is to move all regexes to the ignore list so that the test can continue to pass with and without this sonic-sairedis change. Once the sairedis change merges, we can change the ignore list to the expect list.
gshemesh2 pushed a commit to gshemesh2/sonic-mgmt that referenced this pull request Jan 26, 2026
…de (sonic-net#20357)

The sonic-sairedis change from sonic-net/sonic-sairedis#1613 modified the behavior of BULK operations which resulted in the log spew looking different before and after on API failures. This impacts test_duplicate_route.py. As this test is failing with the above sonic-sairedis change included, sonic-buildimage PRs that bump up the submodule reference fail pipeline checks.

The fix is to move all regexes to the ignore list so that the test can continue to pass with and without this sonic-sairedis change. Once the sairedis change merges, we can change the ignore list to the expect list.

Signed-off-by: Guy Shemesh <[email protected]>
ytzur1 pushed a commit to ytzur1/sonic-mgmt that referenced this pull request Feb 2, 2026
…de (sonic-net#20357)

The sonic-sairedis change from sonic-net/sonic-sairedis#1613 modified the behavior of BULK operations which resulted in the log spew looking different before and after on API failures. This impacts test_duplicate_route.py. As this test is failing with the above sonic-sairedis change included, sonic-buildimage PRs that bump up the submodule reference fail pipeline checks.

The fix is to move all regexes to the ignore list so that the test can continue to pass with and without this sonic-sairedis change. Once the sairedis change merges, we can change the ignore list to the expect list.

Signed-off-by: Yael Tzur <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants