Enhance accelerator parity testing framework#6629
Merged
rapids-bot[bot] merged 9 commits intorapidsai:branch-25.06from May 7, 2025
Merged
Enhance accelerator parity testing framework#6629rapids-bot[bot] merged 9 commits intorapidsai:branch-25.06from
rapids-bot[bot] merged 9 commits intorapidsai:branch-25.06from
Conversation
... by reason and other fields. This enables us to better identify failure groups that are considered bugs in contrast to expected divergence and flaky tests.
csadorf
added
improvement
csadorf
commented
May 6, 2025
Contributor
Author
There was a problem hiding this comment.
Unfortunately the diff on this will be unwieldy. You will have to trust me to a certain extent that the list is equivalent. The test runs should also reveal that though.
viclafargue
approved these changes
May 7, 2025
Contributor
Author
|
/merge |
4 tasks
18 tasks
Ofek-Haim
pushed a commit
to Ofek-Haim/cuml
that referenced
this pull request
May 13, 2025
This PR enhances the accelerator parity testing framework with several improvements: - Refactors xfail list structure to better group tests by reason and failure type - Adds support for custom extra markers in test configuration - Documents workflow for fixing parity issues - Improves test result summarization with options to limit output and show tracebacks - Includes initial work on test failure triage Authors: - Simon Adorf (https://github.com/csadorf) Approvers: - Victor Lafargue (https://github.com/viclafargue) URL: rapidsai#6629
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
This PR enhances the accelerator parity testing framework with several improvements: