-
Notifications
You must be signed in to change notification settings - Fork 0
Description
Problem Statement
Sometimes requirements need to know where the test results come from. For example consider a project that tests on Linux, Windows, and Mac - the test result files will have names such as test-results-windows-latest.trx or test-results-ubuntu-latest.junit.xml. In these cases a project may have requirements such as "Shall support running on Windows" and "Shall support running on Linux".
Proposed Solution
To support this it it seems like we want to be able support a few different styles of test names. The general pattern should probably be something like the following regex pattern:
^((?<filepart>(.*))@)?(?<testname>.*)$
Examples would be
- "SomeTest" - SomeTest test from any test file
- "Platform_*" - All platform tests from any file
- "Windows@SomeTest" - SomeTest test from result files whose file name contains "Windows" (case insensitive)
- "Linux@*" - All tests from result files whose name contains "Linux" (case insensitive)
- "macOS@Security_*" - All security tests on macOS
The should probably only match in the base-name portion of the test results file name rather than the path.
Alternatives Considered
No response
Additional Context
Support for this should be captured as new requirements, tested with appropriate testing, and documented in the readme and user guide.
Priority
High - Blocking current work
Contribution
- I would be willing to submit a PR for this feature
Code of Conduct
- I agree to follow this project's Code of Conduct