Skip to content

[Feature]: Test Source Linking #51

@Malcolmnixon

Description

@Malcolmnixon

Problem Statement

Sometimes requirements need to know where the test results come from. For example consider a project that tests on Linux, Windows, and Mac - the test result files will have names such as test-results-windows-latest.trx or test-results-ubuntu-latest.junit.xml. In these cases a project may have requirements such as "Shall support running on Windows" and "Shall support running on Linux".

Proposed Solution

To support this it it seems like we want to be able support a few different styles of test names. The general pattern should probably be something like the following regex pattern:
^((?<filepart>(.*))@)?(?<testname>.*)$

Examples would be

  • "SomeTest" - SomeTest test from any test file
  • "Platform_*" - All platform tests from any file
  • "Windows@SomeTest" - SomeTest test from result files whose file name contains "Windows" (case insensitive)
  • "Linux@*" - All tests from result files whose name contains "Linux" (case insensitive)
  • "macOS@Security_*" - All security tests on macOS

The should probably only match in the base-name portion of the test results file name rather than the path.

Alternatives Considered

No response

Additional Context

Support for this should be captured as new requirements, tested with appropriate testing, and documented in the readme and user guide.

Priority

High - Blocking current work

Contribution

  • I would be willing to submit a PR for this feature

Code of Conduct

  • I agree to follow this project's Code of Conduct

Metadata

Metadata

Labels

enhancementNew feature or request

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions