Skip to content

Conversation

@pkoenig10
Copy link
Contributor

When a CompilationTestHelper is reused after a positive test case, it is possible for a false positive test case to pass. This is because we do not clear the DiagnosticTestHelper after calling doTest. So a subsequent false positive test will pass if the diagnostics is that same as the previous positive test case.

@cushon
Copy link
Collaborator

cushon commented May 13, 2020

Thanks for the report. These instances aren't really intended to be use-used, but I agree we should either support re-use or else detect it and report an error if doTest is called twice on the same instance.

If you have tests where it would be helpful to support the former, can you expand on your use-case?

@cushon cushon self-assigned this May 13, 2020
kluever pushed a commit that referenced this pull request May 14, 2020
…ctoringTestHelper instances

See e.g. #1313

-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=311470656
kluever pushed a commit that referenced this pull request May 14, 2020
…ctoringTestHelper instances

See e.g. #1313

-------------
Created by MOE: https://github.com/google/moe
MOE_MIGRATED_REVID=311470656
@cushon
Copy link
Collaborator

cushon commented May 15, 2020

Tentatively resolving with 8bfc2f8.

@cushon cushon closed this May 15, 2020
@pkoenig10 pkoenig10 deleted the diagnostics branch May 16, 2020 00:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants