Skip to content

Commit 3f40cc6

Browse files
committed
chore(evals): update validation_fidelity_pre_existing_errors to USUALLY_PASSES
- Downgrade policy from ALWAYS_PASSES to USUALLY_PASSES to better reflect the non-deterministic nature of the eval.
1 parent fe70052 commit 3f40cc6

File tree

1 file changed

+1
-1
lines changed

1 file changed

+1
-1
lines changed

evals/validation_fidelity_pre_existing_errors.eval.ts

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -8,7 +8,7 @@ import { describe, expect } from 'vitest';
88
import { evalTest } from './test-helper.js';
99

1010
describe('validation_fidelity_pre_existing_errors', () => {
11-
evalTest('ALWAYS_PASSES', {
11+
evalTest('USUALLY_PASSES', {
1212
name: 'should handle pre-existing project errors gracefully during validation',
1313
files: {
1414
'src/math.ts': `

0 commit comments

Comments
 (0)