Skip to content

Commit e233678

Browse files
authored
Remove flaky Evo2 dataset performance test (#14371)
* Less stringent timing threshold for dataset performance test Signed-off-by: John St John <[email protected]> * Remove timing test from the dataset test suite Signed-off-by: John St John <[email protected]> --------- Signed-off-by: John St John <[email protected]>
1 parent 99e5dac commit e233678

File tree

1 file changed

+0
-7
lines changed

1 file changed

+0
-7
lines changed

tests/collections/llm/gpt/data/megatron/hyena/test_evo2_dataset.py

Lines changed: 0 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1045,13 +1045,6 @@ def benchmark_phylo_tag_masking(num_iterations: int = 1000) -> tuple[float, floa
10451045
return old_time, new_time
10461046

10471047

1048-
def test_phylo_tag_masking_speed():
1049-
num_iterations = 2000
1050-
old_time, new_time = benchmark_phylo_tag_masking(num_iterations=num_iterations)
1051-
# Assert performance equivalent to within 20% or better on a small example.
1052-
assert old_time / num_iterations > (new_time / num_iterations) * 0.8
1053-
1054-
10551048
if __name__ == "__main__":
10561049
num_iterations = 2000
10571050
old_time, new_time = benchmark_phylo_tag_masking(num_iterations=num_iterations)

0 commit comments

Comments
 (0)