Skip to content

Conversation

@pentschev
Copy link
Member

Timeouts have occurred already in a few gpuCI instances, and locally those are consistently reproducible when the spill test is the first to run, where it takes just over 20 seconds probably due to added overhead of CUDA context creation. Increasing the timeout to 30 seconds seems sufficient.

@pentschev pentschev requested a review from a team as a code owner April 26, 2022 08:22
@github-actions github-actions bot added the python python code needed label Apr 26, 2022
@pentschev pentschev added bug Something isn't working 3 - Ready for Review Ready for review by team non-breaking Non-breaking change and removed python python code needed labels Apr 26, 2022
Copy link
Member

@madsbk madsbk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, but maybe increase to 60 sec just to be on the safe side?

@pentschev
Copy link
Member Author

LGTM, but maybe increase to 60 sec just to be on the safe side?

I think 60 seconds may be too much, if we really need to increase that high, maybe we should consider redesigning tests so that they run faster. TBH, 30 seconds already feels too high for me, but spilling is hard to keep that much under.

@pentschev
Copy link
Member Author

Thanks for reviews/approvals @ethyling @madsbk .

@pentschev
Copy link
Member Author

@gpucibot merge

@rapids-bot rapids-bot bot merged commit c4d542b into rapidsai:branch-22.06 Apr 26, 2022
@pentschev pentschev deleted the increase-test-spill-timeout branch June 23, 2022 17:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

3 - Ready for Review Ready for review by team bug Something isn't working non-breaking Non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants