[misc][cuda] use nvml query to avoid accidentally cuda initialization#6007
Merged
youkaichao merged 4 commits intovllm-project:mainfrom Jul 1, 2024
Merged
[misc][cuda] use nvml query to avoid accidentally cuda initialization#6007youkaichao merged 4 commits intovllm-project:mainfrom
youkaichao merged 4 commits intovllm-project:mainfrom
Commits
Commits on Jul 1, 2024
- committed
- committed
- committed
- committed
