-
Notifications
You must be signed in to change notification settings - Fork 61
Locate nvvm, libdevice, nvrtc, and cudart from nvidia-*-cu12 wheels #155
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
brandon-b-miller
merged 37 commits into
NVIDIA:main
from
brandon-b-miller:locate-nvvm-nvrtc-wheels
Apr 21, 2025
Merged
Changes from all commits
Commits
Show all changes
37 commits
Select commit
Hold shift + click to select a range
b8238f9
initial
brandon-b-miller 9c56e55
slightly refactor cuda_paths
brandon-b-miller 886b9b0
refactor libdevice search mechanism
brandon-b-miller 7ffef77
debug get_cuda_paths
brandon-b-miller fcedb13
can launch kernel
brandon-b-miller 151e565
cleanup
brandon-b-miller b4ededf
style
brandon-b-miller 4f2bc2b
reset files
brandon-b-miller 5f4ed8f
initial ci scripts
brandon-b-miller d4bf113
add pynvjitlink to tests and enable
brandon-b-miller 443e998
locate nvrtc
brandon-b-miller 1b436c6
working inside container
brandon-b-miller 532d864
somewhat roundabout logic works for system/wheel
brandon-b-miller 59bb493
skip tests with no set bin dir
brandon-b-miller f5dbee6
ensure builtins on windows
brandon-b-miller 43c3ec2
merge/resolve
brandon-b-miller 6a68eb8
remove system nvrtc from wheel test job
brandon-b-miller 3dbd42d
refactor _get_nvvm_wheel
brandon-b-miller 3f4ca51
actually install nvrtc from wheel
brandon-b-miller 3e8651c
merge/resolve
brandon-b-miller 2364278
merge/resolve
brandon-b-miller 42af9ad
ruff
brandon-b-miller 8cf66d0
prioritize wheels over system installs
brandon-b-miller 4f686e9
global search priority
brandon-b-miller 1e3f9a6
Merge branch 'main' into locate-nvvm-nvrtc-wheels
brandon-b-miller 3d65c3d
local import of driver to determine cuda version
brandon-b-miller 78cebea
short circuit
brandon-b-miller 4e8f73f
bugfix
brandon-b-miller 00bb4da
address reviews
brandon-b-miller 5cebb44
Update numba_cuda/numba/cuda/cuda_paths.py
brandon-b-miller c14644a
get runtime lib from wheel as well
brandon-b-miller 9b3bad9
remove system packages from conda test jobs
brandon-b-miller 51f7694
only remove system packages in cuda 12 ci test jobs
brandon-b-miller 8cc37d7
address reviews in cuda_paths.py
brandon-b-miller d5b68a9
add Graham's patch
brandon-b-miller dfe25c8
source cudart from wheel
brandon-b-miller 9fc2531
simplify logic
brandon-b-miller File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,56 @@ | ||
| #!/bin/bash | ||
| # Copyright (c) 2023-2024, NVIDIA CORPORATION | ||
|
|
||
| set -euo pipefail | ||
|
|
||
| rapids-logger "Install testing dependencies" | ||
| # TODO: Replace with rapids-dependency-file-generator | ||
| python -m pip install \ | ||
| psutil \ | ||
| cffi \ | ||
| cuda-python \ | ||
| nvidia-cuda-runtime-cu12 \ | ||
| nvidia-curand-cu12 \ | ||
| nvidia-cuda-nvcc-cu12 \ | ||
| nvidia-cuda-nvrtc-cu12 \ | ||
| pynvjitlink-cu12 \ | ||
| pytest | ||
|
|
||
|
|
||
| rapids-logger "Build tests" | ||
| PY_SCRIPT=" | ||
| import numba_cuda | ||
| root = numba_cuda.__file__.rstrip('__init__.py') | ||
| test_dir = root + \"numba/cuda/tests/test_binary_generation/\" | ||
| print(test_dir) | ||
| " | ||
|
|
||
| NUMBA_CUDA_TEST_BIN_DIR=$(python -c "$PY_SCRIPT") | ||
| pushd $NUMBA_CUDA_TEST_BIN_DIR | ||
| make | ||
| popd | ||
|
|
||
| rapids-logger "Install wheel" | ||
| package=$(realpath wheel/numba_cuda*.whl) | ||
| echo "Package path: $package" | ||
| python -m pip install $package | ||
|
|
||
| rapids-logger "Check GPU usage" | ||
| nvidia-smi | ||
|
|
||
| RAPIDS_TESTS_DIR=${RAPIDS_TESTS_DIR:-"${PWD}/test-results"}/ | ||
| mkdir -p "${RAPIDS_TESTS_DIR}" | ||
| pushd "${RAPIDS_TESTS_DIR}" | ||
|
|
||
| rapids-logger "Show Numba system info" | ||
| python -m numba --sysinfo | ||
|
|
||
| # remove cuda-nvvm-12-5 leaving libnvvm.so from nvidia-cuda-nvcc-cu12 only | ||
| apt-get update | ||
| apt remove --purge `dpkg --get-selections | grep cuda-nvvm | awk '{print $1}'` -y | ||
| apt remove --purge `dpkg --get-selections | grep cuda-nvrtc | awk '{print $1}'` -y | ||
|
|
||
| rapids-logger "Run Tests" | ||
| NUMBA_CUDA_ENABLE_PYNVJITLINK=1 NUMBA_CUDA_TEST_BIN_DIR=$NUMBA_CUDA_TEST_BIN_DIR python -m numba.runtests numba.cuda.tests -v | ||
|
|
||
| popd | ||
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Uh oh!
There was an error while loading. Please reload this page.