build wheels with CUDA 13.0.x, test wheels against mix of CTK versions by jameslamb · Pull Request #604 · rapidsai/ucxx

jameslamb · 2026-03-05T03:08:23Z

Description

Contributes to rapidsai/build-planning#257

builds CUDA 13 wheels with the 13.0 CTK

Contributes to rapidsai/build-planning#256

updates wheel tests to cover a range of CTK versions (we previously, accidentally, were only testing the latest 12.x and 13.x)

Notes for Reviewers

How I tested this

This uses wheels from similar PRs from RAPIDS dependencies, at build and test time:

build wheels with CUDA 13.0.x, test wheels against mix of CTK versions rmm#2270

copy-pr-bot · 2026-03-05T03:08:27Z

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

jameslamb · 2026-03-05T04:35:59Z

dependencies.yaml

+            packages:
+              # some components (like nvidia-cublas-cu12 and nvidia-cuda-nvcc-cu12) didn't have
+              # aarch64 wheels until CTK 12.3, so allow a slightly looser bound here
+              - cuda-toolkit>=12.2,<12.4


For this repo, it's nvidia-cuda-nvcc-cu12 that ends up being required but can't be installed on aarch64 + CUDA 12.2:

docker run --rm -it rapidsai/citestwheel:26.04-cuda12.2.2-ubuntu22.04-py3.11 bash pip install 'cuda-toolkit[nvcc,nvrtc]==12.2.*' # ERROR: ResolutionImpossible pip install 'cuda-toolkit[nvcc,nvrtc]==12.3.0' # ERROR: No matching distribution found for nvidia-cuda-nvcc-cu12 pip install 'cuda-toolkit[nvcc,nvrtc]==12.3.1' # ERROR: No matching distribution found for nvidia-cuda-nvcc-cu12 pip install 'cuda-toolkit[nvcc,nvrtc]==12.3.2' # Successfully installed cuda-toolkit-12.3.2 nvidia-cuda-nvcc-cu12-12.3.107 nvidia-cuda-nvrtc-cu12-12.3.107

But trying to keep this cuda_version: list consistent across all of RAPIDs, so including cuBLAS in the comment too.

jameslamb · 2026-03-16T02:22:48Z

/ok to test

jameslamb · 2026-03-18T05:07:44Z

.github/workflows/build.yaml

  wheel-build-libucxx:
    secrets: inherit
-    uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@release/26.04
+    uses: rapidsai/shared-workflows/.github/workflows/wheels-build.yaml@build-wheels-old-ctk


DO NOT MERGE label can be removed once:

wheels-build: build on CUDA 13.0 shared-workflows#510 merged

build wheels with CUDA 13.0.x, test wheels against mix of CTK versions rmm#2270 merged

these branch references are all switched back to @release/26.04

all the use_wheels_from_prs.sh stuff is removed

jameslamb · 2026-03-18T16:45:33Z

/merge

#2971) Contributes to rapidsai/build-planning#257 * builds CUDA 13 wheels with the 13.0 CTK * ensures wheels ship with a runtime dependency of `nvidia-nvjitlink>={whatever-minor-version-they-were-built-against}` Contributes to rapidsai/build-planning#256 * updates wheel tests to cover a range of CTK versions (we previously, accidentally, were only testing the latest 12.x and 13.x) Other changes * ensures conda packages also take on floors of `libnvjitlink>={whatever-version-they-were-built-against}` ## Notes for Reviewers ### How I tested this This uses wheels from similar PRs from RAPIDS dependencies, at build and test time: * rapidsai/rmm#2270 * rapidsai/ucxx#604 Authors: - James Lamb (https://github.com/jameslamb) Approvers: - Bradley Dice (https://github.com/bdice) URL: #2971

…wheels against mix of CTK versions (#21671) Contributes to rapidsai/build-planning#257 * builds CUDA 13 wheels with the 13.0 CTK * ensures wheels ship with a runtime dependency of `nvidia-nvjitlink>={whatever-minor-version-they-were-built-against}` Contributes to rapidsai/build-planning#256 * updates wheel tests to cover a range of CTK versions (we previously, accidentally, were only testing the latest 12.x and 13.x) Other changes * ensures conda packages also take on floors of `libnvjitlink>={whatever-version-they-were-built-against}` ## Notes for Reviewers ### How I tested this Used wheels from similar PRs from RAPIDS dependencies, at build and test time: * rapidsai/kvikio#942 * rapidsai/rmm#2270 * rapidsai/ucxx#604 Authors: - James Lamb (https://github.com/jameslamb) Approvers: - Kyle Edwards (https://github.com/KyleFromNVIDIA) - Bradley Dice (https://github.com/bdice) URL: #21671

…wheels against mix of CTK versions (#1862) The changes from #1405 introduced linking against nvJitLink. nvJitLink has versioned symbols that are added in each new CTK release, and some of those are exposed in `libcuvs.so`. `libcuvs` wheels are built against the latest CTK supported in RAPIDS (CUDA 13.1.1 as of this writing), so when those wheels are used in environments with older nvJitLink, runtime errors like this can happen: > libcugraph.so: undefined symbol: __nvJitLinkGetErrorLog_13_1, version libnvJitLink.so.13 For more details, see rapidsai/cugraph#5443 This tries to fix that. Contributes to rapidsai/build-planning#257 * builds CUDA 13 wheels with the 13.0 CTK * ensures CUDA 13 wheels ship with a runtime dependency of `nvidia-nvjitlink>={whatever-minor-version-they-were-built-against}` Contributes to rapidsai/build-planning#256 * updates wheel tests to cover a range of CTK versions (we previously, accidentally, were only testing the latest 12.x and 13.x) Other changes * ensures conda packages also take on floors of `libnvjitlink>={whatever-minor-version-they-were-built-against}` ## Notes for Reviewers ### How I tested this This uses wheels from similar PRs from RAPIDS dependencies, at build and test time: * rapidsai/raft#2971 * rapidsai/rmm#2270 * rapidsai/ucxx#604 ### Other Options 1. avoiding those versioned symbols with a build-time shim (#1855 does this, but hasn't been successful yet) 2. statically linking libnvJitLink (hasn't been successful yet) Authors: - James Lamb (https://github.com/jameslamb) Approvers: - Gil Forsyth (https://github.com/gforsyth) URL: #1862

…wheels against mix of CTK versions (#5457) Fixes #5443 Contributes to rapidsai/build-planning#257 * builds CUDA 13 wheels with the 13.0 CTK * ensures wheels ship with a runtime dependency of `nvidia-nvjitlink>={whatever-minor-version-they-were-built-against}` Contributes to rapidsai/build-planning#256 * updates wheel tests to cover a range of CTK versions (we previously, accidentally, were only testing the latest 12.x and 13.x) Other changes * ensures conda packages also take on floors of `libnvjitlink>={whatever-version-they-were-built-against}` ## Notes for Reviewers ### How I tested this This uses wheels from similar PRs from RAPIDS dependencies, at build and test time: * rapidsai/cudf#21671 * rapidsai/kvikio#942 * rapidsai/raft#2971 * rapidsai/rmm#2270 * rapidsai/ucxx#604 Authors: - James Lamb (https://github.com/jameslamb) Approvers: - Gil Forsyth (https://github.com/gforsyth) URL: #5457

build wheels with CUDA 13.0.x, test wheels against mix of CTK versions

b1e5230

jameslamb added improvement Improves an existing functionality non-breaking Introduces a non-breaking change labels Mar 5, 2026

This was referenced Mar 5, 2026

wheels: build with oldest CUDA 13 CTK (13.0.x) rapidsai/build-planning#257

Open

wheels CI: test mix of cuda-toolkit version in CI rapidsai/build-planning#256

Open

build wheels with CUDA 13.0.x, test wheels against mix of CTK versions rapidsai/raft#2971

Merged

loosen 12.2 constraint slightly

bf3b694

jameslamb commented Mar 5, 2026

View reviewed changes

This was referenced Mar 5, 2026

enforce a floor on libnvjitlink, build wheels with CUDA 13.0.x, test wheels against mix of CTK versions rapidsai/cuvs#1862

Merged

enforce a floor on libnvjitlink, build wheels with CUDA 13.0.x, test wheels against mix of CTK versions rapidsai/cudf#21671

Merged

jameslamb and others added 3 commits March 9, 2026 08:51

Merge branch 'main' into test-oldest-ctk

7cb09c7

remove unnecessary gha-tools fork usage

8b6e2e4

update commits

b9406fa

jameslamb mentioned this pull request Mar 9, 2026

enforce a floor on libnvjitlink, build wheels with CUDA 13.0.x, test wheels against mix of CTK versions rapidsai/cugraph#5457

Merged

jameslamb changed the base branch from main to release/0.49 March 12, 2026 19:13

jameslamb and others added 3 commits March 15, 2026 21:12

merge release/0.49

3cb49c7

update RMM commits

d673fd7

Apply suggestion from @jameslamb

347de3a

jameslamb commented Mar 18, 2026

View reviewed changes

jameslamb changed the title ~~WIP: build wheels with CUDA 13.0.x, test wheels against mix of CTK versions~~ build wheels with CUDA 13.0.x, test wheels against mix of CTK versions Mar 18, 2026

jameslamb added the DO NOT MERGE Hold off on merging; see PR for details label Mar 18, 2026

jameslamb marked this pull request as ready for review March 18, 2026 05:08

jameslamb requested review from a team as code owners March 18, 2026 05:08

jameslamb requested a review from gforsyth March 18, 2026 05:08

revert testing changes

1563f88

bdice approved these changes Mar 18, 2026

View reviewed changes

jameslamb removed the DO NOT MERGE Hold off on merging; see PR for details label Mar 18, 2026

rapids-bot bot merged commit b0bb3df into rapidsai:release/0.49 Mar 18, 2026
161 of 164 checks passed

jameslamb deleted the test-oldest-ctk branch March 18, 2026 16:45

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

build wheels with CUDA 13.0.x, test wheels against mix of CTK versions#604

build wheels with CUDA 13.0.x, test wheels against mix of CTK versions#604
rapids-bot[bot] merged 9 commits intorapidsai:release/0.49from
jameslamb:test-oldest-ctk

jameslamb commented Mar 5, 2026

Uh oh!

copy-pr-bot bot commented Mar 5, 2026

Uh oh!

jameslamb Mar 5, 2026

Uh oh!

jameslamb commented Mar 16, 2026

Uh oh!

jameslamb Mar 18, 2026 •

edited

Loading

Uh oh!

jameslamb commented Mar 18, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

jameslamb commented Mar 5, 2026

Description

Notes for Reviewers

How I tested this

Uh oh!

copy-pr-bot bot commented Mar 5, 2026

Uh oh!

jameslamb Mar 5, 2026

Choose a reason for hiding this comment

Uh oh!

jameslamb commented Mar 16, 2026

Uh oh!

jameslamb Mar 18, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

jameslamb commented Mar 18, 2026

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

jameslamb Mar 18, 2026 •

edited

Loading