Skip to content

Use nvcomp wheel instead of bundling nvcomp#16946

Merged
rapids-bot[bot] merged 13 commits intorapidsai:branch-24.12from
KyleFromNVIDIA:nvcomp-wheel
Oct 2, 2024
Merged

Use nvcomp wheel instead of bundling nvcomp#16946
rapids-bot[bot] merged 13 commits intorapidsai:branch-24.12from
KyleFromNVIDIA:nvcomp-wheel

Conversation

@KyleFromNVIDIA
Copy link
Member

Description

Contributes to https://github.com/rapidsai/rapids-wheels-planning/issues/74

Checklist

  • I am familiar with the Contributing Guidelines.
  • New or existing tests cover these changes.
  • The documentation is up to date with these changes.

@KyleFromNVIDIA KyleFromNVIDIA added improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Sep 27, 2024
@KyleFromNVIDIA KyleFromNVIDIA requested a review from a team as a code owner September 27, 2024 18:18
@github-actions github-actions bot added the Python Affects Python cuDF API. label Sep 27, 2024
@KyleFromNVIDIA KyleFromNVIDIA marked this pull request as draft September 27, 2024 19:23
@github-actions github-actions bot added libcudf Affects libcudf (C++/CUDA) code. CMake CMake build issue labels Sep 27, 2024
@KyleFromNVIDIA
Copy link
Member Author

@bdice I've applied your suggestions to rapidsai/kvikio#478 too.

@KyleFromNVIDIA KyleFromNVIDIA marked this pull request as ready for review October 1, 2024 16:36
@KyleFromNVIDIA KyleFromNVIDIA requested review from a team as code owners October 1, 2024 16:36
Copy link
Contributor

@bdice bdice left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, just one question on the CMake variable name.

@KyleFromNVIDIA
Copy link
Member Author

/merge

@jlowe
Copy link
Contributor

jlowe commented Oct 3, 2024

Note that this has broken downstream projects that build from a libcudf installed area since nvcomp is no longer installed alongside libcudf artifacts. See #16986.

@jameslamb jameslamb mentioned this pull request Nov 7, 2024
3 tasks
rapids-bot bot pushed a commit that referenced this pull request Nov 8, 2024
Related to rapidsai/build-planning#33 and rapidsai/build-planning#74

The last use of CMake function `install_aliased_imported_targets()` here was removed in #16946. This proposes removing the file holding its definition.

Authors:
  - James Lamb (https://github.com/jameslamb)

Approvers:
  - Kyle Edwards (https://github.com/KyleFromNVIDIA)

URL: #17276
@jameslamb jameslamb mentioned this pull request Jan 21, 2025
3 tasks
rapids-bot bot pushed a commit that referenced this pull request Jan 23, 2025
Follow-up to #16946

Adds a matrix filter `use_cuda_wheels` in the `dependencies.yaml` list used for `libcudf`'s `nvcomp` dependency. Some types of builds (like RAPIDS devcontainers) prefer to use the system-installed nvCOMP to one provided by wheels.

This ensures that preference is respected, because those builds pass matrix selector `use_cuda_wheels=false` through `rapids-dependency-file-generator` (rapidsai/devcontainers#382).

## Notes for Reviewers

### How I tested this

Saw that `nvidia-nvcomp-cu12` made it into the environment in pip devcontainers builds in previous PRs:

```text
...
 numpy>=1.23,<3.0a0
  nvidia-nvcomp-cu12==4.1.0.6
  nvtx>=0.2.1
...
```

([logs from recent PR build in this repo](https://github.com/rapidsai/cudf/actions/runs/12860325999/job/35852085397#step:8:1010))

It's not there as of this PR 😁 

```text
...
  numpy>=1.23,<3.0a0
  nvtx>=0.2.1
...
```

([build link](https://github.com/rapidsai/cudf/actions/runs/12896597574/job/35959950655?pr=17774#step:8:1028))

#

Authors:
  - James Lamb (https://github.com/jameslamb)
  - Bradley Dice (https://github.com/bdice)

Approvers:
  - Bradley Dice (https://github.com/bdice)

URL: #17774
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CMake CMake build issue improvement Improvement / enhancement to an existing function libcudf Affects libcudf (C++/CUDA) code. non-breaking Non-breaking change Python Affects Python cuDF API.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

6 participants