Skip to content

enforce wheel size limits, README formatting in CI#4754

Merged
rapids-bot[bot] merged 5 commits intorapidsai:branch-24.12from
jameslamb:wheel-validation
Nov 15, 2024
Merged

enforce wheel size limits, README formatting in CI#4754
rapids-bot[bot] merged 5 commits intorapidsai:branch-24.12from
jameslamb:wheel-validation

Conversation

@jameslamb
Copy link
Member

Description

Contributes to rapidsai/build-planning#110

Proposes adding 2 types of validation on wheels in CI, to ensure we continue to produce wheels that are suitable for PyPI.

Notes for Reviewers

This intentionally omits the libraries that are about to be moved to other repos.

@jameslamb jameslamb added improvement Improvement / enhancement to an existing function DO NOT MERGE Hold off on merging; see PR for details non-breaking Non-breaking change labels Nov 13, 2024
@jameslamb jameslamb changed the title WIP: [DO NOT MERGE] enforce wheel size limits, README formatting in CI enforce wheel size limits, README formatting in CI Nov 14, 2024
@jameslamb jameslamb removed the DO NOT MERGE Hold off on merging; see PR for details label Nov 14, 2024
@jameslamb jameslamb requested a review from bdice November 14, 2024 03:39
@jameslamb jameslamb marked this pull request as ready for review November 14, 2024 03:39
@jameslamb jameslamb requested review from a team as code owners November 14, 2024 03:39
Copy link
Contributor

@bdice bdice left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approving with one suggestion.

]

# detect when package size grows significantly
max_allowed_size_compressed = '1.5G'
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we do what @betatim proposed for cuml here (and in pylibcugraph) as well, and have separate CUDA 11/12 limits?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah with the benefit of a night of sleep, I do think that's better and the little bit of extra complexity in the script is worth it. I'll do that here.

And put up a PR in cuvs doing that too... it had a similar huge threshold + huge difference across CUDA versions.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just put up a proposal for setting these thresholds, let me know what you think.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me!

@jameslamb
Copy link
Member Author

/merge

@rapids-bot rapids-bot bot merged commit d493216 into rapidsai:branch-24.12 Nov 15, 2024
@jameslamb jameslamb deleted the wheel-validation branch November 15, 2024 00:18
rapids-bot bot pushed a commit to rapidsai/cuvs that referenced this pull request Nov 15, 2024
`cuvs-cu11` wheels are significantly larger than `cuvs-cu12` wheels, because (among other reasons) they are not able to dynamically link to CUDA math library wheels.

In #464, I proposed a size limit for CI checks of "max CUDA 11 wheel size + a buffer".

This PR proposes using different thresholds based on CUDA major version, following these discussions:

* rapidsai/cugraph#4754 (comment)
* rapidsai/cuml#6136 (comment)

Authors:
  - James Lamb (https://github.com/jameslamb)

Approvers:
  - Mike Sarahan (https://github.com/msarahan)

URL: #469
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci improvement Improvement / enhancement to an existing function non-breaking Non-breaking change python

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants