Skip to content

Scaling workspace resources#181

Merged
rapids-bot[bot] merged 6 commits intorapidsai:branch-24.08from
achirkin:enh-scaled-workspace-resource
Jun 12, 2024
Merged

Scaling workspace resources#181
rapids-bot[bot] merged 6 commits intorapidsai:branch-24.08from
achirkin:enh-scaled-workspace-resource

Conversation

@achirkin
Copy link
Copy Markdown
Contributor

@achirkin achirkin commented Jun 6, 2024

Use raft's large workspace resource for large temporary allocations during ANN index build.
This is the port of rapidsai/raft#2194, which didn't make into raft before the algorithms were ported to cuVS.

@achirkin achirkin requested a review from a team as a code owner June 6, 2024 19:14
@github-actions github-actions Bot added the cpp label Jun 6, 2024
@achirkin achirkin mentioned this pull request Jun 6, 2024
10 tasks
@cjnolet cjnolet added improvement Improves an existing functionality non-breaking Introduces a non-breaking change labels Jun 7, 2024
Copy link
Copy Markdown
Contributor

@tfeher tfeher left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Artem for the PR! It is great to fix potential OOM errors with this PR. Overall this looks good, I have added a few comments.

Comment thread cpp/src/neighbors/ivf_pq/ivf_pq_build.cuh Outdated
Comment thread cpp/src/neighbors/ivf_pq/ivf_pq_build.cuh Outdated
Comment thread cpp/src/neighbors/ivf_pq/ivf_pq_build.cuh Outdated
Comment thread cpp/src/neighbors/detail/cagra/utils.hpp
Comment thread cpp/src/neighbors/ivf_pq/ivf_pq_build.cuh Outdated
Comment thread cpp/src/neighbors/detail/cagra/cagra_build.cuh Outdated
Comment thread cpp/src/neighbors/detail/cagra/cagra_build.cuh Outdated
@achirkin achirkin requested a review from tfeher June 10, 2024 15:12
Comment thread cpp/src/neighbors/detail/cagra/cagra_build.cuh Outdated
Comment thread cpp/src/neighbors/ivf_pq/ivf_pq_build.cuh
Comment thread cpp/src/neighbors/ivf_pq/ivf_pq_build.cuh Outdated
@achirkin achirkin requested a review from tfeher June 11, 2024 08:47
Copy link
Copy Markdown
Contributor

@tfeher tfeher left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks Artem for the update, LGTM.

@benfred
Copy link
Copy Markdown
Contributor

benfred commented Jun 12, 2024

/merge

@rapids-bot rapids-bot Bot merged commit 5668ef0 into rapidsai:branch-24.08 Jun 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

cpp improvement Improves an existing functionality non-breaking Introduces a non-breaking change

Projects

Status: Done

Development

Successfully merging this pull request may close these issues.

4 participants