handle more RAPIDS version formats in update-version.sh, refactor dependencies.yaml

[jameslamb]

Description

Contributes to rapidsai/build-planning#13.

Updates update-version.sh to correctly handle RAPIDS dependencies like cudf-cu12==24.2.*.

This also pulls in some dependency refactoring originally added in #4088, which allows greater use of dependencies.yaml globs (and therefore less maintenance effort to support new CUDA versions).

Checklist

• I am familiar with the Contributing Guidelines.
• New or existing tests cover these changes.
• The documentation is up to date with these changes.

How I tested this

The portability of this updated sed command was tested here: rapidsai/cudf#14825 (comment).

In this repo, I ran the following:

# running in docker because some of this repo's `update-version.sh` stuff doesn't work with mac's sed
docker run \
  --rm \
  -v $(pwd):/opt/scratch \
  -w /opt/scratch \
  -it rapidsai/ci-conda:cuda11.8.0-ubuntu22.04-py3.10 \
  bash

./ci/release/update-version.sh '23.12.00'
git diff

./ci/release/update-version.sh '24.04.00'
git diff

Confirmed that that first git diff changed all the things I expected, and that second one showed 0 changes.

[bdice]

Approving with one small suggestion.

[jameslamb]

This CI failure:

  CMake Error at /home/coder/cugraph-ops/cpp/build/release/_deps/raft-build/raft-targets.cmake:56 (set_target_properties):
    The link interface of target "raft::raft" contains:
  
      hnswlib::hnswlib
  
    but the target was not found.  Possible reasons include:
  
      * There is a typo in the target name.
      * A find_package call is missing for an IMPORTED target.
      * An ALIAS target is missing.

(build link)

Should hopefully be fixed by rapidsai/raft#2135

[jameslamb]

I just pulled latest branch-24.04 and re-ran update-version.sh. Realized there are a few more branch updates for GitHub Actions workflows that were missed: 9090fc2

[jameslamb]

ah looks like @jakirkham noticed the same thing on #4127.

Let's get that one passing and merged first, then update this one.

[rlratzel]

LGTM, although I didn't verify the regexes in the sed calls work so I'm assuming that was tested.

[jakirkham]

ah looks like @jakirkham noticed the same thing on #4127.

Let's get that one passing and merged first, then update this one.

That PR is now merged. So we should be good to update here

[jameslamb]

Thanks @jakirkham , I've updated this to the latest branch-24.04.

[jakirkham]

Thanks James! 🙏

Looks like we are seeing some test failures with CUDA 12 wheels. Not sure if they are related to this change

[bdice]

I think the Python test failures could be related to pandas 2 changes in cudf. There are lots of separate failure cases.
https://github.com/rapidsai/cugraph/actions/runs/7758006471/job/21161144430?pr=4109#step:7:4281

[vyasr]

Python failures should be fixed when #4144 merges

[bdice]

/merge