Skip to content

Add lower bound to dask-ml>=2024#7600

Merged
rapids-bot[bot] merged 2 commits intorapidsai:mainfrom
bdice:require-dask-ml-2024
Dec 12, 2025
Merged

Add lower bound to dask-ml>=2024#7600
rapids-bot[bot] merged 2 commits intorapidsai:mainfrom
bdice:require-dask-ml-2024

Conversation

@bdice
Copy link
Copy Markdown
Contributor

@bdice bdice commented Dec 11, 2025

I was seeing issues with the RAPIDS pip devcontainers solving dask-ml. Adding a lower bound to constrain the solution space appears to fix the problem.

Here is the error I saw:

Collecting dask-ml (from -r /tmp/rapids.requirements.txt (line 23))
Using cached dask_ml-2025.1.0-py3-none-any.whl.metadata (6.0 kB)
Using cached dask_ml-2024.4.4-py3-none-any.whl.metadata (5.9 kB)
Using cached dask_ml-2024.3.20-py3-none-any.whl.metadata (4.3 kB)
Using cached dask_ml-2023.3.24-py3-none-any.whl.metadata (4.3 kB)
Using cached dask_ml-2022.5.27-py3-none-any.whl.metadata (4.3 kB)
Using cached dask_ml-2022.1.22-py3-none-any.whl.metadata (4.3 kB)
Using cached dask_ml-2021.11.30-py3-none-any.whl.metadata (4.3 kB)
Using cached dask_ml-2021.11.16-py3-none-any.whl.metadata (4.3 kB)
Using cached dask_ml-2021.10.17-py3-none-any.whl.metadata (4.3 kB)
Using cached dask_ml-1.9.0-py3-none-any.whl.metadata (4.2 kB)
Using cached dask_ml-1.8.0-py3-none-any.whl.metadata (2.7 kB)
Using cached dask_ml-1.7.0-py3-none-any.whl.metadata (2.7 kB)
Using cached dask_ml-1.6.0-py3-none-any.whl.metadata (2.7 kB)
Using cached dask_ml-1.5.0-py3-none-any.whl.metadata (2.7 kB)
Using cached dask_ml-1.4.0-py3-none-any.whl.metadata (2.7 kB)
Using cached dask_ml-1.3.0-py3-none-any.whl.metadata (2.9 kB)
Using cached dask_ml-1.2.0-py3-none-any.whl.metadata (2.9 kB)
Using cached dask_ml-1.1.1-py3-none-any.whl.metadata (2.9 kB)
Using cached dask_ml-1.1.0-py3-none-any.whl.metadata (2.9 kB)
Using cached dask_ml-1.0.0-py3-none-any.whl.metadata (2.9 kB)
Using cached dask_ml-0.13.0-py2.py3-none-any.whl.metadata (3.1 kB)
Using cached dask_ml-0.12.0-py2.py3-none-any.whl.metadata (3.0 kB)
Using cached dask_ml-0.11.0-py2.py3-none-any.whl.metadata (2.8 kB)
Using cached dask_ml-0.10.0-py2.py3-none-any.whl.metadata (2.9 kB)
Using cached dask_ml-0.9.0-py2.py3-none-any.whl.metadata (2.9 kB)
Using cached dask-ml-0.8.0.tar.gz (243 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'error'
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> [23 lines of output]
    Traceback (most recent call last):
      File "/home/coder/.local/share/venvs/rapids/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
        main()
        ~~~~^^
      File "/home/coder/.local/share/venvs/rapids/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
        json_out["return_val"] = hook(**hook_input["kwargs"])
        ~~~~^^^^^^^^^^^^^^^^^^^^^^^^
      File "/home/coder/.local/share/venvs/rapids/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 143, in get_requires_for_build_wheel
        return hook(config_settings)
      File "/tmp/pip-build-env-jqfmfxhw/overlay/lib/python3.13/site-packages/setuptools/build_meta.py", line 331, in get_requires_for_build_wheel
        return self._get_build_requires(config_settings, requirements=[])
        ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/tmp/pip-build-env-jqfmfxhw/overlay/lib/python3.13/site-packages/setuptools/build_meta.py", line 301, in _get_build_requires
        self.run_setup()
        ~~~~~~~~~~~~~~^^
      File "/tmp/pip-build-env-jqfmfxhw/overlay/lib/python3.13/site-packages/setuptools/build_meta.py", line 512, in run_setup
        super().run_setup(setup_script=setup_script)
        ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/tmp/pip-build-env-jqfmfxhw/overlay/lib/python3.13/site-packages/setuptools/build_meta.py", line 317, in run_setup
        exec(code, locals())
        ~~~~^^^^^^^^^^^^^^^^
      File "<string>", line 4, in <module>
    ModuleNotFoundError: No module named 'numpy'
    [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed to build 'dask-ml' when getting requirements to build wheel
Failing `requirements.txt` file:
--extra-index-url=https://download.pytorch.org/whl/cu130
--extra-index-url=https://pypi.anaconda.org/rapidsai-wheels-nightly/simple
--extra-index-url=https://pypi.nvidia.com
aiobotocore>=2.2.0
boto3>=1.21.21
botocore>=1.24.21
cachetools
certifi
click >=8.1
cloudpickle
cmake>=3.26.4,!=3.30.0
cmake>=3.30.4
cmake>=3.30.4,<4
confluent-kafka>=2.8.0,<2.9.0
cramjam
cuda-core==0.3.*
cuda-python>=13.0.0,<14.0a0
cuda-toolkit[nvcc,nvrtc]==13.*
cupy-cuda13x>=13.6.0
cython>=3.0.0,<3.2.0
cython>=3.0.3,<3.2.0
cython>=3.1.2,<3.2.0
dask-ml
fastavro>=0.22.9
fsspec>=0.6.0
fsspec[http]>=0.6.0
graphviz
hdbscan>=0.8.39,<0.8.40
hypothesis>=6.0,<7
hypothesis>=6.131.7
identify>=2.5.20
ipykernel
ipython
joblib>=0.11
jupyter_client
libucx-cu13>=1.19.0,<1.20
matplotlib
mmh3
moto[server]>=4.0.8
mpi4py
msgpack
nanoarrow
nbconvert
nbformat
nbsphinx
networkx>=2.5.1
networkx>=3.2
nltk
notebook
notebook>=0.5.0
numba-cuda>=0.22.1,<0.23.0
numba-cuda[cu13]>=0.22.1,<0.23.0
numba>=0.60.0,<0.62.0
numpy >=1.23,<3.0
numpy>=1.23,<3.0
numpydoc
numpydoc<1.9
numpydoc>=1.1.0
nvidia-libnvcomp-cu13==5.1.0.21
nvidia-ml-py>=12
nvidia-nccl-cu13>=2.19
nvtx>=0.2.1
ogb
openmpi >=5.0
openpyxl
packaging
pandas
pandas>=1.3
pandas>=2.0,<2.4.0
polars>=1.29,<1.35
pre-commit
psutil
pyarrow>=15.0.0,!=17.0.0; platform_machine=='aarch64'
pyarrow>=15.0.0; platform_machine=='x86_64'
pydata-sphinx-theme!=0.14.2
pynndescent
pytest
pytest-asyncio
pytest-asyncio>=1.0.0
pytest-benchmark
pytest-cases
pytest-cases>=3.8.2
pytest-cov
pytest-forked
pytest-httpserver
pytest-mpl
pytest-rerunfailures!=16.0.0
pytest-timeout
pytest-xdist
pytest<9.0
pytest<9.0.0
python-louvain
pyyaml
pyyaml>=6
rangehttpserver
rapids-build-backend>=0.4.0,<0.5.0
rapids-dask-dependency==26.2.*,>=0.0.0a0
rapids-logger==0.2.*,>=0.0.0a0
recommonmark
rich
s3fs>=2022.3.0
scikit-build-core[pyproject]>=0.10.0
scikit-learn
scikit-learn>=0.23.1
scikit-learn>=1.4
scikit-learn>=1.4,<1.8.0
scipy
scipy>=1.11.0
seaborn
sentence-transformers
setuptools
setuptools>=61.0.0
setuptools>=64.0.0
sphinx
sphinx-click
sphinx-click>=2.7.1
sphinx-copybutton
sphinx-markdown-tables
sphinx-rtd-theme>=0.5.1
sphinx_rtd_theme
statsmodels
streamz
structlog
tenacity
tensordict>=0.1.2
torch-geometric>=2.5,<2.7
torch>=2.9.0
treelite>=4.6.1,<5.0.0
typing-extensions; python_version < '3.11'
typing_extensions>=4.0.0
tzdata
umap-learn==0.5.7
wheel
xxhash
zarr>=3.0.0,<3.2.0,<4.0.0
zict>=2.0.0
zstandard

@copy-pr-bot
Copy link
Copy Markdown

copy-pr-bot Bot commented Dec 11, 2025

Auto-sync is disabled for draft pull requests in this repository. Workflows must be run manually.

Contributors can view more details about this message here.

@github-actions github-actions Bot added conda conda issue Cython / Python Cython or Python issue labels Dec 11, 2025
@bdice bdice added improvement Improvement / enhancement to an existing function non-breaking Non-breaking change labels Dec 11, 2025
@bdice bdice marked this pull request as ready for review December 11, 2025 16:36
@bdice bdice requested a review from a team as a code owner December 11, 2025 16:36
@bdice bdice requested a review from msarahan December 11, 2025 16:36
@csadorf
Copy link
Copy Markdown
Contributor

csadorf commented Dec 11, 2025

We should maybe merge #7567 first.

@bdice
Copy link
Copy Markdown
Contributor Author

bdice commented Dec 12, 2025

/merge

@rapids-bot rapids-bot Bot merged commit c72007d into rapidsai:main Dec 12, 2025
152 of 160 checks passed
mani-builds pushed a commit to mani-builds/cuml that referenced this pull request Jan 11, 2026
I was seeing issues with the RAPIDS pip devcontainers solving dask-ml. Adding a lower bound to constrain the solution space appears to fix the problem.

Here is the error I saw:
```
Collecting dask-ml (from -r /tmp/rapids.requirements.txt (line 23))
Using cached dask_ml-2025.1.0-py3-none-any.whl.metadata (6.0 kB)
Using cached dask_ml-2024.4.4-py3-none-any.whl.metadata (5.9 kB)
Using cached dask_ml-2024.3.20-py3-none-any.whl.metadata (4.3 kB)
Using cached dask_ml-2023.3.24-py3-none-any.whl.metadata (4.3 kB)
Using cached dask_ml-2022.5.27-py3-none-any.whl.metadata (4.3 kB)
Using cached dask_ml-2022.1.22-py3-none-any.whl.metadata (4.3 kB)
Using cached dask_ml-2021.11.30-py3-none-any.whl.metadata (4.3 kB)
Using cached dask_ml-2021.11.16-py3-none-any.whl.metadata (4.3 kB)
Using cached dask_ml-2021.10.17-py3-none-any.whl.metadata (4.3 kB)
Using cached dask_ml-1.9.0-py3-none-any.whl.metadata (4.2 kB)
Using cached dask_ml-1.8.0-py3-none-any.whl.metadata (2.7 kB)
Using cached dask_ml-1.7.0-py3-none-any.whl.metadata (2.7 kB)
Using cached dask_ml-1.6.0-py3-none-any.whl.metadata (2.7 kB)
Using cached dask_ml-1.5.0-py3-none-any.whl.metadata (2.7 kB)
Using cached dask_ml-1.4.0-py3-none-any.whl.metadata (2.7 kB)
Using cached dask_ml-1.3.0-py3-none-any.whl.metadata (2.9 kB)
Using cached dask_ml-1.2.0-py3-none-any.whl.metadata (2.9 kB)
Using cached dask_ml-1.1.1-py3-none-any.whl.metadata (2.9 kB)
Using cached dask_ml-1.1.0-py3-none-any.whl.metadata (2.9 kB)
Using cached dask_ml-1.0.0-py3-none-any.whl.metadata (2.9 kB)
Using cached dask_ml-0.13.0-py2.py3-none-any.whl.metadata (3.1 kB)
Using cached dask_ml-0.12.0-py2.py3-none-any.whl.metadata (3.0 kB)
Using cached dask_ml-0.11.0-py2.py3-none-any.whl.metadata (2.8 kB)
Using cached dask_ml-0.10.0-py2.py3-none-any.whl.metadata (2.9 kB)
Using cached dask_ml-0.9.0-py2.py3-none-any.whl.metadata (2.9 kB)
Using cached dask-ml-0.8.0.tar.gz (243 kB)
Installing build dependencies: started
Installing build dependencies: finished with status 'done'
Getting requirements to build wheel: started
Getting requirements to build wheel: finished with status 'error'
error: subprocess-exited-with-error

× Getting requirements to build wheel did not run successfully.
│ exit code: 1
╰─> [23 lines of output]
    Traceback (most recent call last):
      File "/home/coder/.local/share/venvs/rapids/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 389, in <module>
        main()
        ~~~~^^
      File "/home/coder/.local/share/venvs/rapids/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 373, in main
        json_out["return_val"] = hook(**hook_input["kwargs"])
        ~~~~^^^^^^^^^^^^^^^^^^^^^^^^
      File "/home/coder/.local/share/venvs/rapids/lib/python3.13/site-packages/pip/_vendor/pyproject_hooks/_in_process/_in_process.py", line 143, in get_requires_for_build_wheel
        return hook(config_settings)
      File "/tmp/pip-build-env-jqfmfxhw/overlay/lib/python3.13/site-packages/setuptools/build_meta.py", line 331, in get_requires_for_build_wheel
        return self._get_build_requires(config_settings, requirements=[])
        ~~~~~~~~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/tmp/pip-build-env-jqfmfxhw/overlay/lib/python3.13/site-packages/setuptools/build_meta.py", line 301, in _get_build_requires
        self.run_setup()
        ~~~~~~~~~~~~~~^^
      File "/tmp/pip-build-env-jqfmfxhw/overlay/lib/python3.13/site-packages/setuptools/build_meta.py", line 512, in run_setup
        super().run_setup(setup_script=setup_script)
        ~~~~~~~~~~~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^
      File "/tmp/pip-build-env-jqfmfxhw/overlay/lib/python3.13/site-packages/setuptools/build_meta.py", line 317, in run_setup
        exec(code, locals())
        ~~~~^^^^^^^^^^^^^^^^
      File "<string>", line 4, in <module>
    ModuleNotFoundError: No module named 'numpy'
    [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
ERROR: Failed to build 'dask-ml' when getting requirements to build wheel
```

<details><summary>Failing `requirements.txt` file:</summary>

```
--extra-index-url=https://download.pytorch.org/whl/cu130
--extra-index-url=https://pypi.anaconda.org/rapidsai-wheels-nightly/simple
--extra-index-url=https://pypi.nvidia.com
aiobotocore>=2.2.0
boto3>=1.21.21
botocore>=1.24.21
cachetools
certifi
click >=8.1
cloudpickle
cmake>=3.26.4,!=3.30.0
cmake>=3.30.4
cmake>=3.30.4,<4
confluent-kafka>=2.8.0,<2.9.0
cramjam
cuda-core==0.3.*
cuda-python>=13.0.0,<14.0a0
cuda-toolkit[nvcc,nvrtc]==13.*
cupy-cuda13x>=13.6.0
cython>=3.0.0,<3.2.0
cython>=3.0.3,<3.2.0
cython>=3.1.2,<3.2.0
dask-ml
fastavro>=0.22.9
fsspec>=0.6.0
fsspec[http]>=0.6.0
graphviz
hdbscan>=0.8.39,<0.8.40
hypothesis>=6.0,<7
hypothesis>=6.131.7
identify>=2.5.20
ipykernel
ipython
joblib>=0.11
jupyter_client
libucx-cu13>=1.19.0,<1.20
matplotlib
mmh3
moto[server]>=4.0.8
mpi4py
msgpack
nanoarrow
nbconvert
nbformat
nbsphinx
networkx>=2.5.1
networkx>=3.2
nltk
notebook
notebook>=0.5.0
numba-cuda>=0.22.1,<0.23.0
numba-cuda[cu13]>=0.22.1,<0.23.0
numba>=0.60.0,<0.62.0
numpy >=1.23,<3.0
numpy>=1.23,<3.0
numpydoc
numpydoc<1.9
numpydoc>=1.1.0
nvidia-libnvcomp-cu13==5.1.0.21
nvidia-ml-py>=12
nvidia-nccl-cu13>=2.19
nvtx>=0.2.1
ogb
openmpi >=5.0
openpyxl
packaging
pandas
pandas>=1.3
pandas>=2.0,<2.4.0
polars>=1.29,<1.35
pre-commit
psutil
pyarrow>=15.0.0,!=17.0.0; platform_machine=='aarch64'
pyarrow>=15.0.0; platform_machine=='x86_64'
pydata-sphinx-theme!=0.14.2
pynndescent
pytest
pytest-asyncio
pytest-asyncio>=1.0.0
pytest-benchmark
pytest-cases
pytest-cases>=3.8.2
pytest-cov
pytest-forked
pytest-httpserver
pytest-mpl
pytest-rerunfailures!=16.0.0
pytest-timeout
pytest-xdist
pytest<9.0
pytest<9.0.0
python-louvain
pyyaml
pyyaml>=6
rangehttpserver
rapids-build-backend>=0.4.0,<0.5.0
rapids-dask-dependency==26.2.*,>=0.0.0a0
rapids-logger==0.2.*,>=0.0.0a0
recommonmark
rich
s3fs>=2022.3.0
scikit-build-core[pyproject]>=0.10.0
scikit-learn
scikit-learn>=0.23.1
scikit-learn>=1.4
scikit-learn>=1.4,<1.8.0
scipy
scipy>=1.11.0
seaborn
sentence-transformers
setuptools
setuptools>=61.0.0
setuptools>=64.0.0
sphinx
sphinx-click
sphinx-click>=2.7.1
sphinx-copybutton
sphinx-markdown-tables
sphinx-rtd-theme>=0.5.1
sphinx_rtd_theme
statsmodels
streamz
structlog
tenacity
tensordict>=0.1.2
torch-geometric>=2.5,<2.7
torch>=2.9.0
treelite>=4.6.1,<5.0.0
typing-extensions; python_version < '3.11'
typing_extensions>=4.0.0
tzdata
umap-learn==0.5.7
wheel
xxhash
zarr>=3.0.0,<3.2.0,<4.0.0
zict>=2.0.0
zstandard
```

</details>

Authors:
  - Bradley Dice (https://github.com/bdice)

Approvers:
  - Kyle Edwards (https://github.com/KyleFromNVIDIA)

URL: rapidsai#7600
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

conda conda issue Cython / Python Cython or Python issue improvement Improvement / enhancement to an existing function non-breaking Non-breaking change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants