Skip to content

Installing Dask-SQL w/ RAPIDS #324

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
charlesbluca merged 10 commits into from
Nov 23, 2021
Merged

Installing Dask-SQL w/ RAPIDS #324

Changes from 7 commits
Commits
Show all changes
10 commits
Select commit Hold shift + click to select a range
60b00c1
Installing Dask-SQL w/ RAPIDS
DaceT Nov 18, 2021
d45870f
Update docs/pages/installation.rst
DaceT Nov 22, 2021
8843714
Update docs/pages/installation.rst
DaceT Nov 22, 2021
c09d910
Adding more information about GPU Support
DaceT Nov 22, 2021
aaf8523
Merge branch 'dask-contrib:main' into patch-1
DaceT Nov 22, 2021
8d27cff
Merge remote-tracking branch 'upstream/main' into patch-1
charlesbluca Nov 22, 2021
cfeff30
Run pre-commit hooks
charlesbluca Nov 22, 2021
67e93ab
Merge branch 'dask-contrib:main' into patch-1
DaceT Nov 23, 2021
8ee3f11
Update docs/pages/installation.rst
DaceT Nov 23, 2021
b5ad937
Update docs/pages/installation.rst
DaceT Nov 23, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
27 changes: 27 additions & 0 deletions docs/pages/installation.rst
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -23,6 +23,33 @@ Install the package from the ``conda-forge`` channel:

conda install dask-sql -c conda-forge

Experimental GPU support
^^^^^^^^^^^^^^^^^^^^^^^^

- GPU support is currently tied to the `RAPIDS <https://rapids.ai/>`_ libraries.
- It is in development and generally requires the latest cuDF nightlies.
- It is experimental, so users should expect some bugs or undefined behavior.

Create a new conda environment or use an existing one to install RAPIDS with the chosen methods and packages:
Copy link
Collaborator

@charlesbluca charlesbluca Nov 19, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think we should maybe add a short blurb about GPU support here, bringing up the following to contextualize the env creation line below:

  • GPU support right now is specifically tied to the RAPIDS libraries
  • It is in development, and generally requires the latest nightlies of cuDF
  • It is experimental, and users should still expect some level of bugs / undefined behavior

Copy link
Contributor Author

@DaceT DaceT Nov 22, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks @charlesbluca, I'll see to add them!


.. code-block:: bash

conda create --name rapids-env -c rapidsai-nightly -c nvidia -c conda-forge -y cudatoolkit=11.2 cudf=21.12 ucx-py ucx-proc=*=gpu
conda activate rapids-env

Install the stable package from the ``conda-forge`` channel:

.. code-block:: bash

conda install -c conda-forge dask-sql

Or the latest nightly from the ``dask`` channel (currently only available for Linux-based operating systems):

.. code-block:: bash

conda install -c dask/label/dev dask-sql


With ``pip``
------------

Expand Down