From 1c1fcf3696dcf0ecaafbd179c045ef8a2597b50c Mon Sep 17 00:00:00 2001 From: Michael Norris Date: Fri, 7 Feb 2025 09:11:57 -0800 Subject: [PATCH] Update INSTALL.md to remove some raft references, add missing dependency (#4176) Summary: For issue: https://github.com/facebookresearch/faiss/issues/4175 Reproduce on CI by: 1. Update build-pull-request.yml and action.yml to only run `conda install -c pytorch -c nvidia -c rapidsai -c conda-forge faiss-gpu-cuvs`, and also start a tmate session. 2. Log into the host 3. `cd` to ~/miniconda3/bin. Try to import faiss. It fails ``` runner@fv-az802-878:~/miniconda3/bin$ ./python Python 3.12.8 | packaged by conda-forge | (main, Dec 5 2024, 14:24:40) [GCC 13.3.0] on linux Type "help", "copyright", "credits" or "license" for more information. >>> import faiss Traceback (most recent call last): File "", line 1, in File "/home/runner/miniconda3/lib/python3.12/site-packages/faiss/__init__.py", line 17, in from .loader import * File "/home/runner/miniconda3/lib/python3.12/site-packages/faiss/loader.py", line 149, in from .swigfaiss import * File "/home/runner/miniconda3/lib/python3.12/site-packages/faiss/swigfaiss.py", line 13, in from . import _swigfaiss ImportError: libnvJitLink.so.12: cannot open shared object file: No such file or directory >>> ``` Reviewed By: asadoughi Differential Revision: D69278685 --- INSTALL.md | 8 ++++---- conda/faiss-gpu-cuvs/meta.yaml | 1 + 2 files changed, 5 insertions(+), 4 deletions(-) diff --git a/INSTALL.md b/INSTALL.md index 6e75826a56..ca491a6a60 100644 --- a/INSTALL.md +++ b/INSTALL.md @@ -6,7 +6,7 @@ pre-release nightly builds. - The CPU-only faiss-cpu conda package is currently available on Linux (x86-64 and aarch64), OSX (arm64 only), and Windows (x86-64) - faiss-gpu, containing both CPU and GPU indices, is available on Linux (x86-64 only) for CUDA 11.4 and 12.1 -- faiss-gpu-raft [^1] package containing GPU indices provided by [NVIDIA RAFT](https://github.com/rapidsai/raft/) version 24.06, is available on Linux (x86-64 only) for CUDA 11.8 and 12.4. +- faiss-gpu-cuvs [^1] package containing GPU indices provided by [NVIDIA cuVS](https://github.com/rapidsai/cuvs/) version 24.12, is available on Linux (x86-64 only) for CUDA 11.8 and 12.4. To install the latest stable release: @@ -17,15 +17,15 @@ $ conda install -c pytorch faiss-cpu=1.10.0 # GPU(+CPU) version $ conda install -c pytorch -c nvidia faiss-gpu=1.10.0 -# GPU(+CPU) version with NVIDIA RAFT -$ conda install -c pytorch -c nvidia -c rapidsai -c conda-forge faiss-gpu-raft=1.10.0 +# GPU(+CPU) version with NVIDIA cuVS +$ conda install -c pytorch -c nvidia -c rapidsai -c conda-forge libnvjitlink faiss-gpu-cuvs=1.10.0 # GPU(+CPU) version using AMD ROCm not yet available ``` For faiss-gpu, the nvidia channel is required for CUDA, which is not published in the main anaconda channel. -For faiss-gpu-raft, the rapidsai, conda-forge and nvidia channels are required. +For faiss-gpu-cuvs, the rapidsai, conda-forge and nvidia channels are required. Nightly pre-release packages can be installed as follows: diff --git a/conda/faiss-gpu-cuvs/meta.yaml b/conda/faiss-gpu-cuvs/meta.yaml index a8edf41e58..45a757b59b 100644 --- a/conda/faiss-gpu-cuvs/meta.yaml +++ b/conda/faiss-gpu-cuvs/meta.yaml @@ -76,6 +76,7 @@ outputs: - libcublas {{ libcublas_constraints }} - libcuvs =24.12 - cuda-version {{ cuda_constraints }} + - libnvjitlink test: requires: - conda-build