Skip to content

Commit 64c2bf5

Browse files
authored
chore: Revise README for submodule and CUDA details
Updated instructions for submodule updates and corrected workflow file names. Adjusted CUDA architecture compatibility details.
1 parent 5b4178a commit 64c2bf5

1 file changed

Lines changed: 4 additions & 4 deletions

File tree

README.md

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -1,7 +1,7 @@
11
## Artifacts
22

33
This repo is created to easily build binaries related to common LLM/NLP libraries. Before doing a release for any package, refer to following key steps,
4-
1. Run `git submodule update --remote --merge` to update all submodules.
4+
1. Run `update-submodules.yaml` to update all submodules.
55
2. Update the respective workflow to choose your preferred CUDA/Python/OS version.
66
3. Create a new release, including a description with the latest source package version.
77
4. Run the desired workflow file.
@@ -13,10 +13,10 @@ Provide custom-built CUDA-compatible wheels that override the default CMAKE args
1313
**References:**
1414
- Source: [llama-cpp-python](https://github.com/abetlen/llama-cpp-python)
1515
- CMAKE documentation: [llama.cpp build guide](https://github.com/ggml-org/llama.cpp/blob/master/docs/build.md#unified-memory)
16-
- Pre-built wheels are generated using the `llama-cpu.yaml` or `llama-cuda.yaml` workflows
16+
- Pre-built wheels are generated using the `llama-build-cpu.yaml` or `llama-build-cuda.yaml` workflows
1717
- CUDA Support & Architecture Compatibility for different GPUs:
1818
```bash
19-
-DCMAKE_CUDA_ARCHITECTURE=70;75;80
19+
-DCMAKE_CUDA_ARCHITECTURE=75;80
2020
```
2121

2222
| Compute Capability | CUDA Architecture | GPUs | Supported CUDA Versions | Azure Support |
@@ -26,7 +26,7 @@ Provide custom-built CUDA-compatible wheels that override the default CMAKE args
2626
| **sm_70 / sm_72** | Volta | Tesla V100, Jetson AGX Xavier|**12.8.x** *(deprecated in 13.x)* ||
2727
| **sm_75** | Turing | RTX 2080, T4 |**12.8.x** ||
2828
| **sm_80** | Ampere | A100 |**12.8.x** ||
29-
| **sm_86** | Ampere | RTX 3090, A100 |**12.8.x** ||
29+
| **sm_86** | Ampere | RTX 3090, |**12.8.x** ||
3030
| **sm_89 / sm_90** | Ada / Hopper | RTX 4090, H100 | ✅ 12.8.x and 13.x ||
3131

3232

0 commit comments

Comments
 (0)