Skip to content

enhance custom easyblock for NCCL so it defines $NCCL_HOME in generated module file #3782

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
boegel merged 2 commits into from
Aug 13, 2025
Merged

enhance custom easyblock for NCCL so it defines $NCCL_HOME in generated module file #3782

Changes from all commits
Commits
Show all changes
2 commits
Select commit Hold shift + click to select a range
f6d83bd
Set NCCL_HOME in NCCL easyblock
Flamefire Jun 17, 2025
c43f19e
Simplify CUDA CCs selection
Flamefire Jun 17, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
19 changes: 7 additions & 12 deletions easybuild/easyblocks/n/nccl.py
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -31,14 +31,18 @@
import os

from easybuild.easyblocks.generic.configuremake import ConfigureMake
from easybuild.tools.config import build_option
from easybuild.tools.systemtools import get_shared_lib_ext
from easybuild.tools.filetools import copy_file


class EB_NCCL(ConfigureMake):
"""Support for building NCCL."""

def __init__(self, *args, **kwargs):
"""Init module env"""
super().__init__(*args, **kwargs)
self.module_load_environment.NCCL_HOME = ['']

def configure_step(self):
"""NCCL has no configure step"""
pass
Expand All @@ -47,17 +51,8 @@ def build_step(self):
"""Build NCCL"""
# NCCL builds for all supported CUDA compute capabilities by default
# If cuda_compute_capabilities is specified then we override this with the selected options

# list of CUDA compute capabilities to use can be specifed in three ways (where 3 overrules 2 overrules 1):
# (1) in the easyconfig file, via the custom cuda_compute_capabilities;
# (2) via the EasyBuild environment variable EASYBUILD_CUDA_COMPUTE_CAPABILITIES;
# (3) in the EasyBuild configuration, via --cuda-compute-capabilities configuration option;
cuda_cc = build_option('cuda_compute_capabilities') or self.cfg['cuda_compute_capabilities']

nvcc_gencode = []
for cc in cuda_cc:
add = cc.replace('.', '')
nvcc_gencode.append('-gencode=arch=compute_%s,code=sm_%s' % (add, add))
cuda_cc = self.cfg.get_cuda_cc_template_value("cuda_cc_space_sep_no_period", required=False).split()
nvcc_gencode = [f'-gencode=arch=compute_{cc},code=sm_{cc}' for cc in cuda_cc]

if nvcc_gencode:
self.cfg.update('buildopts', 'NVCC_GENCODE="%s"' % ' '.join(nvcc_gencode))
Expand Down