Eliminate duplicate multideps from modules #29

mboisson · 2023-11-21T20:13:21Z

When combining multi_deps with iterative builds, it generates a list with duplicates, for example:

   /cvmfs/soft.computecanada.ca/easybuild/modules/2023/x86-64-v3/Compiler/gcccore/nlopt/2.7.1.lua:
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
help([[
Description
===========
NLopt is a free/open-source library for nonlinear optimization,
 providing a common interface for a number of different free optimization routines
 available online as well as original implementations of various other algorithms.


More information
================
 - Homepage: http://ab-initio.mit.edu/wiki/index.php/NLopt


Compatible modules
==================
This module is compatible with the following modules, one of each line is required:
* python/3.10, python/3.10, python/3.10, python/3.10, python/3.11, python/3.11, python/3.11, python/3.11
]])

This commit fixes that.

Corresponding upstream PR: easybuilders#4386

…t present.

…uild-framework into computecanada-master

… is not set.

…ada-master

We still get loads for icc and ifort for HPL.

…ada-master

…a-main

This is the case for toolchains with Open MPI / linalg but no BLACS.

ldd fails on debug ELF objects, where the "file" command gives exactly the same output as for shared libraries.

easybuild-framework version 4.5.0 (release notes are available at https://easybuild.readthedocs.io/en/latest/Release_notes.html)

easybuild-framework version 4.5.1 (release notes are available at https://easybuild.readthedocs.io/en/latest/Release_notes.html)

easybuild-framework version 4.5.2 (release notes are available at https://easybuild.readthedocs.io/en/latest/Release_notes.html)

easybuild-framework version 4.5.3 (release notes are available at https://easybuild.readthedocs.io/en/latest/Release_notes.html)

This is a much cheaper test than "import easybuild.main".

easybuild-framework version 4.5.4 (release notes are available at https://easybuild.readthedocs.io/en/latest/Release_notes.html)

…a-main

We treat gcccore as builddependency, because it doesn't expand MODULEPATH as upstream does.

easybuild-framework version 4.6.0 (release notes are available at https://easybuild.readthedocs.io/en/latest/Release_notes.html)

…a-main

easybuild-framework version 4.7.0 (release notes are available at https://easybuild.readthedocs.io/en/latest/Release_notes.html)

easybuild-framework version 4.7.2 (release notes are available at https://docs.easybuild.io/release-notes)

bartoldeman and others added 30 commits February 21, 2017 18:31

Add gomkl toolchain, combining Intel Compilers + MKL + Open MPI.

73d4252

Add support for gmkl toolchain (GCC + MKL, no MPI)

3078f9d

modified filetools to gunzip patches if they are gziped

0a4b789

gzip the patch back if it was gunzipped for patching

39ad948

keep the original gz file

7af7f57

fixed typo in --keep

0953bc6

Make sure self.FFT_LIB does not contain interface libs if they are no…

33a5648

…t present.

modified the extraction to use the built-in extract_file

67090fe

Set permissions of tempdir to 0755.

faab9e4

Change permissions of two temp files to 0644.

7aea180

use modaltsoftname instead of name for the install path

986c30d

simplified the previous commit

b4b03bc

Merge branch 'computecanada-master' of github.com:ComputeCanada/easyb…

196bbe3

…uild-framework into computecanada-master

HACK: disable sanity check for obtained module name if modaltsoftname…

ecb4c5c

… is not set.

Use Core directory for gcc-system toolchain.

b38e93a

Set COMPILER_FAMILY to GCCcore to avoid using the optarch from GCC.

b370e43

Replace sanity check hack (ecb4c5c) by a proper fix.

205491a

Make sure the gcc toolchain uses GCC as compiler family, not GCCcore.

b3e64bd

Use "Core" for GCCcore-generated modules.

b9ec927

Merge remote-tracking branch 'github_hpcugent/master' into computecan…

d53077e

…ada-master

Sync hierarchical_mns.py with upstream.

0e760d6

Re-add excluding dependencies of excluded deps.

ca288e3

We still get loads for icc and ifort for HPL.

merge develop_develop_gunzip_patches

0d799fe

Merge remote-tracking branch 'github_hpcugent/master' into computecan…

3b21d0c

…ada-master

Rever 9d6a73c. The framework does the correct thing now by itself.

0d989a8

added iimklc toolchain

fc11fd8

fixing iimklc

d5bd3ea

Added toolchain options to specify extra compiler arguments

ff0d9bf

Merge branch 'extra_compiler_flags' into computecanada-master

38b5194

cosmetic changes

73bd76f

bartoldeman and others added 27 commits July 28, 2021 01:54

Merge remote-tracking branch 'github_hpcugent/main' into computecanad…

3e9e226

…a-main

added back line that should have been kept

dab827b

Merge branch 'fix_bash_shebang_for' into computecanada-main

f099882

Merge branch 'fix_bash_shebang_for' into computecanada-main

590f856

Merge branch 'fix_bash_shebang_for' into computecanada-main

651ee1e

added an option no_download to obtain_file, and use it for checksums

73a3264

Merge remote-tracking branch 'github_hpcugent/main' into computecanad…

70243fd

…a-main

Allow self.BLACS_LIB to be None.

0012bb4

This is the case for toolchains with Open MPI / linalg but no BLACS.

Test for self.SCALAPACK_LIB to see need for BLACS/SCALAPACK vars.

7d00148

Fix the FlexiBLAS lib for Intel

2c99480

Import TC_CONSTANT_INTELCOMP

ebe1c83

Make sure correct include directory is used for FlexiBLAS

215b4f8

Only warn if ldd fails, don't cause exceptions.

2b230fd

ldd fails on debug ELF objects, where the "file" command gives exactly the same output as for shared libraries.

Merge tag 'easybuild-framework-v4.5.0' into computecanada-main

be97b65

easybuild-framework version 4.5.0 (release notes are available at https://easybuild.readthedocs.io/en/latest/Release_notes.html)

Merge tag 'easybuild-framework-v4.5.1' into computecanada-main

f7a37d2

easybuild-framework version 4.5.1 (release notes are available at https://easybuild.readthedocs.io/en/latest/Release_notes.html)

Merge tag 'easybuild-framework-v4.5.2' into computecanada-main

8895f6e

easybuild-framework version 4.5.2 (release notes are available at https://easybuild.readthedocs.io/en/latest/Release_notes.html)

Merge tag 'easybuild-framework-v4.5.3' into computecanada-main

7ef8e49

easybuild-framework version 4.5.3 (release notes are available at https://easybuild.readthedocs.io/en/latest/Release_notes.html)

Simply import easybuild to check if it's working.

cedab47

This is a much cheaper test than "import easybuild.main".

Merge tag 'easybuild-framework-v4.5.4' into computecanada-main

910b1ac

easybuild-framework version 4.5.4 (release notes are available at https://easybuild.readthedocs.io/en/latest/Release_notes.html)

Merge remote-tracking branch 'github_hpcugent/main' into computecanad…

42d51f5

…a-main

Prevent depends_on('gcccore/...') via toolchain deps.

721a39a

We treat gcccore as builddependency, because it doesn't expand MODULEPATH as upstream does.

Merge tag 'easybuild-framework-v4.6.0' into computecanada-main

a6dbb4b

easybuild-framework version 4.6.0 (release notes are available at https://easybuild.readthedocs.io/en/latest/Release_notes.html)

Merge remote-tracking branch 'github_hpcugent/main' into computecanad…

65a52a3

…a-main

Merge tag 'easybuild-framework-v4.7.0' into computecanada-main

906ea57

easybuild-framework version 4.7.0 (release notes are available at https://easybuild.readthedocs.io/en/latest/Release_notes.html)

Merge tag 'easybuild-framework-v4.7.2' into computecanada-main

0967379

easybuild-framework version 4.7.2 (release notes are available at https://docs.easybuild.io/release-notes)

hot fix for easybuilders#4281

59d2f54

add set_shell_function to module_generator

13850b2

mboisson requested a review from bartoldeman November 21, 2023 20:13

mboisson changed the base branch from develop to drop_duplicate_multideps_from_modules November 21, 2023 20:13

mboisson closed this Nov 21, 2023

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Eliminate duplicate multideps from modules #29

Eliminate duplicate multideps from modules #29

Uh oh!

mboisson commented Nov 21, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants

Eliminate duplicate multideps from modules #29

Eliminate duplicate multideps from modules #29

Uh oh!

Conversation

mboisson commented Nov 21, 2023

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

7 participants