1- # Installing extensions in parallel * (experimental!) * {: #installing_extensions_in_parallel }
1+ # Installing extensions in parallel {: #installing_extensions_in_parallel }
22
3- Since EasyBuild v4.5.0 (initial) support is available for installing
4- extensions in parallel, that is to run the installation command for
5- multiple extensions that are ready to install at the same time in the
6- background, to exploit the availability of multiple cores.
3+ Since EasyBuild v4.5.0 support is available for installing R libraries
4+ ( extensions in an easyconfig) in parallel, that is to run the installation
5+ command for multiple extensions that are ready to install at the same time
6+ in the background, to exploit the availability of multiple cores.
77
8- ** Note: this is an**
9- [ experimental feature] [ experimental_features ] . ** Some of the mentioned functionality may be subject to
10- change or be prone to errors.**
118
129## Configuration {: #installing_extensions_in_parallel_configuration }
1310
@@ -42,7 +39,7 @@ easyblock.
4239
4340## Caveats and Known issues {: #installing_extensions_in_parallel_caveats_known_issues }
4441
45- * (last update: EasyBuild v4.5 .0)*
42+ * (last update: EasyBuild v5.0 .0)*
4643
4744There are a couple of caveats and known issues with installing
4845extensions in parallel, which we hope to resolve in future EasyBuild
@@ -64,29 +61,6 @@ the corresponding easyblocks that are used to install those extensions
6461required dependencies and starting the installation command
6562asynchronously.
6663
67- ### List of extensions must be self-contained {: #installing_extensions_in_parallel_caveats_known_issues_exts_list }
68-
69- The EasyBuild framework currently enforces that all required
70- dependencies for a particular extension are included in the list of
71- extensions that is being installed (specified via the ` exts_list `
72- easyconfig parameter). Extensions provided by dependencies are not taken
73- into account (yet).
74-
75- As a result, trying to install an
76- [ R-bundle-Bioconductor] ( https://github.com/easybuilders/easybuild-easyconfigs/tree/main/easybuild/easyconfigs/r/R-bundle-Bioconductor )
77- easyconfig with ` parallel-extensions-install ` enabled will result in an
78- error reporting missing required dependencies.
79-
80- ### Skipping of installed extensions is still done sequentially {: #installing_extensions_in_parallel_caveats_known_issues_skip }
81-
82- Checking which extensions are already installed for which the
83- installation can be skipped when ` --skip ` (see
84- [ Installing additional extensions using ` -k ` /` -skip ` ] [ partial_installation_skip ] ) is being used
85- is still done sequentially.
86-
87- Additional work is needed to also run these checks in parallel across
88- the cores that are available to EasyBuild.
89-
9064### Sanity check for extensions is still run sequentially {: #installing_extensions_in_parallel_caveats_known_issues_sanity_check }
9165
9266The sanity checks that are done for each extension are still done
0 commit comments