-
Notifications
You must be signed in to change notification settings - Fork 29
Add options for max memory, n_jobs #219
Copy link
Copy link
Open
Labels
Description
One of the ideas of the option-based configuration of clustermq is that code should be portable between compute environments, e.g. when moving to a different HPC scheduler.
If moving from HPC to local parallelization (even on a heavy duty server), resources will be much more limiting.
For a multicore setup, it would be nice to provide options for setting limits on total concurrent jobs (defaulting to cores/available cores) and memory (defaulting to memory available on that machine)
This way HPC scripts would not need to be adjusted, but could run (at reduced capacity) on multicore environments
Reactions are currently unavailable