hpc parameter+

[mb010]

I aim to write code that can generalise to other slurm facilities within ~30min of someone cloning the code.
With a few minor changes / improvements / bug fixes the primary change is the known_hpc.cfg file which contains all global variables previously in processMeerKAT.py and a few parameters to help build system specific sbatch files. This should allow users to add the limits of their hpc facility and have their submissions checked against those values, instead of the ilifu limits (node, mem, cores etc.).

[AlecThomson]

+1 to this change! I've just opened a PR on the PR with some minor fixes I found.

One outlying issue here is that now the help screen is pretty bare, e.g.

> processMeerKAT.py -h
usage: /home/tho822/repos/idia-pipeline/processMeerKAT/processMeerKAT.py
       [-h] [--hpc name]

Process MeerKAT data via CASA MeasurementSet. Version: 1.1

optional arguments:
  -h, --help  show this help message and exit
  --hpc name  Name of hpc facility being used. If not known to
              processMeerKAT/known_hpc.cfg slurm limits are functionally
              removed [default: ilifu].

I think the new arg parsing messes with the help output.

A similar issue was talked about here, but I'm not sure if that solution would really help here.

[AlecThomson]

Ping @mb010 @Jordatious @Kitchi,

I've got a big fix for this PR in mb010#2. It'd be great if this could be reviewed an merged, if approved.

[mb010]

Any chance this can be merged? I don't know who owns / holds responsibility for this repo, but if its functionally dead, this feature has been tested and will help others to use it in the future. :)

Thanks!