add OpenSSL/1.1 to NESSI/2023.04 #100

trz42 · 2023-04-23T12:21:04Z

This pull request mainly serves as a test to verify if and how OpenSSL/1.1 can be built. OpenSSL/1.1 is a dependency of CMake-3.20.1-GCCcore-10.3.0.eb (and potentially others).

We just add OpenSS-1.1.eb to the easystack file and submit a single job for each bot instance (Fram, AWS and eX3). We expect it to work on AWS and eX3, but not on Fram. Particularly, we expect it to fail in the sanity-check step when a connection to GitHub.com is tried. This should not work out of the box because on Fram, compute nodes are not directly connected to the internet.
We try to fix the issue by letting openssl use the argument -proxy when the environment variable https_proxy is defined. We adjust the easyblock EB_OpenSSL_wrapper (implemented in openssl_wrapper.py) for this and provide the necessary option in the easystack file. We submit jobs on all three bot instances as in (1).
If all works well, we open a PR for the updated easyblock and build OpenSSL using that.

nessi-bot · 2023-04-23T12:21:08Z

Instance eX3-NESSI is configured to build:

arch x86_64/amd/zen2 for repo nessi.no-2022.11
arch x86_64/amd/zen2 for repo nessi.no-2023.04
arch x86_64/amd/zen2 for repo eessi-2023.04
arch aarch64/generic for repo nessi.no-2022.11
arch aarch64/generic for repo nessi.no-2023.04
arch aarch64/generic for repo eessi-2023.04

nessi-bot · 2023-04-23T12:21:08Z

Instance AWS-NESSI is configured to build:

arch x86_64/generic for repo nessi.no-2022.11
arch x86_64/generic for repo nessi.no-2023.04
arch x86_64/generic for repo eessi-2023.04
arch x86_64/intel/skylake_avx512 for repo nessi.no-2022.11
arch x86_64/intel/skylake_avx512 for repo nessi.no-2023.04
arch x86_64/intel/skylake_avx512 for repo eessi-2023.04
arch x86_64/intel/cascadelake for repo nessi.no-2022.11
arch x86_64/intel/cascadelake for repo nessi.no-2023.04
arch x86_64/intel/cascadelake for repo eessi-2023.04
arch x86_64/amd/zen2 for repo nessi.no-2022.11
arch x86_64/amd/zen2 for repo nessi.no-2023.04
arch x86_64/amd/zen2 for repo eessi-2023.04
arch aarch64/generic for repo nessi.no-2022.11
arch aarch64/generic for repo nessi.no-2023.04
arch aarch64/generic for repo eessi-2023.04

nessi-bot · 2023-04-23T12:21:09Z

Instance Fram-NESSI is configured to build:

arch x86_64/generic for repo nessi.no-2022.11
arch x86_64/generic for repo nessi.no-2023.04
arch x86_64/generic for repo eessi-2023.04
arch x86_64/intel/broadwell for repo nessi.no-2022.11
arch x86_64/intel/broadwell for repo nessi.no-2023.04
arch x86_64/intel/broadwell for repo eessi-2023.04

trz42 · 2023-04-23T12:23:34Z

bot: build inst:Fram repo:nessi.no-2023.04 arch:x86_64/generic
bot: build inst:AWS repo:nessi.no-2023.04 arch:x86_64/generic
bot: build inst:eX3 repo:nessi.no-2023.04 arch:aarch64/generic

received bot command build inst:Fram repo:nessi.no-2023.04 arch:x86_64/generic from trz42 (expanded command format: build instance:Fram repository:nessi.no-2023.04 architecture:x86_64/generic)
received bot command build inst:AWS repo:nessi.no-2023.04 arch:x86_64/generic from trz42 (expanded command format: build instance:AWS repository:nessi.no-2023.04 architecture:x86_64/generic)
received bot command build inst:eX3 repo:nessi.no-2023.04 arch:aarch64/generic from trz42 (expanded command format: build instance:eX3 repository:nessi.no-2023.04 architecture:aarch64/generic)

nessi-bot · 2023-04-23T12:23:41Z

New job on instance eX3-NESSI for architecture aarch64-generic for repository nessi.no-2023.04 in job dir /home/thomarob/pilot.nessi.no/PR155/jobs/2023.04/pr_100/470307

date	job status	comment
Apr 23 12:23:22 UTC 2023	submitted	job id `470307` awaits release by job manager
Apr 23 12:26:02 UTC 2023	released	job awaits launch by Slurm scheduler
Apr 23 12:31:04 UTC 2023	running	job `470307` is running
Apr 23 12:36:05 UTC 2023	finished	😁 SUCCESS (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-470307.out` :heavy_check_mark: no message matching `ERROR:` :heavy_check_mark: no message matching `FAILED:` :heavy_check_mark: no message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-aarch64-generic-1682253233.tar.gz`

nessi-bot · 2023-04-23T12:23:42Z

New job on instance Fram-NESSI for architecture x86_64-generic for repository nessi.no-2023.04 in job dir /cluster/projects/nn9992k/pilot.nessi.no/PR155/jobs/2023.04/pr_100/5061796

date	job status	comment
Apr 23 12:23:41 UTC 2023	submitted	job id `5061796` awaits release by job manager
Apr 23 12:26:05 UTC 2023	released	job awaits launch by Slurm scheduler
Apr 23 12:31:07 UTC 2023	running	job `5061796` is running
Apr 23 12:36:08 UTC 2023	finished	😢 FAILURE (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-5061796.out` :heavy_multiplication_x: found message matching `ERROR:` :heavy_multiplication_x: found message matching `FAILED:` :heavy_multiplication_x: found message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-x86_64-generic-1682253194.tar.gz`

nessi-bot · 2023-04-23T12:23:43Z

New job on instance AWS-NESSI for architecture x86_64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/nessibot/pilot.nessi.no/PR155/jobs/2023.04/pr_100/4638

date	job status	comment
Apr 23 12:23:42 PM UTC 2023	submitted	job id `4638` awaits release by job manager
Apr 23 12:25:27 PM UTC 2023	released	job awaits launch by Slurm scheduler
Apr 23 12:29:29 PM UTC 2023	running	job `4638` is running
Apr 23 12:39:35 PM UTC 2023	finished	😁 SUCCESS (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-4638.out` :heavy_check_mark: no message matching `ERROR:` :heavy_check_mark: no message matching `FAILED:` :heavy_check_mark: no message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-x86_64-generic-1682253520.tar.gz`

trz42 · 2023-04-23T12:57:13Z

bot: build inst:Fram repo:nessi.no-2023.04 arch:x86_64/generic
bot: build inst:AWS repo:nessi.no-2023.04 arch:x86_64/generic
bot: build inst:eX3 repo:nessi.no-2023.04 arch:aarch64/generic

received bot command build inst:Fram repo:nessi.no-2023.04 arch:x86_64/generic from trz42 (expanded command format: build instance:Fram repository:nessi.no-2023.04 architecture:x86_64/generic)
received bot command build inst:AWS repo:nessi.no-2023.04 arch:x86_64/generic from trz42 (expanded command format: build instance:AWS repository:nessi.no-2023.04 architecture:x86_64/generic)
received bot command build inst:eX3 repo:nessi.no-2023.04 arch:aarch64/generic from trz42 (expanded command format: build instance:eX3 repository:nessi.no-2023.04 architecture:aarch64/generic)

nessi-bot · 2023-04-23T12:57:20Z

New job on instance Fram-NESSI for architecture x86_64-generic for repository nessi.no-2023.04 in job dir /cluster/projects/nn9992k/pilot.nessi.no/PR155/jobs/2023.04/pr_100/5061821

date	job status	comment
Apr 23 12:57:19 UTC 2023	submitted	job id `5061821` awaits release by job manager
Apr 23 13:01:12 UTC 2023	released	job awaits launch by Slurm scheduler
Apr 23 13:06:15 UTC 2023	running	job `5061821` is running
Apr 23 13:11:16 UTC 2023	finished	😢 FAILURE (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-5061821.out` :heavy_multiplication_x: found message matching `ERROR:` :heavy_multiplication_x: found message matching `FAILED:` :heavy_multiplication_x: found message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-x86_64-generic-1682255173.tar.gz`

nessi-bot · 2023-04-23T12:57:20Z

New job on instance eX3-NESSI for architecture aarch64-generic for repository nessi.no-2023.04 in job dir /home/thomarob/pilot.nessi.no/PR155/jobs/2023.04/pr_100/470308

date	job status	comment
Apr 23 12:57:01 UTC 2023	submitted	job id `470308` awaits release by job manager
Apr 23 13:01:08 UTC 2023	released	job awaits launch by Slurm scheduler
Apr 23 13:06:10 UTC 2023	running	job `470308` is running
Apr 23 13:11:11 UTC 2023	finished	😢 FAILURE (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-470308.out` :heavy_multiplication_x: found message matching `ERROR:` :heavy_multiplication_x: found message matching `FAILED:` :heavy_multiplication_x: found message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-aarch64-generic-1682255317.tar.gz`

nessi-bot · 2023-04-23T12:57:22Z

New job on instance AWS-NESSI for architecture x86_64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/nessibot/pilot.nessi.no/PR155/jobs/2023.04/pr_100/4639

date	job status	comment
Apr 23 12:57:21 PM UTC 2023	submitted	job id `4639` awaits release by job manager
Apr 23 12:57:39 PM UTC 2023	released	job awaits launch by Slurm scheduler
Apr 23 01:01:42 PM UTC 2023	running	job `4639` is running
Apr 23 01:09:47 PM UTC 2023	finished	😢 FAILURE (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-4639.out` :heavy_multiplication_x: found message matching `ERROR:` :heavy_multiplication_x: found message matching `FAILED:` :heavy_multiplication_x: found message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-x86_64-generic-1682255359.tar.gz`

trz42 · 2023-04-23T13:34:09Z

bot: build inst:Fram repo:nessi.no-2023.04 arch:x86_64/generic
bot: build inst:AWS repo:nessi.no-2023.04 arch:x86_64/generic
bot: build inst:eX3 repo:nessi.no-2023.04 arch:aarch64/generic

received bot command build inst:Fram repo:nessi.no-2023.04 arch:x86_64/generic from trz42 (expanded command format: build instance:Fram repository:nessi.no-2023.04 architecture:x86_64/generic)
received bot command build inst:AWS repo:nessi.no-2023.04 arch:x86_64/generic from trz42 (expanded command format: build instance:AWS repository:nessi.no-2023.04 architecture:x86_64/generic)
received bot command build inst:eX3 repo:nessi.no-2023.04 arch:aarch64/generic from trz42 (expanded command format: build instance:eX3 repository:nessi.no-2023.04 architecture:aarch64/generic)

nessi-bot · 2023-04-23T13:34:15Z

New job on instance eX3-NESSI for architecture aarch64-generic for repository nessi.no-2023.04 in job dir /home/thomarob/pilot.nessi.no/PR155/jobs/2023.04/pr_100/470310

date	job status	comment
Apr 23 13:33:56 UTC 2023	submitted	job id `470310` awaits release by job manager
Apr 23 13:36:15 UTC 2023	released	job awaits launch by Slurm scheduler
Apr 23 13:41:17 UTC 2023	running	job `470310` is running
Apr 23 13:46:18 UTC 2023	finished	😁 SUCCESS (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-470310.out` :heavy_check_mark: no message matching `ERROR:` :heavy_check_mark: no message matching `FAILED:` :heavy_check_mark: no message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-aarch64-generic-1682257435.tar.gz`

nessi-bot · 2023-04-23T13:34:16Z

New job on instance Fram-NESSI for architecture x86_64-generic for repository nessi.no-2023.04 in job dir /cluster/projects/nn9992k/pilot.nessi.no/PR155/jobs/2023.04/pr_100/5061848

date	job status	comment
Apr 23 13:34:15 UTC 2023	submitted	job id `5061848` awaits release by job manager
Apr 23 13:36:20 UTC 2023	released	job awaits launch by Slurm scheduler
Apr 23 13:41:21 UTC 2023	finished	😁 SUCCESS (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-5061848.out` :heavy_check_mark: no message matching `ERROR:` :heavy_check_mark: no message matching `FAILED:` :heavy_check_mark: no message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-x86_64-generic-1682257259.tar.gz`

nessi-bot · 2023-04-23T13:34:18Z

New job on instance AWS-NESSI for architecture x86_64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/nessibot/pilot.nessi.no/PR155/jobs/2023.04/pr_100/4640

date	job status	comment
Apr 23 01:34:17 PM UTC 2023	submitted	job id `4640` awaits release by job manager
Apr 23 01:35:53 PM UTC 2023	released	job awaits launch by Slurm scheduler
Apr 23 01:39:55 PM UTC 2023	running	job `4640` is running
Apr 23 01:50:01 PM UTC 2023	finished	😁 SUCCESS (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-4640.out` :heavy_check_mark: no message matching `ERROR:` :heavy_check_mark: no message matching `FAILED:` :heavy_check_mark: no message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-x86_64-generic-1682257672.tar.gz`

trz42 · 2023-04-23T14:32:01Z

bot: build repo:nessi.no-2023.04

received bot command build repo:nessi.no-2023.04 from trz42 (expanded command format: build repository:nessi.no-2023.04)

nessi-bot · 2023-04-23T14:32:08Z

New job on instance eX3-NESSI for architecture x86_64-amd-zen2 for repository nessi.no-2023.04 in job dir /home/thomarob/pilot.nessi.no/PR155/jobs/2023.04/pr_100/470311

date	job status	comment
Apr 23 14:31:49 UTC 2023	submitted	job id `470311` awaits release by job manager
Apr 23 14:36:28 UTC 2023	released	job awaits launch by Slurm scheduler
Apr 23 14:41:32 UTC 2023	finished	😁 SUCCESS (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-470311.out` :heavy_check_mark: no message matching `ERROR:` :heavy_check_mark: no message matching `FAILED:` :heavy_check_mark: no message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-x86_64-amd-zen2-1682260856.tar.gz`
Apr 23 15:54:52 UTC 2023	uploaded	transfer of `eessi-2023.04-software-linux-x86_64-amd-zen2-1682260856.tar.gz` to S3 bucket succeeded
Apr 23 04:20:24 PM UTC 2023	staged	tarball `eessi-2023.04-software-linux-x86_64-amd-zen2-1682260856.tar.gz` downloaded to S0, merge PR https://github.com/NorESSI/staging/pull/295 for approval
Apr 23 06:43:19 PM UTC 2023	approved	👍 tarball `eessi-2023.04-software-linux-x86_64-amd-zen2-1682260856.tar.gz` approved, see PR https://github.com/NorESSI/staging/pull/295
Apr 23 06:43:53 PM UTC 2023	ingested	🎉 tarball `eessi-2023.04-software-linux-x86_64-amd-zen2-1682260856.tar.gz` successfully ingested at `2023.04/software/linux/x86_64/amd/zen2/`

nessi-bot · 2023-04-23T14:32:10Z

New job on instance eX3-NESSI for architecture aarch64-generic for repository nessi.no-2023.04 in job dir /home/thomarob/pilot.nessi.no/PR155/jobs/2023.04/pr_100/470312

date	job status	comment
Apr 23 14:31:51 UTC 2023	submitted	job id `470312` awaits release by job manager
Apr 23 14:36:30 UTC 2023	running	job `470312` is running
Apr 23 14:46:34 UTC 2023	finished	😁 SUCCESS (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-470312.out` :heavy_check_mark: no message matching `ERROR:` :heavy_check_mark: no message matching `FAILED:` :heavy_check_mark: no message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-aarch64-generic-1682261047.tar.gz`
Apr 23 15:54:04 UTC 2023	uploaded	transfer of `eessi-2023.04-software-linux-aarch64-generic-1682261047.tar.gz` to S3 bucket succeeded
Apr 23 04:19:38 PM UTC 2023	staged	tarball `eessi-2023.04-software-linux-aarch64-generic-1682261047.tar.gz` downloaded to S0, merge PR https://github.com/NorESSI/staging/pull/293 for approval
Apr 23 06:41:52 PM UTC 2023	approved	👍 tarball `eessi-2023.04-software-linux-aarch64-generic-1682261047.tar.gz` approved, see PR https://github.com/NorESSI/staging/pull/293
Apr 23 06:42:35 PM UTC 2023	ingested	🎉 tarball `eessi-2023.04-software-linux-aarch64-generic-1682261047.tar.gz` successfully ingested at `2023.04/software/linux/aarch64/generic/`

nessi-bot · 2023-04-23T14:32:11Z

New job on instance Fram-NESSI for architecture x86_64-generic for repository nessi.no-2023.04 in job dir /cluster/projects/nn9992k/pilot.nessi.no/PR155/jobs/2023.04/pr_100/5061917

date	job status	comment
Apr 23 14:32:10 UTC 2023	submitted	job id `5061917` awaits release by job manager
Apr 23 14:36:28 UTC 2023	released	job awaits launch by Slurm scheduler
Apr 23 14:41:31 UTC 2023	finished	😁 SUCCESS (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-5061917.out` :heavy_check_mark: no message matching `ERROR:` :heavy_check_mark: no message matching `FAILED:` :heavy_check_mark: no message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-x86_64-generic-1682260871.tar.gz`
Apr 23 15:51:02 UTC 2023	uploaded	transfer of `eessi-2023.04-software-linux-x86_64-generic-1682260871.tar.gz` to S3 bucket succeeded
Apr 23 04:28:20 PM UTC 2023	staged	tarball `eessi-2023.04-software-linux-x86_64-generic-1682260871.tar.gz` downloaded to S0, merge PR https://github.com/NorESSI/staging/pull/297 for approval
Apr 23 06:44:52 PM UTC 2023	rejected	👎 tarball `eessi-2023.04-software-linux-x86_64-generic-1682260871.tar.gz` rejected, see PR https://github.com/NorESSI/staging/pull/297

nessi-bot · 2023-04-23T14:32:13Z

New job on instance Fram-NESSI for architecture x86_64-intel-broadwell for repository nessi.no-2023.04 in job dir /cluster/projects/nn9992k/pilot.nessi.no/PR155/jobs/2023.04/pr_100/5061918

date	job status	comment
Apr 23 14:32:12 UTC 2023	submitted	job id `5061918` awaits release by job manager
Apr 23 14:36:26 UTC 2023	released	job awaits launch by Slurm scheduler
Apr 23 14:41:29 UTC 2023	finished	😁 SUCCESS (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-5061918.out` :heavy_check_mark: no message matching `ERROR:` :heavy_check_mark: no message matching `FAILED:` :heavy_check_mark: no message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-x86_64-intel-broadwell-1682260876.tar.gz`
Apr 23 15:51:22 UTC 2023	uploaded	transfer of `eessi-2023.04-software-linux-x86_64-intel-broadwell-1682260876.tar.gz` to S3 bucket succeeded
Apr 23 04:29:05 PM UTC 2023	staged	tarball `eessi-2023.04-software-linux-x86_64-intel-broadwell-1682260876.tar.gz` downloaded to S0, merge PR https://github.com/NorESSI/staging/pull/299 for approval
Apr 23 06:46:20 PM UTC 2023	approved	👍 tarball `eessi-2023.04-software-linux-x86_64-intel-broadwell-1682260876.tar.gz` approved, see PR https://github.com/NorESSI/staging/pull/299
Apr 23 06:47:05 PM UTC 2023	ingested	🎉 tarball `eessi-2023.04-software-linux-x86_64-intel-broadwell-1682260876.tar.gz` successfully ingested at `2023.04/software/linux/x86_64/intel/broadwell/`

nessi-bot · 2023-04-23T14:32:22Z

New job on instance AWS-NESSI for architecture x86_64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/nessibot/pilot.nessi.no/PR155/jobs/2023.04/pr_100/4641

date	job status	comment
Apr 23 02:32:21 PM UTC 2023	submitted	job id `4641` awaits release by job manager
Apr 23 02:34:21 PM UTC 2023	released	job awaits launch by Slurm scheduler
Apr 23 02:38:31 PM UTC 2023	running	job `4641` is running
Apr 23 02:46:54 PM UTC 2023	finished	😁 SUCCESS (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-4641.out` :heavy_check_mark: no message matching `ERROR:` :heavy_check_mark: no message matching `FAILED:` :heavy_check_mark: no message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-x86_64-generic-1682261141.tar.gz`
Apr 23 03:51:03 PM UTC 2023	uploaded	transfer of `eessi-2023.04-software-linux-x86_64-generic-1682261141.tar.gz` to S3 bucket succeeded
Apr 23 04:28:42 PM UTC 2023	staged	tarball `eessi-2023.04-software-linux-x86_64-generic-1682261141.tar.gz` downloaded to S0, merge PR https://github.com/NorESSI/staging/pull/298 for approval
Apr 23 06:45:06 PM UTC 2023	approved	👍 tarball `eessi-2023.04-software-linux-x86_64-generic-1682261141.tar.gz` approved, see PR https://github.com/NorESSI/staging/pull/298
Apr 23 06:46:04 PM UTC 2023	ingested	🎉 tarball `eessi-2023.04-software-linux-x86_64-generic-1682261141.tar.gz` successfully ingested at `2023.04/software/linux/x86_64/generic/`

nessi-bot · 2023-04-23T14:32:24Z

New job on instance AWS-NESSI for architecture x86_64-intel-skylake_avx512 for repository nessi.no-2023.04 in job dir /mnt/shared/home/nessibot/pilot.nessi.no/PR155/jobs/2023.04/pr_100/4642

date	job status	comment
Apr 23 02:32:23 PM UTC 2023	submitted	job id `4642` awaits release by job manager
Apr 23 02:34:18 PM UTC 2023	released	job awaits launch by Slurm scheduler
Apr 23 02:38:29 PM UTC 2023	running	job `4642` is running
Apr 23 02:46:52 PM UTC 2023	finished	😁 SUCCESS (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-4642.out` :heavy_check_mark: no message matching `ERROR:` :heavy_check_mark: no message matching `FAILED:` :heavy_check_mark: no message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-x86_64-intel-skylake_avx512-1682261087.tar.gz`
Apr 23 03:50:43 PM UTC 2023	uploaded	transfer of `eessi-2023.04-software-linux-x86_64-intel-skylake_avx512-1682261087.tar.gz` to S3 bucket succeeded
Apr 23 04:29:51 PM UTC 2023	staged	tarball `eessi-2023.04-software-linux-x86_64-intel-skylake_avx512-1682261087.tar.gz` downloaded to S0, merge PR https://github.com/NorESSI/staging/pull/301 for approval
Apr 23 06:48:43 PM UTC 2023	approved	👍 tarball `eessi-2023.04-software-linux-x86_64-intel-skylake_avx512-1682261087.tar.gz` approved, see PR https://github.com/NorESSI/staging/pull/301
Apr 23 06:49:19 PM UTC 2023	ingested	🎉 tarball `eessi-2023.04-software-linux-x86_64-intel-skylake_avx512-1682261087.tar.gz` successfully ingested at `2023.04/software/linux/x86_64/intel/skylake_avx512/`

nessi-bot · 2023-04-23T14:32:26Z

New job on instance AWS-NESSI for architecture x86_64-intel-cascadelake for repository nessi.no-2023.04 in job dir /mnt/shared/home/nessibot/pilot.nessi.no/PR155/jobs/2023.04/pr_100/4643

date	job status	comment
Apr 23 02:32:25 PM UTC 2023	submitted	job id `4643` awaits release by job manager
Apr 23 02:34:15 PM UTC 2023	released	job awaits launch by Slurm scheduler
Apr 23 02:38:27 PM UTC 2023	running	job `4643` is running
Apr 23 02:44:47 PM UTC 2023	finished	😁 SUCCESS (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-4643.out` :heavy_check_mark: no message matching `ERROR:` :heavy_check_mark: no message matching `FAILED:` :heavy_check_mark: no message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-x86_64-intel-cascadelake-1682261068.tar.gz`
Apr 23 03:51:13 PM UTC 2023	uploaded	transfer of `eessi-2023.04-software-linux-x86_64-intel-cascadelake-1682261068.tar.gz` to S3 bucket succeeded
Apr 23 04:29:27 PM UTC 2023	staged	tarball `eessi-2023.04-software-linux-x86_64-intel-cascadelake-1682261068.tar.gz` downloaded to S0, merge PR https://github.com/NorESSI/staging/pull/300 for approval
Apr 23 06:47:21 PM UTC 2023	approved	👍 tarball `eessi-2023.04-software-linux-x86_64-intel-cascadelake-1682261068.tar.gz` approved, see PR https://github.com/NorESSI/staging/pull/300
Apr 23 06:48:28 PM UTC 2023	ingested	🎉 tarball `eessi-2023.04-software-linux-x86_64-intel-cascadelake-1682261068.tar.gz` successfully ingested at `2023.04/software/linux/x86_64/intel/cascadelake/`

nessi-bot · 2023-04-23T14:32:27Z

New job on instance AWS-NESSI for architecture x86_64-amd-zen2 for repository nessi.no-2023.04 in job dir /mnt/shared/home/nessibot/pilot.nessi.no/PR155/jobs/2023.04/pr_100/4644

date	job status	comment
Apr 23 02:32:27 PM UTC 2023	submitted	job id `4644` awaits release by job manager
Apr 23 02:34:12 PM UTC 2023	released	job awaits launch by Slurm scheduler
Apr 23 02:38:25 PM UTC 2023	running	job `4644` is running
Apr 23 02:46:50 PM UTC 2023	finished	😁 SUCCESS (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-4644.out` :heavy_check_mark: no message matching `ERROR:` :heavy_check_mark: no message matching `FAILED:` :heavy_check_mark: no message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-x86_64-amd-zen2-1682261129.tar.gz`
Apr 23 03:50:53 PM UTC 2023	uploaded	transfer of `eessi-2023.04-software-linux-x86_64-amd-zen2-1682261129.tar.gz` to S3 bucket succeeded
Apr 23 04:20:45 PM UTC 2023	staged	tarball `eessi-2023.04-software-linux-x86_64-amd-zen2-1682261129.tar.gz` downloaded to S0, merge PR https://github.com/NorESSI/staging/pull/296 for approval
Apr 23 06:44:22 PM UTC 2023	rejected	👎 tarball `eessi-2023.04-software-linux-x86_64-amd-zen2-1682261129.tar.gz` rejected, see PR https://github.com/NorESSI/staging/pull/296

nessi-bot · 2023-04-23T14:32:29Z

New job on instance AWS-NESSI for architecture aarch64-generic for repository nessi.no-2023.04 in job dir /mnt/shared/home/nessibot/pilot.nessi.no/PR155/jobs/2023.04/pr_100/4645

date	job status	comment
Apr 23 02:32:28 PM UTC 2023	submitted	job id `4645` awaits release by job manager
Apr 23 02:34:10 PM UTC 2023	released	job awaits launch by Slurm scheduler
Apr 23 02:38:23 PM UTC 2023	running	job `4645` is running
Apr 23 02:48:56 PM UTC 2023	finished	😁 SUCCESS (click triangle for detailed information) Details: :heavy_check_mark: job output file `slurm-4645.out` :heavy_check_mark: no message matching `ERROR:` :heavy_check_mark: no message matching `FAILED:` :heavy_check_mark: no message matching `required modules missing:` :heavy_check_mark: found message(s) matching `No missing modules!` :heavy_check_mark: found message matching `tar.gz created!` Artefacts: `eessi-2023.04-software-linux-aarch64-generic-1682261232.tar.gz`
Apr 23 03:51:23 PM UTC 2023	uploaded	transfer of `eessi-2023.04-software-linux-aarch64-generic-1682261232.tar.gz` to S3 bucket succeeded
Apr 23 04:19:59 PM UTC 2023	staged	tarball `eessi-2023.04-software-linux-aarch64-generic-1682261232.tar.gz` downloaded to S0, merge PR https://github.com/NorESSI/staging/pull/294 for approval
Apr 23 06:43:03 PM UTC 2023	rejected	👎 tarball `eessi-2023.04-software-linux-aarch64-generic-1682261232.tar.gz` rejected, see PR https://github.com/NorESSI/staging/pull/294

trz42 · 2023-04-23T15:43:07Z

Checklist for building:

did the builds for all required architectures succeed (SUCCESS message + reasonably sized tarball)
is the PR up-to-date with the target branch nessi.no-2023.04-dev in the repository (if not what are the differences)
- PR#2922 may not be final, but the change needed for building OpenSSL/1.1 here will be kept in place one way or the other
- the temporarily used custom OpenSSL_wrapper easyblock has been moved to to that PR (it's not part of this PR here any longer)
are all requested changes sound (checking files changed on GitHub.com)
is/are the easyconfig/s being built included with the EB version used (if not why not)
- only the easyblock is not yet part (because a PR needed to be used)
were any changes needed to get the build(s) succeed (common changes for all architectures, changes for a single architecture, changes because of build environment specifics, etc.)
- yes, see PR#2922

trz42 · 2023-04-23T16:12:07Z

Checklist for deployment/ingestion

at least one tarball for each architecture has been uploaded
- x86_64-intel-broadwell
- x86_64-intel-skylake_avx512
- x86_64-intel-cascadelake
- x86_64-amd-zen2
- x86_64-generic
- aarch64-generic
at least one tarball for each architecture has been staged
- x86_64-intel-broadwell
- x86_64-intel-skylake_avx512
- x86_64-intel-cascadelake
- x86_64-amd-zen2
- x86_64-generic
- aarch64-generic
for each architecture one and only one tarball has been approved
- x86_64-intel-broadwell
- x86_64-intel-skylake_avx512
- x86_64-intel-cascadelake
- x86_64-amd-zen2
- x86_64-generic
- aarch64-generic
for each architecture one and only one tarball was ingested
- x86_64-intel-broadwell
- x86_64-intel-skylake_avx512
- x86_64-intel-cascadelake
- x86_64-amd-zen2
- x86_64-generic
- aarch64-generic

has the package become available via CernVM-FS for all architectures ingested (for lmod cache updates pay attention to timestamp of files)
command

ls -l /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/{generic,amd/zen2,intel/[bsc]*}/{software,modules/all}/OpenSSL/*
ls -l /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/aarch64/generic/{software,modules/all}/OpenSSL/*

log

-rw-r--r-- 1 cvmfs cvmfs 1497 Apr 23 14:40 /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/amd/zen2/modules/all/OpenSSL/1.1.lua
-rw-r--r-- 1 cvmfs cvmfs 1496 Apr 23 14:45 /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/generic/modules/all/OpenSSL/1.1.lua
-rw-rw-r-- 1 cvmfs cvmfs 1504 Apr 23 14:40 /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/broadwell/modules/all/OpenSSL/1.1.lua
-rw-r--r-- 1 cvmfs cvmfs 1506 Apr 23 14:44 /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/modules/all/OpenSSL/1.1.lua
-rw-r--r-- 1 cvmfs cvmfs 1509 Apr 23 14:44 /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/skylake_avx512/modules/all/OpenSSL/1.1.lua

/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/amd/zen2/software/OpenSSL/1.1:
total 28
drwxr-xr-x 2 cvmfs cvmfs 4096 Apr 23 14:39 bin
drwxr-xr-x 3 cvmfs cvmfs 4096 Apr 23 14:40 easybuild
drwxr-xr-x 3 cvmfs cvmfs 4096 Apr 23 14:39 include
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:39 lib
lrwxrwxrwx 1 cvmfs cvmfs    3 Apr 23 14:40 lib64 -> lib
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:39 share
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:40 ssl

/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/generic/software/OpenSSL/1.1:
total 28
drwxr-xr-x 2 cvmfs cvmfs 4096 Apr 23 14:43 bin
drwxr-xr-x 3 cvmfs cvmfs 4096 Apr 23 14:45 easybuild
drwxr-xr-x 3 cvmfs cvmfs 4096 Apr 23 14:43 include
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:43 lib
lrwxrwxrwx 1 cvmfs cvmfs    3 Apr 23 14:45 lib64 -> lib
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:44 share
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:45 ssl

/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/broadwell/software/OpenSSL/1.1:
total 28
drwxr-xr-x 2 cvmfs cvmfs 4096 Apr 23 14:39 bin
drwxr-xr-x 3 cvmfs cvmfs 4096 Apr 23 14:41 easybuild
drwxr-xr-x 3 cvmfs cvmfs 4096 Apr 23 14:39 include
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:39 lib
lrwxrwxrwx 1 cvmfs cvmfs    3 Apr 23 14:40 lib64 -> lib
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:40 share
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:40 ssl

/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/cascadelake/software/OpenSSL/1.1:
total 28
drwxr-xr-x 2 cvmfs cvmfs 4096 Apr 23 14:43 bin
drwxr-xr-x 3 cvmfs cvmfs 4096 Apr 23 14:44 easybuild
drwxr-xr-x 3 cvmfs cvmfs 4096 Apr 23 14:43 include
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:43 lib
lrwxrwxrwx 1 cvmfs cvmfs    3 Apr 23 14:44 lib64 -> lib
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:43 share
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:44 ssl

/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/x86_64/intel/skylake_avx512/software/OpenSSL/1.1:
total 28
drwxr-xr-x 2 cvmfs cvmfs 4096 Apr 23 14:43 bin
drwxr-xr-x 3 cvmfs cvmfs 4096 Apr 23 14:44 easybuild
drwxr-xr-x 3 cvmfs cvmfs 4096 Apr 23 14:43 include
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:43 lib
lrwxrwxrwx 1 cvmfs cvmfs    3 Apr 23 14:44 lib64 -> lib
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:43 share
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:44 ssl

-rw-r--r-- 1 cvmfs cvmfs 1497 Apr 23 14:43 /cvmfs/pilot.nessi.no/versions/2023.04/software/linux/aarch64/generic/modules/all/OpenSSL/1.1.lua

/cvmfs/pilot.nessi.no/versions/2023.04/software/linux/aarch64/generic/software/OpenSSL/1.1:
total 28
drwxr-xr-x 2 cvmfs cvmfs 4096 Apr 23 14:40 bin
drwxr-xr-x 3 cvmfs cvmfs 4096 Apr 23 14:43 easybuild
drwxr-xr-x 3 cvmfs cvmfs 4096 Apr 23 14:40 include
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:40 lib
lrwxrwxrwx 1 cvmfs cvmfs    3 Apr 23 14:43 lib64 -> lib
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:42 share
drwxr-xr-x 4 cvmfs cvmfs 4096 Apr 23 14:43 ssl

poksumdo

All looking good.

add OpenSSL-1.1 to NESSI/2023.04

5b57ff7

add enhanced easyblock and use it via options in easystack file

4a49ed7

fix string formatting error

fe78426

trz42 mentioned this pull request Apr 23, 2023

use proxy in sanity check of custom easyblock to install OpenSSL wrapper easybuilders/easybuild-easyblocks#2922

Merged

removed openssl_wrapper.py + using easyblock PR 2922 instead

9fb6a4c

trz42 added the bot:deploy label Apr 23, 2023

trz42 added the NESSI/2023.04 label Apr 23, 2023

poksumdo added the ingested label Apr 23, 2023

poksumdo approved these changes Apr 23, 2023

View reviewed changes

poksumdo merged commit f4e6b1d into NorESSI:nessi.no-2023.04-dev Apr 23, 2023

add OpenSSL/1.1 to NESSI/2023.04 #100

add OpenSSL/1.1 to NESSI/2023.04 #100

Uh oh!

Conversation

trz42 commented Apr 23, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023

Uh oh!

nessi-bot bot commented Apr 23, 2023

Uh oh!

nessi-bot bot commented Apr 23, 2023

Uh oh!

trz42 commented Apr 23, 2023 • edited by nessi-bot bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

trz42 commented Apr 23, 2023 • edited by nessi-bot bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

trz42 commented Apr 23, 2023 • edited by nessi-bot bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

trz42 commented Apr 23, 2023 • edited by nessi-bot bot Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited by trz42 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited by trz42 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited by trz42 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited by trz42 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited by trz42 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited by trz42 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited by trz42 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited by trz42 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

nessi-bot bot commented Apr 23, 2023 • edited by trz42 Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

trz42 commented Apr 23, 2023 • edited Loading Uh oh! There was an error while loading. Please reload this page.

trz42 commented Apr 23, 2023 •

edited

Loading

trz42 commented Apr 23, 2023 •

edited by nessi-bot bot

Loading

nessi-bot bot commented Apr 23, 2023 •

edited

Loading

nessi-bot bot commented Apr 23, 2023 •

edited

Loading

nessi-bot bot commented Apr 23, 2023 •

edited

Loading

trz42 commented Apr 23, 2023 •

edited by nessi-bot bot

Loading

nessi-bot bot commented Apr 23, 2023 •

edited

Loading

nessi-bot bot commented Apr 23, 2023 •

edited

Loading

nessi-bot bot commented Apr 23, 2023 •

edited

Loading

trz42 commented Apr 23, 2023 •

edited by nessi-bot bot

Loading

nessi-bot bot commented Apr 23, 2023 •

edited

Loading

nessi-bot bot commented Apr 23, 2023 •

edited

Loading

nessi-bot bot commented Apr 23, 2023 •

edited

Loading

trz42 commented Apr 23, 2023 •

edited by nessi-bot bot

Loading

nessi-bot bot commented Apr 23, 2023 •

edited by trz42

Loading

nessi-bot bot commented Apr 23, 2023 •

edited by trz42

Loading

nessi-bot bot commented Apr 23, 2023 •

edited by trz42

Loading

nessi-bot bot commented Apr 23, 2023 •

edited by trz42

Loading

nessi-bot bot commented Apr 23, 2023 •

edited by trz42

Loading

nessi-bot bot commented Apr 23, 2023 •

edited by trz42

Loading

nessi-bot bot commented Apr 23, 2023 •

edited by trz42

Loading

nessi-bot bot commented Apr 23, 2023 •

edited by trz42

Loading

nessi-bot bot commented Apr 23, 2023 •

edited by trz42

Loading

trz42 commented Apr 23, 2023 •

edited

Loading

trz42 commented Apr 23, 2023 •

edited

Loading