Use EESSI module in EESSI-install-software.sh #790

casparvl · 2024-10-16T08:50:27Z

No description provided.

… set the environment

…xtend module

eessi-bot · 2024-10-16T08:50:30Z

Instance eessi-bot-mc-aws is configured to build for:

architectures: x86_64/generic, x86_64/intel/haswell, x86_64/intel/skylake_avx512, x86_64/amd/zen2, x86_64/amd/zen3, aarch64/generic, aarch64/neoverse_n1, aarch64/neoverse_v1
repositories: eessi.io-2023.06-compat, eessi-hpc.org-2023.06-software, eessi-hpc.org-2023.06-compat, eessi.io-2023.06-software

eessi-build-deploy-bot-deucalion · 2024-10-16T08:50:31Z

Instance boegel-bot-deucalion is configured to build for:

architectures: aarch64/a64fx
repositories: eessi.io-2023.06-software

eessi-bot · 2024-10-16T08:50:31Z

Instance eessi-bot-mc-azure is configured to build for:

architectures: x86_64/amd/zen4
repositories: eessi-hpc.org-2023.06-software, eessi-hpc.org-2023.06-compat, eessi.io-2023.06-software, eessi.io-2023.06-compat

casparvl · 2024-10-16T08:50:52Z

bot: build repo:eessi.io-2023.06-software arch:zen2

eessi-bot · 2024-10-16T08:50:55Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen2 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen2
handling command build repository:eessi.io-2023.06-software architecture:zen2 resulted in:
- submitted job 23588, for details & status see Use EESSI module in EESSI-install-software.sh #790 (comment)

eessi-build-deploy-bot-deucalion · 2024-10-16T08:50:55Z

Updates by the bot instance boegel-bot-deucalion (click for details)

account casparvl has NO permission to send commands to the bot

eessi-bot · 2024-10-16T08:50:56Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen2 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen2
handling command build repository:eessi.io-2023.06-software architecture:zen2 resulted in:
- no jobs were submitted

eessi-bot · 2024-10-16T08:51:00Z

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-amd-zen2 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.10/pr_790/23588

date	job status	comment
Oct 16 08:50:59 UTC 2024	submitted	job id `23588` awaits release by job manager
Oct 16 08:51:23 UTC 2024	released	job awaits launch by Slurm scheduler
Oct 16 09:54:36 UTC 2024	running	job `23588` is running
Oct 16 10:00:42 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-23588.out` ❌ found message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ❌ no message matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts No artefacts were created or found.
Oct 16 10:00:42 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ OK ] ( 1/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos /aeb2d9df @BotBuildTests:x86-64-amd-zen2-node+default P: perf: 433.066 timesteps/s (r:0, l:None, u:None) [ OK ] ( 2/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos /04ff9ece @BotBuildTests:x86-64-amd-zen2-node+default P: perf: 433.174 timesteps/s (r:0, l:None, u:None) [ OK ] ( 3/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /31ac6ab9 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 5.93 us (r:0, l:None, u:None) [ OK ] ( 4/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /f3be40a2 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 4.76 us (r:0, l:None, u:None) [ OK ] ( 5/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /10e66fba @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 10.85 us (r:0, l:None, u:None) [ OK ] ( 6/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /5be57ae7 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 8.43 us (r:0, l:None, u:None) [ OK ] ( 7/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /c8c9aff5 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 0.34 us (r:0, l:None, u:None) [ OK ] ( 8/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /9795e491 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 0.33 us (r:0, l:None, u:None) [ OK ] ( 9/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /48da21c5 @BotBuildTests:x86-64-amd-zen2-node+default P: bandwidth: 7728.22 MB/s (r:0, l:None, u:None) [ OK ] (10/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /1b8c1ca2 @BotBuildTests:x86-64-amd-zen2-node+default P: bandwidth: 7814.82 MB/s (r:0, l:None, u:None) [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-23588.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

ocaisa · 2024-10-16T08:52:16Z

@casparvl The EESSI module had a few issues, I've added quite a few changes and a lot of additional CI in #781

(it was not that it didn't work, but it actually did not give back the original environment after unloading!)

casparvl · 2024-10-16T09:01:41Z

Ghehe, is that a polite way of saying you would like a review? ;-)

I don't think it will outright affect the use in EESSI-install-software.sh in this PR, since we don't unload it here. But I'll put it on my radar - I want to review the cuDNN one first though...

casparvl · 2024-10-16T09:28:48Z

bot: build repo:eessi.io-2023.06-software arch:zen2

eessi-bot · 2024-10-16T09:28:51Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen2 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen2
handling command build repository:eessi.io-2023.06-software architecture:zen2 resulted in:
- submitted job 23589, for details & status see Use EESSI module in EESSI-install-software.sh #790 (comment)

eessi-build-deploy-bot-deucalion · 2024-10-16T09:28:52Z

Updates by the bot instance boegel-bot-deucalion (click for details)

account casparvl has NO permission to send commands to the bot

eessi-bot · 2024-10-16T09:28:52Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen2 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen2
handling command build repository:eessi.io-2023.06-software architecture:zen2 resulted in:
- no jobs were submitted

eessi-bot · 2024-10-16T09:28:56Z

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-amd-zen2 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.10/pr_790/23589

date	job status	comment
Oct 16 09:28:55 UTC 2024	submitted	job id `23589` awaits release by job manager
Oct 16 09:29:22 UTC 2024	released	job awaits launch by Slurm scheduler
Oct 16 09:30:24 UTC 2024	running	job `23589` is running
Oct 16 09:36:31 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-23589.out` ❌ found message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ❌ no message matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts No artefacts were created or found.
Oct 16 09:36:31 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ OK ] ( 1/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos /aeb2d9df @BotBuildTests:x86-64-amd-zen2-node+default P: perf: 436.353 timesteps/s (r:0, l:None, u:None) [ OK ] ( 2/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos /04ff9ece @BotBuildTests:x86-64-amd-zen2-node+default P: perf: 435.814 timesteps/s (r:0, l:None, u:None) [ OK ] ( 3/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /31ac6ab9 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 4.82 us (r:0, l:None, u:None) [ OK ] ( 4/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /f3be40a2 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 4.56 us (r:0, l:None, u:None) [ OK ] ( 5/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /10e66fba @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 8.92 us (r:0, l:None, u:None) [ OK ] ( 6/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /5be57ae7 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 8.72 us (r:0, l:None, u:None) [ OK ] ( 7/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /c8c9aff5 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 0.33 us (r:0, l:None, u:None) [ OK ] ( 8/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /9795e491 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 0.3 us (r:0, l:None, u:None) [ OK ] ( 9/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /48da21c5 @BotBuildTests:x86-64-amd-zen2-node+default P: bandwidth: 7769.14 MB/s (r:0, l:None, u:None) [ OK ] (10/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /1b8c1ca2 @BotBuildTests:x86-64-amd-zen2-node+default P: bandwidth: 7687.88 MB/s (r:0, l:None, u:None) [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-23589.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

…tall

casparvl · 2024-10-16T14:32:01Z

bot: build repo:eessi.io-2023.06-software arch:zen2

eessi-bot · 2024-10-16T14:32:04Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen2 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen2
handling command build repository:eessi.io-2023.06-software architecture:zen2 resulted in:
- submitted job 23602, for details & status see Use EESSI module in EESSI-install-software.sh #790 (comment)

eessi-bot · 2024-10-16T14:32:04Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen2 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen2
handling command build repository:eessi.io-2023.06-software architecture:zen2 resulted in:
- no jobs were submitted

eessi-build-deploy-bot-deucalion · 2024-10-16T14:32:04Z

Updates by the bot instance boegel-bot-deucalion (click for details)

account casparvl has NO permission to send commands to the bot

eessi-bot · 2024-10-16T14:32:09Z

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-amd-zen2 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.10/pr_790/23602

date	job status	comment
Oct 16 14:32:08 UTC 2024	submitted	job id `23602` awaits release by job manager
Oct 16 14:32:22 UTC 2024	released	job awaits launch by Slurm scheduler
Oct 16 14:33:24 UTC 2024	running	job `23602` is running
Oct 16 14:39:33 UTC 2024	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-23602.out` ❌ found message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ❌ no message matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts No artefacts were created or found.
Oct 16 14:39:33 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ OK ] ( 1/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos /aeb2d9df @BotBuildTests:x86-64-amd-zen2-node+default P: perf: 441.162 timesteps/s (r:0, l:None, u:None) [ OK ] ( 2/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos /04ff9ece @BotBuildTests:x86-64-amd-zen2-node+default P: perf: 436.124 timesteps/s (r:0, l:None, u:None) [ OK ] ( 3/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /31ac6ab9 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 4.7 us (r:0, l:None, u:None) [ OK ] ( 4/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /f3be40a2 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 4.51 us (r:0, l:None, u:None) [ OK ] ( 5/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /10e66fba @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 11.18 us (r:0, l:None, u:None) [ OK ] ( 6/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /5be57ae7 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 8.4 us (r:0, l:None, u:None) [ OK ] ( 7/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /c8c9aff5 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 0.34 us (r:0, l:None, u:None) [ OK ] ( 8/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /9795e491 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 0.31 us (r:0, l:None, u:None) [ OK ] ( 9/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /48da21c5 @BotBuildTests:x86-64-amd-zen2-node+default P: bandwidth: 7887.22 MB/s (r:0, l:None, u:None) [ OK ] (10/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /1b8c1ca2 @BotBuildTests:x86-64-amd-zen2-node+default P: bandwidth: 7916.31 MB/s (r:0, l:None, u:None) [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-23602.out` ❌ found message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

…tware-layer into use_module_in_eessi_install

casparvl · 2024-10-16T14:45:45Z

bot: build repo:eessi.io-2023.06-software arch:zen2

eessi-bot · 2024-10-16T14:45:48Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen2 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen2
handling command build repository:eessi.io-2023.06-software architecture:zen2 resulted in:
- submitted job 23605, for details & status see Use EESSI module in EESSI-install-software.sh #790 (comment)

eessi-build-deploy-bot-deucalion · 2024-10-16T14:45:48Z

Updates by the bot instance boegel-bot-deucalion (click for details)

account casparvl has NO permission to send commands to the bot

casparvl · 2024-10-22T06:17:13Z

Hmm...

size: 0 MiB (3659 bytes)
entries: 1
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
no module files in tarball
software under 2023.06/software/linux/x86_64/amd/zen2/software
no software packages in tarball
other under 2023.06/software/linux/x86_64/amd/zen2
2023.06/scripts/gpu_support/nvidia/install_cuda_and_libraries.sh

That's not the artefacts list I expected :D Yes, this script should be reinstalled. But it should at the very least also install the patchelf I listed in the EasyStack file. Looking at the logs:

== Running parse hook for patchelf-0.18.0-GCCcore-13.2.0.eb...
== Running parse hook for GCCcore-13.2.0.eb...
== patchelf/0.18.0-GCCcore-13.2.0 is already installed (module found), skipping
== No easyconfigs left to be built.
== Build succeeded for 0 out of 0

Ah, that explains! Someone already installed my favorite dummy package that I like to try ;-)

casparvl · 2024-10-22T06:17:33Z

bot: build repo:eessi.io-2023.06-software arch:zen2

eessi-build-deploy-bot-deucalion · 2024-10-22T06:17:36Z

Updates by the bot instance boegel-bot-deucalion (click for details)

account casparvl has NO permission to send commands to the bot

eessi-bot · 2024-10-22T06:17:36Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen2 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen2

eessi-bot · 2024-10-22T06:17:37Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen2 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen2
handling command build repository:eessi.io-2023.06-software architecture:zen2 resulted in:
- no jobs were submitted

eessi-bot · 2024-10-22T06:17:40Z

# Note we need to do this after running install_cuda_and_libraries, since that does installations in the EESSI_SITE_INSTALL 
error: patch failed: easystacks/software.eessi.io/2023.06/eessi-2023.06-eb-4.9.4-2023a.yml:9
error: easystacks/software.eessi.io/2023.06/eessi-2023.06-eb-4.9.4-2023a.yml: patch does not apply

Unable to download or merge changes between the source branch and the destination branch.
Tip: This can usually be resolved by syncing your branch and resolving any merge conflicts.

…tall

casparvl · 2024-10-22T06:18:28Z

bot: build repo:eessi.io-2023.06-software arch:zen2

eessi-bot · 2024-10-22T06:18:31Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen2 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen2
handling command build repository:eessi.io-2023.06-software architecture:zen2 resulted in:
- submitted job 24701, for details & status see Use EESSI module in EESSI-install-software.sh #790 (comment)

eessi-build-deploy-bot-deucalion · 2024-10-22T06:18:31Z

Updates by the bot instance boegel-bot-deucalion (click for details)

account casparvl has NO permission to send commands to the bot

eessi-bot · 2024-10-22T06:18:31Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen2 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen2
handling command build repository:eessi.io-2023.06-software architecture:zen2 resulted in:
- no jobs were submitted

eessi-bot · 2024-10-22T06:18:35Z

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-amd-zen2 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.10/pr_790/24701

date	job status	comment
Oct 22 06:18:34 UTC 2024	submitted	job id `24701` awaits release by job manager
Oct 22 06:18:59 UTC 2024	released	job awaits launch by Slurm scheduler
Oct 22 06:26:01 UTC 2024	running	job `24701` is running
Oct 22 06:37:17 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-24701.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-1729578614.tar.gz` size: 7 MiB (8113119 bytes) entries: 508 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all `util-linux/2.39-GCCcore-13.2.0.lua` software under 2023.06/software/linux/x86_64/amd/zen2/software `util-linux/2.39-GCCcore-13.2.0` other under 2023.06/software/linux/x86_64/amd/zen2 `2023.06/scripts/gpu_support/nvidia/install_cuda_and_libraries.sh`
Oct 22 06:37:17 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ OK ] ( 1/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos /aeb2d9df @BotBuildTests:x86-64-amd-zen2-node+default P: perf: 434.84 timesteps/s (r:0, l:None, u:None) [ OK ] ( 2/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos /04ff9ece @BotBuildTests:x86-64-amd-zen2-node+default P: perf: 439.021 timesteps/s (r:0, l:None, u:None) [ OK ] ( 3/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /31ac6ab9 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 4.97 us (r:0, l:None, u:None) [ OK ] ( 4/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /f3be40a2 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 6.02 us (r:0, l:None, u:None) [ OK ] ( 5/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /10e66fba @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 9.18 us (r:0, l:None, u:None) [ OK ] ( 6/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /5be57ae7 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 10.83 us (r:0, l:None, u:None) [ OK ] ( 7/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /c8c9aff5 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 0.34 us (r:0, l:None, u:None) [ OK ] ( 8/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /9795e491 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 0.31 us (r:0, l:None, u:None) [ OK ] ( 9/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /48da21c5 @BotBuildTests:x86-64-amd-zen2-node+default P: bandwidth: 7442.93 MB/s (r:0, l:None, u:None) [ OK ] (10/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /1b8c1ca2 @BotBuildTests:x86-64-amd-zen2-node+default P: bandwidth: 7301.12 MB/s (r:0, l:None, u:None) [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-24701.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

casparvl · 2024-10-22T07:09:45Z

bot: build repo:eessi.io-2023.06-software arch:zen2

eessi-bot · 2024-10-22T07:09:48Z

Updates by the bot instance eessi-bot-mc-aws (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen2 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen2
handling command build repository:eessi.io-2023.06-software architecture:zen2 resulted in:
- submitted job 24702, for details & status see Use EESSI module in EESSI-install-software.sh #790 (comment)

eessi-build-deploy-bot-deucalion · 2024-10-22T07:09:48Z

Updates by the bot instance boegel-bot-deucalion (click for details)

account casparvl has NO permission to send commands to the bot

eessi-bot · 2024-10-22T07:09:48Z

Updates by the bot instance eessi-bot-mc-azure (click for details)

received bot command build repo:eessi.io-2023.06-software arch:zen2 from casparvl
- expanded format: build repository:eessi.io-2023.06-software architecture:zen2
handling command build repository:eessi.io-2023.06-software architecture:zen2 resulted in:
- no jobs were submitted

eessi-bot · 2024-10-22T07:09:52Z

New job on instance eessi-bot-mc-aws for CPU micro-architecture x86_64-amd-zen2 for repository eessi.io-2023.06-software in job dir /project/def-users/SHARED/jobs/2024.10/pr_790/24702

date	job status	comment
Oct 22 07:09:51 UTC 2024	submitted	job id `24702` awaits release by job manager
Oct 22 07:10:23 UTC 2024	released	job awaits launch by Slurm scheduler
Oct 22 07:11:25 UTC 2024	running	job `24702` is running
Oct 22 07:17:35 UTC 2024	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-24702.out` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-1729581072.tar.gz` size: 0 MiB (3659 bytes) entries: 1 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/amd/zen2/software no software packages in tarball other under 2023.06/software/linux/x86_64/amd/zen2 `2023.06/scripts/gpu_support/nvidia/install_cuda_and_libraries.sh`
Oct 22 07:17:35 UTC 2024	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ OK ] ( 1/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos /aeb2d9df @BotBuildTests:x86-64-amd-zen2-node+default P: perf: 441.041 timesteps/s (r:0, l:None, u:None) [ OK ] ( 2/10) EESSI_LAMMPS_lj %scale=1_node %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos /04ff9ece @BotBuildTests:x86-64-amd-zen2-node+default P: perf: 444.564 timesteps/s (r:0, l:None, u:None) [ OK ] ( 3/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /31ac6ab9 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 4.65 us (r:0, l:None, u:None) [ OK ] ( 4/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_allreduce %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /f3be40a2 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 4.8 us (r:0, l:None, u:None) [ OK ] ( 5/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /10e66fba @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 8.86 us (r:0, l:None, u:None) [ OK ] ( 6/10) EESSI_OSU_Micro_Benchmarks_coll %benchmark_info=mpi.collective.osu_alltoall %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /5be57ae7 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 8.29 us (r:0, l:None, u:None) [ OK ] ( 7/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /c8c9aff5 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 0.35 us (r:0, l:None, u:None) [ OK ] ( 8/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_latency %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /9795e491 @BotBuildTests:x86-64-amd-zen2-node+default P: latency: 0.3 us (r:0, l:None, u:None) [ OK ] ( 9/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %device_type=cpu /48da21c5 @BotBuildTests:x86-64-amd-zen2-node+default P: bandwidth: 7915.54 MB/s (r:0, l:None, u:None) [ OK ] (10/10) EESSI_OSU_Micro_Benchmarks_pt2pt %benchmark_info=mpi.pt2pt.osu_bw %scale=1_node %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %device_type=cpu /1b8c1ca2 @BotBuildTests:x86-64-amd-zen2-node+default P: bandwidth: 7875.25 MB/s (r:0, l:None, u:None) [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-24702.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`
Oct 28 15:10:33 UTC 2024	uploaded	transfer of `eessi-2023.06-software-linux-x86_64-amd-zen2-1729581072.tar.gz` to S3 bucket succeeded

casparvl · 2024-10-22T07:11:30Z

#790 proves the adaptations to the script works. I removed util-linux, since that was just to prove the functionality. #790 is to actually deploy the slightly modified install_cuda_and_libraries.sh

ocaisa

Looks good, I think I see an issue in a particular scenario for dev.eessi.io

EESSI-install-software.sh

Co-authored-by: ocaisa <[email protected]>

ocaisa · 2024-10-28T15:47:59Z

Staging PR has been merged

eessi-bot · 2024-10-28T15:48:10Z

PR merged! Moved ['/project/def-users/SHARED/jobs/2024.10/pr_790/23588', '/project/def-users/SHARED/jobs/2024.10/pr_790/23589', '/project/def-users/SHARED/jobs/2024.10/pr_790/23602', '/project/def-users/SHARED/jobs/2024.10/pr_790/23605', '/project/def-users/SHARED/jobs/2024.10/pr_790/23626', '/project/def-users/SHARED/jobs/2024.10/pr_790/24404', '/project/def-users/SHARED/jobs/2024.10/pr_790/24701', '/project/def-users/SHARED/jobs/2024.10/pr_790/24702'] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2024.10.28

eessi-bot · 2024-10-28T15:48:11Z

PR merged! Moved [] to /project/def-users/SHARED/trash_bin/EESSI/software-layer/2024.10.28

Caspar van Leeuwen added 3 commits October 16, 2024 09:55

Modify EESSI-install-software.sh so that it loads the EESSI module to…

d27fcf4

… set the environment

Also replace source of easybuild configuration by loading the EESSI-e…

4d22c13

…xtend module

Add a quick build so we can test the EESSI-install-software.sh script

660697a

casparvl changed the title ~~Use module in eessi install~~ Use EESSI module in EESSI-install-software.sh Oct 16, 2024

casparvl and others added 2 commits October 16, 2024 16:24

Merge branch '2023.06-software.eessi.io' into use_module_in_eessi_ins…

50b9b8d

…tall

Move test if we are in prefix

41f8e02

Merge branch 'use_module_in_eessi_install' of github.com:casparvl/sof…

6034cc2

…tware-layer into use_module_in_eessi_install

Merge branch '2023.06-software.eessi.io' into use_module_in_eessi_ins…

e963240

…tall

Caspar van Leeuwen added 2 commits October 22, 2024 09:09

Remove util-linux again, this was just to prove the PR worked

ce5f2c8

Remove util-linux again, this was just to prove the PR worked

f38b24f

ocaisa requested changes Oct 22, 2024

View reviewed changes

EESSI-install-software.sh Outdated Show resolved Hide resolved

EESSI-install-software.sh Show resolved Hide resolved

Update EESSI-install-software.sh

abf1aff

Co-authored-by: ocaisa <[email protected]>

casparvl marked this pull request as ready for review October 22, 2024 21:30

ocaisa approved these changes Oct 28, 2024

View reviewed changes

ocaisa added the bot:deploy Ask bot to deploy missing software installations to EESSI label Oct 28, 2024

ocaisa merged commit 5fb04c0 into EESSI:2023.06-software.eessi.io Oct 28, 2024
51 checks passed

Neves-P mentioned this pull request Nov 5, 2024

[WIP] Project subdirectories in dev.eessi.io install path and EESSI-extend integration #804

Draft

Use EESSI module in EESSI-install-software.sh #790

Use EESSI module in EESSI-install-software.sh #790

Conversation

casparvl commented Oct 16, 2024

eessi-bot bot commented Oct 16, 2024

eessi-build-deploy-bot-deucalion bot commented Oct 16, 2024

eessi-bot bot commented Oct 16, 2024

casparvl commented Oct 16, 2024

eessi-bot bot commented Oct 16, 2024 • edited Loading

eessi-build-deploy-bot-deucalion bot commented Oct 16, 2024

eessi-bot bot commented Oct 16, 2024 • edited Loading

eessi-bot bot commented Oct 16, 2024 • edited Loading

ocaisa commented Oct 16, 2024

casparvl commented Oct 16, 2024 • edited Loading

casparvl commented Oct 16, 2024

eessi-bot bot commented Oct 16, 2024 • edited Loading

eessi-build-deploy-bot-deucalion bot commented Oct 16, 2024

eessi-bot bot commented Oct 16, 2024 • edited Loading

eessi-bot bot commented Oct 16, 2024 • edited Loading

casparvl commented Oct 16, 2024

eessi-bot bot commented Oct 16, 2024 • edited Loading

eessi-bot bot commented Oct 16, 2024 • edited Loading

eessi-build-deploy-bot-deucalion bot commented Oct 16, 2024

eessi-bot bot commented Oct 16, 2024 • edited Loading

casparvl commented Oct 16, 2024

eessi-bot bot commented Oct 16, 2024 • edited Loading

eessi-build-deploy-bot-deucalion bot commented Oct 16, 2024

casparvl commented Oct 22, 2024

casparvl commented Oct 22, 2024

eessi-build-deploy-bot-deucalion bot commented Oct 22, 2024

eessi-bot bot commented Oct 22, 2024

eessi-bot bot commented Oct 22, 2024 • edited Loading

eessi-bot bot commented Oct 22, 2024

casparvl commented Oct 22, 2024

eessi-bot bot commented Oct 22, 2024 • edited Loading

eessi-build-deploy-bot-deucalion bot commented Oct 22, 2024

eessi-bot bot commented Oct 22, 2024 • edited Loading

eessi-bot bot commented Oct 22, 2024 • edited Loading

casparvl commented Oct 22, 2024

eessi-bot bot commented Oct 22, 2024 • edited Loading

eessi-build-deploy-bot-deucalion bot commented Oct 22, 2024

eessi-bot bot commented Oct 22, 2024 • edited Loading

eessi-bot bot commented Oct 22, 2024 • edited Loading

casparvl commented Oct 22, 2024

ocaisa left a comment

Choose a reason for hiding this comment

ocaisa commented Oct 28, 2024

eessi-bot bot commented Oct 28, 2024

eessi-bot bot commented Oct 28, 2024

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

casparvl commented Oct 16, 2024 •

edited

Loading

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

eessi-bot bot commented Oct 16, 2024 •

edited

Loading

eessi-bot bot commented Oct 22, 2024 •

edited

Loading

eessi-bot bot commented Oct 22, 2024 •

edited

Loading

eessi-bot bot commented Oct 22, 2024 •

edited

Loading

eessi-bot bot commented Oct 22, 2024 •

edited

Loading

eessi-bot bot commented Oct 22, 2024 •

edited

Loading

eessi-bot bot commented Oct 22, 2024 •

edited

Loading

eessi-bot bot commented Oct 22, 2024 •

edited

Loading