Add host-injections CUDA build list for 2025.06 #120

casparvl · 2025-10-30T13:11:09Z

No description provided.

casparvl · 2025-10-30T13:16:07Z

Testing in EESSI/software-layer#1278 ...

…the missing PTX

casparvl · 2025-10-30T15:23:24Z

bot: build repo:eessi.io-2025.06-software instance:eessi-bot-surf for:arch=x86_64/intel/icelake,accel=nvidia/cc80

eessi-bot-surf · 2025-10-30T15:23:32Z

New job on instance eessi-bot-surf for repository eessi.io-2025.06-software
Building on: intel-icelake and accelerator nvidia/cc80
Building for: x86_64/intel/icelake and accelerator nvidia/cc80
Job dir: /projects/eessibot/eessi-bot-surf/jobs/2025.10/pr_120/15646511

date	job status	comment
Oct 30 15:23:30 UTC 2025	submitted	job id `15646511` will be eligible to start in about 20 seconds
Oct 30 15:23:42 UTC 2025	received	job awaits launch by Slurm scheduler
Oct 30 15:24:06 UTC 2025	running	job `15646511` is running
Oct 30 15:25:27 UTC 2025	finished	😢 FAILURE (click triangle for details) Details ✅ job output file `slurm-15646511.out` ✅ no message matching `FATAL:` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ❌ no message matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2025.06-software-linux-x86_64-intel-icelake-accel-nvidia-cc80-17618378800.tar.gz` size: 0 MiB (450 bytes) entries: 1 modules under 2025.06/software/linux/x86_64/intel/icelake/accel/nvidia/cc80/modules/all no module files in tarball software under 2025.06/software/linux/x86_64/intel/icelake/accel/nvidia/cc80/software no software packages in tarball reprod directories under 2025.06/software/linux/x86_64/intel/icelake/accel/nvidia/cc80/reprod no reprod directories in tarball other under 2025.06/software/linux/x86_64/intel/icelake/accel/nvidia/cc80 `2025.06/scripts/gpu_support/nvidia/easystacks/eessi-2025.06-eb-5.1.2-CUDA-host-injections.yml`
Oct 30 15:25:27 UTC 2025	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 0/0 test case(s) from 0 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-15646511.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

casparvl · 2025-10-30T15:24:10Z

EESSI/software-layer#1278 (comment) shows that this PR works, but I guess we won't to deploy the 2025.06/scripts/gpu_support/nvidia/easystacks/eessi-2025.06-eb-5.1.2-CUDA-host-injections.yml script as part of this PR (#120 in software-layer-scripts), and not of part of that software-layer PR.

casparvl · 2025-10-30T15:33:02Z

Hm, the failure is that there is no "No missing installations" message. But: we don't expect that, since we're not installing any modules, only some scripts. How do we deal with this?

Edit: Added (grep -v "scripts/gpu_support/" || true) so that this easystack doesn't end up in changed_easystacks. That way, if [ -z "${changed_easystacks}" ]; then immediately evaluates to true and the 'No missing installation' message is correctly printed.

…changed_easystacks. Needed to avoid missing 'No missing installations' in the build log.

casparvl · 2025-10-30T20:59:40Z

bot: build repo:eessi.io-2025.06-software instance:eessi-bot-surf for:arch=x86_64/intel/icelake,accel=nvidia/cc80

eessi-bot-surf · 2025-10-30T20:59:47Z

New job on instance eessi-bot-surf for repository eessi.io-2025.06-software
Building on: intel-icelake and accelerator nvidia/cc80
Building for: x86_64/intel/icelake and accelerator nvidia/cc80
Job dir: /projects/eessibot/eessi-bot-surf/jobs/2025.10/pr_120/15649414

date	job status	comment
Oct 30 20:59:45 UTC 2025	submitted	job id `15649414` will be eligible to start in about 20 seconds
Oct 30 20:59:54 UTC 2025	received	job awaits launch by Slurm scheduler
Oct 30 21:00:17 UTC 2025	running	job `15649414` is running
Oct 30 21:01:37 UTC 2025	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-15649414.out` ✅ no message matching `FATAL:` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2025.06-software-linux-x86_64-intel-icelake-accel-nvidia-cc80-17618580450.tar.gz` size: 0 MiB (450 bytes) entries: 1 modules under 2025.06/software/linux/x86_64/intel/icelake/accel/nvidia/cc80/modules/all no module files in tarball software under 2025.06/software/linux/x86_64/intel/icelake/accel/nvidia/cc80/software no software packages in tarball reprod directories under 2025.06/software/linux/x86_64/intel/icelake/accel/nvidia/cc80/reprod no reprod directories in tarball other under 2025.06/software/linux/x86_64/intel/icelake/accel/nvidia/cc80 `2025.06/scripts/gpu_support/nvidia/easystacks/eessi-2025.06-eb-5.1.2-CUDA-host-injections.yml`
Oct 30 21:01:37 UTC 2025	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 0/0 test case(s) from 0 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-15649414.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

casparvl · 2025-10-30T21:05:19Z

bot: build repo:eessi.io-2023.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2

eessi-bot-aws · 2025-10-30T21:05:25Z

New job on instance eessi-bot-mc-aws for repository eessi.io-2023.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.10/pr_120/100488

date	job status	comment
Oct 30 21:05:24 UTC 2025	submitted	job id `100488` awaits release by job manager
Oct 30 21:06:23 UTC 2025	released	job awaits launch by Slurm scheduler
Oct 30 21:11:26 UTC 2025	running	job `100488` is running
Oct 30 21:14:29 UTC 2025	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-100488.out` ✅ no message matching `FATAL:` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2023.06-software-linux-x86_64-amd-zen2-17618586860.tar.gz` size: 0 MiB (45 bytes) entries: 0 modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all no module files in tarball software under 2023.06/software/linux/x86_64/amd/zen2/software no software packages in tarball reprod directories under 2023.06/software/linux/x86_64/amd/zen2/reprod no reprod directories in tarball other under 2023.06/software/linux/x86_64/amd/zen2 no other files in tarball
Oct 30 21:14:29 UTC 2025	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ OK ] ( 1/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/29Aug2024-foss-2023b-kokkos %scale=1_node /aeb2d9df @BotBuildTests:x86_64_amd_zen2+default P: perf: 290.654 timesteps/s (r:0, l:None, u:None) [ OK ] ( 2/10) EESSI_LAMMPS_lj %device_type=cpu %module_name=LAMMPS/2Aug2023_update2-foss-2023a-kokkos %scale=1_node /04ff9ece @BotBuildTests:x86_64_amd_zen2+default P: perf: 446.425 timesteps/s (r:0, l:None, u:None) [ OK ] ( 3/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /775175bf @BotBuildTests:x86_64_amd_zen2+default P: latency: 1.78 us (r:0, l:None, u:None) [ OK ] ( 4/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_allreduce %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /52707c40 @BotBuildTests:x86_64_amd_zen2+default P: latency: 1.81 us (r:0, l:None, u:None) [ OK ] ( 5/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node %device_type=cpu /b1aacda9 @BotBuildTests:x86_64_amd_zen2+default P: latency: 5.71 us (r:0, l:None, u:None) [ OK ] ( 6/10) EESSI_OSU_coll %benchmark_info=mpi.collective.osu_alltoall %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node %device_type=cpu /c6bad193 @BotBuildTests:x86_64_amd_zen2+default P: latency: 4.12 us (r:0, l:None, u:None) [ OK ] ( 7/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /15cad6c4 @BotBuildTests:x86_64_amd_zen2+default P: latency: 0.58 us (r:0, l:None, u:None) [ OK ] ( 8/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_latency %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /6672deda @BotBuildTests:x86_64_amd_zen2+default P: latency: 0.56 us (r:0, l:None, u:None) [ OK ] ( 9/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.2-gompi-2023b %scale=1_node /2a9a47b1 @BotBuildTests:x86_64_amd_zen2+default P: bandwidth: 7067.96 MB/s (r:0, l:None, u:None) [ OK ] (10/10) EESSI_OSU_pt2pt_CPU %benchmark_info=mpi.pt2pt.osu_bw %module_name=OSU-Micro-Benchmarks/7.1-1-gompi-2023a %scale=1_node /1b24ab8e @BotBuildTests:x86_64_amd_zen2+default P: bandwidth: 6963.65 MB/s (r:0, l:None, u:None) [ PASSED ] Ran 10/10 test case(s) from 10 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-100488.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

casparvl · 2025-10-30T21:49:32Z

Again wrong version. I can't seem to get this right...

bot: build repo:eessi.io-2025.06-software instance:eessi-bot-mc-aws for:arch=x86_64/amd/zen2

eessi-bot-aws · 2025-10-30T21:49:38Z

New job on instance eessi-bot-mc-aws for repository eessi.io-2025.06-software
Building on: amd-zen2
Building for: x86_64/amd/zen2
Job dir: /project/def-users/SHARED/jobs/2025.10/pr_120/100493

date	job status	comment
Oct 30 21:49:37 UTC 2025	submitted	job id `100493` awaits release by job manager
Oct 30 21:50:33 UTC 2025	released	job awaits launch by Slurm scheduler
Oct 30 21:51:39 UTC 2025	running	job `100493` is running
Oct 30 21:52:42 UTC 2025	finished	😁 SUCCESS (click triangle for details) Details ✅ job output file `slurm-100493.out` ✅ no message matching `FATAL:` ✅ no message matching `ERROR:` ✅ no message matching `FAILED:` ✅ no message matching `required modules missing:` ✅ found message(s) matching `No missing installations` ✅ found message matching `.tar.gz created!` Artefacts `eessi-2025.06-software-linux-x86_64-amd-zen2-17618610570.tar.gz` size: 0 MiB (443 bytes) entries: 1 modules under 2025.06/software/linux/x86_64/amd/zen2/modules/all no module files in tarball software under 2025.06/software/linux/x86_64/amd/zen2/software no software packages in tarball reprod directories under 2025.06/software/linux/x86_64/amd/zen2/reprod no reprod directories in tarball other under 2025.06/software/linux/x86_64/amd/zen2 `2025.06/scripts/gpu_support/nvidia/easystacks/eessi-2025.06-eb-5.1.2-CUDA-host-injections.yml`
Oct 30 21:52:42 UTC 2025	test result	😁 SUCCESS (click triangle for details) ReFrame Summary [ PASSED ] Ran 0/0 test case(s) from 0 check(s) (0 failure(s), 0 skipped, 0 aborted) Details ✅ job output file `slurm-100493.out` ✅ no message matching `ERROR:` ✅ no message matching `[\sFAILED\s].Ran . test case`

Caspar van Leeuwen added 2 commits October 30, 2025 14:09

Add host-injections CUDA build list

ca1af57

Fix indent

380808a

casparvl marked this pull request as draft October 30, 2025 13:16

Caspar van Leeuwen added 4 commits October 30, 2025 14:19

Fix colons

70b3da3

cuDNN does not contain PTX code, making the sanity check fail. Allow …

e75dac5

…the missing PTX

Set the cuda-sanity-check-accept-missing-ptx value

e25b625

Make mkdir verbose, so that we see if the directory gets created

54bd9ad

casparvl marked this pull request as ready for review October 30, 2025 15:36

casparvl mentioned this pull request Oct 30, 2025

{2025.05} Cuda 12.6.0, 12.8.0, cuDNN 9.5.0.50, 9.10.1.4 EESSI/software-layer#1278

Draft

Exclude easystacks in scripts/gpu_support from being included in the …

7294adb

…changed_easystacks. Needed to avoid missing 'No missing installations' in the build log.

Make sure the grep command always returns success

96494f5

casparvl added ready-to-deploy 2025.06-software.eessi.io 2025.06 version of software.eessi.io ready-to-review labels Oct 30, 2025

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

Add host-injections CUDA build list for 2025.06 #120

Add host-injections CUDA build list for 2025.06 #120

Uh oh!

casparvl commented Oct 30, 2025

Uh oh!

casparvl commented Oct 30, 2025

Uh oh!

casparvl commented Oct 30, 2025

Uh oh!

eessi-bot-surf bot commented Oct 30, 2025 •

edited

Loading

Uh oh!

casparvl commented Oct 30, 2025

Uh oh!

casparvl commented Oct 30, 2025 •

edited

Loading

Uh oh!

casparvl commented Oct 30, 2025

Uh oh!

eessi-bot-surf bot commented Oct 30, 2025 •

edited

Loading

Uh oh!

casparvl commented Oct 30, 2025

Uh oh!

eessi-bot-aws bot commented Oct 30, 2025 •

edited

Loading

Uh oh!

casparvl commented Oct 30, 2025

Uh oh!

eessi-bot-aws bot commented Oct 30, 2025 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Add host-injections CUDA build list for 2025.06 #120

Are you sure you want to change the base?

Add host-injections CUDA build list for 2025.06 #120

Uh oh!

Conversation

casparvl commented Oct 30, 2025

Uh oh!

casparvl commented Oct 30, 2025

Uh oh!

casparvl commented Oct 30, 2025

Uh oh!

eessi-bot-surf bot commented Oct 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

casparvl commented Oct 30, 2025

Uh oh!

casparvl commented Oct 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

casparvl commented Oct 30, 2025

Uh oh!

eessi-bot-surf bot commented Oct 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

casparvl commented Oct 30, 2025

Uh oh!

eessi-bot-aws bot commented Oct 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

casparvl commented Oct 30, 2025

Uh oh!

eessi-bot-aws bot commented Oct 30, 2025 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

eessi-bot-surf bot commented Oct 30, 2025 •

edited

Loading

casparvl commented Oct 30, 2025 •

edited

Loading

eessi-bot-surf bot commented Oct 30, 2025 •

edited

Loading

eessi-bot-aws bot commented Oct 30, 2025 •

edited

Loading

eessi-bot-aws bot commented Oct 30, 2025 •

edited

Loading