Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

PR for testing bot PR254 - NESSI/23.06 - snakemake v8.4.2 with foss/2023a #71

Merged
merged 1 commit into from
Apr 10, 2024

Conversation

trz42
Copy link
Owner

@trz42 trz42 commented Feb 17, 2024

PR for testing bot PR254. Build snakemake and upload it to different directories in bucket test-PR254.

Missing installations:

11 out of 81 required modules missing:

* GitPython/3.1.40-GCCcore-12.3.0 (GitPython-3.1.40-GCCcore-12.3.0.eb)
* GLPK/5.0-GCCcore-12.3.0 (GLPK-5.0-GCCcore-12.3.0.eb)
* wrapt/1.15.0-gfbf-2023a (wrapt-1.15.0-gfbf-2023a.eb)
* CoinUtils/2.11.10-GCC-12.3.0 (CoinUtils-2.11.10-GCC-12.3.0.eb)
* Osi/0.108.9-GCC-12.3.0 (Osi-0.108.9-GCC-12.3.0.eb)
* MUMPS/5.6.1-foss-2023a-metis (MUMPS-5.6.1-foss-2023a-metis.eb)
* Clp/1.17.9-foss-2023a (Clp-1.17.9-foss-2023a.eb)
* Cgl/0.60.8-foss-2023a (Cgl-0.60.8-foss-2023a.eb)
* Cbc/2.10.11-foss-2023a (Cbc-2.10.11-foss-2023a.eb)
* PuLP/2.8.0-foss-2023a (PuLP-2.8.0-foss-2023a.eb)
* snakemake/8.4.2-foss-2023a (snakemake-8.4.2-foss-2023a.eb)

@eessi-bot-devel-trz42
Copy link

Instance dev-PR254 is configured to build:

  • arch x86_64/amd/zen2 for repo nessi-2022.11-swl-deb10
  • arch x86_64/amd/zen2 for repo nessi-2023.06-cl
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb10
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb11
  • arch aarch64/generic for repo nessi-2022.11-swl-deb10
  • arch aarch64/generic for repo nessi-2023.06-cl
  • arch aarch64/generic for repo nessi-2023.06-swl-deb10
  • arch aarch64/generic for repo nessi-2023.06-swl-deb11

@trz42
Copy link
Owner Author

trz42 commented Feb 17, 2024

bot: build inst:PR254 repo:nessi-2023.06-swl-deb10 arch:aarch64/generic

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Feb 17, 2024

Updates by the bot instance dev-PR254 (click for details)
  • received bot command build inst:PR254 repo:nessi-2023.06-swl-deb10 arch:aarch64/generic from trz42

    • expanded format: build instance:PR254 repository:nessi-2023.06-swl-deb10 architecture:aarch64/generic
  • handling command build instance:PR254 repository:nessi-2023.06-swl-deb10 architecture:aarch64/generic resulted in:

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Feb 17, 2024

New job on instance dev-PR254 for architecture aarch64-generic for repository nessi-2023.06-swl-deb10 in job dir /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.02/pr_71/131891

date job status comment
Feb 17 09:25:13 PM UTC 2024 submitted job id 131891 awaits release by job manager
Feb 17 09:25:22 PM UTC 2024 released job awaits launch by Slurm scheduler
Feb 17 09:26:27 PM UTC 2024 running job 131891 is running
Feb 17 10:27:13 PM UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-131891.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-generic-1708208755.tar.gzsize: 41 MiB (44038727 bytes)
entries: 1887
modules under 2023.06/software/linux/aarch64/generic/modules/all
Cbc/2.10.11-foss-2023a.lua
Cgl/0.60.8-foss-2023a.lua
Clp/1.17.9-foss-2023a.lua
CoinUtils/2.11.10-GCC-12.3.0.lua
GitPython/3.1.40-GCCcore-12.3.0.lua
GLPK/5.0-GCCcore-12.3.0.lua
MUMPS/5.6.1-foss-2023a-metis.lua
Osi/0.108.9-GCC-12.3.0.lua
PuLP/2.8.0-foss-2023a.lua
snakemake/8.4.2-foss-2023a.lua
wrapt/1.15.0-gfbf-2023a.lua
software under 2023.06/software/linux/aarch64/generic/software
Cbc/2.10.11-foss-2023a
Cgl/0.60.8-foss-2023a
Clp/1.17.9-foss-2023a
CoinUtils/2.11.10-GCC-12.3.0
GitPython/3.1.40-GCCcore-12.3.0
GLPK/5.0-GCCcore-12.3.0
MUMPS/5.6.1-foss-2023a-metis
Osi/0.108.9-GCC-12.3.0
PuLP/2.8.0-foss-2023a
snakemake/8.4.2-foss-2023a
wrapt/1.15.0-gfbf-2023a
other under 2023.06/software/linux/aarch64/generic
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Feb 17 10:27:13 PM UTC 2024 test result (no tests yet)
Feb 17 10:31:28 PM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1708208755.tar.gz to S3 bucket succeeded
Feb 17 10:41:14 PM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1708208755.tar.gz to S3 bucket succeeded
Feb 17 10:55:35 PM UTC 2024 not uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1708208755.tar.gz to S3 bucket failed
Feb 17 11:02:21 PM UTC 2024 not uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1708208755.tar.gz to S3 bucket failed
Feb 17 11:12:44 PM UTC 2024 uploaded transfer of eessi-2023.06-software-linux-aarch64-generic-1708208755.tar.gz to S3 bucket succeeded

@trz42
Copy link
Owner Author

trz42 commented Feb 17, 2024

bot: show_config

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Feb 17, 2024

Updates by the bot instance dev-PR254 (click for details)

@eessi-bot-devel-trz42
Copy link

Instance dev-PR254 is configured to build:

  • arch x86_64/amd/zen2 for repo nessi-2022.11-swl-deb10
  • arch x86_64/amd/zen2 for repo nessi-2023.06-cl
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb10
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb11
  • arch aarch64/generic for repo nessi-2022.11-swl-deb10
  • arch aarch64/generic for repo nessi-2023.06-cl
  • arch aarch64/generic for repo nessi-2023.06-swl-deb10
  • arch aarch64/generic for repo nessi-2023.06-swl-deb11

@trz42
Copy link
Owner Author

trz42 commented Feb 17, 2024

bot: show_config

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Feb 17, 2024

Updates by the bot instance dev-PR254 (click for details)

@eessi-bot-devel-trz42
Copy link

Instance dev-PR254 is configured to build:

  • arch x86_64/amd/zen for repo nessi-2022.11-swl-deb10
  • arch x86_64/amd/zen for repo nessi-2023.06-cl
  • arch x86_64/amd/zen for repo nessi-2023.06-swl-deb10
  • arch x86_64/amd/zen for repo nessi-2023.06-swl-deb11
  • arch x86_64/amd/zen2 for repo nessi-2022.11-swl-deb10
  • arch x86_64/amd/zen2 for repo nessi-2023.06-cl
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb10
  • arch x86_64/amd/zen2 for repo nessi-2023.06-swl-deb11
  • arch x86_64/amd/zen3 for repo nessi-2022.11-swl-deb10
  • arch x86_64/amd/zen3 for repo nessi-2023.06-cl
  • arch x86_64/amd/zen3 for repo nessi-2023.06-swl-deb10
  • arch x86_64/amd/zen3 for repo nessi-2023.06-swl-deb11
  • arch aarch64/generic for repo nessi-2022.11-swl-deb10
  • arch aarch64/generic for repo nessi-2023.06-cl
  • arch aarch64/generic for repo nessi-2023.06-swl-deb10
  • arch aarch64/generic for repo nessi-2023.06-swl-deb11
  • arch aarch64/thunderx2 for repo nessi-2022.11-swl-deb10
  • arch aarch64/thunderx2 for repo nessi-2023.06-cl
  • arch aarch64/thunderx2 for repo nessi-2023.06-swl-deb10
  • arch aarch64/thunderx2 for repo nessi-2023.06-swl-deb11

@trz42
Copy link
Owner Author

trz42 commented Feb 17, 2024

bot: build inst:PR254 repo:nessi-2023.06-swl-deb11 arch:x86_64/amd/zen3

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Feb 17, 2024

Updates by the bot instance dev-PR254 (click for details)
  • received bot command build inst:PR254 repo:nessi-2023.06-swl-deb11 arch:x86_64/amd/zen3 from trz42

    • expanded format: build instance:PR254 repository:nessi-2023.06-swl-deb11 architecture:x86_64/amd/zen3
  • handling command build instance:PR254 repository:nessi-2023.06-swl-deb11 architecture:x86_64/amd/zen3 resulted in:

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Feb 17, 2024

New job on instance dev-PR254 for architecture x86_64-amd-zen3 for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.02/pr_71/131893

date job status comment
Feb 17 09:36:25 PM UTC 2024 submitted job id 131893 awaits release by job manager
Feb 17 09:36:43 PM UTC 2024 released job awaits launch by Slurm scheduler
Feb 17 09:37:49 PM UTC 2024 running job 131893 is running
Feb 17 09:46:12 PM UTC 2024 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-131893.out
❌ found message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
❌ no message matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
No artefacts were created or found.
Feb 17 09:46:12 PM UTC 2024 test result (no tests yet)

@trz42
Copy link
Owner Author

trz42 commented Feb 17, 2024

bot: build inst:PR254 repo:nessi-2023.06-swl-deb11 arch:x86_64/amd/zen2

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Feb 17, 2024

Updates by the bot instance dev-PR254 (click for details)
  • received bot command build inst:PR254 repo:nessi-2023.06-swl-deb11 arch:x86_64/amd/zen2 from trz42

    • expanded format: build instance:PR254 repository:nessi-2023.06-swl-deb11 architecture:x86_64/amd/zen2
  • handling command build instance:PR254 repository:nessi-2023.06-swl-deb11 architecture:x86_64/amd/zen2 resulted in:

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Feb 17, 2024

New job on instance dev-PR254 for architecture x86_64-amd-zen2 for repository nessi-2023.06-swl-deb11 in job dir /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.02/pr_71/131894

date job status comment
Feb 17 09:48:44 PM UTC 2024 submitted job id 131894 awaits release by job manager
Feb 17 09:49:19 PM UTC 2024 released job awaits launch by Slurm scheduler
Feb 17 09:50:25 PM UTC 2024 running job 131894 is running
Feb 17 11:44:25 PM UTC 2024 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-131894.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1708213405.tar.gzsize: 43 MiB (45352090 bytes)
entries: 1887
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
Cbc/2.10.11-foss-2023a.lua
Cgl/0.60.8-foss-2023a.lua
Clp/1.17.9-foss-2023a.lua
CoinUtils/2.11.10-GCC-12.3.0.lua
GitPython/3.1.40-GCCcore-12.3.0.lua
GLPK/5.0-GCCcore-12.3.0.lua
MUMPS/5.6.1-foss-2023a-metis.lua
Osi/0.108.9-GCC-12.3.0.lua
PuLP/2.8.0-foss-2023a.lua
snakemake/8.4.2-foss-2023a.lua
wrapt/1.15.0-gfbf-2023a.lua
software under 2023.06/software/linux/x86_64/amd/zen2/software
Cbc/2.10.11-foss-2023a
Cgl/0.60.8-foss-2023a
Clp/1.17.9-foss-2023a
CoinUtils/2.11.10-GCC-12.3.0
GitPython/3.1.40-GCCcore-12.3.0
GLPK/5.0-GCCcore-12.3.0
MUMPS/5.6.1-foss-2023a-metis
Osi/0.108.9-GCC-12.3.0
PuLP/2.8.0-foss-2023a
snakemake/8.4.2-foss-2023a
wrapt/1.15.0-gfbf-2023a
other under 2023.06/software/linux/x86_64/amd/zen2
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp
Feb 17 11:44:25 PM UTC 2024 test result (no tests yet)

@trz42
Copy link
Owner Author

trz42 commented Feb 17, 2024

bot: status

@eessi-bot-devel-trz42
Copy link

eessi-bot-devel-trz42 bot commented Feb 17, 2024

Updates by the bot instance dev-PR254 (click for details)
  • received bot command status from trz42

    • expanded format: status
  • handling command status resulted in:

@eessi-bot-devel-trz42
Copy link

This is the status of all the bot: build commands:

arch result date status url
aarch64-generic 😢 FAILURE Feb 17 09:46:12 PM UTC 2024 finished #71 (comment)

@trz42
Copy link
Owner Author

trz42 commented Feb 17, 2024

Test deployment with the following settings:

bucket_name = dev-pr254
tarball_prefix =
metadata_prefix =

From pyghee.log

[20240217-T23:29:07] run_subprocess(): 'Upload tarball to S3 bucket' by running '/home/thomarob/bot-devel/test_sync_feb24/eessi-bot-software-layer/scripts/eessi-upload-to-staging --bucket-name dev-pr254 --endpoint-url https://minio.nessi.no:60900 --repository trz42/software-layer --pull-request-number 71 --pr-comment-id 1950358795 /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.02/pr_71/131891/eessi-2023.06-software-linux-aarch64-generic-1708208755.tar.gz' in directory '/home/thomarob/bot-devel/test_sync_feb24/eessi-bot-software-layer'

So, neither --tarball-prefix nor --metadata-prefix arguments were used because the corresponding settings in app.cfg are empty.

Both the tarball and metadata file are uploaded to the legacy location

BUCKET/VERSION/software/linux/aarch64/generic/1708208755

@trz42 trz42 added the bot:deploy Instruct bot to deploy built artefacts to Stratum 0 label Feb 17, 2024
@trz42
Copy link
Owner Author

trz42 commented Feb 17, 2024

Test deployment with the following settings:

bucket_name = dev-pr254
metadata_prefix = metadata
tarball_prefix = tarballs

From pyghee.log

[20240217-T23:36:24] run_subprocess(): 'Upload tarball to S3 bucket' by running '/home/thomarob/bot-devel/test_sync_feb24/eessi-bot-software-layer/scripts/eessi-upload-to-staging --bucket-name dev-pr254 --endpoint-url https://minio.nessi.no:60900 --metadata-prefix metadata --repository trz42/software-layer --pull-request-number 71 --pr-comment-id 1950358795 --tarball-prefix tarballs /home/thomarob/bot-devel/test_sync_feb24/jobs/2024.02/pr_71/131891/eessi-2023.06-software-linux-aarch64-generic-1708208755.tar.gz' in directory '/home/thomarob/bot-devel/test_sync_feb24/eessi-bot-software-layer'

So, both --metadata-prefix and --tarball-prefix arguments are used. Upload seems not to have succeeded ... or was just slow ... and timed out (for tarball).

  • The metadata file was uploaded to BUCKET/metadata/
  • The tarball wasn't uploaded, but the initiated transfer was to the correct location. From pyghee.log
    'upload failed: ../jobs/2024.02/pr_71/131891/eessi-2023.06-software-linux-aarch64-generic-1708208755.tar.gz to s3://dev-pr254/tarballs/eessi-2023.06-software-linux-aarch64-generic-1708208755.tar.gz Connect timeout on endpoint URL: "https://minio.nessi.no:60900/dev-pr254/tarballs/eessi-2023.06-software-linux-aarch64-generic-1708208755.tar.gz?uploadId=NTMzYWY4ZWMtY2U1Ny00MzQ2LWExZmYtMWY1OWY0ZWI4YzlmLmM2N2ZkYzFhLThjZjYtNGI4Ni1iZmJlLTgxYzc4ZmM0Yzg1OQ&partNumber=5
    

@trz42 trz42 added bot:deploy Instruct bot to deploy built artefacts to Stratum 0 and removed bot:deploy Instruct bot to deploy built artefacts to Stratum 0 labels Feb 17, 2024
@trz42
Copy link
Owner Author

trz42 commented Feb 17, 2024

Test deployment with the following settings:

bucket_name = dev-pr254
metadata_prefix = new/${github_repository}/${pull_request_number}
tarball_prefix = tarballs/${legacy_aws_path}

From pyghee.log

Uploading to https://minio.nessi.no:60900/dev-pr254/tarballs//eessi-2023.06-software-linux-aarch64-generic-1708208755.tar.gz
  store tarball at tarballs//eessi-2023.06-software-linux-aarch64-generic-1708208755.tar.gz
  store metadata file at new///eessi-2023.06-software-linux-aarch64-generic-1708208755.tar.gz.meta.txt

So, somehow the expansion did not work (maybe was done too early).

@trz42 trz42 removed the bot:deploy Instruct bot to deploy built artefacts to Stratum 0 label Feb 17, 2024
@trz42 trz42 added the bot:deploy Instruct bot to deploy built artefacts to Stratum 0 label Feb 17, 2024
@trz42
Copy link
Owner Author

trz42 commented Feb 17, 2024

Test deployment with the following settings:

metadata_prefix = new/'${github_repository}'/${pull_request_number}
tarball_prefix = tarballs/'${legacy_aws_path}'

The above worked for the tarball which was stored under

BUCKET/tarballs/VERSION/software/linux/aarch64/generic/1708208755

For the metadata file it failed with

  store metadata file at new/trz42/software-layer//eessi-2023.06-software-linux-aarch64-generic-1708208755.tar.gz.meta.txt
'
err 'upload failed: ../../../../../tmp/tmp.6KykDyK5sA to s3://dev-pr254/new/trz42/software-layer//eessi-2023.06-software-linux-aarch64-generic-1708208755.tar.gz.meta.txt An error occurred (XMinioInvalidObjectName) when calling the PutObject operation: Object name contains unsupported characters.
'
ec '1'

@trz42 trz42 added bot:deploy Instruct bot to deploy built artefacts to Stratum 0 and removed bot:deploy Instruct bot to deploy built artefacts to Stratum 0 labels Feb 17, 2024
@trz42
Copy link
Owner Author

trz42 commented Feb 17, 2024

Test deployment with the following settings:

metadata_prefix = new/'${github_repository}'/'${pull_request_number}'
tarball_prefix = new/'${github_repository}'/'${pull_request_number}'

Works like a charm! 🎉

@trz42 trz42 added bot:deploy Instruct bot to deploy built artefacts to Stratum 0 and removed bot:deploy Instruct bot to deploy built artefacts to Stratum 0 labels Feb 17, 2024
@trz42 trz42 merged commit 7478ce5 into trz42:nessi.no-2023.06 Apr 10, 2024
22 of 30 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bot:deploy Instruct bot to deploy built artefacts to Stratum 0 development
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants