Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

{2023.06}[foss/2022a] TensorFlow 2.11.0 #346

Conversation

boegel
Copy link
Contributor

@boegel boegel commented Sep 29, 2023

31 out of 70 required modules missing:

* Zip/3.0-GCCcore-11.3.0 (Zip-3.0-GCCcore-11.3.0.eb)
* Eigen/3.4.0-GCCcore-11.3.0 (Eigen-3.4.0-GCCcore-11.3.0.eb)
* protobuf/3.19.4-GCCcore-11.3.0 (protobuf-3.19.4-GCCcore-11.3.0.eb)
* double-conversion/3.2.0-GCCcore-11.3.0 (double-conversion-3.2.0-GCCcore-11.3.0.eb)
* GMP/6.2.1-GCCcore-11.3.0 (GMP-6.2.1-GCCcore-11.3.0.eb)
* Rust/1.60.0-GCCcore-11.3.0 (Rust-1.60.0-GCCcore-11.3.0.eb)
* git/2.36.0-GCCcore-11.3.0-nodocs (git-2.36.0-GCCcore-11.3.0-nodocs.eb)
* Python/3.10.4-GCCcore-11.3.0 (Python-3.10.4-GCCcore-11.3.0.eb)
* pybind11/2.9.2-GCCcore-11.3.0 (pybind11-2.9.2-GCCcore-11.3.0.eb)
* dill/0.3.6-GCCcore-11.3.0 (dill-0.3.6-GCCcore-11.3.0.eb)
* pkgconfig/1.5.5-GCCcore-11.3.0-python (pkgconfig-1.5.5-GCCcore-11.3.0-python.eb)
* hypothesis/6.46.7-GCCcore-11.3.0 (hypothesis-6.46.7-GCCcore-11.3.0.eb)
* Bazel/5.1.1-GCCcore-11.3.0 (Bazel-5.1.1-GCCcore-11.3.0.eb)
* giflib/5.2.1-GCCcore-11.3.0 (giflib-5.2.1-GCCcore-11.3.0.eb)
* Ninja/1.10.2-GCCcore-11.3.0 (Ninja-1.10.2-GCCcore-11.3.0.eb)
* Szip/2.1.1-GCCcore-11.3.0 (Szip-2.1.1-GCCcore-11.3.0.eb)
* flatbuffers/2.0.7-GCCcore-11.3.0 (flatbuffers-2.0.7-GCCcore-11.3.0.eb)
* ICU/71.1-GCCcore-11.3.0 (ICU-71.1-GCCcore-11.3.0.eb)
* JsonCpp/1.9.5-GCCcore-11.3.0 (JsonCpp-1.9.5-GCCcore-11.3.0.eb)
* LMDB/0.9.29-GCCcore-11.3.0 (LMDB-0.9.29-GCCcore-11.3.0.eb)
* NASM/2.15.05-GCCcore-11.3.0 (NASM-2.15.05-GCCcore-11.3.0.eb)
* libjpeg-turbo/2.1.3-GCCcore-11.3.0 (libjpeg-turbo-2.1.3-GCCcore-11.3.0.eb)
* nsync/1.25.0-GCCcore-11.3.0 (nsync-1.25.0-GCCcore-11.3.0.eb)
* protobuf-python/3.19.4-GCCcore-11.3.0 (protobuf-python-3.19.4-GCCcore-11.3.0.eb)
* HDF5/1.12.2-gompi-2022a (HDF5-1.12.2-gompi-2022a.eb)
* SciPy-bundle/2022.05-foss-2022a (SciPy-bundle-2022.05-foss-2022a.eb)
* h5py/3.7.0-foss-2022a (h5py-3.7.0-foss-2022a.eb)
* libpng/1.6.37-GCCcore-11.3.0 (libpng-1.6.37-GCCcore-11.3.0.eb)
* snappy/1.1.9-GCCcore-11.3.0 (snappy-1.1.9-GCCcore-11.3.0.eb)
* networkx/2.8.4-foss-2022a (networkx-2.8.4-foss-2022a.eb)
* TensorFlow/2.11.0-foss-2022a (TensorFlow-2.11.0-foss-2022a.eb)

@eessi-bot
Copy link

eessi-bot bot commented Sep 29, 2023

Instance eessi-bot-citc-aws is configured to build:

  • arch x86_64/generic for repo eessi-2021.12
  • arch x86_64/generic for repo eessi.org-2023.06-compat
  • arch x86_64/generic for repo eessi.io-2023.06-compat
  • arch x86_64/generic for repo eessi-2023.06-software
  • arch x86_64/intel/haswell for repo eessi-2021.12
  • arch x86_64/intel/haswell for repo eessi.org-2023.06-compat
  • arch x86_64/intel/haswell for repo eessi.io-2023.06-compat
  • arch x86_64/intel/haswell for repo eessi-2023.06-software
  • arch x86_64/intel/skylake_avx512 for repo eessi-2021.12
  • arch x86_64/intel/skylake_avx512 for repo eessi.org-2023.06-compat
  • arch x86_64/intel/skylake_avx512 for repo eessi.io-2023.06-compat
  • arch x86_64/intel/skylake_avx512 for repo eessi-2023.06-software
  • arch x86_64/amd/zen2 for repo eessi-2021.12
  • arch x86_64/amd/zen2 for repo eessi.org-2023.06-compat
  • arch x86_64/amd/zen2 for repo eessi.io-2023.06-compat
  • arch x86_64/amd/zen2 for repo eessi-2023.06-software
  • arch x86_64/amd/zen3 for repo eessi-2021.12
  • arch x86_64/amd/zen3 for repo eessi.org-2023.06-compat
  • arch x86_64/amd/zen3 for repo eessi.io-2023.06-compat
  • arch x86_64/amd/zen3 for repo eessi-2023.06-software
  • arch aarch64/generic for repo eessi-2021.12
  • arch aarch64/generic for repo eessi.org-2023.06-compat
  • arch aarch64/generic for repo eessi.io-2023.06-compat
  • arch aarch64/generic for repo eessi-2023.06-software
  • arch aarch64/neoverse_n1 for repo eessi-2021.12
  • arch aarch64/neoverse_n1 for repo eessi.org-2023.06-compat
  • arch aarch64/neoverse_n1 for repo eessi.io-2023.06-compat
  • arch aarch64/neoverse_n1 for repo eessi-2023.06-software
  • arch aarch64/neoverse_v1 for repo eessi-2021.12
  • arch aarch64/neoverse_v1 for repo eessi.org-2023.06-compat
  • arch aarch64/neoverse_v1 for repo eessi.io-2023.06-compat
  • arch aarch64/neoverse_v1 for repo eessi-2023.06-software

@boegel
Copy link
Contributor Author

boegel commented Sep 29, 2023

bot: build repo:eessi-2023.06-software arch:aarch64/neoverse_v1

@eessi-bot
Copy link

eessi-bot bot commented Sep 29, 2023

Updates by the bot instance eessi-bot-citc-aws (click for details)
  • received bot command build repo:eessi-2023.06-software arch:aarch64/neoverse_v1 from boegel

    • expanded format: build repository:eessi-2023.06-software architecture:aarch64/neoverse_v1
  • handling command build repository:eessi-2023.06-software architecture:aarch64/neoverse_v1 resulted in:

@eessi-bot
Copy link

eessi-bot bot commented Sep 29, 2023

New job on instance eessi-bot-citc-aws for architecture aarch64-neoverse_v1 for repository eessi-2023.06-software in job dir /mnt/shared/home/bot/eessi-bot-software-layer/jobs/2023.09/pr_346/7613

date job status comment
Sep 29 14:42:34 UTC 2023 submitted job id 7613 awaits release by job manager
Sep 29 14:42:40 UTC 2023 released job awaits launch by Slurm scheduler
Sep 29 14:56:12 UTC 2023 running job 7613 is running
Sep 29 17:34:43 UTC 2023 finished
😢 FAILURE (click triangle for details)
Details
✅ job output file slurm-7613.out
❌ found message matching ERROR:
❌ found message matching FAILED:
❌ found message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-aarch64-neoverse_v1-1696008619.tar.gzsize: 573 MiB (601190126 bytes)
entries: 75347
modules under 2023.06/software/linux/aarch64/neoverse_v1/modules/all
Bazel/5.1.1-GCCcore-11.3.0.lua
dill/0.3.6-GCCcore-11.3.0.lua
double-conversion/3.2.0-GCCcore-11.3.0.lua
Eigen/3.4.0-GCCcore-11.3.0.lua
flatbuffers/2.0.7-GCCcore-11.3.0.lua
giflib/5.2.1-GCCcore-11.3.0.lua
git/2.36.0-GCCcore-11.3.0-nodocs.lua
GMP/6.2.1-GCCcore-11.3.0.lua
h5py/3.7.0-foss-2022a.lua
HDF5/1.12.2-gompi-2022a.lua
hypothesis/6.46.7-GCCcore-11.3.0.lua
ICU/71.1-GCCcore-11.3.0.lua
JsonCpp/1.9.5-GCCcore-11.3.0.lua
libjpeg-turbo/2.1.3-GCCcore-11.3.0.lua
libpng/1.6.37-GCCcore-11.3.0.lua
LMDB/0.9.29-GCCcore-11.3.0.lua
NASM/2.15.05-GCCcore-11.3.0.lua
networkx/2.8.4-foss-2022a.lua
Ninja/1.10.2-GCCcore-11.3.0.lua
nsync/1.25.0-GCCcore-11.3.0.lua
pkgconfig/1.5.5-GCCcore-11.3.0-python.lua
protobuf/3.19.4-GCCcore-11.3.0.lua
protobuf-python/3.19.4-GCCcore-11.3.0.lua
pybind11/2.9.2-GCCcore-11.3.0.lua
Python/3.10.4-GCCcore-11.3.0.lua
Rust/1.60.0-GCCcore-11.3.0.lua
SciPy-bundle/2022.05-foss-2022a.lua
snappy/1.1.9-GCCcore-11.3.0.lua
Szip/2.1.1-GCCcore-11.3.0.lua
Zip/3.0-GCCcore-11.3.0.lua
software under 2023.06/software/linux/aarch64/neoverse_v1/software
Bazel/5.1.1-GCCcore-11.3.0
dill/0.3.6-GCCcore-11.3.0
double-conversion/3.2.0-GCCcore-11.3.0
Eigen/3.4.0-GCCcore-11.3.0
flatbuffers/2.0.7-GCCcore-11.3.0
giflib/5.2.1-GCCcore-11.3.0
git/2.36.0-GCCcore-11.3.0-nodocs
GMP/6.2.1-GCCcore-11.3.0
h5py/3.7.0-foss-2022a
HDF5/1.12.2-gompi-2022a
hypothesis/6.46.7-GCCcore-11.3.0
ICU/71.1-GCCcore-11.3.0
JsonCpp/1.9.5-GCCcore-11.3.0
libjpeg-turbo/2.1.3-GCCcore-11.3.0
libpng/1.6.37-GCCcore-11.3.0
LMDB/0.9.29-GCCcore-11.3.0
NASM/2.15.05-GCCcore-11.3.0
networkx/2.8.4-foss-2022a
Ninja/1.10.2-GCCcore-11.3.0
nsync/1.25.0-GCCcore-11.3.0
pkgconfig/1.5.5-GCCcore-11.3.0-python
protobuf/3.19.4-GCCcore-11.3.0
protobuf-python/3.19.4-GCCcore-11.3.0
pybind11/2.9.2-GCCcore-11.3.0
Python/3.10.4-GCCcore-11.3.0
Rust/1.60.0-GCCcore-11.3.0
SciPy-bundle/2022.05-foss-2022a
snappy/1.1.9-GCCcore-11.3.0
Szip/2.1.1-GCCcore-11.3.0
Zip/3.0-GCCcore-11.3.0
other under 2023.06/software/linux/aarch64/neoverse_v1
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp

@boegel
Copy link
Contributor Author

boegel commented Sep 30, 2023

Same problem as in #343 :

/tmp/eb-esitnstn/eb-vmjuzsmj/eb-eoggyst1/eb-1a_l2ddk/tmpag2kz9yq/rpath_wrappers/gcc_wrapper/gcc -U_FORTIFY_SOURCE -fstack-protector -Wall -Wunused-but-set-parameter -Wno-free-nonheap-object -fno-omit-frame-pointer -g0 -O2 '-D_FORTIFY_SOURCE=1' -DNDEBUG -ffunction-sections -fdata-sections -MD -MF bazel-out/aarch64-opt/bin/external/XNNPACK/_objs/asm_microkernels/3/4x16c4-minmax-rndnu-aarch64-neondot-ld128.pic.d -fPIC -iquote external/XNNPACK -iquote bazel-out/aarch64-opt/bin/external/XNNPACK -isystem external/XNNPACK/include -isystem bazel-out/aarch64-opt/bin/external/XNNPACK/include -isystem external/XNNPACK/src -isystem bazel-out/aarch64-opt/bin/external/XNNPACK/src -Wno-all -Wno-extra -Wno-deprecated -Wno-deprecated-declarations -Wno-ignored-attributes -Wno-unknown-warning -Wno-array-parameter -Wno-stringop-overflow -Wno-array-bounds -Wunused-result '-Werror=unused-result' -DAUTOLOAD_DYNAMIC_KERNELS -O2 -ftree-vectorize '-mcpu=native' -fno-math-errno -fPIC -fPIC -Iinclude -Isrc '-march=armv8.2-a+fp16+dotprod' -O2 -fno-canonical-system-headers -Wno-builtin-macro-redefined '-D__DATE__="redacted"' '-D__TIMESTAMP__="redacted"' '-D__TIME__="redacted"' -c external/XNNPACK/src/qu8-igemm/gen/4x16c4-minmax-rndnu-aarch64-neondot-ld128.S -o bazel-out/aarch64-opt/bin/external/XNNPACK/_objs/asm_microkernels/3/4x16c4-minmax-rndnu-aarch64-neondot-ld128.pic.o)
# Configuration: a224c8afb49181e93a8e149806f65517774524036a5f02c72227e226f6d6f67c
# Execution platform: @local_execution_config_platform//:platform
cc1: warning: switch '-mcpu=zeus+crypto+sha3+sm4+nodotprod+noprofile+nopauth' conflicts with '-march=armv8.2-a+fp16+dotprod' switch
cc1: note: unrecognized command-line option '-Wno-unknown-warning' may have been intended to silence earlier diagnostics
external/XNNPACK/src/qu8-igemm/gen/4x16c4-minmax-rndnu-aarch64-neondot-ld128.S: Assembler messages:
external/XNNPACK/src/qu8-igemm/gen/4x16c4-minmax-rndnu-aarch64-neondot-ld128.S:123: Error: selected processor does not support `udot v12.4s,v8.16b,v0.16b'

@boegel
Copy link
Contributor Author

boegel commented Sep 30, 2023

There are also 18 failing tests (out of 35441) for scipy 1.8.1, but the test command is still existing with zero exit code...

FAILED optimize/tests/test_linprog.py::TestLinprogIPSparse::test_bug_6139 - A...
FAILED optimize/tests/test_linprog.py::TestLinprogIPSparsePresolve::test_bug_6139
FAILED optimize/tests/test_optimize.py::test_equal_bounds[None-constraints3-<lambda>-kwds0-SLSQP]
FAILED optimize/tests/test_optimize.py::test_equal_bounds[None-constraints3-Bounds-kwds0-SLSQP]
FAILED optimize/tests/test_optimize.py::test_equal_bounds[None-constraints5-<lambda>-kwds0-SLSQP]
FAILED optimize/tests/test_optimize.py::test_equal_bounds[None-constraints5-<lambda>-kwds1-SLSQP]
FAILED optimize/tests/test_optimize.py::test_equal_bounds[None-constraints5-<lambda>-kwds2-SLSQP]
FAILED optimize/tests/test_optimize.py::test_equal_bounds[None-constraints5-Bounds-kwds0-SLSQP]
FAILED optimize/tests/test_optimize.py::test_equal_bounds[None-constraints5-Bounds-kwds1-SLSQP]
FAILED optimize/tests/test_optimize.py::test_equal_bounds[None-constraints5-Bounds-kwds2-SLSQP]
FAILED optimize/tests/test_optimize.py::test_equal_bounds[callback-constraints3-<lambda>-kwds0-SLSQP]
FAILED optimize/tests/test_optimize.py::test_equal_bounds[callback-constraints3-Bounds-kwds0-SLSQP]
FAILED optimize/tests/test_optimize.py::test_equal_bounds[callback-constraints5-<lambda>-kwds0-SLSQP]
FAILED optimize/tests/test_optimize.py::test_equal_bounds[callback-constraints5-<lambda>-kwds1-SLSQP]
FAILED optimize/tests/test_optimize.py::test_equal_bounds[callback-constraints5-<lambda>-kwds2-SLSQP]
FAILED optimize/tests/test_optimize.py::test_equal_bounds[callback-constraints5-Bounds-kwds0-SLSQP]
FAILED optimize/tests/test_optimize.py::test_equal_bounds[callback-constraints5-Bounds-kwds1-SLSQP]
FAILED optimize/tests/test_optimize.py::test_equal_bounds[callback-constraints5-Bounds-kwds2-SLSQP]
= 18 failed, 35441 passed, 2756 skipped, 11452 deselected, 104 xfailed, 11 xpassed, 34 warnings in 391.16s (0:06:31) =

@boegel
Copy link
Contributor Author

boegel commented Sep 30, 2023

bot: build repo:eessi-2023.06-software arch:x86_64/amd/zen2

@eessi-bot
Copy link

eessi-bot bot commented Sep 30, 2023

Updates by the bot instance eessi-bot-citc-aws (click for details)
  • received bot command build repo:eessi-2023.06-software arch:x86_64/amd/zen2 from boegel

    • expanded format: build repository:eessi-2023.06-software architecture:x86_64/amd/zen2
  • handling command build repository:eessi-2023.06-software architecture:x86_64/amd/zen2 resulted in:

@eessi-bot
Copy link

eessi-bot bot commented Sep 30, 2023

New job on instance eessi-bot-citc-aws for architecture x86_64-amd-zen2 for repository eessi-2023.06-software in job dir /mnt/shared/home/bot/eessi-bot-software-layer/jobs/2023.09/pr_346/7617

date job status comment
Sep 30 08:20:51 UTC 2023 submitted job id 7617 awaits release by job manager
Sep 30 08:21:54 UTC 2023 released job awaits launch by Slurm scheduler
Sep 30 08:25:58 UTC 2023 running job 7617 is running
Sep 30 17:41:41 UTC 2023 finished
😁 SUCCESS (click triangle for details)
Details
✅ job output file slurm-7617.out
✅ no message matching ERROR:
✅ no message matching FAILED:
✅ no message matching required modules missing:
✅ found message(s) matching No missing installations
✅ found message matching .tar.gz created!
Artefacts
eessi-2023.06-software-linux-x86_64-amd-zen2-1696095508.tar.gzsize: 866 MiB (908878123 bytes)
entries: 95125
modules under 2023.06/software/linux/x86_64/amd/zen2/modules/all
Bazel/5.1.1-GCCcore-11.3.0.lua
dill/0.3.6-GCCcore-11.3.0.lua
double-conversion/3.2.0-GCCcore-11.3.0.lua
Eigen/3.4.0-GCCcore-11.3.0.lua
flatbuffers/2.0.7-GCCcore-11.3.0.lua
giflib/5.2.1-GCCcore-11.3.0.lua
git/2.36.0-GCCcore-11.3.0-nodocs.lua
GMP/6.2.1-GCCcore-11.3.0.lua
h5py/3.7.0-foss-2022a.lua
HDF5/1.12.2-gompi-2022a.lua
hypothesis/6.46.7-GCCcore-11.3.0.lua
ICU/71.1-GCCcore-11.3.0.lua
JsonCpp/1.9.5-GCCcore-11.3.0.lua
libjpeg-turbo/2.1.3-GCCcore-11.3.0.lua
libpng/1.6.37-GCCcore-11.3.0.lua
LMDB/0.9.29-GCCcore-11.3.0.lua
NASM/2.15.05-GCCcore-11.3.0.lua
networkx/2.8.4-foss-2022a.lua
Ninja/1.10.2-GCCcore-11.3.0.lua
nsync/1.25.0-GCCcore-11.3.0.lua
pkgconfig/1.5.5-GCCcore-11.3.0-python.lua
protobuf/3.19.4-GCCcore-11.3.0.lua
protobuf-python/3.19.4-GCCcore-11.3.0.lua
pybind11/2.9.2-GCCcore-11.3.0.lua
Python/3.10.4-GCCcore-11.3.0.lua
Rust/1.60.0-GCCcore-11.3.0.lua
SciPy-bundle/2022.05-foss-2022a.lua
snappy/1.1.9-GCCcore-11.3.0.lua
Szip/2.1.1-GCCcore-11.3.0.lua
TensorFlow/2.11.0-foss-2022a.lua
Zip/3.0-GCCcore-11.3.0.lua
software under 2023.06/software/linux/x86_64/amd/zen2/software
Bazel/5.1.1-GCCcore-11.3.0
dill/0.3.6-GCCcore-11.3.0
double-conversion/3.2.0-GCCcore-11.3.0
Eigen/3.4.0-GCCcore-11.3.0
flatbuffers/2.0.7-GCCcore-11.3.0
giflib/5.2.1-GCCcore-11.3.0
git/2.36.0-GCCcore-11.3.0-nodocs
GMP/6.2.1-GCCcore-11.3.0
h5py/3.7.0-foss-2022a
HDF5/1.12.2-gompi-2022a
hypothesis/6.46.7-GCCcore-11.3.0
ICU/71.1-GCCcore-11.3.0
JsonCpp/1.9.5-GCCcore-11.3.0
libjpeg-turbo/2.1.3-GCCcore-11.3.0
libpng/1.6.37-GCCcore-11.3.0
LMDB/0.9.29-GCCcore-11.3.0
NASM/2.15.05-GCCcore-11.3.0
networkx/2.8.4-foss-2022a
Ninja/1.10.2-GCCcore-11.3.0
nsync/1.25.0-GCCcore-11.3.0
pkgconfig/1.5.5-GCCcore-11.3.0-python
protobuf/3.19.4-GCCcore-11.3.0
protobuf-python/3.19.4-GCCcore-11.3.0
pybind11/2.9.2-GCCcore-11.3.0
Python/3.10.4-GCCcore-11.3.0
Rust/1.60.0-GCCcore-11.3.0
SciPy-bundle/2022.05-foss-2022a
snappy/1.1.9-GCCcore-11.3.0
Szip/2.1.1-GCCcore-11.3.0
TensorFlow/2.11.0-foss-2022a
Zip/3.0-GCCcore-11.3.0
other under 2023.06/software/linux/x86_64/amd/zen2
.lmod/cache/spiderT.lua
.lmod/cache/spiderT.luac_5.1
.lmod/cache/timestamp

@boegel
Copy link
Contributor Author

boegel commented Oct 2, 2023

I've opened a dedicated issue in the EasyBuild repo for the problem on aarch64/*, since this is in no way specific to EESSI: easybuilders/easybuild-easyconfigs#18899

@boegel boegel changed the base branch from 2023.06 to pilot.eessi-hpc.org-2023.06 November 21, 2023 21:19
@bedroge
Copy link
Collaborator

bedroge commented Apr 16, 2024

Closing this PR, because it's targeting the now unsupported pilot repository.

@bedroge bedroge closed this Apr 16, 2024
trz42 added a commit to TopRichard/bot-software-layer1 that referenced this pull request May 4, 2024
…WARE_SUBDIR_OVERRIDE

make sure that software directory that corresponds to $EESSI_SOFTWARE_SUBDIR_OVERRIDE exists
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants