Release v1.45.0

[RachaelSTamakloe]

Highlights:

• A3 Ultra GKE blueprints updated to use Kueue 0.10.0 and Jobset 0.7.2 which are now supported.
• Module improvements to support GKE cluster deletion protection, default node pools with shielded instances, latest GKE version in Rapid channel for A3 Ultra clusters, configurable upgrade settings for node pools and managed hyperdisk support.
• Example for running NVIDIA NeMo on a3-ultragpu-8g Slurm clusters

What's Changed

Key New Features 🎉

• Integrating kueue v0.10.0 to enable TAS with rank ordering support by @ighosh98 in Integrating kueue v0.10.0 to enable TAS with rank ordering support #3417
• Add max_distance variable by @alyssa-sm in Add max_distance variable #3413
• Enable hierarchical namespace support in cloud-storage-bucket module by @SwarnaBharathiMantena in Enable hierarchical namespace support in cloud-storage-bucket module #3513
• Add NeMo framework example to a3-Ultra by @akiki-liang0 in Add NeMo framework example to a3-Ultra #3477
• Remove Slurm-GCP v5 modules from Cluster Toolkit, refer modules/README.md
  Remove Slurm-gcp v5 modules and update documentation #3497

Module Improvements 🔨

• Expose cluster deletion protection by @annuay-google in Expose cluster deletion protection #3392
• Parallelstore striping config by @dgouju in Parallelstore striping config #3333
• Make upgrade settings configurable for gke-cluster by @ighosh98 in Make upgrade settings configurable for gke-cluster #3462
• Add kubectl provider in root module for blueprint with GKE cluster module setup by @mohitchaurasia91 in Add kubectl provider in root module for blueprint with GKE cluster module setup #3406
• add GKE support for managed hyperdisk by @chengcongdu in add GKE support for managed hyperdisk #3476
• Add shielded instance config to default pool by @annuay-google in Add shielded instance config to default pool #3507
• Add support for Redhat 7, 8 and 9 to startup-script Anisble by @wiktorn in Add support for Redhat 7, 8 and 9 to startup-script Anisble #3487

Improvements 🛠

• Enable reservations support for kueue integration tests by @ighosh98 in Enable reservations support for kueue integration tests #3424
• Update Kueue TAS Test Definition and add Kueue v0.10.0 toleration by @ighosh98 in Update Kueue TAS Test Definition and add Kueue v0.10.0 toleration #3425
• Update README with GKE parallelstore related example blueprint details by @mohitchaurasia91 in Update README with GKE parallelstore related example blueprint details #3409
• Upgrade a3-ultra to use kueue v0.10.0 by @ighosh98 in Upgrade a3-ultra to use kueue v0.10.0 #3438
• A3 Ultra Integration tests by @ighosh98 in A3 Ultra Integration tests #3453
• Update A3U blueprint to remove commit refs and remove hardcoded network names by @ighosh98 in Update A3U blueprint to remove commit refs and remove hardcoded network names #3456
• Add compact placement validations by @parulbajaj01 in Add compact placement validations #3439
• Allow customization of Parallelstore mounts by @wiktorn in Allow customization of Parallelstore mounts #3144
• Add lifecycle rule to ignore local SSDs by @chajath in Add lifecycle rule to ignore local SSDs #3450
• update a3mega nccl plugin to 1.0.7 and rxdm to 1.0.13_1 by @chengcongdu in update a3mega nccl plugin to 1.0.7 and rxdm to 1.0.13_1 #3466
• Enable optional creation of cloud router/nat for vpcs by @abbas1902 in Enable optional creation of cloud router/nat for vpcs #3499
• Use version prefix in conjunction with release channels by @annuay-google in Use version prefix in conjunction with release channels #3520
• Bump jobset version to 0.7.2 and remove v0.7.1 as valid version by @ankitkinra in Bump jobset version to 0.7.2 and remove v0.7.1 as valid version #3517
• Include MemSpecLimit when calculating defmem by @wiktorn in Include MemSpecLimit when calculating defmem #3300

Deprecations 💤

• Remove slurm-gcp v5 tests by @harshthakkar01 in Remove slurm-gcp v5 tests #3493
• Remove slurm-gcp v5 examples and update documentation by @harshthakkar01 in Remove slurm-gcp v5 examples and update documentation #3494
• Remove Slurm-gcp v5 modules and update documentation by @harshthakkar01 in Remove Slurm-gcp v5 modules and update documentation #3497

Bug fixes 🐞

• Fix GKE parallelstore blueprint name going beyond network char limit by @mohitchaurasia91 in Fix GKE parallelstore blueprint name going beyond network char limit #3432
• Updated ansible playbook test file name by @mohitchaurasia91 in Updated ansible playbook test file name #3433
• TAS Plugin Bug fix by @ighosh98 in TAS Plugin Bug fix #3449
• Update mount-daos.sh by @samskillman in Update mount-daos.sh #3457
• Placement policy null condition checks added by @ighosh98 in Placement policy null condition checks added #3459

New Contributors

• @SwarnaBharathiMantena made their first contribution in a test PR #3377
• @chajath made their first contribution in Fix non-constant format string errors #3451
• @parulbajaj01 made their first contribution in Add compact placement validations #3439

Full Changelog: v1.44.2...v1.45.0

---

This discussion was created from the release Release v1.45.0.