From d59b1afce0416054af4dc958caa3337bc235c6b2 Mon Sep 17 00:00:00 2001 From: Howard Huang Date: Wed, 25 Sep 2024 19:53:56 -0700 Subject: [PATCH] Update base for Update on "[WIP] zero bubble" To run zb test: `python test_runner.py ./test_out --test pp_zb` internal mast run: ` torchx run mast.py:train --additional_folders /home/howardhuang/local/torchtitan --twtask_bootstrap_script run_torchtitan.sh --h "grandteton" --nodes 8 train_configs/debug_model_3d_mast.toml ` [ghstack-poisoned]