You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
This repository has been archived by the owner on Oct 16, 2023. It is now read-only.
Hello, I tried running run_clm_no_trainer_colossalai_new.sh and get the error about Gemini Manager missing process_group. Apart from that, I saw the script doesn't use colossalai_zero.py to define warmup_non_model_data_ratio and gpu_margin_mem_ratio. Appreciate it if you have any suggestion about it.
The text was updated successfully, but these errors were encountered:
Sign up for freeto subscribe to this conversation on GitHub.
Already have an account?
Sign in.
Hello, I tried running run_clm_no_trainer_colossalai_new.sh and get the error about
Gemini Manager missing process_group
. Apart from that, I saw the script doesn't use colossalai_zero.py to definewarmup_non_model_data_ratio
andgpu_margin_mem_ratio
. Appreciate it if you have any suggestion about it.The text was updated successfully, but these errors were encountered: