Skip to content
This repository has been archived by the owner on Oct 16, 2023. It is now read-only.

Run error on run_clm_no_trainer_colossalai_new #14

Open
MikeChenfu opened this issue Dec 15, 2022 · 0 comments
Open

Run error on run_clm_no_trainer_colossalai_new #14

MikeChenfu opened this issue Dec 15, 2022 · 0 comments

Comments

@MikeChenfu
Copy link

Hello, I tried running run_clm_no_trainer_colossalai_new.sh and get the error about Gemini Manager missing process_group. Apart from that, I saw the script doesn't use colossalai_zero.py to define warmup_non_model_data_ratio and gpu_margin_mem_ratio. Appreciate it if you have any suggestion about it.

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant