Skip to content

Commit

Permalink
Fix on Llama-3.2-3B-Instruct-gsm8k
Browse files Browse the repository at this point in the history
  • Loading branch information
12010486 authored Feb 7, 2025
1 parent 9b5e48a commit 09b9123
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions examples/text-generation/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -813,7 +813,7 @@ deepspeed --num_gpus 8 run_lm_eval.py \
--tasks winogrande \
-o eval.json
```
Evaluate Llama-3.2-1B-Instruct on 8 Gaudi2 on task GSM8K (CoT), using the BF16 data type:
Evaluate Llama-3.2-3B-Instruct on 8 Gaudi2 on task GSM8K (CoT), using the BF16 data type:
```
deepspeed --num_gpus 8 run_lm_eval.py \
--model_name_or_path meta-llama/Llama-3.2-3B-Instruct \
Expand All @@ -824,7 +824,7 @@ deepspeed --num_gpus 8 run_lm_eval.py \
--sdp_on_bf16 \
--trim_logits \
--batch_size=32 \
--tasks gsm8k_cot \
--tasks gsm8k_cot_llama \
--num_fewshot=8 \
--fewshot_as_multiturn \
--use_chat_template \
Expand Down

0 comments on commit 09b9123

Please sign in to comment.