Skip to content

Commit

Permalink
run the tests on 2 GPUs only
Browse files Browse the repository at this point in the history
  • Loading branch information
younesbelkada committed Jan 12, 2024
1 parent 34e4ee7 commit ceedd8d
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions commands/run_dpo.sh
Original file line number Diff line number Diff line change
Expand Up @@ -14,8 +14,7 @@ EXTRA_TRAINING_ARGS="""--use_peft \
"""

# This is a hack to get the number of available GPUs
mapfile -t num_gpus < <(nvidia-smi --format=csv --query-gpu=index | tail -n+2 | wc -l)
NUM_GPUS=${num_gpus[0]}
NUM_GPUS=2

if [[ "${TRL_ACCELERATE_CONFIG}" == "" ]]; then
EXTRA_ACCELERATE_ARGS=""
Expand Down

0 comments on commit ceedd8d

Please sign in to comment.