Skip to content

Commit

Permalink
train_claim_gpu_num: 4
Browse files Browse the repository at this point in the history
  • Loading branch information
yuiseki committed Mar 29, 2024
1 parent 0256911 commit 3907dcb
Show file tree
Hide file tree
Showing 4 changed files with 4 additions and 4 deletions.
2 changes: 1 addition & 1 deletion recipes/A5000_24GB_x8/coder-dolphin-en.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@ dataset_train_split_test_size: 0.2
lora_r: 8
lora_alpha: 16
lora_dropout: 0.05
train_claim_gpu_num: 3
train_claim_gpu_num: 4
train_per_device_train_batch_size: 8
train_gradient_accumulation_steps: 2
train_num_train_epochs: 4
Expand Down
2 changes: 1 addition & 1 deletion recipes/A5000_24GB_x8/coder-math-ja-wikipedia.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ dataset_train_split_test_size: 0.2
lora_r: 8
lora_alpha: 16
lora_dropout: 0.05
train_claim_gpu_num: 3
train_claim_gpu_num: 4
train_per_device_train_batch_size: 8
train_gradient_accumulation_steps: 2
train_num_train_epochs: 4
Expand Down
2 changes: 1 addition & 1 deletion recipes/A5000_24GB_x8/coder-math-ja.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ dataset_train_split_test_size: 0.2
lora_r: 8
lora_alpha: 16
lora_dropout: 0.05
train_claim_gpu_num: 3
train_claim_gpu_num: 4
train_per_device_train_batch_size: 8
train_gradient_accumulation_steps: 2
train_num_train_epochs: 4
Expand Down
2 changes: 1 addition & 1 deletion recipes/A5000_24GB_x8/coder-wizardlm-en.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -10,7 +10,7 @@ dataset_train_split_test_size: 0.2
lora_r: 8
lora_alpha: 16
lora_dropout: 0.05
train_claim_gpu_num: 3
train_claim_gpu_num: 4
train_per_device_train_batch_size: 8
train_gradient_accumulation_steps: 2
train_num_train_epochs: 4
Expand Down

0 comments on commit 3907dcb

Please sign in to comment.