Skip to content

Commit

Permalink
[Example] Fix llm_finetune example json part
Browse files Browse the repository at this point in the history
  • Loading branch information
chongxiaoc committed Jul 13, 2023
1 parent 60f1416 commit bcdf349
Showing 1 changed file with 7 additions and 6 deletions.
13 changes: 7 additions & 6 deletions examples/llm_finetuning/train_imdb_ray.py
Original file line number Diff line number Diff line change
Expand Up @@ -11,17 +11,18 @@
- name: review
type: text
encoder:
type: auto_transformer
pretrained_model_name_or_path: bigscience/bloom-3b
trainable: true
adapter: lora
output_features:
- name: sentiment
type: category
model_type: llm
base_model: bigscience/bloom-3b
adapter:
type: lora
trainer:
type: finetune
batch_size: 4
epochs: 3
Expand Down

0 comments on commit bcdf349

Please sign in to comment.