We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
root@ecs-50958108:/workspace/train/LLaMA-Factory# llamafactory-cli env [2025-01-15 08:20:32,880] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
llamafactory
sh文件
model_name_or_path: /dataNfs/pre-trained/MiniCPM-V-2_6 trust_remote_code: true
stage: sft do_train: true finetuning_type: lora lora_target: all
dataset_dir: data dataset: mllm_demo # video: mllm_video_demo template: minicpm_v cutoff_len: 32000 max_samples: 10000 overwrite_cache: true preprocessing_num_workers: 16 image_resolution: 1003520
output_dir: /dataNfs/checkpoint/visual/MiniCPM-V-2_6/test logging_steps: 500 save_steps: 2000 plot_loss: true overwrite_output_dir: true
per_device_train_batch_size: 1 gradient_accumulation_steps: 1 learning_rate: 1.0e-4 num_train_epochs: 3.0 lr_scheduler_type: cosine warmup_ratio: 0.1 bf16: true ddp_timeout: 180000000
#val_size: 0.1 #per_device_eval_batch_size: 1 #eval_strategy: steps #eval_steps: 500
报错 使用的是给定的mllm_demo数据 是否数据格式不兼容还是什么原因 望解答 谢谢
No response
The text was updated successfully, but these errors were encountered:
手动更新模型文件 https://huggingface.co/openbmb/MiniCPM-V-2_6/blob/main/modeling_minicpmv.py
Sorry, something went wrong.
更新后可以了 再请教一下 出现这三个警告是否有影响 因为我使用qwen2vl时没有出现过这种警告
没有
No branches or pull requests
Reminder
System Info
root@ecs-50958108:/workspace/train/LLaMA-Factory# llamafactory-cli env
[2025-01-15 08:20:32,880] [INFO] [real_accelerator.py:222:get_accelerator] Setting ds_accelerator to cuda (auto detect)
llamafactory
version: 0.9.2.dev0Reproduction
sh文件
model
model_name_or_path: /dataNfs/pre-trained/MiniCPM-V-2_6
trust_remote_code: true
method
stage: sft
do_train: true
finetuning_type: lora
lora_target: all
dataset
dataset_dir: data
dataset: mllm_demo # video: mllm_video_demo
template: minicpm_v
cutoff_len: 32000
max_samples: 10000
overwrite_cache: true
preprocessing_num_workers: 16
image_resolution: 1003520
output
output_dir: /dataNfs/checkpoint/visual/MiniCPM-V-2_6/test
logging_steps: 500
save_steps: 2000
plot_loss: true
overwrite_output_dir: true
train
per_device_train_batch_size: 1
gradient_accumulation_steps: 1
learning_rate: 1.0e-4
num_train_epochs: 3.0
lr_scheduler_type: cosine
warmup_ratio: 0.1
bf16: true
ddp_timeout: 180000000
eval
#val_size: 0.1
#per_device_eval_batch_size: 1
#eval_strategy: steps
#eval_steps: 500
报错

使用的是给定的mllm_demo数据 是否数据格式不兼容还是什么原因 望解答 谢谢
Others
No response
The text was updated successfully, but these errors were encountered: