Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

windows多卡微调 #6667

Closed
1 task done
q872839000 opened this issue Jan 16, 2025 · 1 comment
Closed
1 task done

windows多卡微调 #6667

q872839000 opened this issue Jan 16, 2025 · 1 comment
Labels
solved This problem has been already solved

Comments

@q872839000
Copy link

Reminder

  • I have read the above rules and searched the existing issues.

System Info

windows系统 3张T4显卡

Reproduction

我在另外一台单卡4070上微调是没问题的，正常运行了，但是就是没任何效果，且加载检查点模型时，使用推理方式auto，它是使用CPU加载的，不知道为什么没用上GPU（CUDA环境正常）； 然后我在另外一台三张T4显卡的机器上进行微调，就会报错：Distributed package does not hava NCCLbuilt in，除了换linux机器，还有别的方案吗，或者通过什么配置可以只选择单卡微调。

Others

No response
@q872839000 q872839000 added bug Something isn't working pending This problem is yet to be addressed labels Jan 16, 2025
@hiyouga hiyouga added solved This problem has been already solved and removed bug Something isn't working pending This problem is yet to be addressed labels Jan 17, 2025
@hiyouga
Copy link
Owner

hiyouga commented Jan 17, 2025

set CUDA_VISIBLE_DEVICES=0

@hiyouga hiyouga closed this as completed Jan 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
solved This problem has been already solved
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@hiyouga @q872839000