-
Notifications
You must be signed in to change notification settings - Fork 5.2k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
昇腾910B上进行推理时,调不了NPU卡 #6671
Comments
ASCEND_RT_VISIBLE_DEVICE,指定npu显卡是这个 |
改了,但是还是调不了卡 |
有这个 Warning: CAUTION: The operator 'aten::isin.Tensor_Tensor_out' is not currently supported on the NPU backend and will fall back to run on the CPU. This may have performance implications. (function npu_cpu_fallback) 说明已经在调用了呀 |
Reminder
System Info
llamafactory
version: 0.9.2.dev0Reproduction
Others
执行的命令是:ASCEND_RT_VISIBLE_DEVICES=0,1,2,3 llamafactory-cli chat
--model_name_or_path /LLaMA-Factory-main/model/Qwen2-VL-2B-Instruct
--template qwen2_vl
--infer_backend huggingface
The text was updated successfully, but these errors were encountered: