New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

使用Ollama运行DeepSeek时候，不能启用GPU优化吗？ #1983

Open

nanhuaijin opened this issue Feb 12, 2025 · 0 comments

nanhuaijin commented Feb 12, 2025

终端启动可以通过命令：OLLAMA_GPU_LAYER=metal ollama run deepseek-coder-7b 来启用GPU加速
在ChatBox使用，测试的时候GPU基本保持很低的利用率，而终端启动的GPU利用率会偏高一点，响应也会快一点

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment