Skip to content

Issues: xorbitsai/inference

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

178 Open 1,449 Closed
178 Open 1,449 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

成功加载deepseek 70b大模型，但是推理失败，Exception: [address=0.0.0.0:41759, pid=473846] CUDA error: CUBLAS_STATUS_NOT_INITIALIZED when calling cublasCreate(handle) gpu
#2837 opened Feb 11, 2025 by MOON1234567890A
1 of 3 tasks
v1.x
6
VllM ： NCCLerror: unhandled system error (run withNCCL DEBUG=INFo for details) gpu
#2836 opened Feb 10, 2025 by amzfc
1 of 3 tasks
v1.x
3
kokoro not working
#2835 opened Feb 10, 2025 by Tint0ri
1 of 3 tasks
v1.x
5
升级1.2.1使用docker运行大模型报socket错误 gpu
#2834 opened Feb 10, 2025 by Navichiong
1 of 3 tasks
v1.x
3
通过xinference部署的FLUX.1-dev量化版本Q4_k_s 在dify内调用失败 gpu
#2832 opened Feb 10, 2025 by XiaoCC
1 of 3 tasks
v1.x
4
Failed to load model from file: /data/DeepSeek R1-Distill-Qwen-32B-Q4 K M.gguf
#2830 opened Feb 10, 2025 by thymol-zzw
1 of 3 tasks
v1.x
3
Add support for DeepSeekR1 dynamic quantized model feature
#2829 opened Feb 9, 2025 by caiyuanhangDicp v1.x
1
Starting error for windows. gpu
#2827 opened Feb 9, 2025 by Rongbeixu v1.x
3
Failed to infer device type gpu
#2825 opened Feb 8, 2025 by kingdomad
1 of 3 tasks
v1.x
1
增加deepseek-r1-distill-qwen量化版本的支持 feature
#2824 opened Feb 8, 2025 by kingdomad v1.x
1
Docker运行的xinference V1.2.1 部署F5-tts报错 gpu
#2819 opened Feb 8, 2025 by XiaoCC
1 of 3 tasks
v1.x
2
GPU 不被调用 gpu
#2816 opened Feb 7, 2025 by wilsonlv
1 of 3 tasks
v1.x
2
调用chat接口时不指定max_tokens参数默认返回的tokens长度为1024，怎么发布模型时修改默认配置增加返回tokens长度
#2815 opened Feb 7, 2025 by wangyongpenga v1.x
2
deepseekV3和R1的支持。
#2814 opened Feb 7, 2025 by Return-sudo v1.x
6
windows ModuleNotFoundError: No module named 'quantile' gpu
#2813 opened Feb 7, 2025 by wilsonlv
1 of 3 tasks
v1.x
4
Align Handling of reasoning_content and content for DeepSeek R1 Models with Official API feature help wanted Extra attention is needed
#2812 opened Feb 7, 2025 by autherlj v1.x
8
xinference support lmdeploy deploying deepseek-r1-distill-qwen model feature
#2810 opened Feb 6, 2025 by nikhe v1.x
1
I deployed DeepSeek-R1-Distill-Llama-70B using Xinference, but the output lacks Chain of Thought (CoT).
#2809 opened Feb 6, 2025 by Touchlz
1 of 3 tasks
v1.x
1
Qwen2.5 VL not foung in version 1.2.1
#2808 opened Feb 6, 2025 by fatherplus
1 of 3 tasks
v1.x
1
最新的cpu版本，模型起不来 gpu
#2807 opened Feb 6, 2025 by luofeng0603
1 of 3 tasks
v1.x
Help: 在xinference上运行deepseek-r1-distill-qwen-32b时, 怎么才能让它不返回<think>标签 ? When running on xinference, how can I make it not return the < think > tag?
#2806 opened Feb 6, 2025 by wangyongpenga v1.x
3
使用xinfernece启动DeepSeek-R1-Distill-Qwen-14B时候，通过程序调用接口，发现缺少<think>起始符号，有</think>
#2805 opened Feb 6, 2025 by web3aipro v1.x
5
xinference中不支持deepseek-r1-distill-qwen的函数调用 feature
#2802 opened Feb 5, 2025 by andyzhou1982 v1.x
1
glm_edge_v tensor error gpu
#2801 opened Feb 5, 2025 by ilovesouthpark
1 of 3 tasks
v1.x
建议 支持deepseek-ai/Janus-Pro-7B feature
#2800 opened Feb 5, 2025 by Damonpkl v1.x
ProTip! no:milestone will show everything without a milestone.