New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

chatglm 失去 function calling 能力 #485

Open

NingRiCheng opened this issue Aug 16, 2024 · 0 comments

NingRiCheng commented Aug 16, 2024

使用 fastllm 导出 chatglm4的int4和int8的模型，启用openai_server服务，能够正常对话。
但是使用openai的调用函数功能 function calling 不返回。请问这个原因是否是模型结构被改变了

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment