We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
运行 python3 -u chatglm_service_fastapi.py --host 127.0.0.1 --port 7861 --quantize 4 --device 1,2,3 好几次卡在 starting server... 这一步。卡10分钟也没结果
The text was updated successfully, but these errors were encountered:
根据您反馈的问题做了排查:
THUDM/chatglm-6b-int4
chatglm-6b
Sorry, something went wrong.
No branches or pull requests
运行 python3 -u chatglm_service_fastapi.py --host 127.0.0.1 --port 7861 --quantize 4 --device 1,2,3
好几次卡在 starting server... 这一步。卡10分钟也没结果
The text was updated successfully, but these errors were encountered: