We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
modelscope中MSAgent-Bench-中文Agent数据集提到,实验评估包含四个维度: 1.插件调用的准确率:识别api_name后面的是否正确, 2.插件url的准确率:url的地址是否正确 3.插件传入参数的准确率:parameters对应的参数是否正确 4.插件整体的准确率:生成的 function calling是否完全正确,整个json可以被load的格式 请问具体如何实现呢?有没有脚本参考?
modelscope 1.12.0 modelscope-agent 0.4.1 modelscope_studio 0.3.0 Python 3.10.14
None
The text was updated successfully, but these errors were encountered:
lcl6679292
No branches or pull requests
Initial Checks
What happened + What you expected to happen
modelscope中MSAgent-Bench-中文Agent数据集提到,实验评估包含四个维度:
1.插件调用的准确率:识别api_name后面的是否正确,
2.插件url的准确率:url的地址是否正确
3.插件传入参数的准确率:parameters对应的参数是否正确
4.插件整体的准确率:生成的 function calling是否完全正确,整个json可以被load的格式
请问具体如何实现呢?有没有脚本参考?
Versions / Dependencies
modelscope 1.12.0
modelscope-agent 0.4.1
modelscope_studio 0.3.0
Python 3.10.14
Reproduction script
Issue Severity
None
The text was updated successfully, but these errors were encountered: