Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How to use it to test models? #1

Open
cyzhh opened this issue Mar 6, 2024 · 1 comment
Open

How to use it to test models? #1

cyzhh opened this issue Mar 6, 2024 · 1 comment

Comments

@cyzhh
Copy link

cyzhh commented Mar 6, 2024

Hello, I feel that your github is very difficult to use. The eval.py type ”bai-scieval-valid.json“ does not have this file. In addition, can you improve your README file to better test other open source models such as ChatGLM?

@Sunliangtai
Copy link
Collaborator

Sorry for the llllllllate reply, since this is the official github account of our lab, I didn't receive your question via email in time. Thanks a lot! I have modified eval.py and fix the bug you mentioned. To test other open source models, you can evaluate using scieval-test.json and then upload the results to our website.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants