Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

关于模型评估 #593

Open
Da1zheng opened this issue Oct 12, 2024 · 1 comment
Open

关于模型评估 #593

Da1zheng opened this issue Oct 12, 2024 · 1 comment
Labels
question Further information is requested

Comments

@Da1zheng
Copy link

作者您好,我使用IEPile数据集切分出来部分数据作为测试集,测试结果经过推理脚本保存在results目录。

现在我想对这些测试结果(格式包含task,source,instruction,output字段)使用评估脚本eval_func.py进行评估,但是数据格式不正确(缺少id字段)导致评估脚本不能正常运行。请问怎么对IEPile切分出来的测试集进行评估呢

image

@Da1zheng Da1zheng added the question Further information is requested label Oct 12, 2024
@guihonghao
Copy link
Contributor

正常使用下面代码生成的测试指令数据带有id字段。--split test

python ie2instruction/convert_func.py \
    --src_path data/NER/sample.json \
    --tgt_path data/NER/test.json \
    --schema_path data/NER/schema.json \
    --language zh \
    --task NER \
    --split_num 6 \
    --split test

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
question Further information is requested
Projects
None yet
Development

No branches or pull requests

2 participants