Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How do you generate predictions on test file? #13

Open
ButteredGroove opened this issue Aug 16, 2019 · 5 comments
Open

How do you generate predictions on test file? #13

ButteredGroove opened this issue Aug 16, 2019 · 5 comments
Assignees

Comments

@ButteredGroove
Copy link

How do I generate predictions from a test file? I've tried each of the following, but all used the dev file instead of the test file:

python3 src/parser.py --predict --outdir ./Indonesian --datadir /gpfs-volume --include id_gsd --ext-word-emb-file ~/embeddings/Indonesian/id.vectors.xz --testfile=/gpfs-volume/UD_Indonesian-GSD/id_gsd-ud-test.conllu
python3 src/parser.py --predict --outdir ./Indonesian --datadir /gpfs-volume --include id_gsd --ext-word-emb-file ~/embeddings/Indonesian/id.vectors.xz --devfile=/gpfs-volume/UD_Indonesian-GSD/id_gsd-ud-test.conllu

I had to rename the test data file as the dev file to generate test predictions. What did I miss?

@mdelhoneux
Copy link
Member

You do not need to use the --include flag when using directly the --trainfile or --testfile options and in fact, doing so ignores your argument to --testfile. This is not great design, will try to fix this.

@mdelhoneux mdelhoneux self-assigned this Aug 16, 2019
@chen955
Copy link

chen955 commented Jan 16, 2020

why yield osentence in Predict of arc_hybrid.py? Is it really predictable?

@mdelhoneux
Copy link
Member

I don't understand your question?

@chen955
Copy link

chen955 commented Jan 17, 2020

I means it looks like only reading tagged label from the dev file when I predict.

@mdelhoneux
Copy link
Member

Ah ok, no, we do predict inside the Predict function, see

child.pred_parent_id = parent.id
and
child.pred_relation = best[0]

in the apply_transition function

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants