New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Not able to replicate result available in readme #160

Open

Shailendra77 opened this issue Mar 17, 2021 · 0 comments

Shailendra77 commented Mar 17, 2021 •

edited

Loading

Using following commands for prediction

python3 run_ner.py --do_train=false --do_predict=true --do_eval=true --vocab_file=$BIOBERT_DIR/vocab.txt --bert_config_file=$BIOBERT_DIR/bert_config.json --init_checkpoint=$BIOBERT_DIR/model.ckpt-1000000 --num_train_epochs=10.0 --data_dir=$NER_DIR --output_dir=$OUTPUT_DIR

python3 biocodes/ner_detokenize.py --token_test_path=$OUTPUT_DIR/token_test.txt --label_test_path=$OUTPUT_DIR/label_test.txt --answer_path=$NER_DIR/test.tsv --output_dir=$OUTPUT_DIR

perl biocodes/conlleval.pl < $OUTPUT_DIR/NER_result_conll.txt

Also tried with fine tuning and different dataset (NCBI disease, BC4CHEMD, BC2GM) but not able to achieve same accuracy

Shailendra77 changed the title ~~Not able to replicate result available in readmi~~ Not able to replicate result available in readme

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment