cannot reproduce the baseline score of question answering with transformers v4.19.2

[kumapo]

I tried to reproduce the baseline score with run_squad.py parameters you provided and patched transformers v4.19.2.
but the result score in eval_results.json is quite low compared to the baseline.

    "exact": 42.30076542098154,
    "f1": 42.390814948221525,

based on fune-tuning/README.md, I think you confirmed that transformers v4.19.2 worked.
How was the score then?

I'm attaching the requirements.txt and eval_results.json when I tested with transformers v4.19.2.

[tomohideshibata]

Thank you for your report. I will check it.

Which pretrained model have you used?

[kumapo]

@tomohideshibata

Thank you for quick reply.
I used cl-tohoku/bert-base-japanese-v2.