This repository has been archived by the owner on Oct 31, 2023. It is now read-only.
how to only compute the perplexity of each paragraph using your language model with local data? #54
Comments
|
Hi, did you finish it？I also want to do something like this, maybe we can discuss this and exchange ideas :) |
Sign up for free
to subscribe to this conversation on GitHub.
Already have an account?
Sign in.
how to only compute the perplexity of each paragraph using your language model with local data? i don't want to use -d to dump data? I have downloaded the Chinese model use make lang=zh dl_lm
The text was updated successfully, but these errors were encountered: