Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Does persisting support CJK language characters? #5

Open
arianneorpilla opened this issue Apr 29, 2021 · 1 comment
Open

Does persisting support CJK language characters? #5

arianneorpilla opened this issue Apr 29, 2021 · 1 comment

Comments

@arianneorpilla
Copy link

arianneorpilla commented Apr 29, 2021

I want to use this library to optimise searching through hundreds of thousands of dictionary entries for my language learning application and I think using a trie will allow me to perform this more efficiently.

I tested building a trie of 200K imported words and it took quite a while but it worked. I can't seem to persist the trie, however. When I import it back with fromFile, I get something similar to Invalid radix-10 number or so. My suspicion is that the encoding or the format of the file used for persistence doesn't quite like that I am including Japanese characters in my trie.

It would be great if I could use this library as it would allow me to support a broad range of custom dictionaries for my application. Cheers!

@AKushWarrior
Copy link
Owner

AKushWarrior commented Apr 29, 2021

Could you give me a list of dysfunctional characters (or character codes) that I could test?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants