Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Machine Translation TFLite Models #42

Open
tulasiram58827 opened this issue Nov 29, 2020 · 4 comments
Open

Machine Translation TFLite Models #42

tulasiram58827 opened this issue Nov 29, 2020 · 4 comments

Comments

@tulasiram58827
Copy link
Contributor

tulasiram58827 commented Nov 29, 2020

Hi all,
From past few weeks with the help of @sayakpaul I worked on creating TFLite models for Text Detection and Recognition. I have also created a Notebook to do end to end OCR inference with a choice to select CRAFT or EAST as text detector and Keras OCR as recognition engine. Thanks to TFLite team for making on device OCR possible.

Although OCR itself is very good use case. But it will be really useful if we extend the OCR to Machine Translation. I really excited to see end to end mobile application for Image translation especially in the context of India(where there are 23 official languages). I will be working on this and will be adding PR to add the project in INPROGRESS section soon.

I am also thinking to extend the OCR to TTS(Text to Speech) where it can be to people of low vision or no vision. I am happy to collaborate on this project if anyone or interested to work.

@sayakpaul you can tag anyone if they may be interested to collaborate in TTS Project.

CC : @khanhlvg

@sayakpaul
Copy link
Contributor

Tagging in @margaretmz and @farmaker47.

@khanhlvg
Copy link

FYI:

  • ML Kit has a Translation API that runs on-device. You may want to compare it with other open-source Machine Translation models and provide an insight on how their performance are compared to each other.
  • TensorFlowTTS is a Text-To-Speech engine by the community and it supports conversion to TFLite.

@tulasiram58827
Copy link
Contributor Author

Thanks @khanhlvg for references.

  • Yes we will compare it.
  • This is actually gold mine. Thank you so much for sharing. I am excited to see integration of OCR models with this TTS .

@sayakpaul
Copy link
Contributor

For TTS, we have this too - https://github.com/mozilla/TTS.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants