Streaming on Android Added to examples for whispercpp #1934
liam-mceneaney
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
Hi everyone! I edited the Android demo to be capable of streaming audio to whisper in 5 second chunks. A lot of kinks to work out and sometimes I have to dump the audio buffer if whisper falls behind. I hope someone can look through my current implementation and point out things I can do better.
Using a converted distil-small.en to ggml model I am achieving about a 2x faster than realtime transcription on an S24 Ultra Below is my repo: https://github.com/liam-mceneaney/androidwhisper.cpp/tree/master
My PR: #1924
If anyone has tested a build with CLBlast let me know if it improves performance!
Beta Was this translation helpful? Give feedback.
All reactions