Streaming on Android Added to examples for whispercpp #1934
liam-mceneaney
started this conversation in
Show and tell
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
-
Hi everyone! I edited the Android demo to be capable of streaming audio to whisper in 5 second chunks. A lot of kinks to work out and sometimes I have to dump the audio buffer if whisper falls behind. I hope someone can look through my current implementation and point out things I can do better.
Using a converted distil-small.en to ggml model I am achieving about a 2x faster than realtime transcription on an S24 Ultra Below is my repo: https://github.com/liam-mceneaney/androidwhisper.cpp/tree/master
My PR: #1924
If anyone has tested a build with CLBlast let me know if it improves performance!
Beta Was this translation helpful? Give feedback.
All reactions