Use miniaudio for direct decoding flac, mp3, ogg and wav

[data-man]

miniaudio.h taken from mackron/miniaudio@6d5efde. And stb_vorbis.c from nothings/stb@5c20573.
I think miniaudio can be used in many other purposes in the future.
Note: tested in Linux only.

Thank you for the awesome project!

[data-man]

It's very unexpected that there's no reaction at all. Doesn't anyone really want it?

[data-man]

If it can be integrated into the shared library without any additional features

Yes, it is. All OS-specific sound I/O functions are disabled.
But they can be used in the future instead of SDL.

[satmandu]

This looks amazing. Any chance of getting this to work on macos?

[data-man]

This looks amazing. Any chance of getting this to work on macos?

I can't see any problems.
https://github.com/mackron/miniaudio?tab=readme-ov-file#supported-platforms

Windows
macOS, iOS
Linux
FreeBSD / OpenBSD / NetBSD
Android
Raspberry Pi
Emscripten / HTML5

[satmandu]

Does master need to be merged into this? It looks many commits behind. I'd love to try building off of this branch.

[data-man]

Does master need to be merged into this? It looks many commits behind. I'd love to try building off of this branch.

Please try now.

[satmandu]

Thanks! This worked great! I was able to directly decode a .flac file of an old family interview without any additional conversion!

@ggerganov Any chance of getting this reviewed?

[satmandu]

(FYI I ran this branch on a M1 MBP running the current version of macos.)

[ggerganov]

Good job and sorry for the delay. We can use this in the examples, but for now I don't plan to add audio decoding directly into whisper.cpp. It seems better to leave this to the user.

Let's resolve the CI and merge. Later on, if we can completely remove SDL dependency, it would be great. But I am not sure how difficult it would be.

[data-man]

I hope that I've properly corrected all remarks.

[data-man]

Later on, if we can completely remove SDL dependency, it would be great. But I am not sure how difficult it would be.

I think https://github.com/mackron/miniaudio/blob/master/examples/simple_capture.c can be taken as template for audio recording.

[data-man]

miniaudio 0.11.22 was released, so I've updated this PR.

[mrfragger]

I get why libopus isn't included..read the threads. But still way over my head trying to included it in the souce code for whisper.cpp and custom compile miniaudio with opus support.
Anyway to include opus by default? It's the only audio codec I use for audiobooks.

v0.11.22 - 2025-02-24

In the extras folder, the miniaudio_libvorbis.h and miniaudio_libopus.h files have been deprecated. They have been replaced with versions in the extras/decoders folder. They are now split into a separate .c and .h files. The old files still exist for compatibility, but you need to transition over to the new versions. The transition should be trivial. Compile the .c files like a normal source file, and include the .h file like a normal header.