AirCaption: Subtitle video on Windows & Mac with Whisper.cpp

[kevin2379]

AirCaption allows users to run whisper.cpp locally on Windows & Mac to generate and edit captions for video.

AirCaption.Demo.mp4

Features

• Subtitle video or audio in multiple languages
• Multiple whisper.cpp models (tiny to large)
• Easily edit text and timing of captions
• Merge and split captions
• Import and edit existing caption files
• Export SRT, VTT or TXT files

Technologies

• Whisper.cpp
• Electron
• React
• FFMPEG
• Video.js
• Wavesurfer.js

The software was originally intended for video content producers but seems to be more popular with content consumers who want to caption videos themselves before watching (when subtitles don’t already exist).

Download for free at https://www.aircaption.com/download

Thank you @ggerganov for all the work you’ve put into whisper.cpp. This project would not have been possible without you!

[albertputinjobs]

Can u make a chrome extension which can display live subtitles on top of video ? that would be great!

[lightninglu10]

@albertputinjobs I'm building that right now! Might be done in about 2 weeks or so:

First.Take.on.Twitter_._.@stephenasmith.STILL.believes.Jayson.Tatum.and.Jaylen.Brown.can.win.a.championship.together_.https___t.co_vnJ63kYPWs_._.Twitter.-.30.May.2023.1.mp4

[kevin2379]

@albertputinjobs I think that’s a great idea! Glad to hear @lightninglu10 has already started on that. To run in browser, this would likely need to use the tiny.en or possibly base.en models, and those should work fine for this purpose.

AirCaption is intended more for creating very accurate SRT and VTT files that can be distributed along with videos online. For example, a user could use the medium model which would take longer but might be around 90% accurate, then they can edit to get to 99% accuracy, which is what would typically be required for this purpose.

The next feature on the AirCaption roadmap is support for multiple video projects and a transcribe Queue, so that users can set many videos to transcribe and they will all get done one after another.