VLC player demos real-time AI subtitling for videos

bnew

Veteran
Joined
Nov 1, 2015
Messages
60,145
Reputation
9,006
Daps
166,220


VideoLAN shows off the creation and translation of subtitles in more than 100 languages, all offline.​


By Dominic Preston, a news editor with over a decade’s experience in journalism. He previously worked at Android Police and Tech Advisor.

Jan 9, 2025, 9:07 AM EST

The VideoLAN traffic cone icon

Image: VideoLAN

The popular open-source VLC video player was demonstrated on the floor of CES 2025 with automatic AI subtitling and translation, generated locally and offline in real time. Parent organization VideoLAN shared a video on Tuesday in which president Jean-Baptiste Kempf shows off the new feature, which uses open-source AI models to generate subtitles for videos in several languages.

“At the same time we have automatic translation working to translate the subtitles to your own language,” Kempf says, with more than 100 languages planned for support. “What’s important is that this is running on your machine locally, offline, without any cloud services. It runs directly inside the executable.”

VLC automatic subtitles generation and translation based on local and open source AI models running on your machine working offline, and supporting numerous languages!

Demo can be found on our #CES2025 booth in Eureka Park. pic.twitter.com/UVmgT6K4ds

— VideoLAN (@videolan) January 8, 2025

AI-powered subtitling has been under development for some time in the form of a plug-in using OpenAI’s speech recognition system Whisper, but this new demo appears to be built directly into the VLC app and generates translated subtitles in real time. There’s no word on when the feature will roll out.

This week, VideoLAN also celebrated hitting 6 billion downloads, with Kempf boasting, “The number of active users of VLC is actually growing, even in this age of streaming services.”

With CES 2025 still in full swing, we’ll track VideoLAN down on the show floor to see the AI subtitling in action for ourselves.
 

bnew

Veteran
Joined
Nov 1, 2015
Messages
60,145
Reputation
9,006
Daps
166,220













1/81
@videolan
VLC automatic subtitles generation and translation based on local and open source AI models running on your machine working offline, and supporting numerous languages!
Demo can be found on our /search?q=#CES2025 booth in Eureka Park.



https://video.twimg.com/ext_tw_video/1877070093605122048/pu/vid/avc1/480x848/Hi51dz0a2LSv6Yly.mp4

2/81
@videolan
Demos of the subtitles generation in Hebrew and German here.



Ggy0D-AWYAAW-H-.jpg

Ggy0FWKWwAABKtj.jpg


3/81
@videolan
Japanese and French too.



Ggy3XthXoAAIDE2.jpg

Ggy3XtiWgAAOChL.jpg


4/81
@MarkMann447
What languages are supported?



5/81
@videolan
For detection (audio) or generation (subtitles)?



6/81
@jessyseonoob
hmmm can we have automatic voice AI translation !!!



7/81
@videolan
Of course.



8/81
@Entropie34
I bet it's very computationally intensive to run a decent STT coupled with an LLM/NLP translation model in real time locally. It would be better to handle it via the cloud to make it more accessible to the general public



9/81
@videolan
Absolutely not! The goal is to not depend on an expensive cloud operation!



10/81
@DeezNutsElite
Does this mean we can watch any Anime or Japanese Obstacle Course show with English Sub?!



11/81
@videolan
Probably, yes.



12/81
@PELock
What is your business model? Just curious :smile:



13/81
@videolan
None.



14/81
@RaduUrsache
how about a modern UI? its not 2001 anymore



15/81
@videolan
Which OS?



16/81
@AlexLandherr
Could this be applied to generate a subtitle track as e.g. an SRT file that could then be merged with the corresponding video file?

This would be great for people that need subtitles like “English SDH” when there aren’t any available.



17/81
@videolan
Yes



18/81
@AlexLandherr
How good is the synchronization for e.g. an episode of a TV show?

I have old TV episodes with excellent video and audio that lacks any subtitles.



19/81
@videolan
Send it to us, and we can test!



20/81
@MrRoja1
How do you guys make money?
Thanks a lot for serving us in the last almost 20 years.



21/81
@videolan
We don’t



22/81
@abd9l
C'est généré en temps réel ou alors y'a une phase de processing en amont ?



23/81
@videolan
Temps réel !



24/81
@BeggarBucks
Great work if it's built in, real-time, and auto language detection. I need to use subtitle edit to generate and embed the subtitles so I can stream it to other devices.



Gg1xX-NXcAA-byO.png


25/81
@saoulidisg
Gimme



26/81
@vdecrypto
Great!!



27/81
@vanrohan776
Next step is automatic dubbing!



28/81
@jerflash
Hey! I missed CES this year but this is legit awesome! Def need to check this out



29/81
@troysimpson
super cool



30/81
@rafaelrlevy
Love it! When will it be available on the app?



31/81
@3unjee
Good stuff /search?q=#VideolabsDaily



32/81
@Yevgen_nft
is it filmed on android?)



33/81
@Ratuno_Aoi
The end of fansubs?



34/81
@manueleyno
When release?



35/81
@Jaynoco
VLC, Audacity, and Blender, among many others… deserve medals of the highest honor… For their work in providing free solutions to computer users.

After all these years they continue to provide.



36/81
@IainToft
@rickygervais 🤣 no greater work has been subtitled



37/81
@watashytotoro
Wooow. I mean wow. Please please tell us more. Well done guys.



38/81
@_Vicos_
Hello, i have a specific question if a video is captured via lan etc and reproduced on vlc at the same time, ai will work and generate subs or translate ? When is it available?



39/81
@Visaa_16
AI features that are actually useful. Great stuff; good work by the team.



40/81
@lazyhumanbeing3
One of the most favourite software for users over the years. Non-profit, didn’t add any useless features to make VLC slow. And now adding AI subtitles and translations. 🔥🔥 ❤️❤️



41/81
@Blaq_Mo
Impressive



42/81
@wei_b0
Ayo we got AI in VLC before GTA 6!!!!!



43/81
@feverqqq
I have been waiting for this so long. Much excite



44/81
@frdysk
The one who took this video need some lens cleaning lesson



45/81
@TragicWarrior
This is awesome! Well done VLC team!



46/81
@snekstep
That is awesome! I desperately need this in @KodiTV as well



47/81
@mysticaltech
Amazing use of open-source AI, well done!



48/81
@guillaumemeyer
Amazing! Any published doc to try this @videolan ?



49/81
@harishkgarg
this is amazing.

is it available to use in the product right away?



50/81
@canary_earth
Are the new Samsung TVs using your software? They're demoing live subtitles at their CES booth too.



51/81
@sofhia_v1
That sounds like a game changer for accessibility! Offline AI models could really enhance user experience. Excited to see it in action at CES!



52/81
@ChrisHa93378389
Badass. @LordMeepTheTndi



53/81
@101radek
all my problems are solved now



54/81
@short_straw
Wildly disappointing. Why participate in this exploitation if you're not even getting paid?..



55/81
@Sauram228
broooo!!
win win win!!

VLC ftw!



56/81
@WellKnitTech
I've been developing a transcription script based on OpenAI Whisper. Can you tell me I can use VLC instead?



57/81
@DFintelligence
Quel bande de génie. Mais bon les gars j'arrive au stand on va refaire la vidéo en nettoyant la lentille du tel ok?



58/81
@dwjorgeb
VLC is the OG 🚀



59/81
@majdoubTn
Even for live feed?



60/81
@Luffy_liberal_
I faking love you guys



61/81
@heruhermawan
Wait, subtitles & translations powered by local AI—all offline?

This is the dream combo of privacy, accessibility, and innovation.

Can't wait to see it in action!



62/81
@KazakhstanBorat
sweet jesus yes



63/81
@jetha
This looks great! Has the feature shipped yet? Would love to see how Gemma deals with it.



64/81
@Seattleyachts
Omg omg omg you have a CES booth! Yay. VLC has been my favorite app for a long time. So excited for what's to come!



65/81
@TeslaSpacexfan
❤️❤️



66/81
@ULTRAK1LL3R
VLC is an OG



67/81
@zast57
Felicitation pour cette future fonctionnalité. Y a t il déjà une date de sortie ? (Beta ou release officielle)



68/81
@victorbayas
Was this recorded with the same camera as ovni videos?



69/81
@Weyrsy
Comment ça c'est français



70/81
@ckmontague
Let's Go!!!! 🤙❤️🎉



71/81
@DANNYonPC
👀



72/81
@vividmotionEN
VLC should be in an internet hall of fame at this point



73/81
@jfcarpio
We love you, VLC.



74/81
@dafr0g_
finally, some useful stuff coming out of CES. keep being awesome!



75/81
@alicodermaker
This is amazing. What models are you using for this local LLM?



76/81
@iTetraGG
Impressionnant et plutôt promettant, par contre faut penser à nettoyer l'objectif pour la prochaine



77/81
@realRayLin
vlc is here 👀



78/81
@ahrishikesh
Great work and hope someday you can generate voice itself instead of just subtitles in other languages



79/81
@l0gix5
Niccccceeew. wow



80/81
@danesz
Really nice! I also built a Chrome extension (still in PoC phase) which does the same thing in Chrome for the subtitles in the video element AI-based video subtitle translator



81/81
@umutkalbim95
Will you release a beta version to try?




To post tweets in this format, more info here: https://www.thecoli.com/threads/tips-and-tricks-for-posting-the-coli-megathread.984734/post-52211196
 

Double Burger With Cheese

Veteran
Supporter
Joined
May 6, 2012
Messages
26,801
Reputation
16,555
Daps
158,345
Reppin
Atlanta
man I’ve asked you this before and you mentioned you read all these articles you post and I was like ok, I got you breh. Now, I’ve changed my mind, and I think you lied to me. I don’t believe that shyt. No way you reading all these random ass articles. shyt be content overload. I’m curious as to what the fukk you got going on breh
 

bnew

Veteran
Joined
Nov 1, 2015
Messages
60,145
Reputation
9,006
Daps
166,220
man I’ve asked you this before and you mentioned you read all these articles you post and I was like ok, I got you breh. Now, I’ve changed my mind, and I think you lied to me. I don’t believe that shyt. No way you reading all these random ass articles. shyt be content overload. I’m curious as to what the fukk you got going on breh

Z6BvP0S.png



You don't believe I read 315 words? :skip:


i've barely read two chapter books worth of content so far today not including comments online. :gucci:

random articles, called news :heh:


me posting about technology, politics, history isn't random. :rudy: now if it's about sports or video games that would be uncharacteristic for me. :ld:
 
Last edited:

Double Burger With Cheese

Veteran
Supporter
Joined
May 6, 2012
Messages
26,801
Reputation
16,555
Daps
158,345
Reppin
Atlanta
Z6BvP0S.png



You don't believe I read 315 words? :skip:


i've barely read two chapter books worth of content so far today not including comments online. :gucci:

random articles, called news :heh:


me posting about technology, politics, history isn't random. :rudy: now if it's about sports or video games that would be uncharacteristic for me. :ld:

I’m sorry for doubting you brother
 
Joined
Aug 3, 2012
Messages
42,363
Reputation
-35,711
Daps
236,689
Z6BvP0S.png



You don't believe I read 315 words? :skip:


i've barely read two chapter books worth of content so far today not including comments online. :gucci:

random articles, called news :heh:


me posting about technology, politics, history isn't random. :rudy: now if it's about sports or video games that would be uncharacteristic for me. :ld:



I don't know why they doubt you, You post a lot of good shyt in the AI thread that fall on deaf ears, but is about to fukk up all our lives within the next decade
:wow:
 

boogers

cats rule, dogs drool
Supporter
Joined
Mar 11, 2022
Messages
9,412
Reputation
3,947
Daps
27,198
Reppin
#catset
been a VLC user since 2002. amazing program. this is what we should be using AI for, not goofy shyt.

i HATE the mac version. there must be a way to get the full right-click menu like on windows. you have to un-fullscreen and use the menu bar :why:

23.png
 
Last edited:
Top