[P] Generate transcripts with Whisper AI and automatically translate with LibreTranslate

Submitted by meddit_app t3_zp41dd in MachineLearning

Hey guys wanted to show you my app which offers a convenient frontend to use Whisper for transcriptions with Libretranslate to power automatic translations

Code is all open-source here: https://github.com/mayeaux/generate-subtitles

Also running an instance that you can use for free at https://freesubtitles.ai

29

Comments

You must log in or register to comment.

omar91041 t1_j0ql5q8 wrote

I quite like the idea. Super helpful! Keep up the good work!

3

m98789 t1_j0qqo7p wrote

Do you know if Yiddish is supported?

3

muffdivemcgruff t1_j0rgc3l wrote

This is dope!

3

meddit_app OP t1_j0rvyhe wrote

Thanks! A lot more cool features to come for sure. Auto download content with yt-dlp among other things

2

JustOneAvailableName t1_j0tj00w wrote

Did you compare results with the build in translate of Whisper?

2

meddit_app OP t1_j0u3hoj wrote

Not really, the issue with Whisper's built in translation is that you have to in essence re-transcribe the entire content so it doesn't really scale. Libretranslate isn't amazing but it works pretty decently.

2

CallMeInfinitay t1_j0tux3y wrote

Thanks for offering this service. One suggestion I have is to add support for Facebook's NLLB-200 model instead of Libretranslate

2

meddit_app OP t1_j0u3kkq wrote

>Facebook's NLLB-200

I'll definitely look into that thanks for the suggestion.

1

moonblaze95 t1_j1386rh wrote

Can’t whisper do translation without outside software? What’s the purpose of libretranslate?

1

meddit_app OP t1_j14z1zw wrote

The only way Whisper can transcribe is from doing a full transcription which is a very expensive process, there is no way to translate already generated text

1

emotionalfool123 t1_j1cf866 wrote

Can we scrape the transcripts generated in other languages using auto-translate feature of youtube CC option? It has all the languages one needs.

1