How to Transcribe and Translate Audio or Video to Any Language Using AI

Summary

The video demonstrates using two AI tools, Descript and DeepL, to easily transcribe and translate video and audio files. Descript provides automated transcription and editing capabilities, exporting transcripts and captions. DeepL then instantly translates the English transcript into over 30 languages. Together these tools enable creating accessible, multilingual content and subtitles to reach broader audiences. The value and accessibility of AI is highlighted, mentioning a website cataloguing AI courses and tutorials on platforms like ChatGPT and Midjourney for those wanting to further leverage AI.

Takeaways

• 😀 The video demonstrates how to use Descript and DeepL to transcribe and translate video and audio files
• 📹 Descript provides accurate AI-powered transcription of video and audio files
• 📝 Descript transcripts can be edited and exported to various formats like Word docs
• 🌎 DeepL translates transcripts and captions to over 30 languages quickly
• 🇪🇸 Translated files can be saved as SRT/VTT captions for subtitling videos
• 🔭 Analytics can identify top visitor countries to translate captions accordingly
• 🚀 Skill Leap AI has a catalog of 200+ AI tutorials including ChatGPT prompts
• ⏱ Using Descript and DeepL saves money and time on transcription/translation
• 💡 Integrating the two tools makes content accessible to more people globally
• 🎥 The workflow enables creating multi-language versions of videos easily

Q & A

What two AI tools does the narrator use to transcribe and translate video and audio files?

The narrator uses Descript for transcription and deepl.com translator for translation.

What file formats can you export the transcript to from Descript?

From Descript you can export the transcript to plain text, Microsoft Word doc, SRT captions file, and VTT captions file.

How accurate is the AI transcription in Descript?

The narrator says the AI transcription in Descript is incredibly accurate after testing it on 12 hours of video.

What languages can you translate to with deepl.com translator?

Deepl.com translator supports over 30 languages including Spanish, Chinese, Portuguese, Japanese and Italian.

How can translated caption files be used?

The translated caption files can be used to add subtitles in different languages to videos on YouTube or on the narrator's own platform.

How can you use Google Analytics with translated captions?

Google Analytics shows the top visitor countries. Captions can be translated to the top 10 languages to make the platform accessible globally.

What website does the narrator mention that has AI courses?

The website is skillleap.ai which has hundreds of tutorials on AI tools like ChatGPT and content creation platforms.

What editing can you do to transcripts in Descript?

In Descript you can highlight text to correct errors and also add punctuation. Edits to transcripts propagate to associated video/audio.

What is the benefit of the AI voice overdub feature in Descript?

The voice overdub feature lets you train the AI with your own voice so it can overdub parts of the audio that have mistakes.

What is the limitation on translating long text with the free version of deepl.com?

The free version of deepl.com has a character limit per translation. For long text files an upgraded account is recommended.

Outlines

00:00

😀 Transcribing and Translating Videos with AI

The first paragraph introduces two AI tools for transcribing and translating video and audio files to save time and money. It focuses on Descript, an AI-powered transcription tool that can also edit transcripts to alter videos and audio. The transcript is exported to make edits in Word and generate caption files for subtitles.

05:01

😃 Translating to Multiple Languages

The second paragraph shows how to use the DeepL translator to quickly translate the English transcript into over 30 languages like Spanish, Chinese and Portuguese. Translated caption files can then provide subtitles in different languages based on website visitor locations tracked in Google Analytics.

Keywords

💡transcription

Transcription refers to the process of converting speech (either from audio or video files) into text format. In the video, the narrator shows how the Descript software can automatically transcribe video and audio files with high accuracy using AI. This allows efficient conversion of large volumes of speech content into text, saving huge amounts of time and money. The transcribed text can then be edited, translated, exported, or used to generate subtitles.

💡translation

Translation refers to converting text content from one language into another language. The narrator demonstrates the DeepL translator website, which can rapidly translate the English transcript into over 30 languages like Spanish, Chinese, Portuguese etc. This allows the content to be made accessible to global audiences in their native languages. Combined with transcription, it enables automated multilingual subtitling.

💡editing

Editing refers to making changes and corrections in the automatically generated transcript text to improve accuracy. The Descript software allows the user to simply highlight and correct any errors in the transcript via a simple text editor. This saves time compared to manually transcribing or editing from scratch.

💡export

The narrator shows how both the edited transcript text and the translated versions can be exported and saved in various file formats like Word, Plain text, SubRip subtitle file etc. These output files can then be used for other downstream needs - upload subtitles, put transcript on website, analyze text data.

💡accessibility

A key benefit highlighted in the video is making content accessible to wider audiences across languages through subtitling and translation. The described workflows enable automated multilingual translations and subtitles at scale. The narrator gives the example of identifying top visitor languages using Google Analytics and creating matching subtitle files to increase accessibility.

💡automation

A core theme emphasized throughout the video is utilizing AI to automate manual and repetitive tasks like transcription, translation and subtitling. Humans no longer need to carry out this time-intensive work. This massively boosts productivity and efficiency for processing large volumes of content.

💡accuracy

The narrator points out the high accuracy in transcription and translation achieved by AI tools like Descript and DeepL. For transcripts, any minor errors can also be easily edited and corrected. So automation does not mean completely sacrificing quality.

💡workflows

The video focuses on step-by-step workflows combining multiple AI tools to produce transcriptions, translations and subtitles with great efficiency. Understanding and implementing such human-AI collaborative workflows is key to unlocking the power of existing technologies.

💡cost saving

A major benefit highlighted in the beginning is the significant time and money savings enabled by AI transcription and translation. Instead of expensive manual effort, content can be processed automatically at scale, with no restriction on volume.

💡multilinguality

The automated translation capability shown in DeepL to convert transcripts into over 30 languages highlights how AI can make content truly multilingual and global. This removes language barriers faced by various international audiences.

Highlights

Uses Descript to transcribe audio and video files automatically with AI

Descript allows editing transcripts to correct any mistakes

Exports transcripts to Word docs, subtitles, captions

Uses DeepL to translate transcripts instantly into over 30 languages

DeepL translations are incredibly fast, just a few seconds

Can create translated subtitles/captions for videos

Translations allow reaching wider international audiences

Skill Leap AI provides many AI tutorials and courses

Descript has tons of advanced audio/video editing features

Fixes to transcripts propagate to associated video/audio

Large volumes of content can be processed

Analytics show top visitor countries to focus translations

Creates accessible, multi-language platforms

Saves money compared to human translation services

Saves time compared to manual transcription

Transcripts

with the power of two different AI tools

that I want to share with you in this

video I was able to transcribe and

translate most of my video files right

now and also my audio files too I want

to show you my exact workflow it will

save you ton of money and ton of time so

the first one is for transcription and

they have ton of free minutes that you

could use this is called descript I'll

go ahead and Link it on screen and Below

but this option basically does a lot

more than transcribing I'm only gonna

show you just a brief transcription

version and then we'll use the

translation AI tool after this one so

once you get dscript installed all I

have to do is click on new project here

and here I chose the video option but

you could choose the audio option so now

all I have to do is take my file from my

computer and drop it right here so

here's a file so I'm gonna grab it right

here and I'm gonna drag and drop it

right here and usually takes just a few

seconds this is a two minute video file

and right here I'm gonna go ahead and

choose my name one option this has is it

basically lets you do this AI voice

overdub so you could train it with your

own voice and overdub any part of it

where you make a mistake again I'm not

going to show you that in this video but

dscript has ton of options like that

including editing a text file which

edits then the video file too and the

audio file then over here you could

transcribe this to ton of different

languages so it will translate and

transcribe but I'm going to show you a

tool for that part in a second right now

I'm just going to choose English for the

English transcription this is in English

the video and as you can see over here

is the entire text I'm going to put it

on mute here but basically if I just

press play it's going to follow along

with the video word by word and it is

incredibly accurate this is not done by

any humans right now this is just Ai and

as I've been watching this I've done it

with close to 12 hours worth of videos

just in the last week okay but all I

have to do is if I wanna correct

something I just highlighted and then

the correct option here is right here

and I'm going to I'm just going to

select that and press enter and it's

going to change that for me so I could

quickly go ahead and change anything

that I see as I go through it so right

here I could add a period here and I

could go ahead and capitalize this again

real quickly I could make changes and

then it's going to follow along with

everything I'm saying as I go through

this whole process okay now I'm going to

go to publish here and I'm going to go

to export I could actually export the

video or audio file if I alter this in

any way so if I edited sections out it's

going to let me just edit the fixed

version of the video or audio but here I

just want the transcript and I have lots

of different file formats just plain

text or Microsoft doc here I'm just

going to use the Microsoft Word doc here

and I'm going to save this file and then

if I want the caption file this lets you

download the SRT file or the vtt file

this is how I subtitled my video so I

usually go ahead and Export one of those

as well I could use those on YouTube for

example or on my own platform for a

caption subtitle file in addition to the

transcript now let me go ahead and open

the transfer script I'll go to edit over

here and select all and then I'll go

ahead and right click over here and copy

everything now here's the second

platform that I'm going to show you for

the translation portion so all you have

to do is go to deepl.com translator and

they do have a lot of free credits here

as well but I did get the upgraded

version because I usually have much

longer text files that I'm going to

import here they do have a limit on how

much you could do at one time if you

want to keep using it for free you will

hit that limit so I'm gonna paste over

here and this is my English detected and

did you see over here the Spanish

version just appeared just like that I

got the Spanish version it took not even

one second for this to translate from

English to Spanish

and here's the most interesting part I

could select this option and I could

click any other language I believe they

have over 30 right now and look at this

just like this two seconds later I got

the Chinese version

if I want the Portuguese version two

seconds later I got the Portuguese

version all these I could go ahead and

press command or control a to select I

could go ahead and right click and copy

and then I could save it in the word doc

or any type of format that I want to

save it as I could also translate files

from PDFs docs and PowerPoint but I

could also do this with my caption file

if I copy and paste that caption file I

downloaded from the script this is

English this is Portuguese or if I want

Japanese or Italian here's Japanese for

example is going to take this and turn

it into this type of format if I save

this as a plain text

and then add dot SRT or dot vtt at the

end of the file type I got myself a

whole different language so on my

website when I do this you could go over

and press the subtitle option now you

have English Portuguese Spanish Chinese

then I could use a free platform like

Google analytics to see where my

visitors are coming from all the

different countries are listed here I

could take the top ten I could use deep

ell I could do the caption file that way

I could do the transcription that way

and then I could basically make my

platform accessible to a whole lot more

people and the platform that I mentioned

that I'm using this for this website

skill leap AI is basically an entire

catalog of AI courses and content so you

could learn everything in the world of

AI including how to use chat GPT

correctly with hundreds and hundreds of

prompts included ton of different

tutorials on content creation platforms

like mid-journey Runway Adobe there are

nearly 200 tutorials if you're

interested I'll put a link in the

description so you can learn more I hope

you found this video useful and I'll see

you next time