Heygen AI Tutorial - How To Create an Instant AI Clone in 2 Minutes

Summary

This tutorial showcases how to create an instant Avatar using an AI-powered platform, demonstrating the ease of setting up a realistic video with just minutes of footage. It highlights features like video translation, voice cloning in over 120 languages, and access to various avatars and templates. The platform's user-friendly interface allows beginners to produce professional-quality videos without prior experience, with most functionalities available for free. The video also touches on premium features and plans for more extensive use, emphasizing the potential of AI in revolutionizing video creation and interaction.

Takeaways

• 😀 The tutorial introduces 'haen', an AI-powered platform for creating video avatars and translating voice into different languages, with an easy setup process requiring only minimal footage.
• 😃 It highlights the platform's capability to create instant avatars with lifelike lip movements and voice cloning, allowing users to generate avatars that resemble them closely.
• 🙂 Demonstrates video translation feature, where users can convert their voice into a completely new language while maintaining lip sync, expanding the reach to diverse audiences.
• 🎉 Offers access to over 120 different avatars and 300+ voices, alongside templates for creating professional-quality videos for various purposes, including team or client presentations.
• 🔥 Showcases the ease of use for beginners, with most features available for free and no prior experience required, making it accessible to a wide range of users.
• 😎 Guides through the process of creating videos from templates or AI-generated scripts, offering customization options for different occasions and content types.
• 💪 Emphasizes the 'instant Avatar' and 'video translate' as standout features, with a detailed walkthrough on setting them up and showcasing their benefits for content creation.
• 🙌 Reveals integration with 11 Labs API for realistic AI voices, enhancing the quality of video outputs with natural-sounding voiceovers.
• 🏆 Presents examples of premium and free voice samples to illustrate the quality difference, underscoring the value of premium options for more authentic sounding avatars.
• 🚀 Discusses pricing plans, indicating that while basic features are free, more extensive use cases might require a subscription to access additional credits, longer video durations, and advanced features.

Q & A

What is the main topic of the tutorial?

The main topic of the tutorial is how to create an instant avatar using an AI-powered video creation platform.

How long did it take to set up the AI clone shown in the tutorial?

The AI clone was set up in just 2 minutes of footage.

What is the name of the AI-powered video creation platform demonstrated in the tutorial?

The name of the platform is not explicitly mentioned in the transcript, but it is referred to as 'haen'.

What features does the platform offer for video creation?

The platform offers features such as instant avatar creation, video translation, access to over 120 different avatars, 300 plus voices, and templates for producing videos without the need for prior experience.

How can users access the AI script generation feature?

Users can access the AI script generation feature by clicking on 'template' or 'AI script generation' and then inputting a topic, URL, or choosing from various options like language, tone, and additional information.

What are the different types of avatars available on the platform?

The platform offers instant avatars, photo avatars that can be created by uploading an image, and studio avatars with various 4K and other high-quality options.

How does the real-time avatar feature work?

The real-time avatar feature allows users to have a low-latency, lifelike AI avatar that can engage in real-time chat, support multiple concurrent avatars, and has unlimited session length.

What is the process for changing the voice in the platform?

To change the voice, users can click on the voice selection menu and choose from various voices powered by 11 Labs API or import their API key from 11 Labs or Element to access the most realistic voices.

What are the pricing plans available for the platform?

The platform offers a free plan with one credit, one instant avatar, and one space seat. There are also paid plans like the Creator plan at $48/month (annually) or $59/month (monthly), and the Business plan at $79/month, each offering more credits, video duration, and advanced features.

What is the maximum video duration allowed with one credit?

One credit allows for a maximum video duration of 1 minute.

How can users avoid common mistakes when creating avatars?

To avoid common mistakes, users should keep their head steady in the frame for the best lip-sync results, and be mindful of the length of the text as longer scripts may require more credits to render.

Outlines

00:00

🎥 Introduction to AI Video Creation

This paragraph introduces the viewer to an AI-powered video creation platform, emphasizing the ease of creating an instant avatar using just a few minutes of footage. The speaker demonstrates their own AI clone and outlines the various features available on the platform, such as video translation and access to numerous avatars and voices. The platform's user-friendliness is highlighted, assuring that no experience is needed to utilize its capabilities. The paragraph concludes with a teaser on how to access the platform and its offerings, setting the stage for an in-depth tutorial.

05:00

🌐 Accessing and Navigating the Platform

The speaker guides the viewer on how to access the AI video creation platform, explaining the sign-in process through Google, Facebook, or SSO. An overview of the platform's interface is provided, including the credit system and its relation to video duration. The paragraph delves into the features of the platform, such as the 'Instant Avatar' and 'Video Translate', and how they can be utilized to create high-quality videos for various purposes, from sales promotions to educational content. The paragraph also touches on the importance of these features in enhancing video creation for personal or professional use.

10:02

👤 Exploring Instant Avatars and Customization

This paragraph focuses on the 'Instant Avatar' feature, showcasing different premium avatar options and their capabilities. The speaker discusses the various avatar types, including real-time avatars for simultaneous interactions and multi-language support. The paragraph also highlights the customization options available, such as uploading personal photos to create photo avatars or using studio avatars for a more professional touch. The speaker demonstrates how to integrate these avatars into videos, adding personal elements like titles and images, and emphasizes the potential of these features to enhance video engagement and personalization.

15:02

🗣️ Video Translation and Pricing Plans

The speaker introduces the 'Video Translate' feature, which allows users to translate their videos into different languages with synchronized lip movements. A demonstration is provided, showing how an English video can be translated into Korean. The paragraph also addresses common issues that may arise, such as difficulties in capturing lip movements when the subject moves too much. The speaker then outlines the pricing plans available, detailing the features included in each plan and their respective costs. The paragraph concludes with a recommendation to test the platform for free and a reminder to consider the value of personalized videos in various applications.

Keywords

💡Instant Avatar

Instant Avatar refers to the quick creation of a digital avatar that mimics human speech and expressions. In the context of the video, it is a core feature that allows users to generate a lifelike AI clone with minimal setup time, as demonstrated by the creator who used just 2 minutes of footage to set up their avatar. This technology is particularly useful for producing videos with a personalized touch, where the avatar's lips move synchronously with the voiceover, enhancing the viewer's experience and engagement.

💡AI Clone

An AI Clone is a digital replica or representation of a person, created using artificial intelligence. It is designed to mimic the individual's speech patterns, facial expressions, and mannerisms. In the video, the AI Clone is central to the tutorial, as it is used to demonstrate how to create a realistic avatar that can be utilized in video production. The AI Clone is a significant advancement in video creation, as it allows for the generation of personalized content without the need for the individual to be physically present during the production process.

💡Video Translation

Video Translation is the process of converting the language of the audio and/or text in a video to a different language, while also adjusting the avatar's lip movements to match the new language. This feature is highlighted in the video as a powerful tool for reaching a wider audience by making content accessible in multiple languages. It leverages advanced AI algorithms to ensure that the translated voice and the avatar's lip-syncing are as natural and seamless as possible.

💡AI Script Generation

AI Script Generation refers to the use of artificial intelligence to automatically create a script based on a given topic, URL, or other input. This technology is showcased in the video as a time-saving and creative tool that can help users produce content without the need for extensive writing experience. The AI generates a script that is not only relevant but also tailored to the user's requirements, such as tone and additional information.

💡Voice Clone

A Voice Clone is a digital representation of a voice, created using artificial intelligence techniques that capture the unique characteristics of an individual's speech. In the video, the Voice Clone is used to demonstrate how users can achieve a high level of realism in their videos by matching the avatar's lip movements to the cloned voice. This feature allows for a more authentic and personalized video experience, as the avatar can be made to sound like a real person, enhancing the viewer's connection to the content.

💡Real-Time Avatar

Real-Time Avatar refers to an AI-powered digital avatar that can engage in live interactions, such as real-time chats, with users. This innovative feature, as described in the video, allows for multiple concurrent avatar interactions and supports unlimited session lengths. It represents a significant leap in AI technology, as it enables more dynamic and interactive communication experiences between users and AI avatars.

💡API Integration

API Integration is the process of incorporating Application Programming Interfaces (APIs) into software to enable it to interact with external services or systems. In the context of the video, API Integration is used to bring in high-quality voices from 11 Labs or Element, enhancing the realism of the AI-generated avatars. This integration allows users to access a wide range of premium voices, which can be crucial for creating professional and engaging video content.

💡Photo Avatars

Photo Avatars are digital representations created using a person's photograph, which are then animated to speak or express emotions. In the video, Photo Avatars are presented as an accessible option for users who want to create videos with a personalized touch without the need for complex animation or recording processes. Users can upload an image and have it transformed into a talking avatar, making it a user-friendly feature for a variety of applications, such as YouTube videos or marketing content.

💡Studio Avatars

Studio Avatars are high-quality, professionally designed digital avatars that can be used in video production. These avatars, as mentioned in the video, often come in high-resolution formats like 4K and can be used to add a more polished and professional appearance to videos. They are suitable for use in training materials, promotional content, and other scenarios where a high level of visual quality is required.

💡Video Templates

Video Templates are pre-designed video structures or frameworks that users can customize and populate with their own content. These templates, as discussed in the video, can significantly streamline the video creation process by providing a ready-made layout, style, and structure. They are particularly useful for users who may not have extensive video editing skills or who want to produce content quickly and efficiently.

💡Customization

Customization in the context of the video refers to the ability of users to tailor and modify the appearance, behavior, and characteristics of their AI-generated avatars to fit their specific needs and preferences. This includes adjusting the avatar's facial expressions, selecting different voices, and fine-tuning the lip-syncing to achieve a more realistic and engaging video experience.

Highlights

Introduction to an AI-powered video creation platform that allows users to generate avatars and voices for video content.

The platform enables users to create an AI clone with just 2 minutes of footage, showcasing the ease of use and quick setup.

Demonstration of how to set up a video with voice translation, where the AI clone's lips move in sync with the new language.

Access to over 120 different avatars and 300 plus voices, providing a diverse range of options for video creation.

The platform's user-friendly interface allows even beginners to produce high-quality videos without any prior experience.

Showcasing the 'Instant Avatar' feature, which offers four different premium versions for users to test and utilize.

Introduction of the real-time avatar feature, a low-latency, lifelike AI avatar that can engage in multiple concurrent chats and supports multi-language.

Explanation of how to use the API for real-time avatars and the potential for changing AI interactions.

Discussion of the different avatar types available, including photo avatars and studio avatars, and their applications in various types of videos.

Demonstration of editing capabilities within the platform, such as adding text elements, assets, and templates to videos.

The option to render videos with different resolutions, including 720p and 1080p for free, and 4K with a premium version.

Instant Avatar feature that allows users to record their own audio and have it drive the avatar's speech and movements.

The video translation feature that can translate the audio and lip movements of a video into different languages.

A warning about the importance of keeping the head steady in the frame for the best results with video translation.

Pricing plans for the platform, including the free version and the Creator and Business plans with their respective benefits.

The potential of personalized videos for training and YouTube content, making them more engaging and relatable.

Invitation to test the platform for free through a link in the description, emphasizing its potential value for various applications.

Transcripts

hey welcome to this hey gen tutorial I'm

going to show you how to make an instant

Avatar you see my lips are moving up and

down just like this guy yes that's me as

an AI clone and I only set it up with 2

minutes of footage and there are a bunch

of mistakes that you can do while

creating it so I'm going to show you

everything that I did second I'm going

to show you how to set up the video

translate where you can turn your voice

into a completely new

language

and the lips change as well and the

voice clone is the same how you can get

access to over 120 different Avatar 300

plus voices and templates so you can

make better videos whether it's online

or internally for your team or clients

you don't need any experience you can do

most of it completely for free even if

you're a beginner so by the end of this

video you will become a hayen expert

first I want to show you how to access

haen so you can see here AI powered

video creations at scale effortlessly

produce studio quality videos with AI

generated avatars and voices so just

click on get started for free now we can

sign in with Google Facebook or SSO I'm

going to select Google and now we're on

the inside as you can see we have one

credit which equals 1 minute of video

and this is rounded up to 30 seconds

I'll show you what costs credits

throughout this video my favorite

features is by far the instant Avatar as

well as this video translate but I'm

going to save those at the end feel free

to scroll the timeline down below as you

wish the first thing we're going to look

at is the create video section as you

can see we can start from a template or

we can start from an AI script

generation let's click on template and

this is how it looks like as you can can

see this could be really beneficial for

you if you are having some sort of

Valentine's Day Sale Black Friday sale

or opening or want to create an ad for a

dental clinic furniture shop even luxury

jewelry but if you select the AI script

generation this screen will pop up as

you can see we can either put a topic

input or a URL input we put in a topic

like how to build good work habits as a

solo founder output language English but

they also have a bunch of different

languages tone let's keep it

professional additional info let's just

add motivate solo Founders there is also

an URL input where you can just put your

website let's just test the topic input

for now generate script it's writing for

us here really fast and we're going to

click on create video as you can see

with now landed in the studio it turned

into a 52 second video and we can just

just listen to The Voice are you a solo

founder trying to build your business

from the ground up do you often find it

challenging to stay motivated and

focused building good work habits is

crucial for success as a solo founder I

actually like the intro a lot but if you

don't like the text you can always open

the GPT script writer so you can write

just like it was chat GPT which is just

so convenient and if you don't like the

voice you can click on Ryan here and you

have a bunch of other voic voices these

are taken with 11 Labs API which is my

favorite AI voice tool and the way that

you can do that is just click on this

bottom in the top right and as you can

see you can now import your API key here

from 11 Labs or element to get the

absolute most realistic voices let me

show you some of the free ones and let

me show you some of the ones that have

this premium to show you the difference

let's check out Tony hello this is how I

sound hope you like it here's Ryan hello

this is how I sound hope you like it

this is Christopher hello this is how I

sound hope you like it and this is

William hello this is how I sound hope

you like it it's definitely decent but

not amazing let's listen to the premium

ones like Charles hi this is how I sound

hope you like it just way better right

Alexander hi this is how I sound hope

you like it almost like an army man

Jackson hi this is how I sound hope you

like it like an American Dad what about

British Arthur hello this is how I sound

hope you like it damn that is really

cool one for this example we're going to

pick Tony but as you see we only have

this guy here I don't really like him

that much so we're going to check out

the avatars but let me show you the

newest feature that they just launched

this is the real time Avatar and

essentially this is the first low

latency lifelike AI Avatar where you can

essentially have a real time chat you

can talk to multiple concurrent avatars

at the same time have unlimited session

length with any of the avatars you

create which I'm going to show you in a

minute and multilanguage support this is

all set up with an API and if you want

to get it set up for you you can also

contact them to get help this could

change how we interact with all of AI

which is very exciting but I believe

these two next features are probably my

favorite so for the instant avatars as

you can see these ones are pretty

premium but you actually have four

different versions you can test so as

you can see this is the first one now

it's not going to move on the preview

window as you can see if we click play

here you a solo founder trying to build

the animation is not going to start so

we actually have to render him out in

order to show you how it looks like here

is the second fine tun Avatar I've seen

her speak before and it looks really

realistic the same with this guy and the

last one we have a actual vertical one

that I bet is going to look really good

here is an example welcome to the new

era of video Creation with Heen simply

type your script to get started here's

another example welcome to the new era

of video Creation with haen simply type

your script to get started here is Leah

welcome to the new era of video Creation

with haen simply type your script to get

started Ed word welcome to the new era

of video Creation with haen simply type

your script to get started yep that's

pretty impressive I want to render it

out with Edward but I need to show you

the other avatars as well you can see we

have these photo avatars that you can

just basically upload an image and you

can make them speak and then we have the

studio avatars as you can see we have

some 4K ones here like the first one

that I showed you earlier and multiple

other variations of this that you could

put in the foreground of any of your

training videos a lot of people are

using these in YouTube videos to get a

more Personal Touch so say we're going

to use this girl we can put her over to

the right and we can add these elements

like a WhatsApp image and we can even

add titles here as well as you can see

it all fits down into the timeline with

all the durations just like editing in

any other software you can even upload a

video and now if you want to you can

drag this in as a background as well and

you could make tutorial videos showing

your screen if you want to export to

another editing software you can always

just drag a shape in here and make it

like a green screen shape color green

make it super bright and then just send

backwards so you've seen the avatars

text elements and assets they also have

the templates let me just really quickly

show you click on this guy for example

and you just added a new segment to the

video as you can see click on another

template and we just added another

segment as well and through multiple

different steps you can show multiple

different things to teach somebody in a

more personalized way I really want to

try this Avatar here so I'm just going

to click on submit and it's now loading

unfortunately I don't have enough

credits because the text is too long now

it's 19 seconds so we just export that

costs half a credit and now it's ready

let's check it out are you a solo

founder trying to build your business

from the ground up do you often find it

challenging to stay motivated and

focused building good work habits is

crucial for success as a solo founder in

this video I will share some valuable

tips and strategies to help you develop

and maintain productive work habits wow

I mean this guy is pretty impressive I

really like the way his mouth moves his

hands doesn't move too much it could

pass as a real now the options you have

is downloading in 720p or actually 1080p

for free with the premium version you

can get it at 4K and you can export the

C caption SRT now what if you wanted to

make this of your face right how would

you do that well let me show you the

instant Avatar so let's click on create

a video in landscape mode and see what

we can do with it as you can see we're

now in the studio now I want to not do a

text transcript I actually want an audio

script to drive your avatar speech I'm

going to record audio up to 1 minute so

let's just click on start hey this is me

record recording a video now if my mouth

looks weird or I use duck lips it's

actually because I went to Seria I got

some like plastic surgery and it went

really bad so please don't make fun of

my lips also if my hands are moving

around a little bit sporadically it's

actually because this is not me this is

an AI avatar version of me so you know

don't expect too much all right I'm

leaving and there's nothing I can do

about it there we go it actually added a

53 second long clip that's perfect I'm

going to go up and click on submit this

will use one of my credits I only get

one credit for free so I hope that it's

going to turn out well hey this is me

talking into the microphone as you can

see my lips are moving up and down my

upper lip is a little bit like a duck

lip I went to Serbia I got this bow box

injected and after a couple of days it

got rank so yeah this is permanent

damage and there's nothing I can do

about it also you might see my hands are

moving around

sporadically even when I'm not talking

so there's nothing I can do about

that I'm dying I'm a little bit

speechless to be honest because it looks

so real look at the shirt if I myself

look at my hands go down hon like I

don't want to use my this is so wild I

bet with just a tiny bit more

fine-tuning we can even get the lips to

be almost 100% perfect now you can

choose to customize this you can make

your video bio you can download it as a

1080p original video and if you upgrade

you can get a 4K video and Export

captions as SRT but the next feature

might be even cooler called video

translate as you can see we can go on

the left side click on video translate

and you can now drop to upload I'm going

to show you the video I'm going to use

and I'm filming this into the camera

right now speaking in English I have to

do 30 seconds of footage so that they

can get my voice and everything like

that hopefully I can speak in Spanish or

French or Turkish or maybe Korean as

well I wonder if it's going to make my

mouth go up like and down like that so

I'm just going to drag it in here but

nothing starts unless we choose a target

language here they have over 25

different languages that you can choose

between here is a better screenshot if

you want to stop the video now and find

your language I'm going to pick Korean

for this example and click on translate

this video there's also this option to

translate only the audio and here is the

result

so as you can see this is just

ridiculous right I actually sent this to

a couple of my friends and they're like

I don't see it but I know you don't

speak Korean so if you have a friend

that speaks a different language send

one of these videos to them and they're

going to reply with only crying laughing

emojis also I need to give you a quick

warning about the video that you put in

so I use this video where I'm moving way

too much back and forth and because of

that the algorithm can't really keep up

with my mouth and stuff so just look at

this bad example so you can avoid this

mistake I don't know about you but I

sound like a final boss in an anime so

keep your head steady in frame for the

best result now you might be wondering

what's the price as you can see for free

you get one credit or one minute Max

duration one instant Avatar and one

space seat so that basically means how

many people can be in your account it

features 120 public avatars 300 public

voices talking photo generative AI

outfit Avatar face swap and 400 video

templates creat remark able you can do

for free but if you're actually going to

use it in your workflow it definitely

isn't enough so that's why we have the

Creator plan and the business plan so

with the Creator plan you actually get

360 credits at

$48 a month this is if it's buil yearly

if you pay monthly it's $59 a month

maximum 5 minutes per video duration

usually most YouTube videos are 8

minutes long which means that either you

have to do two of them and then cut them

together or upgrade it to another plan

now you can have three instant avatars

which if you're going to use the AI

Avatar I recommend it so you have

different spaces and maybe you talking

in different sets and you get the

premium voices Auto captions no

watermark Avatar fine tune voice clone

that can create your avatars even better

now it changes when we go over to the

business here where the monthly plan is

$79 it gives you 60 credits per month

and a whopping 20 minute Max duration it

also has instant avatars but the

craziest part is the API access so

technically you could create avatars

without even entering the haen software

priority video processing brand kit and

the 4K resolution and there is an

Enterprise for those that go all in now

for this you have to contact sales want

to drag these sliders up as well where

if you get more credits it's basically

more expensive the maximum package at

$899 per month and if you think about it

what is personalized video worth for you

if you make training videos there are

more personal so you see a human and not

just a robot voice if you make YouTube

videos they can actually connect with a

character instead of just a voice so

personally I think it's a great

investment if you're doing any type of

faceless video so do you feel like you

can use haen now and if it's a good

software for you click the link in the

description down below to test haen for

free so you can make better videos for

your work your education or your

personal life thanks so much for

watching and I'll see you in the next

one