NEW! THIS Changes It ALL!! Create Mind Blowing Local AI Images That Speak Right On Your Own PC!

Summary

This video script introduces 'Hallo', a groundbreaking AI software that enables users to animate still images of people, creating realistic facial expressions, movements, and lip-syncing to any audio. The presenter demonstrates how to install and use Hallo locally on a PC, showcasing its potential for diverse applications from brand spokespersons to comedic content. The tutorial covers the setup process, including using Pinocchio for simplified AI software installation, and provides tips for optimizing results, promising a follow-up for advanced features and troubleshooting.

Takeaways

• 😃 The video is about demonstrating the capabilities of an AI software called 'Hallo', which can animate still images and create realistic facial expressions and lip-syncing.
• 🚀 The presenter is highly excited about the technology, emphasizing its ability to bring still images to life without the need for expensive cloud-based services.
• 💻 'Hallo' is an advanced AI software that operates locally on a user's PC, allowing for the animation of any person's image, regardless of the source.
• 🎭 The software can be used to create animations for various purposes, such as brand spokespersons or comedic content, offering a wide range of applications.
• 🖼️ To use 'Hallo', a clear image of a person's face occupying about 70% of the image space and sized to 512x512 pixels is required.
• 🔊 The audio for the animation must be in WAV format and should be relatively short, ideally 4 seconds or less.
• 🤖 The presenter suggests using 'Pinocchio', an AI portal that simplifies the installation of AI software, to make the process of setting up 'Hallo' quick and easy.
• 👍 'Pinocchio' automates the installation of necessary AI components and dependencies, providing a user-friendly interface accessible through a web browser.
• 🛠️ The presenter provides guidance on how to install 'Hallo' using 'Pinocchio', including dealing with potential security warnings during the installation process.
• 📊 The processing time for generating the animated video varies depending on the user's PC hardware, particularly the GPU, with the presenter estimating 2 to 3 minutes of processing time per second of video.
• 🔧 The video script also mentions that the presenter will address common issues and provide troubleshooting tips in a follow-up video.

Q & A

What is the main topic of the video?

The video is about how to animate a still image using advanced AI software called Hallo, which runs locally on a PC.

What does the presenter find mindblowing about Hallo?

The presenter finds it mindblowing that you can animate a still image with realistic facial expressions, movement, and lip syncing using consumer-grade hardware on your own PC.

What is the purpose of the software Pinocchio mentioned in the video?

Pinocchio is an AI portal that simplifies the installation of AI software, including Hallo, requiring minimal setup and configuration from the user.

What are the minimum hardware requirements to run Hallo?

The video suggests that you need an Nvidia graphics card, with a 3060 or higher likely being sufficient, though exact requirements are not specified.

What kind of images and audio are required to use Hallo?

The image needs to be a face occupying about 70% of the image space, square, and sized to 512 by 512 pixels. The audio must be in WAV format and relatively short, around 4 seconds or less.

What does the presenter use as examples in the video?

The presenter uses photos of women downloaded from Pexels and animates them to make them talk using the Hallo software.

What steps are involved in setting up Hallo using Pinocchio?

The steps include downloading Pinocchio, extracting it, installing it, using the Discover feature to find and download Hallo, and then starting Hallo from the Pinocchio interface.

How does the presenter suggest improving the animation quality if it looks artificial?

The presenter suggests adjusting the pose weight, face weight, and lip weight settings in Hallo to make the animations look more natural and less exaggerated.

What additional content does the presenter promise in future videos?

The presenter promises to cover how to smooth out generated videos to make them look more natural and provide basic troubleshooting tips.

What does the presenter ask viewers to do to help others?

The presenter asks viewers to leave comments on the video about whether the steps worked for them and to include information about their GPU to help other people.

Outlines

00:00

🚀 Introduction to Hallo AI

The video creator expresses their excitement about this video, highlighting their previous video on animating still images using advanced AI on a personal computer. They introduce 'Hallo', an AI tool that runs locally on a PC to animate images, create realistic facial expressions, and lip-sync with any spoken text or singing. The potential of this technology is vast and impressive, making it possible to bring any image to life.

05:02

🖥️ Installing and Using Hallo with Pinocchio

The video explains the requirements for running Hallo, emphasizing the need for an Nvidia graphics card. The creator mentions using Pinocchio, an AI portal, to simplify the installation process. They guide viewers through downloading and installing Pinocchio, setting it up, and starting Hallo. Detailed steps are provided, including extracting files, running the installer, and launching Hallo through the Pinocchio interface.

10:03

🎨 Preparing Images and Audio for Hallo

To use Hallo, an image of a face and an audio clip are needed. The image should be square (512x512 pixels) and the audio should be in WAV format. The video provides a download pack with sample images and voice clips to help viewers follow along. The creator demonstrates how to select and upload an image and its corresponding audio clip in Hallo, explaining default settings and the rendering process.

15:07

✨ Creating Talking Heads with Hallo

The rendering process is discussed, with an example of a generated talking head shown. The creator highlights the adjustments made to improve the animation, such as altering pose, face, and lip weights to reduce exaggerated expressions. The video concludes with an overview of what has been covered, promising more tips and troubleshooting in a follow-up video. Viewers are encouraged to experiment with the provided samples and subscribe for more content.

Keywords

💡Hallo

Hallo is an advanced AI that runs locally on a PC and allows users to animate still images. The AI creates realistic facial expressions, movements, and lip-syncing to spoken text or singing. This concept is central to the video as it showcases the capabilities of local AI animation without the need for cloud services.

💡AI (Artificial Intelligence)

Artificial Intelligence refers to the simulation of human intelligence processes by machines. In the video, AI is used to animate still images, making them appear lifelike with realistic expressions and movements. The speaker emphasizes the advancement in AI technology that allows for these capabilities on consumer-grade hardware.

💡Pinocchio

Pinocchio is a software that simplifies the installation of AI tools like Hallo. It automates the setup process, making it easier for users to install and run AI applications without needing extensive technical knowledge. The video highlights Pinocchio as a user-friendly way to access and use Hallo.

💡GPU (Graphics Processing Unit)

A GPU is a specialized processor designed to accelerate graphics rendering. In the context of the video, having a powerful GPU is necessary to run Hallo effectively. The speaker mentions that users will need an Nvidia graphics card, ideally a 3060 or higher, to achieve the best performance.

💡Lip Syncing

Lip syncing refers to the synchronization of lip movements with spoken words or singing. The video demonstrates how Hallo can create animations where the character's lip movements match the audio input, making the animation appear more realistic.

💡Pexels

Pexels is a website offering free stock photos and videos. In the video, the speaker uses images from Pexels to demonstrate how Hallo can animate any photograph, turning still images into lifelike animations with realistic expressions and movements.

💡Local AI

Local AI refers to AI applications that run directly on a user's computer rather than on remote servers. The video emphasizes the advantages of running Hallo locally, such as privacy, control, and potentially faster processing times without relying on cloud services.

💡Rendering

Rendering is the process of generating an image or animation from a model. In the video, rendering refers to the time it takes for Hallo to process and create the animated video from the input image and audio. The speaker notes that rendering times can vary based on the computer's hardware.

💡Facial Expressions

Facial expressions are movements of the facial muscles that convey emotions. Hallo can generate realistic facial expressions in the animated characters, making them appear more lifelike. The video showcases this capability by animating photos with expressions that match the provided audio.

💡Consumer-grade Hardware

Consumer-grade hardware refers to computer components that are available and affordable for the average consumer, as opposed to professional or enterprise-grade equipment. The video highlights that Hallo can run on consumer-grade hardware, making advanced AI animation accessible to a wider audience.

Highlights

Introduction of a new video showcasing advanced AI animation of still images on personal computers.

Excitement about the capability to animate images without expensive cloud services.

Introduction to 'Hallo', an AI software that animates images with realistic facial expressions and lip syncing.

Potential ethical concerns of making anyone say anything with AI.

Demonstration of animating an unknown woman's photograph to express happiness.

Explanation of how Hallo works with any type of image, expanding creative possibilities.

Example of animating a photograph with a quote about AI technology.

Discussion on the unlimited potential uses for AI-generated talking heads.

Technical requirements for running Hallo, emphasizing the need for a powerful computer and Nvidia graphics card.

Suggestion to share user experiences and GPU types in the comments for community benefit.

Step-by-step guide on installing Hallo using Pinocchio, an AI software portal.

Instructions for downloading and using Pinocchio to simplify Hallo installation.

Description of the Hallo interface and the process to start the software.

Guidance on preparing images and audio for the animation process.

Explanation of the rendering process and the impact of PC hardware on processing time.

Troubleshooting tips and the promise of a follow-up video to address common issues.

Encouragement for viewers to like, subscribe, and engage with the content.

Final thoughts on the fascination with AI technology and its creative potential.

Closing remarks with a humorous take on the relationship between artificial intelligence and human stupidity.

Transcripts

I am probably more excited about this video right  here than any other video I've ever made. Last week  

I made a video showing how you can take a still  image and animate it using Advanced AI right on  

your own computer, and I thought that was amazing.  The fact that we live in a time where you can  

bring a still image to life without having to use  some expensive service out on the cloud somewhere  

to me that's just mindblowing well if you were  like me and thought that was amazing wait till you  

see what's in store today today I'm going to share  with you how to install and use hallo and I hope  

I'm saying that right it's h a l l o and according  to Google it should be pronounced as ha plus low  

so Hallo so I'll be calling it hallo. hallo is  an advanced AI that runs locally right on your own  

PC and allows you to take an image of any person  no matter if it's a photograph an illustration  

or an AI generated image and not only animate it  but also create realistic facial expressions and  

movement along with lip syncing the image to any  spoken text or even singing if you desire. With  

hallow you can literally make anyone say anything  you want which in a way is kind of scary but at  

the same time the types of things we can create  with all of this new technology is pretty damn  

amazing. And to be able to do it with nothing more  than consumer grade Hardware right on your own PC  

uh like I said before really this it just blows  my mind so here's a picture of a woman no idea  

who she is I just downloaded her photograph from  pexels but you can kind of tell from looking at  

her photo that she's a happy person how about we  let her tell us why she's happy. I'm having the  

best day ever because I'm young I'm beautiful and  I have a cool hat. My life is truly wonderful.

So as you can see not only can we give life to her  photo but we can make the life that we give her  

wonderful. I mean what more could you ask for right?  So the awesome thing is this works with any type  

of image opening up a wide range of possibilities  and usage scenarios. Let's take a look at another  

example once again this is downloaded from pexels  I'll give credit to the photographers in the  

description below. I don't always watch videos on  AI technology, but when I do I watch Ron Pierson. 

Well now that she's been given life it's pretty  obvious that she's fully grasped the intelligence  

part of artificial intelligence. Of course these  are very simple examples of the possibilities this  

technology has to offer from Brand spokespersons  to fun and comedic uses and everything in between  

you now have at your disposal unlimited faces  where you can customize the dialogue and make  

use of them no matter what your needs are. So  let's create one together. In order to animate  

images locally like this on your own PC you're  going to need a fairly beefy computer if you  

have one great and if you don't don't worry I'll  still show you how you can run an experiment with  

Hallo remotely now exactly what a beefy computer is  well that's kind of hard to say since I couldn't  

find an actual recommended specifications the only  thing for certain is that you will need an Nvidia  

graphics card if you have an Nvidia graphics  card and you've already successfully run say  

for example stable diffusion or other AI image  generators it's likely you should be good to go as  

for actual GPU requirements my guess would be that  anything from a 3060 up should probably work but  

again that's just a guess for those of you who are  going to follow along it would be really awesome  

if you could leave a comment saying if the steps  in this video work for you or don't work along  

with What GPU you are running so that we can help  other people out. All right so let's get started uh  

but first my friend Tony here has something he'd  like to say... I'm thinking you should hit the like  

and subscribe button, you know just for shits and  giggles. Go on do it. Okay well you heard him. Now  

there are a couple different ways to install Hallo on your PC and because I'm such a great guy we're  

going to do it the quickest easiest most painfree  way possible by making use of something called  

Pinocchio think of Pinocchio as an AI portal  Pinocchio greatly simplifies installation of AI  

software in many cases requiring literally just  a single click this means no more command line  

arguments or using git or manually installing  python or any of that stuff Pinocchio not only  

installs the necessary AI components and  dependencies it then provides a simple user  

interface to access it all in your browser head on  over to Pinocchio dot computer that's Pinocchio and it's  

spelled p i n o k io dot computer and click the link  to download Pinocchio onto your PC I'll put a link  

to Pinocchio in the description below for those  of you who think your PC might not be up to the  

task of running hallo just click the link and the  description below to try Hallo remotely and then  

skip ahead in this video to generating our first  image I've time stamped the video accordingly here  

there it is all right we're going to move that  into a folder that we want to extract it in I'm  

going to put mine in a folder called AI it's where  I keep all of my uh AI projects together as you  

can see I already have Pinokio installed um but what  you're going to do is you're going to right click  

on Pinocchio and you're going to choose extract  all when you do extract all you will wind up with  

this same folder that I have right here in the  same folder structure so go ahead and do that  

right now and once you've got it extracted you  can safely go ahead and delete the uh the zip  

file here then go inside your Pinocchio folder  and you're going to see Pinocchio set up 1.3.4  

or whatever the current version is when you're  downloading Pinocchio and just double click  

this to install Pinocchio if you get any sort  of a security warning during the installation  

of Pinocchio from Windows uh go ahead and click  continue uh to continue on with the installation  

windows will sometimes give you a security warning  like that if it's software that's been downloaded  

from the internet and it's relatively unknown  software but Hallo is completely safe to install  

on your computer I'm going to go ahead and start  mine now and like I said since I already have it  

installed mine may start a little bit faster than  yours since I don't have to download uh uh all of  

the files that your initial installation is going  to have to download so it should start up here in  

just a just a couple seconds and when Pinocchio  starts you will see it's going to have uh this  

cool little user interface on it and here it is  now as you can tell I already have hallo installed  

on mine for yours what you're going to want to do  is once you get into uh your uh pinnochio interface  

here this is going to be empty you're going to  click on Discover when you click on Discover  

you're just going to type in hallo just like that  then you're going to click on hello right here and  

then download it to your computer and once you've  clicked that download button just go ahead and sit  

back and relax and let Pinocchio do all of that  tedious downloading and configuration for you  

uh this may take a little while just depending on  your internet connection now once it's done you're  

going to find you're going to see this hallow  right up here just like I do and then what you're  

going to do is you're going to click on that and  you're going to click this little start uh button  

over here and when you click the start button  you're going to see a lot of text that's going  

to appear inside a terminal command type window  uh the first time you launch Halo not Halo hallo  

it will also take a little while because  additional files will need to be downloaded  

okay so I'm going to go ahead and start mine  now and once I click the start button you're  

going to see the terminal window appear here  and you'll see it uh populate with a lot of  

text what we're looking for is um right down  here where my mouse is uh you will see the word  

started once the word started appears here then  we are good to go uh it should be here in just a

second there it is started okay so what you  want to do once you see the word started here  

you're going to look for the line right here it  says running on local URL and then a URL here  

the URL is clickable go ahead and click that your  browser is going to open and you are now in hallow  

all right so we're in hallow and we're ready to  make some Talking Heads now the first thing we  

need to do is gather up an image and a sound bite  uh the image needs to be of a face with the face  

occupying roughly about 70% or more of the image  space and the image needs to be square and sized  

to 512 by 512 pixels uh a good source for face  images is pexels.com the images are free to use  

just search for the word face okay and the audio  must and wave format and for our example what  

we're working on here today a relatively short  audio clip I'd say 4 seconds or less would be  

pretty much ideal so if you want to follow along  with me I've included a download pack with sample  

images and voice clips in the description below  this will save you from having to hunt around and  

resize images and gather together sound clips and  all of that kind of stuff and it will allow us to  

create the same images working together just pause  this video now if you want to go download those  

so go ahead and select your image and sound or if  you've downloaded my samples select the woman one  

image let me find it here woman one we're going to  drag you right here and then the corresponding uh  

woman one sound we're going to drop that right  here all right you can also drop an image and  

then record your own audio for that image if you  want by clicking the microphone button right here  

for our first image we're going to leave all of  the default settings as they are okay so with  

our image and our voice clip selected go ahead and  click the submit button down at the bottom of the  

page to start the rendering process now with the  default settings here I tend to average about 2  

to 3 minutes of processing time for every second  of video so if you're following along and using  

my samples the audio is roughly 2 to 3 seconds  in length which means uh for me at least it will  

take around four to 6 minutes to generate this  image also uh keep in mind that the generation  

time for you is going to vary from mine depending  on your PC Hardware uh your times may be a little  

bit longer than mine or a little bit shorter than  mine just depending pretty much on What GPU you're  

running and a good way to know where you're at  in the rendering process is um you can always  

go ahead and just click on your Pinocchio  terminal window here and you can watch the  

progress uh as your image is being generated here  sometimes it takes a long time and you might start  

to think oh I wonder if this is frozen up is it  actually doing anything well you can look at the  

window right here and tell that uh we are actually  making progress now I will tell you that sometimes  

it will freeze up on you and I'm going to make  a additional video here uh within the next few  

days to address some of the common issues that  I've run into and how I fix them but for right  

now everything uh at least on my end here this is  looking good so I'm we're just going to sit back  

and wait for this to finish rendering should be  done here in just a few seconds all right so we're  

done with the rendering it's time to click the  button here and be amazed I will say whatever you

want I will say whatever you want that  that just absolutely kills me that is  

that is so freaking cool I will say whatever  you want I will say whatever you want love it  

love it love it totally unreal all right so I  mean this she looks great whatever you want uh  

let's try another one if you've downloaded my  samples uh go ahead and choose woman two along  

with her corresponding sound bite and click the  uh the submit button I will say whatever you want  

and we are done that one took uh roughly just  just under 4 minutes to uh to generate here so  

let's go ahead and click the play button and  see what we get I will say whatever you want  

I will say whatever you want I still unbelievable  I will say whatever you want and while the result  

is okay this one looks quite a bit more artificial  than our first example did her head is quite still  

I will say whatever you want lip movements and  expressions are greatly ere exaggerated I will  

say so let's see if we can improve that uh just a  little here what we're going to do is we're going  

to leave the size steps FPS and CFG scale uh at  their defaults we're going to change our pose  

weight to three and what that will do is that  will give slightly more movement to her head  

overall her actual entire head and then  what we're going to do is we're going to  

change the face weight down to let's say point 4 what  that'll do is that will reduce her exaggerated  

expressions and we're going to change the  lip weight to point 3 and that will reduce the lip  

movement uh because it was it was just too much  it was greatly exaggerated and then we're going  

to go ahead and press this submit button and  let's let this one render I'm going to pull  

my timer back up here this should uh take  about the same time so be back in about 4

minutes all right so we are done once again about  3 minutes and about 45 seconds it took that time  

and let's see what this one looks like I will  say whatever you want this is it this still just  

amazes me uh I am I am just absolutely blown away  by this I love it so much that that that looks a  

lot better that looks good okay so I don't want  to make this video overly long and I don't want  

to bombard you with too much here all at once uh  We've covered quite a bit we covered downloading  

and installing Pinocchio and the installation and  basic usage of hallo and this is definitely enough  

to get you started and get you going uh creating  fascinating talking images right there on your  

own PC now there are a few more things that I  definitely want to cover like for example how to  

smooth out your generated videos to make them look  more natural along with some basic troubleshooting  

tips and I'm going to cover those in a follow-up  video that I will post here within the next week  

or so thanks so much for hanging out with me today  and I hope you enjoyed this as much as I did and  

I hope you find this just as fascinating as I  do uh be sure to like And subscribe so you'll  

be notified when I upload uh the follow-up  video to this one and if you downloaded my  

samples feel free to go ahead and create some  more talking animations using the male images  

that are included along with their corresponding  sound bites they're pre-sized so it'll save you a  

lot of time and everything's ready for you to use  so thanks for being here and I'll talk to you soon

artificial intelligence is no  match for natural stupidity