Use AI To Turn Images Into Videos!

Summary

The video demonstrates how to use multiple AI generative tools like Midjourney, Runway, Kyber, and Wonder Studios to create fun video effects. The main objective is to showcase creative ways to blend these tools to produce engaging videos. It starts by generating a 16:9 aspect ratio image on Midjourney of a robot in an alien world, then creating a panning animation by prompting successive generations of the image. The best result is brought into Runway's text-to-video generator to produce a short clip of the robot moving. By using the last frame of one generation as the input image for the next, longer seamless transitions are achieved. The animated clips are edited together in DaVinci Resolve for free. Reverse playback and positional keyframing allow the robot to scroll back where it came from. A screenshot of the final frame is animated further in Kyber in a 3D rendering style. Adjustment layers in DaVinci add camera shake and overlay effects. Another demonstrated effect turns the host into a robot using a picture frame lowered over his body. The process involves recording himself, then generating a robot version with the same motion via Wonder Studios. Keyframed cropping in DaVinci conceals parts of the original video to reveal the robot version underneath. Overall, the core message is about blending multiple AI tools to unlock new creative possibilities for generating visual effects and unique videos. Specifically, using the outputs from one generator as inputs for others enables chaining tools. The video aims to inspire viewers to experiment with leveraging different solutions together by showing real examples of what can be built.

Takeaways

• The video demonstrates combining multiple AI generation tools like Midjourney, Runway, Kyber, and Wonder to create fun effects
• Midjourney's panning feature is used to generate an animated image by prompting additional frames
• Runway's image-to-video feature converts AI art into short video clips
• Chaining multiple Runway generations together creates a longer animation
• Kyber converts an AI image into a 3D rendered video
• Wonder AI swaps a person in a video with an animated character
• DaVinci Resolve is used to composite all the media together into a final video
• A viral Twitter video is recreated using Wonder AI and masking
• The video encourages experimenting with and blending different creative AI tools
• Futuretools.io curates notable AI tools and news in a free newsletter

Q & A

What AI tool is used to generate an animated image?

Midjourney's panning feature is used to generate an animated image by prompting additional frames moving in a direction.

How does Runway convert an AI image into a short video?

Runway's image-to-video feature can take a static AI image and automatically generate a short video clip from it.

What technique extends a Runway animation?

Feeding the last frame of one Runway generation as the input image to the next generation chains them together into a longer animation.

How does Kyber animate an AI image?

Kyber converts a static AI image into a 3D rendered video with motion and animation.

What does Wonder AI allow you to do?

Wonder AI can replace a person in a video with an animated 3D character, like a robot.

What tool combines all the media together?

DaVinci Resolve composites all the different AI-generated media into a final video.

How was the viral Twitter video effect achieved?

The viral video was recreated using Wonder AI to replace the person with a robot, and video masking in DaVinci to reveal the effect.

What is the main goal of the video?

The video aims to demonstrate creative techniques for experimenting with and blending different AI generation tools.

Where can you find curated AI tools and news?

Futuretools.io offers a free newsletter curating notable AI tools and news.

What tools are used to create effects in the video?

The video uses Midjourney, Runway, Kyber, Wonder, and DaVinci Resolve to create fun AI effects and animations.

Outlines

00:00

Introduction and Overview

The first paragraph introduces the video, stating it will showcase AI generation tools to create fun videos. It mentions using tools like Midjourney, Runway, Kyber, and DaVinci Resolve to generate images, animations, effects, and edit them together into a final video. The goal is to experiment with the tools for creative video making.

05:01

Generating Images and Animations with Midjourney and Runway

The second paragraph details using Midjourney to generate an initial image of a robot, then using the pan feature to create variations. The best image is taken into Runway's image-to-video generator to create a short animation. By taking the last frame and generating another video, longer seamless animations are created. The paragraph demonstrates chaining together AI tools for creative iterations.

10:03

Adding Effects in DaVinci Resolve

The third paragraph covers pulling the generated animations into DaVinci Resolve for editing. Effects like speed changes, reversals, pans, and overlays are added for visual interest. An adjustment layer with camera shake provides a handheld look. The goal is to blend outputs from multiple AI tools for a creative final video.

Keywords

💡AI generation tools

This refers to software tools that use artificial intelligence to automatically generate images, videos, text and other multimedia content. The video explores several AI generation tools like Midjourney, Runway, Kyber, and Wonder Dynamics. These tools are used to create visual effects and animated sequences in creative ways, which is a core theme of the video.

💡panning

In the context of image generation, panning refers to creating an animated sequence by generating multiple related images and having the AI transition smoothly between them, giving the illusion of the camera panning over a scene. The video demonstrates using Midjourney's image generation capabilities and then panning between the images to create an animated sequence.

💡image-to-video

This refers to AI systems that can take a still image as input and automatically generate a short video clip extending the scene with realistic motion and animation. The video experiments with Runway's image-to-video feature, using it iteratively to extend an animated clip.

💡generative video

Generative video uses AI to automatically create video content. In the video, the presenter uses Kyber to generate a unique animated video from a prompt and base image. Generative video is a key application highlighted for AI generation tools.

💡visual effects

Visual effects refer to techniques to manipulate visual media to create illusions or imagined scenes for movies and videos. The presenter demonstrates combining multiple AI generation tools to create custom visual effects sequences like pan and zoom effects, camera shakes, transitions between tools.

💡robot

The video explores using AI tools to transform the presenter into a robot character, both in a still image and a video. The robot is a theme carried across the AI generation tool experiments, serving as an unusual character and visual effect.

💡wonder dynamics

This is an AI animation studio tool that can take a video clip and transform the people in it into animated fantasy characters via motion transfer. It is used in the video to convert the presenter into a robot in the video footage.

💡DaVinci Resolve

DaVinci Resolve is professional video editing software used by the presenter to composite different AI generated clips together into a final video. It provides transitions between the experiments with different generative tools.

💡futuretools.io

This is the presenter's website where he curates and tracks the latest AI generation tools. He highlights it at the end as a resource for viewers interested in keeping updated on new creative AI tools and trends like those demonstrated in the video.

💡AI experimentation

A core theme of the video is experimenting with creative ways to combine different AI generation tools for visual effects and video content. The presenter demonstrates an exploratory, iterative approach to tinkering with the tools' capabilities.

Highlights

The video shows how to use AI tools like Midjourney, Runway, Kyber, and DaVinci Resolve to generate creative visual effects and animations.

Midjourney's image generation and panning feature is used to create an animated background.

Runway's text-to-video feature generates short video clips from images.

Feeding the last frame of one Runway video into the next iteration creates a smooth transition between videos.

Screenshots from the generated videos are used as prompts in other tools to continue the creative iterations.

Kyber generates a 3D animated video from an image prompt.

DaVinci Resolve stitches together all the generated content into a final video with transitions and effects.

Slow zooms and pans are added for visual interest using DaVinci Resolve's keyframing.

Camera shake and overlay effects make the final video look more realistic.

The video shows how to use Wonder to turn a real video into an AI-generated animated character.

Cropping and layering two DaVinci Resolve video tracks creates the animated picture frame effect.

Keyframing the crop effect synchronizes it to the picture frame movement.

Blending multiple AI tools together allows for creative experimentation and video generation.

The process demonstrates how to iterate and build on AI outputs to produce unique results.

The video aims to inspire viewers to try using AI tools for their own creative projects.

Transcripts

in this video we're going to have some

fun I want to experiment with a handful

of different AI generation tools to make

videos like the one that you're seeing

on the screen right now and I'll also

show you how I made this video where I

turn myself into a robot by pulling a

picture frame over myself there's a

handful of cool tools that I haven't

really played with on video recently

like mid Journey's new panning feature

runways Gen 2 image to video feature and

we can also play with some cool effects

with kyber we'll pull it all together

into a single video using DaVinci

Resolve and see what we come up with so

to start let's generate an image in

mid-journey here imagine a friendly

robot in a colorful alien world let's go

aspect ratio 16 9 to give it the wider

image so here's what we got I really do

like these images I like this bottom

right one a lot let's create an

animation out of this so I'm going to go

ahead and upscale number four here but

then let's pan to the left on this I'm

gonna click the left Arrow I'm gonna use

the same prompt and just see what we get

out of it and here's our version where

it scrolled left and it added another

little robot to it I think I like this

top left one the best let's go ahead and

upscale number one here then I want to

pan left one more time but I don't want

it to keep adding robots so I'm just

gonna get rid of that part and call this

a colorful alien world with beautiful

plant life now we've got our four wide

images I think I like this one the best

so let's go ahead and upscale number

four here and here's our image and let's

go ahead and start playing around with

it in some of these other tools so the

first tool I want to experiment with

here is runway's New Gen 2 it says text

to video but they now actually give you

an option to upload an image here what

I'm going to do is I'm going to go ahead

and take our original image here with

just the first generation with just the

original robot so we can go ahead and

drag and drop it right here we've got

our image prompt I'm going to leave this

prompt completely blank let's just see

what Runway does with it and we'll click

generate and here's the video it

generated it generated a little four

second clip of our robot moving around

here which is pretty cool but there's

one other little trick that I learned

from William can hear on Twitter I mean

X or whatever you call it these days he

used Gen 2 and then used the last frame

of the Gen 2 output as the image prompt

for the Next Generation so that each

video just sort of morphed into the next

video so I'd like to give that a try and

see if we can generate a video a little

bit longer than four seconds so I'm

going to open this video up here in my

video player I'm going to go all the way

to the final frame here of the video and

then I'm going to take a screenshot of

this full frame image here we'll go

ahead and delete our original image here

upload a new image and this time I'm

going to drag my screenshot into this

one and use this as the initial starting

image I'm going to click generate one

more time and now we got this one where

our robot moves a little bit more let's

just see how it looks if I pull them

together in DaVinci Resolve here now one

of the reasons I always like to show off

this stuff using DaVinci Resolve is

because DaVinci Resolve works on a PC it

works on a Mac and it's free to use you

could just download it for free I'll

take both vid1 and vid 2 here here's our

first video here's our second video so

you can see we've kind of got a longer

video now now if I wanted I can do one

more time here and take a screenshot of

this final frame so we'll go full screen

with this new video too we'll go all the

way to our final frame here where our

little dudes looking off to the side and

then we'll take a screenshot of this

full image here and then we'll go ahead

and pull this one in as our starting

image for our third round here and now

we wait

and now we have our third video of our

robot starting to look a little bit less

like a robot as time goes by but this

will be fine for our purposes let's go

ahead and save this video let's go ahead

and pull vid 3 into DaVinci Resolve here

and theoretically they should line up

pretty well and transition into each

other you can see with each subsequent

generation the quality kind of gets a

little bit worse I probably should have

been upscaling each initial image and

starting with the upscaled version to

get a better version of it but what I'm

going to do is I'm going to take this

whole sequence here I'm going to create

a new compound clipped out of it then

I'm actually going to duplicate it at

the very end and then up under speed

change I'm going to reverse it so now

it's actually going to kind of go back

where it came from and the reason I did

that is now I want it to pan a little

bit so I'm going to move these both up

here and then remember I've got this

full image of our initial robot here I

want it to pan to the left and now move

over to this screen here so I'm going to

bring this in and overlap it I'm going

to go to this last frame in my second

clip here I'm going to bring down our

opacity a little bit so I can see what's

behind it and now I'm going to use this

image here and I'm going to do my best

to line up our robots so if I zoom this

in move our position over to the left

here we're now pretty dang close so now

I'm going to move this out of the way

bring my opacity back up on this

original clip and now when it

transitions it should just sort of

freeze on the robot there like that but

I also want it to pan over to the other

image so let's go ahead and add a

keyframe to start here under our

transform keyframe go all the way to the

right of our image here and we'll change

our position so now that this other

robot is on the screen so now it's going

to come out of this video oh and boom

scroll over pan over to this robot and

now we can do some fun work with this

image here so I'll go full screen on

this guy and we'll take a screenshot of

this one now now let's pull this image

into kyber and have some fun with that

one I'm going to create a video here

begin with initial image and we'll pull

our screenshot of our robot over on this

side in let's continue to The Prompt a

video of a friendly robot in a colorful

alien world and let's do in the style of

3D rendering we'll go to video settings

let's have it do this part for eight

seconds we'll have it zoom in while it's

doing it make sure we have show initial

image in the first frame that way it

should be fairly seamless let's click on

preview frames here and let's go ahead

and use this top left one and create our

video and here's what we got out of this

one so we'll go ahead and download this

video we could pull this one into

DaVinci Resolve now I'm gonna overlap it

a little bit here and here's what it

does once it finishes its pan it gets

here and then it starts to do this crazy

thing so now we have a a 37 second video

I'm going to add an adjustment clip over

this entire stretch here of video and

I'm going to keyframe this adjustment

clip so that there's a slow zoom out so

what I'm going to do is I'm going to add

a keyframe at the very end of this video

here and then I'm going to come to the

very beginning of this video add another

keyframe but I'm going to zoom in a

little bit on it and then maybe position

them over to one side a little bit like

this and that's just going to give it a

little bit more of an effects you can

see the whole time it's going through

these various transitions it's kind of

doing this slow zoom out effect and even

when it starts to go in reverse it's

going to continue that same zoom out

effect that it's been doing the whole

time now to finish this whole thing off

I'm going to add a couple little effects

to it so I'm going to go to effects here

and I'm going to add an adjustment clip

and I'm going to stretch this adjustment

clip across the entire length of the

video now anything I do to this

adjustment eclip is going to affect the

entire video and I want to go to filters

and I want to add a little bit of a

camera shake to make it look like a

camera is sort of being held while

shooting this and click on search I can

type camera and you get this camera

Shake I can add that to this layer now

the whole video has this like little

shake to it but the Shake's a little too

intense so I'm going to come here to

effects I'm going to bring down the

motion scale a bit and the speed scale a

little bit so the motion scale of about

0.543 and a speed scale of about 310

seems to have a natural handheld look to

it in my opinion and then I want to add

one more effect to the top here so let's

add one more adjustment clip up here on

track five stretch it across the whole

thing and then I'm going to add this

little DSLR effect it's got these little

camera overlays on the bottom and here's

the finished product

all right

[Music]

I just love taking all of these

different tools and mixing them together

taking mid-journey and using mid

Journey's pan feature and then using Gen

2 to get an animation and then using the

final frame of a video plugging it back

into Gen 2 to get that animation to

further move along and then taking a

screenshot from that video and throwing

it into kyber and getting a different

style of video I think pulling all of

these tools together is one of the most

fun ways to use them and one of the ways

that we can get really really creative

with some of our video making now here's

another video that I made that went sort

of viral on Twitter and it actually spun

off a handful of other people trying to

recreate it where I take this picture

frame and I move it over my body here

and as I move the picture frame down I

slowly turn myself into a robot finally

dropping the whole thing I become a

robot and then I turn around and walk

out of my office as a robot now I don't

think this video is that well done I

could have done it a lot better if I

spent more time on it but people seem to

like it on social media here's another

version from Eric AKA enigmatic e where

he recreated the same effect but you

know totally went up to me and did it to

a whole other level

improving on the effect that I did here

and then here's another one that I came

across from Andres tamashiro where he

managed to replicate the same effect as

well adding some cool flash effects into

it and accomplishing the same thing so

pretty cool to see other people taking

this idea and running with it so here's

how I did it I recorded this video of me

and my office here where I had this

picture frame and I just went through

and did all the stuff that I was doing

with it I put it over my head if you

watch my video there's a little glitch

because it got stuck around my arms and

I had to like fix it that's why you see

a little blip in my original video where

it gets stuck on my arms and then I walk

out of my office then what I did was I

took that exact video and I came over to

wonder Studio here and created a new

project in Wonder Studio added that

video by uploading it over here putting

my video in the timeline and then when

it goes to pick the actor you click scan

frame for actors here and then you can

see it actually found me in the image

and then you open this little slot here

to pick your character I picked the

desert bot here assigned him to my actor

and then rendered out the video once I

rendered out the video I had a video

that looked like this where it's pretty

much the exact same video as before but

this time I'm a robot in the whole video

instead of me in the whole video so I

have two videos this one and this one I

pulled both those videos into DaVinci

Resolve and overlaid them over each

other so that the video underneath is

the video of the robot so if I disable

this video track you'll see that

underneath this video track is the robot

video and then the video that's on top

this video too is the me video now there

are probably better ways to do this but

here's how I did it I actually keyframed

a crop on it so if I click this little

like diamond button on my timeline here

you can see each one of these dots is a

new keyframe so I put this over my head

I start to move it down you can see I

start my AI cropping keyframe right here

I do a crop top right here and as I move

the frame down the keyframe right here

you'll want you can see my crop top

keyframe here start to move as I move

this down so it's basically taking the

top video and slowly cropping the top

off and moving it down so as I move the

picture frame down I am just making sure

that the keyframe of this top is moving

down with the picture frame so it's

essentially revealing the video below it

as I crop it down and it doesn't look

super great around my hands if I bring

my opacity down a little bit on this top

layer you can actually see the layer

below it so you can see as I crop down

it's just hiding more and more of the

top layer here I actually had to bring

the crop back up because the picture

frame was going up a little bit and then

as the picture frame starts to fall

again I had to bring the crop back down

but you can see the picture frame goes

sideways right in here and the crop

isn't following it because I'm just

cropping straight down but it happens so

fast that you barely even notice it but

if you watch as I press play you'll

notice that this crop just moves down

with the picture frame so I can even

show you that right here here's the

picture of just the robot but the crop

is all the way up if I move this crop

down you'll see me again so all I'm

doing is just animating this crop and

moving the crop down with my picture

frame and just adding a keyframe each

time that's the whole process so there

you have it there's a couple fun little

visual effects you can do with your AI

generated images with your video footage

tools like Wonder Dynamics kyber Gen 2

mid journey I just love blending them

all together and pulling things together

and making fun little creative ideas

hopefully you got some ideas out of this

video this was just fun for me to make I

wanted to show off some cool things that

I've been experimenting with you know

hopefully give you some inspiration give

you some ideas of some cool visual

effects to try for some of your future

fun videos If you like this kind of

stuff check out futuretools.io this is

where I curate all of the coolest AI

tools that I come across keep the news

up to date all the time and also I've

got a free newsletter where every single

Friday I will share just a handful of

coolest tools and just the most notable

AI news that I come across you can find

it all over at futuretools.io and join

the free newsletter thank you so much

for watching I hope you found this fun

little experimental nerdout Fest

enjoyable to watch I'm probably going to

nerd out over more tools like this and

experiment and play around on camera in

the future maybe even do some of this

stuff on live stream where I just screw

around live if you want to do that and

hang out live while we mess around with

some tools let me know maybe let's we'll

make happen over on the YouTube channel

once again thank you so much for hanging

out I really really appreciate you I'll

see you guys in the next video bye-bye

[Music]

thank you