Use AI To Turn Images Into Videos!
Summary
TLDRThe video demonstrates how to use multiple AI generative tools like Midjourney, Runway, Kyber, and Wonder Studios to create fun video effects. The main objective is to showcase creative ways to blend these tools to produce engaging videos. It starts by generating a 16:9 aspect ratio image on Midjourney of a robot in an alien world, then creating a panning animation by prompting successive generations of the image. The best result is brought into Runway's text-to-video generator to produce a short clip of the robot moving. By using the last frame of one generation as the input image for the next, longer seamless transitions are achieved. The animated clips are edited together in DaVinci Resolve for free. Reverse playback and positional keyframing allow the robot to scroll back where it came from. A screenshot of the final frame is animated further in Kyber in a 3D rendering style. Adjustment layers in DaVinci add camera shake and overlay effects. Another demonstrated effect turns the host into a robot using a picture frame lowered over his body. The process involves recording himself, then generating a robot version with the same motion via Wonder Studios. Keyframed cropping in DaVinci conceals parts of the original video to reveal the robot version underneath. Overall, the core message is about blending multiple AI tools to unlock new creative possibilities for generating visual effects and unique videos. Specifically, using the outputs from one generator as inputs for others enables chaining tools. The video aims to inspire viewers to experiment with leveraging different solutions together by showing real examples of what can be built.
Takeaways
- The video demonstrates combining multiple AI generation tools like Midjourney, Runway, Kyber, and Wonder to create fun effects
- Midjourney's panning feature is used to generate an animated image by prompting additional frames
- Runway's image-to-video feature converts AI art into short video clips
- Chaining multiple Runway generations together creates a longer animation
- Kyber converts an AI image into a 3D rendered video
- Wonder AI swaps a person in a video with an animated character
- DaVinci Resolve is used to composite all the media together into a final video
- A viral Twitter video is recreated using Wonder AI and masking
- The video encourages experimenting with and blending different creative AI tools
- Futuretools.io curates notable AI tools and news in a free newsletter
Q & A
What AI tool is used to generate an animated image?
-Midjourney's panning feature is used to generate an animated image by prompting additional frames moving in a direction.
How does Runway convert an AI image into a short video?
-Runway's image-to-video feature can take a static AI image and automatically generate a short video clip from it.
What technique extends a Runway animation?
-Feeding the last frame of one Runway generation as the input image to the next generation chains them together into a longer animation.
How does Kyber animate an AI image?
-Kyber converts a static AI image into a 3D rendered video with motion and animation.
What does Wonder AI allow you to do?
-Wonder AI can replace a person in a video with an animated 3D character, like a robot.
What tool combines all the media together?
-DaVinci Resolve composites all the different AI-generated media into a final video.
How was the viral Twitter video effect achieved?
-The viral video was recreated using Wonder AI to replace the person with a robot, and video masking in DaVinci to reveal the effect.
What is the main goal of the video?
-The video aims to demonstrate creative techniques for experimenting with and blending different AI generation tools.
Where can you find curated AI tools and news?
-Futuretools.io offers a free newsletter curating notable AI tools and news.
What tools are used to create effects in the video?
-The video uses Midjourney, Runway, Kyber, Wonder, and DaVinci Resolve to create fun AI effects and animations.
Outlines
Introduction and Overview
The first paragraph introduces the video, stating it will showcase AI generation tools to create fun videos. It mentions using tools like Midjourney, Runway, Kyber, and DaVinci Resolve to generate images, animations, effects, and edit them together into a final video. The goal is to experiment with the tools for creative video making.
Generating Images and Animations with Midjourney and Runway
The second paragraph details using Midjourney to generate an initial image of a robot, then using the pan feature to create variations. The best image is taken into Runway's image-to-video generator to create a short animation. By taking the last frame and generating another video, longer seamless animations are created. The paragraph demonstrates chaining together AI tools for creative iterations.
Adding Effects in DaVinci Resolve
The third paragraph covers pulling the generated animations into DaVinci Resolve for editing. Effects like speed changes, reversals, pans, and overlays are added for visual interest. An adjustment layer with camera shake provides a handheld look. The goal is to blend outputs from multiple AI tools for a creative final video.
Mindmap
Keywords
💡AI generation tools
💡panning
💡image-to-video
💡generative video
💡visual effects
💡robot
💡wonder dynamics
💡DaVinci Resolve
💡futuretools.io
💡AI experimentation
Highlights
The video shows how to use AI tools like Midjourney, Runway, Kyber, and DaVinci Resolve to generate creative visual effects and animations.
Midjourney's image generation and panning feature is used to create an animated background.
Runway's text-to-video feature generates short video clips from images.
Feeding the last frame of one Runway video into the next iteration creates a smooth transition between videos.
Screenshots from the generated videos are used as prompts in other tools to continue the creative iterations.
Kyber generates a 3D animated video from an image prompt.
DaVinci Resolve stitches together all the generated content into a final video with transitions and effects.
Slow zooms and pans are added for visual interest using DaVinci Resolve's keyframing.
Camera shake and overlay effects make the final video look more realistic.
The video shows how to use Wonder to turn a real video into an AI-generated animated character.
Cropping and layering two DaVinci Resolve video tracks creates the animated picture frame effect.
Keyframing the crop effect synchronizes it to the picture frame movement.
Blending multiple AI tools together allows for creative experimentation and video generation.
The process demonstrates how to iterate and build on AI outputs to produce unique results.
The video aims to inspire viewers to try using AI tools for their own creative projects.
Transcripts
in this video we're going to have some
fun I want to experiment with a handful
of different AI generation tools to make
videos like the one that you're seeing
on the screen right now and I'll also
show you how I made this video where I
turn myself into a robot by pulling a
picture frame over myself there's a
handful of cool tools that I haven't
really played with on video recently
like mid Journey's new panning feature
runways Gen 2 image to video feature and
we can also play with some cool effects
with kyber we'll pull it all together
into a single video using DaVinci
Resolve and see what we come up with so
to start let's generate an image in
mid-journey here imagine a friendly
robot in a colorful alien world let's go
aspect ratio 16 9 to give it the wider
image so here's what we got I really do
like these images I like this bottom
right one a lot let's create an
animation out of this so I'm going to go
ahead and upscale number four here but
then let's pan to the left on this I'm
gonna click the left Arrow I'm gonna use
the same prompt and just see what we get
out of it and here's our version where
it scrolled left and it added another
little robot to it I think I like this
top left one the best let's go ahead and
upscale number one here then I want to
pan left one more time but I don't want
it to keep adding robots so I'm just
gonna get rid of that part and call this
a colorful alien world with beautiful
plant life now we've got our four wide
images I think I like this one the best
so let's go ahead and upscale number
four here and here's our image and let's
go ahead and start playing around with
it in some of these other tools so the
first tool I want to experiment with
here is runway's New Gen 2 it says text
to video but they now actually give you
an option to upload an image here what
I'm going to do is I'm going to go ahead
and take our original image here with
just the first generation with just the
original robot so we can go ahead and
drag and drop it right here we've got
our image prompt I'm going to leave this
prompt completely blank let's just see
what Runway does with it and we'll click
generate and here's the video it
generated it generated a little four
second clip of our robot moving around
here which is pretty cool but there's
one other little trick that I learned
from William can hear on Twitter I mean
X or whatever you call it these days he
used Gen 2 and then used the last frame
of the Gen 2 output as the image prompt
for the Next Generation so that each
video just sort of morphed into the next
video so I'd like to give that a try and
see if we can generate a video a little
bit longer than four seconds so I'm
going to open this video up here in my
video player I'm going to go all the way
to the final frame here of the video and
then I'm going to take a screenshot of
this full frame image here we'll go
ahead and delete our original image here
upload a new image and this time I'm
going to drag my screenshot into this
one and use this as the initial starting
image I'm going to click generate one
more time and now we got this one where
our robot moves a little bit more let's
just see how it looks if I pull them
together in DaVinci Resolve here now one
of the reasons I always like to show off
this stuff using DaVinci Resolve is
because DaVinci Resolve works on a PC it
works on a Mac and it's free to use you
could just download it for free I'll
take both vid1 and vid 2 here here's our
first video here's our second video so
you can see we've kind of got a longer
video now now if I wanted I can do one
more time here and take a screenshot of
this final frame so we'll go full screen
with this new video too we'll go all the
way to our final frame here where our
little dudes looking off to the side and
then we'll take a screenshot of this
full image here and then we'll go ahead
and pull this one in as our starting
image for our third round here and now
we wait
and now we have our third video of our
robot starting to look a little bit less
like a robot as time goes by but this
will be fine for our purposes let's go
ahead and save this video let's go ahead
and pull vid 3 into DaVinci Resolve here
and theoretically they should line up
pretty well and transition into each
other you can see with each subsequent
generation the quality kind of gets a
little bit worse I probably should have
been upscaling each initial image and
starting with the upscaled version to
get a better version of it but what I'm
going to do is I'm going to take this
whole sequence here I'm going to create
a new compound clipped out of it then
I'm actually going to duplicate it at
the very end and then up under speed
change I'm going to reverse it so now
it's actually going to kind of go back
where it came from and the reason I did
that is now I want it to pan a little
bit so I'm going to move these both up
here and then remember I've got this
full image of our initial robot here I
want it to pan to the left and now move
over to this screen here so I'm going to
bring this in and overlap it I'm going
to go to this last frame in my second
clip here I'm going to bring down our
opacity a little bit so I can see what's
behind it and now I'm going to use this
image here and I'm going to do my best
to line up our robots so if I zoom this
in move our position over to the left
here we're now pretty dang close so now
I'm going to move this out of the way
bring my opacity back up on this
original clip and now when it
transitions it should just sort of
freeze on the robot there like that but
I also want it to pan over to the other
image so let's go ahead and add a
keyframe to start here under our
transform keyframe go all the way to the
right of our image here and we'll change
our position so now that this other
robot is on the screen so now it's going
to come out of this video oh and boom
scroll over pan over to this robot and
now we can do some fun work with this
image here so I'll go full screen on
this guy and we'll take a screenshot of
this one now now let's pull this image
into kyber and have some fun with that
one I'm going to create a video here
begin with initial image and we'll pull
our screenshot of our robot over on this
side in let's continue to The Prompt a
video of a friendly robot in a colorful
alien world and let's do in the style of
3D rendering we'll go to video settings
let's have it do this part for eight
seconds we'll have it zoom in while it's
doing it make sure we have show initial
image in the first frame that way it
should be fairly seamless let's click on
preview frames here and let's go ahead
and use this top left one and create our
video and here's what we got out of this
one so we'll go ahead and download this
video we could pull this one into
DaVinci Resolve now I'm gonna overlap it
a little bit here and here's what it
does once it finishes its pan it gets
here and then it starts to do this crazy
thing so now we have a a 37 second video
I'm going to add an adjustment clip over
this entire stretch here of video and
I'm going to keyframe this adjustment
clip so that there's a slow zoom out so
what I'm going to do is I'm going to add
a keyframe at the very end of this video
here and then I'm going to come to the
very beginning of this video add another
keyframe but I'm going to zoom in a
little bit on it and then maybe position
them over to one side a little bit like
this and that's just going to give it a
little bit more of an effects you can
see the whole time it's going through
these various transitions it's kind of
doing this slow zoom out effect and even
when it starts to go in reverse it's
going to continue that same zoom out
effect that it's been doing the whole
time now to finish this whole thing off
I'm going to add a couple little effects
to it so I'm going to go to effects here
and I'm going to add an adjustment clip
and I'm going to stretch this adjustment
clip across the entire length of the
video now anything I do to this
adjustment eclip is going to affect the
entire video and I want to go to filters
and I want to add a little bit of a
camera shake to make it look like a
camera is sort of being held while
shooting this and click on search I can
type camera and you get this camera
Shake I can add that to this layer now
the whole video has this like little
shake to it but the Shake's a little too
intense so I'm going to come here to
effects I'm going to bring down the
motion scale a bit and the speed scale a
little bit so the motion scale of about
0.543 and a speed scale of about 310
seems to have a natural handheld look to
it in my opinion and then I want to add
one more effect to the top here so let's
add one more adjustment clip up here on
track five stretch it across the whole
thing and then I'm going to add this
little DSLR effect it's got these little
camera overlays on the bottom and here's
the finished product
all right
[Music]
I just love taking all of these
different tools and mixing them together
taking mid-journey and using mid
Journey's pan feature and then using Gen
2 to get an animation and then using the
final frame of a video plugging it back
into Gen 2 to get that animation to
further move along and then taking a
screenshot from that video and throwing
it into kyber and getting a different
style of video I think pulling all of
these tools together is one of the most
fun ways to use them and one of the ways
that we can get really really creative
with some of our video making now here's
another video that I made that went sort
of viral on Twitter and it actually spun
off a handful of other people trying to
recreate it where I take this picture
frame and I move it over my body here
and as I move the picture frame down I
slowly turn myself into a robot finally
dropping the whole thing I become a
robot and then I turn around and walk
out of my office as a robot now I don't
think this video is that well done I
could have done it a lot better if I
spent more time on it but people seem to
like it on social media here's another
version from Eric AKA enigmatic e where
he recreated the same effect but you
know totally went up to me and did it to
a whole other level
improving on the effect that I did here
and then here's another one that I came
across from Andres tamashiro where he
managed to replicate the same effect as
well adding some cool flash effects into
it and accomplishing the same thing so
pretty cool to see other people taking
this idea and running with it so here's
how I did it I recorded this video of me
and my office here where I had this
picture frame and I just went through
and did all the stuff that I was doing
with it I put it over my head if you
watch my video there's a little glitch
because it got stuck around my arms and
I had to like fix it that's why you see
a little blip in my original video where
it gets stuck on my arms and then I walk
out of my office then what I did was I
took that exact video and I came over to
wonder Studio here and created a new
project in Wonder Studio added that
video by uploading it over here putting
my video in the timeline and then when
it goes to pick the actor you click scan
frame for actors here and then you can
see it actually found me in the image
and then you open this little slot here
to pick your character I picked the
desert bot here assigned him to my actor
and then rendered out the video once I
rendered out the video I had a video
that looked like this where it's pretty
much the exact same video as before but
this time I'm a robot in the whole video
instead of me in the whole video so I
have two videos this one and this one I
pulled both those videos into DaVinci
Resolve and overlaid them over each
other so that the video underneath is
the video of the robot so if I disable
this video track you'll see that
underneath this video track is the robot
video and then the video that's on top
this video too is the me video now there
are probably better ways to do this but
here's how I did it I actually keyframed
a crop on it so if I click this little
like diamond button on my timeline here
you can see each one of these dots is a
new keyframe so I put this over my head
I start to move it down you can see I
start my AI cropping keyframe right here
I do a crop top right here and as I move
the frame down the keyframe right here
you'll want you can see my crop top
keyframe here start to move as I move
this down so it's basically taking the
top video and slowly cropping the top
off and moving it down so as I move the
picture frame down I am just making sure
that the keyframe of this top is moving
down with the picture frame so it's
essentially revealing the video below it
as I crop it down and it doesn't look
super great around my hands if I bring
my opacity down a little bit on this top
layer you can actually see the layer
below it so you can see as I crop down
it's just hiding more and more of the
top layer here I actually had to bring
the crop back up because the picture
frame was going up a little bit and then
as the picture frame starts to fall
again I had to bring the crop back down
but you can see the picture frame goes
sideways right in here and the crop
isn't following it because I'm just
cropping straight down but it happens so
fast that you barely even notice it but
if you watch as I press play you'll
notice that this crop just moves down
with the picture frame so I can even
show you that right here here's the
picture of just the robot but the crop
is all the way up if I move this crop
down you'll see me again so all I'm
doing is just animating this crop and
moving the crop down with my picture
frame and just adding a keyframe each
time that's the whole process so there
you have it there's a couple fun little
visual effects you can do with your AI
generated images with your video footage
tools like Wonder Dynamics kyber Gen 2
mid journey I just love blending them
all together and pulling things together
and making fun little creative ideas
hopefully you got some ideas out of this
video this was just fun for me to make I
wanted to show off some cool things that
I've been experimenting with you know
hopefully give you some inspiration give
you some ideas of some cool visual
effects to try for some of your future
fun videos If you like this kind of
stuff check out futuretools.io this is
where I curate all of the coolest AI
tools that I come across keep the news
up to date all the time and also I've
got a free newsletter where every single
Friday I will share just a handful of
coolest tools and just the most notable
AI news that I come across you can find
it all over at futuretools.io and join
the free newsletter thank you so much
for watching I hope you found this fun
little experimental nerdout Fest
enjoyable to watch I'm probably going to
nerd out over more tools like this and
experiment and play around on camera in
the future maybe even do some of this
stuff on live stream where I just screw
around live if you want to do that and
hang out live while we mess around with
some tools let me know maybe let's we'll
make happen over on the YouTube channel
once again thank you so much for hanging
out I really really appreciate you I'll
see you guys in the next video bye-bye
[Music]
thank you
Voir Plus de Vidéos Connexes
How to Make Stickers to Sell with AI Artificial Intelligence Midjourney App and Photoshop
Unbelievable AI Movie: Create ENTIRE FILM with AI!
Mastering Leonardo AI: A Comprehensive Step-by-Step Tutorial for Beginners
Create an Entire MOVIE From Scratch! FREE AI Tools & Step-by-Step Guide (2024!!)
Midjourney Version 6 - IS AMAZING!!!
This Ai Tool Makes Full Music Videos With Only One Prompt
Create 3D Animated Love Story With Free AI Tools in 5 Mins. #aianimation #pikalabs
5.0 / 5 (0 votes)