最好用的Midjourney新功能+GPT，AI半小时制作动态儿童绘本(最强教程) Best Midjourney feature ever make Children's book Tutorial

Discover the innovative process of creating dynamic children's picture books using AI with Midjourney's style tuner and Runway Gen-2's video generation capabilities. This tutorial showcases how to leverage AI to craft a bedtime story called 'Mia's Wishing Tree', generate consistent character styles, and produce engaging videos with subtle animations. The guide also touches on editing and dubbing the final video, offering a comprehensive approach to producing enchanting children's content.

Takeaways

• 🎨 Introducing two new AI functions - Midjourney's style tuner and Runway gen-2's video generation capabilities, which significantly improve the ease and quality of creating children's picture book videos.
• 📈 The style tuner function enhances picture consistency, making it ideal for maintaining character consistency in children's books.
• 🚀 Runway gen-2's update allows for better control over video results, including the ability to move within the Runway lens and adjust the amplitude of movement in generated videos.
• 📖 Static electricity demonstrates the creation of a children's picture book video titled 'Mia's Wishing Tree' using ChatGPT, showcasing the potential for monetization through short video creation.
• 🛠️ The tutorial provides a step-by-step guide on how to use the style tuner, from creating a channel on Midjourney to generating and selecting preferred image styles.
• 📚 ChatGPT4 is utilized to write a warm, bedtime story suitable for children aged 3-6, with a focus on generating a storyboard for the story.
• 🎨 Midjourney's imagine command is used in conjunction with the style suffix to generate images that match the desired style for the picture book.
• 📹 Runway Gen-2's text2video function is used to animate the generated images, adding movement and life to the static pictures.
• 🎞️ Video editing tools like Adobe Premiere Pro are employed to compile the animated images into a cohesive video, complete with transitions, music, and subtitles.
• 🗣️ The use of subtitles and text-to-speech features in video editing software provides a way to dub the story without the need for a professional voice actor.
• 💡 The final product is a dynamic, engaging children's picture book video that can be shared on various platforms, highlighting the potential of AI in content creation.

Q & A

What are the two new functions mentioned in the script that have made it easier to create children's picture book videos?

The two new functions mentioned are Midjourney's style tuner function and Runway gen-2's video generation capabilities.

How does the style tuner function improve the consistency of pictures in a children's picture book?

The style tuner function allows for the maintenance of a consistent style across images, which is crucial for character consistency in children's picture books.

What significant updates have been made to Runway gen-2's video generation features?

Runway gen-2 now has improved fidelity and consistency in its video results, and it allows users to move in the Runway lens and adjust the amplitude of the movement in the generated videos.

How long did it take the speaker to create a children's picture book video using ChatGPT?

It took the speaker about an hour to create a children's picture book video called 'Mia's Wishing Tree'.

What is the process for using the style tuner function in Midjourney?

To use the style tuner, one needs to go to Midjourney, create a channel, enter a command with a slash followed by 'tune', and then enter the desired picture keywords. The user will then be prompted to create a coordinator for the style and choose the number of groups to generate.

How does the speaker select the desired images from the Midjourney style tuner output?

The speaker reviews each group of images and selects the ones that match the desired style, ignoring those that do not fit the intended style for the project.

What is the role of ChatGPT in this tutorial?

ChatGPT is used to generate a short bedtime story suitable for children aged 3-6, as well as to create a storyboard for the story.

How does the speaker use Runway Gen-2 to add movement to the static images?

The speaker uses Runway Gen-2's text2video tool to upload the static images and adds simple commands to describe the desired movement or scene, then adjusts the intensity of the movement and the camera motion to achieve the desired effect.

What video editing tool is mentioned for the final step of combining the generated content?

The video editing tool mentioned is iMovie, which is used to combine the generated videos, add transitions, music, and dubbing, and finally export the completed children's picture book video.

What is the moral of the story 'Mia's Wishing Tree'?

The moral of the story is that with kindness and bravery, all dreams can come true, and it encourages children to make wishes upon the stars and go to sleep with beautiful wishes.

Outlines

00:00

🎨 Introducing AI in Children's Book Creation

This paragraph introduces the audience to the recent advancements in AI technology that have made it easier to create children's picture book videos. The speaker, static electricity, discusses the release of a new model training function by Midjourney called the style tuner, which significantly improves picture consistency, making it ideal for children's books requiring character consistency. Additionally, the speaker mentions the updates to Runway gen-2, which now allows for better video and picture generation, including the ability to adjust the movement amplitude in the generated videos. The paragraph concludes with a personal anecdote of creating a children's picture book video using ChatGPT in just an hour, highlighting the potential of these AI tools for content creation and monetization.

05:01

🛠️ Utilizing the Style Tuner Function

The speaker delves into the specifics of the style tuner function recently updated by Midjourney. This function addresses a common issue faced by designers where the style could not be fixed when using spells to draw. The speaker illustrates how the style tuner allows for consistency in the painting style across different images, even when changing the content, such as from boys to girls or flowers to spaceships. The explanation includes a step-by-step guide on how to use the style tuner, from creating a channel on Midjourney to entering commands and selecting preferred styles from generated groups of images. The paragraph emphasizes the practical application of the style tuner in maintaining a consistent aesthetic for children's picture books.

10:02

🎥 Combining AI Tools for Video Production

In this paragraph, the speaker describes the process of combining three AI tools—ChatGPT, Midjourney, and Runway Gen-2—for the production of a children's picture book video. The speaker begins by using ChatGPT to generate a bedtime story suitable for young children, focusing on a heartwarming narrative that promotes sleep and positive worldviews. The story selected revolves around a little girl named Mia and her interactions with a wishing tree. The speaker then outlines the process of creating a storyboard using ChatGPT and generating relevant images with Midjourney based on the story's content. The paragraph concludes with a brief mention of enhancing the static images with movement using Runway Gen-2, setting the stage for the next steps in the video production process.

15:03

🖼️ Enhancing Still Images with Runway Gen-2

The speaker continues the discussion on video production by focusing on the use of Runway Gen-2 to add motion to the still images generated by Midjourney. The paragraph details the process of uploading images to Runway Gen-2 and using the text2video function to create animated videos. The speaker explains the options available, such as using text, simple images, or a combination of images and descriptions to generate videos. The emphasis is on adding subtle movements and camera motions to enhance the storytelling without overcomplicating the animation. The speaker also provides tips on maintaining consistency and conserving points for video generation, highlighting the importance of careful selection and re-rolling when necessary.

20:04

🎞️ Video Editing and Dubbing

The final paragraph focuses on the editing process of the generated videos. The speaker explains how to import the videos into a video editing tool, such as iMovie, and create transitions between them to form a cohesive narrative. The addition of background music and the use of subtitles for dubbing are also discussed, with the speaker demonstrating how to use the text-to-speech function to generate dubbing for the story. The paragraph concludes with the speaker's personal touch on exporting the final video and sharing it on various platforms. The speaker also encourages viewers to support their content creation journey by liking and subscribing to their channel, Static Electric AI Design Classroom.

Keywords

AI

Artificial Intelligence (AI) refers to the simulation of human intelligence in machines that are programmed to think and learn like humans. In the context of the video, AI is used to create children's picture book videos, demonstrating its capability to generate content and effects that are consistent with the theme of the story, such as characters and settings.

Midjourney

Midjourney is a platform that utilizes AI to generate images based on user input. In the video, Midjourney's new model training function called 'style tuner' is highlighted for its ability to improve picture consistency, which is crucial for children's picture books that require consistent character and scene depictions.

Style Tuner

The style tuner function is a feature that allows users to create images with a consistent style. As explained in the video, it addresses the issue of style variation in AI-generated images, ensuring that characters and scenes maintain a uniform appearance throughout the picture book, which is essential for storytelling and audience engagement.

Runway Gen-2

Runway Gen-2 is a tool mentioned in the video that has been updated to generate videos and pictures with significant improvements in fidelity and consistency. It allows users to create dynamic videos from AI-generated images, adding movement and life to the static scenes from the children's picture book, enhancing the overall viewing experience.

ChatGPT

ChatGPT is an AI language model that can generate human-like text based on the prompts given to it. In the video, ChatGPT4 is used to write a short bedtime story for children, providing the narrative and structure for the children's picture book video. It demonstrates the ability of AI to create content that is engaging, age-appropriate, and thematically consistent.

Children's Picture Book Video

A children's picture book video is a digital format that combines visual images with narrative text to tell a story, typically aimed at young audiences. In the context of the video, the creation of such a video involves the use of AI tools to generate images, write stories, and add dynamic elements, resulting in an engaging and educational medium for children.

Consistency

Consistency in this context refers to the uniformity and coherence of visual elements and storytelling throughout the picture book. The video emphasizes the importance of consistency in maintaining the integrity of the story and characters, which is achieved through the use of AI functions like the style tuner and the capabilities of Runway Gen-2.

Mia's Wishing Tree

Mia's Wishing Tree is the name of the children's picture book video created in the tutorial. It serves as an example to demonstrate the process of using AI tools to generate content, write stories, and produce a video that is both visually appealing and narratively coherent. The story revolves around a little girl named Mia and her interactions with a magical wishing tree.

Storyboard

A storyboard is a sequence of illustrations or images displayed in the order of scenes they appear in a motion picture, video, or interactive animation. In the video, ChatGPT is used to generate a storyboard for the story of Mia's Wishing Tree, which includes descriptions of scenes and actions that will be visualized through AI-generated images and brought to life with the help of Runway Gen-2.

Video Editing

Video editing is the process of manipulating and rearranging video shots to create a new work. In the video tutorial, video editing involves combining the AI-generated images and animated scenes into a cohesive picture book video, adding transitions, music, and dubbing to finalize the production.

Highlights

AI technology has made it easier to create children's picture book videos.

Midjourney's new model training function 'style tuner' greatly improves picture consistency.

The style tuner function is ideal for maintaining character consistency in children's picture books.

Runway gen-2 has released a new version with significant updates to video generation capabilities.

The new Runway gen-2 allows for movement adjustments in the generated videos.

ChatGPT was used to create a children's picture book video called 'Mia's Wishing Tree'.

The style tuner function solves issues with style consistency in AI-generated images.

By using the style tuner, images can be generated with a specific style suffix for consistency.

The process of selecting preferred images from generated groups is detailed for style consistency.

A step-by-step guide on how to use the style tuner function in Midjourney is provided.

ChatGPT4 is utilized to write a short bedtime story suitable for children aged 3-6.

The story 'Mia's Wishing Tree' is chosen for its warmth and positive message.

A storyboard is created for the story using ChatGPT, guiding the generation of images.

Midjourney is used to generate images based on the storyboard and ChatGPT's output.

Runway Gen-2 is introduced as a tool to animate the static images for a more engaging video.

The tutorial demonstrates how to animate images and add transitions in Runway Gen-2.

Final video editing steps are explained, including adding music and dubbing for the picture book video.

The completed 'Mia's Wishing Tree' video is showcased, blending storytelling with AI-generated visuals.

The entire process from story creation to video production is detailed for creating children's picture book videos.