Combining Blender 3D with AI ft. Enigmatic E // Civitai Guest Stream

In this engaging live stream, the host welcomes Enigmatic E, a skilled AI and 3D artist, to demonstrate the fusion of Blender 3D with AI technology. E showcases his expertise by walking viewers through the process of creating a 3D character, Miles Morales, and animating it using AI tools. The session covers using Luma Labs' Genie for 3D model generation, Mixo for animations, and Blender for refining the model and setting up the scene. E also discusses the importance of a good model foundation for AI to enhance details and colors, highlighting the capabilities of AI in filling in missing information. The stream concludes with a demonstration of creating a clean mask for post-production, emphasizing the endless creative possibilities opened up by blending 3D and AI technologies.

Takeaways

• 🎥 The stream featured a special guest, Enigmatic E, who discussed the combination of 3D and AI in content creation.
• 🤖 Enigmatic E has a background in videography, editing, motion graphics, and pixel art, which led to his interest in blending 3D with AI.
• 💻 The use of 3D animations in AI platforms like Comfy UI can provide more control and better results compared to using video footage.
• 🎨 Luma Labs' Genie, a text-to-3D generator, was showcased as a tool for creating 3D models quickly and easily.
• 🌟 The stream demonstrated the process of creating a 3D character, including selecting and combining different body parts for customization.
• 🚀 The importance of symmetry and clean models was emphasized for better rigging and animation in 3D software like Blender.
• 📹 Blender's free resources and tutorials were recommended for those interested in learning 3D modeling and animation.
• 🎬 The stream included a live demonstration of rigging and animating a 3D character in Blender, highlighting the problem-solving aspect of the process.
• 🌐 The use of Mixo for accessing free animations and the potential for creating custom animations using AI tools like Deep Motion were discussed.
• 📸 The stream also touched on the creation of masks and the use of alpha channels for compositing and background removal in post-production.
• 🔄 The potential for looping animations and the creation of continuous, seamless video content was demonstrated.

Q & A

What is the main topic of the guest stream?

The main topic of the guest stream is combining Blender 3D with AI, featuring a special guest, Enigmatic E, who will walk through the process of creating 3D content enhanced with AI.

What is the significance of using a 3D video in AI applications like Comfy UI?

Using a 3D video in AI applications like Comfy UI allows for better control over the final visuals. It enables the removal of backgrounds without the need for rotoscoping or messy masks, and also provides camera control for more dynamic results.

What is Genie by Luma Labs?

Genie by Luma Labs is a text-to-3D generator that allows users to create 3D models from textual descriptions. It is currently free to use and is a valuable tool for generating 3D content for further AI processing.

How does Mixo contribute to the workflow discussed in the stream?

Mixo is a platform that provides free animations which can be used to animate the 3D models created with tools like Genie. It simplifies the process of animating 3D characters for use in AI applications.

What is the role of Deep Motion in the discussed workflow?

Deep Motion is a tool that can animate videos inserted into it, which can be useful for creating custom animations for 3D models that can then be used in AI applications.

Why is Blender mentioned as a necessary tool in the workflow?

Blender is an essential tool in the workflow because it allows for the manipulation and combination of 3D models and animations. It is used to prepare the models for AI processing by ensuring they are clean, well-posed, and properly formatted.

What is the importance of the T-pose in rigging 3D models?

The T-pose is a standard starting position for 3D models that ensures the model's limbs are spread out, making it easier to rig and animate. It prevents issues with vertices overlapping and helps in creating clean animations.

How does the process of mirroring in Blender help in creating symmetrical models?

Mirroring in Blender allows users to create symmetrical models by duplicating one half of the model onto the other half. This ensures that both sides of the model are identical, which is crucial for realistic and clean animations.

What is the significance of using an Alpha pass in Blender for AI workflows?

An Alpha pass in Blender creates a mask that can be used to isolate the 3D model from its background. This is particularly useful for AI workflows as it allows for cleaner integration with AI applications, leading to better final results.

null

null

How does the use of IP adapters in AI workflows enhance the creative process?

IP adapters allow for more granular control over the AI's output by providing specific prompts for different elements within a scene. This enables creators to tailor the AI's processing to their needs, resulting in more accurate and desired outcomes.

What are the benefits of using AI tools like Comfy UI for video creation?

AI tools like Comfy UI can enhance video creation by adding vibrance, color, and detail to 3D models. They can also fill in missing information, like adding specific costume details to a character, making the process more efficient and the results more polished.

Outlines

00:00

😀 Introduction and Welcoming Guests

The host expresses excitement for the second week of the Creator stream and introduces a special guest, Enigmatic E, who is known for his AI video creation tutorials. The host shares his background with AI and stable diffusion, and how watching Enigmatic E's content was influential. The guest is invited to introduce himself and discuss the agenda for the stream, which includes exploring 3D and AI.

05:29

🎥 Background and Interests in 3D and AI

Enigmatic E shares his journey, starting with his work in videography, motion graphics, pixel art, and animation, which led to his interest in combining 3D with AI. He discusses the benefits of using 3D videos in AI applications, such as the ability to control camera angles and avoid complex masking in post-production. E introduces a text-to-3D generator called Genie from Luma Labs and demonstrates how to use it to create a 3D model of Ryu from Street Fighter.

10:30

🤖 Using AI for 3D Model Enhancement

The discussion continues with ways to improve 3D models using AI. Enigmatic E talks about the process of taking a basic 3D model and enhancing it with AI to add details. He demonstrates this by showing how a simple model can be transformed into a detailed animation using AI, mentioning the use of platforms like Mixo for animations and Deep Motion for recording and creating animations.

15:31

🕹️ The Workflow of 3D Model Creation

Enigmatic E explains the process of finding and using models from Luma, rigging them, and preparing them for animation. He details the importance of having the model in a T-pose for rigging purposes and shows how to use Blender to clean up and retopologize the model. The host and guest also discuss the importance of learning from tutorials and applying that knowledge to one's own projects.

20:31

🖥️ Blender and Its Learning Curve

The conversation shifts to the challenges of learning Blender, with the host acknowledging the difficulty and the guest sharing his experience as a slow learner. They discuss the importance of practice and the option of taking courses for structured learning. The guest demonstrates how to download and import models into Blender and adjust them for use.

25:32

🧩 Assembling the 3D Model in Blender

Enigmatic E guides through the process of assembling a 3D model in Blender by importing different parts like the head and hands, and adjusting their positioning. He also covers how to mirror the model for symmetry, apply materials, and address any issues with the model's geometry. The guest emphasizes the iterative nature of 3D work and the flexibility of approaches.

30:34

🎨 Texturing and Lighting the 3D Scene

The guest discusses adding textures to the 3D model using Blender Kit and demonstrates how to apply and scale them for the building texture. He also adds a light source to the scene and adjusts its properties for a warmer look. The host and guest talk about the creative freedom offered by Blender and the potential for creating engaging content.

35:35

📹 Setting Up the Camera and Rendering the Scene

Enigmatic E sets up the camera view in Blender and adjusts the resolution for the final render. He parents the camera to an empty object to control its movement and positions it for the best view of the animation. The guest also shows how to loop the animation for continuous playback and discusses the process of rendering the animation with the desired settings.

40:35

🚀 Finalizing the Animation and Upscaling with AI

The guest discusses the final steps of preparing the animation for AI upscaling using a tool like Comfy UI. He emphasizes the importance of having a clean mask and the potential for using different AI models to achieve various styles. The host and guest reflect on the creative process and the community's growth in using AI for content creation.

45:40

📈 Exploring Advanced Techniques and Future Streams

The conversation concludes with the host and guest discussing advanced techniques like using multiple masks and IP adapters for detailed control over AI upscaling. They also tease upcoming streams featuring Mid Journeyman and Super Beast AI, and the host provides information on where to find past streams and engage with the community.

50:43

📺 Closing Remarks and Thanks

The host and guest wrap up the stream by thanking the viewers for their time and participation. They encourage the audience to experiment with the techniques discussed and to share their creations. The guest expresses gratitude for the invitation and acknowledges the host's contributions to the AI community. The host also provides a schedule for upcoming streams and wishes everyone a happy Easter weekend.

Keywords

💡Blender 3D

Blender is an open-source 3D creation suite that supports the entirety of the 3D pipeline—modeling, rigging, animation, simulation, rendering, compositing, and motion tracking, even video editing and game creation. In the context of the video, Blender 3D is used to create and manipulate 3D models and animations, which are then combined with AI for unique visual effects.

💡AI

Artificial Intelligence (AI) refers to the simulation of human intelligence in machines that are programmed to think like humans and mimic their actions. In the video, AI is used in conjunction with 3D modeling to enhance and automate the creation of animations and visual effects.

💡Enigmatic E

Enigmatic E is a content creator and expert in the field of AI and 3D modeling. He is known for his YouTube tutorials on creating AI videos and has a significant following in the community. In the video, he is the special guest and provides a walkthrough on combining 3D modeling with AI.

💡Civitai

Civitai is a platform or service that is related to the video's context, likely providing tools or a community for creators. Although not explicitly defined in the script, it seems to be a place where creators can share their work and learn from each other.

💡Mixo

Mixo is a platform that provides a range of 3D character models and animations. Users can access these resources to create their own animations, and it seems to be integrated with AI services to enhance the creative process.

💡Luma Labs

Luma Labs is the developer of Genie, a text-to-3D generator that allows users to create 3D models by simply typing descriptions. This tool is used in the video to generate the initial 3D model of Miles Morales.

💡3D Animation

3D Animation refers to the process of creating the illusion of motion using three-dimensional computer-generated models. It involves a series of steps including modeling, texturing, rigging, and animating to bring characters or objects to life in a virtual environment.

💡Twitch

Twitch is a live streaming platform, mainly focused on video games, but it also covers creative content, including art and software development. In the context of the video, Twitch is the platform where the guest stream is being hosted and where viewers can interact with the streamer and ask questions.

💡Comfortable UI (Comfy UI)

Comfortable UI, or Comfy UI in the context of the video, refers to a user interface or software tool that is used to enhance or refine the AI-generated animations or images. The name 'Comfy' suggests that it is designed for ease of use and to improve the final output quality.

💡Character Animation

Character Animation is a specific type of animation that focuses on creating movement and expressions for characters in a story. This can involve anything from simple movements like walking or running to complex facial expressions and lip-syncing.

Highlights

Enigmatic E, a special guest, shares his expertise on combining 3D and AI in a live stream.

The stream covers the use of Blender 3D for creating AI videos, offering a full-circle moment for the host.

Enigmatic E discusses his background in videography, motion graphics, and pixel art, influencing his interest in 3D and AI.

The benefit of using 3D videos in AI applications like Comfy UI is explained, including camera control and detail enhancement.

Genie, a text-to-3D generator from Luma Labs, is introduced as a key tool for creating 3D models.

The process of generating a 3D model of Ryu from Street Fighter using Genie is demonstrated live.

Mixo is presented as a resource for obtaining free character animations to use in AI applications.

Deep Motion is mentioned as a tool for animating 3D models using AI, allowing users to create custom animations from videos.

The importance of starting with a basic model and incrementally adding complexity is emphasized for learning purposes.

Blender, a free 3D modeling software, is highlighted as an essential tool for anyone looking to work with 3D models and AI.

The process of rigging a 3D model and preparing it for animation within Blender is outlined.

Enigmatic E demonstrates how to create a clean mask for a 3D model in Blender, which is crucial for AI applications.

The live demonstration includes creating a skateboarding animation for a character model in Blender.

Tips for lighting, texturing, and setting up the environment in Blender for a 3D scene are provided.

The final step is rendering the animation from Blender in preparation for using it in AI applications.

Enigmatic E shares his process of using AI to fill in details for a 3D model, showcasing the power of AI in creative workflows.

The stream concludes with a discussion on the potential for combining AI with 3D assets to create unique and complex animations.