AI Rendering ADDED TO SKETCHUP! But is it worth using?

Summary

In this video, Justin introduces the new AI rendering feature from SketchUp, which integrates stable diffusion directly into the software. This tool allows users to create AI-generated renderings of their 3D models, offering various styles and text prompts to refine the output. Despite some limitations, such as lack of control over materials and inability to edit generated images, the feature is seen as a valuable addition for early conceptual visualization and design exploration, also available on SketchUp for iPad.

Takeaways

• 🚀 AI rendering has been integrated into SketchUp through a feature developed by SketchUp Labs.
• 🔍 The AI rendering tool is based on stable diffusion and can be accessed via the extension warehouse within SketchUp.
• 📦 Users can install the AI rendering tool without any additional computer setup or credit management.
• 🎨 The tool offers various pre-made styles and text prompts for users to create different types of renderings.
• 🛠️ Users have the ability to adjust the influence of the prompt and how closely the rendering respects the model geometry.
• 🖼️ The AI rendering generates multiple images based on the prompt and allows users to download and save these images.
• 📷 The AI rendering may not always accurately represent the materials and details of the 3D model.
• 📱 The AI rendering tool is also available on SketchUp for iPad, and can be combined with Sketch mode for unique visualizations.
• 🎨 Users can overlay the AI-generated images onto their 3D models, creating a hybrid of 3D geometry and 2D rendering styles.
• 👁️ The tool is most useful for early conceptual work and visualization, but may have limitations for detailed or specific design renderings.
• 💬 The SketchUp community is encouraged to share their thoughts on the AI rendering tool and its potential applications.

Q & A

What is the main topic of the video?

The main topic of the video is the introduction and demonstration of the new AI rendering feature in SketchUp, specifically the integration of generative AI version of stable diffusion.

How was the AI rendering feature added to SketchUp?

The AI rendering feature was added by incorporating a generative AI version of stable diffusion directly into SketchUp, which is still in development as a beta feature in SketchUp Labs.

How can users access and install the AI rendering tool in SketchUp?

Users can access and install the AI rendering tool by going to the Extension Warehouse in SketchUp and searching for 'SketchUp diffusion'. They can then download it without needing to install anything on their computer.

What are some of the style options available for AI rendering in SketchUp?

Some of the style options available for AI rendering include 'aerial master plan', 'pencil sketch', and 'interior photo realistic', among others.

How does the AI rendering tool handle model geometry and materials?

The AI rendering tool allows users to adjust the influence of the prompt and how strongly it respects the model geometry. However, it may not always accurately represent the materials in the scene.

What is the limitation of the AI rendering tool in terms of editing the generated images?

The limitation is that users cannot go back and make changes to the generated images directly within SketchUp. They would need to use external software like Photoshop for any modifications.

How can the AI rendering tool be used for early conceptual design or visualization?

The AI rendering tool can be used for early conceptual design or visualization by quickly generating different styles of renderings based on the user's prompts and model geometry, providing a variety of visual options to explore.

Is the AI rendering feature available in SketchUp for iPad?

Yes, the AI rendering feature has been added to SketchUp for iPad, and it can be combined with Sketch mode for additional visualization possibilities.

What is the presenter's overall opinion on the AI rendering tool in SketchUp?

The presenter finds the AI rendering tool to be a decent addition to the toolbox, especially for early conceptual work and visualization, but notes that its usefulness may decrease as the design process progresses due to its limitations.

How can users provide feedback or engage in discussion about the AI rendering tool?

Users can provide feedback or engage in discussion by leaving comments below the video, sharing their thoughts on the tool and AI in general.

What is the potential use of the AI rendering tool for existing rendered images?

The AI rendering tool can be used to stylize existing rendered images by importing them into SketchUp, allowing users to quickly create different styles of renderings from a snapshot of the viewport.

Outlines

00:00

🚀 Introduction to AI Rendering in SketchUp

This paragraph introduces the new AI rendering feature in SketchUp, which utilizes stable diffusion to create renderings of 3D models directly within the software. The feature, though still in development, is accessible through SketchUp Labs and can be downloaded from the extension warehouse. The ease of installation and lack of credit management are highlighted, along with a brief overview of how the tool works, including the ability to select styles and generate images based on prompts.

05:00

🎨 Exploring Styles and Customization

The second paragraph delves into the customization options available within the AI rendering tool. Users can choose from various pre-set styles and adjust the influence of the prompt and model geometry to better fit their desired outcome. The paragraph also discusses the limitations of AI rendering, such as the lack of control over final images and the inability to edit specific elements within the generated images. However, it also presents the creative potential of using AI for early conceptual visualizations and the possibility of overlaying AI-generated scenes onto the SketchUp model for a 3D view.

10:01

📱 AI Rendering on SketchUp for iPad

The final paragraph discusses the availability of the AI rendering tool on SketchUp for iPad, which can be combined with the Sketch mode for unique rendering effects. It emphasizes the potential of using AI to quickly generate stylized images from within SketchUp, even from imported images. The paragraph concludes with the creator's ongoing exploration of AI's role in design and encourages viewers to share their thoughts on the tool and AI in general.

Keywords

💡AI rendering

AI rendering refers to the process of using artificial intelligence algorithms to generate visual images or scenes from 3D models. In the context of the video, it involves using SketchUp's new feature to create realistic or stylized images of 3D models directly within the software. This technology leverages the power of AI to automate and enhance the rendering process, offering users a variety of styles and effects to visualize their designs.

💡SketchUp

SketchUp is a popular 3D modeling computer program used primarily for architectural, interior design, and landscaping. In the video, SketchUp is the platform where the AI rendering feature has been integrated, enabling users to render their 3D models with AI-generated images without needing additional software.

💡Stable diffusion

Stable diffusion is a type of AI model that generates images from textual descriptions. It is a deep learning technique used in the field of computer vision. In the video, it is mentioned as the AI technology integrated into SketchUp to create AI renderings, suggesting that SketchUp users can now utilize this technology to produce images that reflect various styles and prompts.

💡SketchUp Labs

SketchUp Labs is a feature within SketchUp that offers experimental and beta tools for users to test and provide feedback on. It is a platform for innovation where new ideas and technologies are introduced before they become fully integrated into the main software. The AI rendering tool discussed in the video is part of SketchUp Labs, indicating that it is still in development and open for user testing.

💡3D models

3D models are digital representations of objects or scenes created using 3D modeling software. They are used in various fields such as architecture, gaming, and film to produce realistic visuals. In the video, 3D models refer to the user-generated designs within SketchUp that can be rendered using the AI tool.

💡Text prompt

A text prompt is a textual description or a set of keywords that guide the AI in generating an image. It serves as the input for the AI model to understand the desired output. In the context of the video, users can input text prompts to instruct the AI rendering tool in SketchUp to create images that match the described style or scene.

💡Style options

Style options refer to the pre-defined visual themes or aesthetics available for AI rendering in SketchUp. These options allow users to choose from a variety of styles to apply to their 3D models, thereby influencing the final look of the AI-generated images.

💡Model geometry

Model geometry refers to the structural and spatial aspects of a 3D model, including its shape, form, and dimensions. In the context of the video, respecting model geometry means that the AI rendering should accurately represent the model's structure and design when generating images.

💡Interior rendering

Interior rendering is the process of creating visual representations of indoor spaces using 3D modeling and rendering techniques. It is used to showcase how the interior of a building or a room might look. In the video, the AI rendering tool is applied to an interior living room model to generate images with different effects, providing a glimpse of how the space could appear in real life.

💡Limitations

Limitations in this context refer to the constraints or shortcomings of the AI rendering tool within SketchUp. These limitations might include the inability to accurately represent materials, difficulty in making changes to generated images, and the tool's potential decrease in usefulness as a design project progresses.

💡SketchUp for iPad

SketchUp for iPad is a version of the SketchUp software designed for use on Apple's iPad devices. It offers a touch-friendly interface and features tailored for mobile design work. The video mentions that the AI rendering feature is also available on this platform, allowing users to combine it with the Sketch mode for additional visualization possibilities.

Highlights

AI rendering from SketchUp has been released, allowing users to create AI renderings of their models directly within SketchUp.

The AI rendering feature is a generative AI version of stable diffusion integrated into SketchUp.

The AI rendering tool is available in SketchUp Labs and is currently in development, offering a beta feature for users to test.

Users can download the diffusion tool for SketchUp from the extension warehouse without needing to install anything on their computer.

The AI rendering tool offers different styles and text prompts for users to create various types of renderings.

The tool allows for adjusting the influence of the prompt and how strongly it respects the model geometry.

AI renderings may not always respect the materials shown in the scene, which is a limitation of AI tools.

Users can add scenes to overlay the AI renderings on top of their SketchUp models, providing a unique 3D viewing experience.

The AI rendering tool can be used for early conceptual work and visualization, offering a new perspective on design ideas.

The AI rendering tool's limitations include a lack of control over the final image and difficulty in making changes to the generated images.

SketchUp diffusion can be used on images imported into SketchUp, allowing for further stylization and rendering options.

SketchUp for iPad now includes the AI rendering feature, which can be combined with Sketch mode for additional creative possibilities.

The AI rendering tool in SketchUp is a valuable addition to a designer's toolbox, particularly for early design stages.

The video invites viewers to share their thoughts on the AI rendering tool and AI in general, sparking a conversation in the comments section.

The host, Justin, provides a comprehensive overview of the AI rendering tool, discussing its capabilities, limitations, and potential uses.

Transcripts

what's up guys Justin here with the

SketchUp essentials.com so AI rendering

from SketchUp has been released and in

this video we're going to check it out

let's go ahead and just jump into it all

right so you might have seen this blog

post show up on the SketchUp blog a

couple days ago now and basically what

it is is it's a post telling us that

they've added a generative AI version of

stable diffusion inside of SketchUp and

so what that means is that means that

you have the ability to take your models

and then create AI rendering of those

models directly inside of SketchUp so

we've talked about a couple different AI

features um for SketchUp before this is

the first one that's come directly from

SketchUp it's technically in SketchUp

Labs meaning that it's still in

development it's kind of like a beta

feature but it's something you can test

out and try and so you could download

diffusion for SketchUp by going into the

extension warehouse and it's probably

going to pop up on your front page right

here but you can just look for SketchUp

diffusion and so if I click on this

notice how this is going to pop up all

the information about this tool from

SketchUp Labs um you can download it and

give it a try and so it's really easy to

use if you click on the install button

it's just going to install it right here

you don't need to install anything on

your computer or anything like that as

far as I can tell there don't seem to be

any credits or limitations or anything

like that on the tool at least that I've

seen so far so um I I think that's not

nice you're not having to manage credits

or anything like that but let's go ahead

and let's jump over into SketchUp and

take a look at what this does and so

with this first model we're going to use

the Cliff of brick model from Mike

brestle um as a model that we're going

to render out and so in general this

works like most of the AI tools

currently work um for most 3D softwares

and what I mean by that is you're going

to click on this button right here and

it's going to pop up a window that's

going to look something like this and so

notice how at least as of right now it's

going to pop up a thumbnail of your

image right here and it's also going to

have options for different styles and a

text prompt and so if I click on this

right if I click on the style notice how

there's a number of different styles

contained in here these are like

pre-made or preset Styles um that you

can use in order to create a rendering

so in this case right here let's say I

was to select the option for aerial

master plan um and then I don't even

need to put a prompt in here right now I

can just click on the button to generate

and what that's going to do is that's

going to take an image it's going to

upload it to diffusion and then it's

going to render it based on that prompt

that's up above so you can see the

aerial master plan prompts that are in

here right now but it's going to create

those images it's going to download them

and then you can see them down below

just like this and so this is

interesting I mean it has the same same

AI issues that you usually run into when

you create these AI renderings

specifically you don't really have a

whole lot of control over the final

image so you can kind of like fine-tune

them other things like that but you can

see how what it does is it gives you a

few different images Down Below based on

the prompt that's up above and so say

that you don't want this to change your

model quite so much cuz obviously my

building was brick and this building

that it's creating is not brick so you

can click in into the settings right

here and there's an option in here where

you can adjust the influence of the

prompt as well as how strongly this

respects your model geometry so I'm

going to bring the prompt influence down

and we're going to bring respect model

geometry up and we're going to click on

generate again and when we do that what

that's going to do actually that might

get a little bit weird because I think

it's actually uploading this image right

here which is not necessarily what I

want that's the thing about these AI

rendering tools is all it's really doing

is it's taking a snapshot and then it's

generating different images based on

that snapshot you'll notice how as I

click in here um this is actually

rendering out the image that I uploaded

I don't necessarily want that what I

want to do is I want to refresh the

input view right here so that I get my

SketchUp model back and then I'm going

to click on the option for Generate and

so like even now if I scroll down and I

look at some of the images this has

created I'm going to drag this to the

left just so it fits on my screen a

little bit better notice how it's not

necessarily respecting the materials

shown in the scene which has always been

in my opinion one of the limiting

factors of AI and so that's kind of the

thing with AI is so in my opinion the

further down the road you go the less

valuable a tool like this gets just

because if you're trying to render

something out that's very specific The

Prompt can definitely make changes to

that um and you're seeing that right

here where it's not even bringing the

brick in anymore however let's say that

we were to go with another version right

here so maybe we wanted this to be a

pencil sketch instead so I'm going to

refresh my geometry with my current view

which is a slightly different view than

I had in here before um and I'm going to

maybe set this to halfway here halfway

here and I'm going to click on generate

um that's going to take this image and

it's going to create a pencil sketch

view of this building right here and I

think this is probably going to fit a

little bit better what we're going for

um because the pencil sketch is not

supposed to show specific materials um

it's supposed to take everything and

make it look more like a sketch so now

if I click in here notice how this gives

me actually really cool pencil sketch

images based on um the geometry that

I've given it now one thing that you can

do with this is you can click on the

option to add scene and so when you add

a scene what that's going to do is

that's going to take this image and it's

going to Overlay it over top of your

SketchUp model right here and and so

that's actually pretty cool because you

can click into this and it kind of

overlays it in your SketchUp model

notice how the model geometry stays very

similar so it's almost like you've got a

3D view in here of the building in that

style if we wanted to have that so you

can save those rendered images as

different scenes in here all right so

now let's create an interior so we're

going to use this living room by Daniel

on and I'm just going to download this

into SketchUp all right so we're going

to go ahead and we're going to bring

this in and we're going to do that same

thing so we're going to load the

diffusion window right here but in this

case we're going to select one of the

Interior options so notice how there's

an option here for interior photo

realistic so we're just going to select

this option right here and we're going

to generate images and what this is

going to do is this is going to upload

this to diffusion um create a couple

images and then bring them back in all

right so then if we click in here we can

see this is that this has created

several different versions of this

layout with different effects in here

and so this has actually done a pretty

good job of creating some pretty decent

images but we can go ahead and we can

add this as a scene inside of SketchUp

and so again the cool thing about this

is the way that this is overlaid on our

3D geometry so you can kind of like um

zoom in zoom out other things like that

and one thing that I would note about

this is theoretically you could take

these and apply them as textures to your

model if you found something that you

really liked now the thing that I don't

necessarily like about this or most of

these AI tools is you can't really like

go back in and make any changes so say

that I wanted this to be a modern

interior living

room Stone on walls

photo

realistic

foggy outside windows right so say that

I type that in here as say that I typed

that in here as my prompt and this went

ahead and this rendered that image out

well the problem is you can't go back in

and change the images that it created

now you could take them over into

Photoshop and make some changes to

things like U you could take this into

Photoshop and you could make some

changes to um the colors and other

things like that but you can't go in for

example and replace this TV which is

like kind of a second TV in here um you

can't go in and say just remove this and

leave the rest of it as is now it does a

really interesting job of creating these

images but the limiting factor has

always been well what if I want to get

rid of this thing in here well you can't

necessarily do that right now so that is

kind of a limiting factor but this is

creating some really interesting images

in here like this one for example I

think looks really good as long as you

don't look too far into the details

that's um one of the other limiting

factors but overall I think this created

a really interesting look for how this

room could look um in real life and so

one other thing that's interesting is

when you understand the way that this is

doing this um you could actually use

this to use AI on some of your rendered

images um because all this is doing is

this is just taking an image from inside

of sketch up right so I could do a file

import and say that I took an image that

I created in D5 render I could actually

bring that in as an image like

this and you could zoom into it and then

you could use SketchUp diffusion on the

actual rendered image that you have in

here right because it's basically just

taking a snapshot of what's in your

viewport so I could actually stylize

this I could add like clay model or

something like that and I could click on

generate and this is actually going to

generate a clay model version of this

image even though it's an image it's

never it's never anything that I

actually had in 3D right so we could

take this whole thing we could let let

it do a little bit of work and you can

see that this is this came through and

it created clay model versions of this

image just like this and you could Crank

that um respect model geometry all the

way up to make sure that it's not

changing your geometry but there are

also interesting possibilities with just

bringing images directly into SketchUp

and using them in this panel right here

in order to quickly create renderings

now one thing I do want to point out

that is kind of interesting is this is

also been added in SketchUp for iPad and

you can actually combine it with Sketch

mode on SketchUp for iPad so um if you

were to come in there and add a sketch

on top of your model and then you were

to run that through diffusion um that's

actually going to give you the ability

to kind of render out the whole thing

with the sketch so I think that is an

interesting possibility for being able

to visualize what things could look like

um so that's definitely something it is

there if you're using SketchUp for iPads

you may want to go try that one out um

because I do think that could be a cool

tool so overall I'm still trying to

figure out where AI fits into the

landscape moving forward I think as a

tool um this inside of SketchUp actually

works fine um the images that it's

creating I think it's doing a good job

limiting factors are the same as they've

always been it doesn't necessarily

respect your materials um even depending

on what your prompt is and it's

difficult to go back and change the

images but as a tool in your toolbox for

doing like early conceptual stuff or

visualization I think it is pretty cool

so I mean as tools go I think this is a

decent one to use for that but I think

the further you go into your design

process probably the less helpful it

gets at least in my opinion but I'd love

to hear from you in the comments down

below what do you think about this tool

in SketchUp or what do you think about

AI in general um I just love having that

conversation with you guys I know that's

kind of a heated topic so make sure that

you keep it um civil um down in the

comments but I'd love to hear what you

think as always thank you so much for

taking the time to watch this and I'll

catch you in the next video thanks guys