Photogrammetry Just Got Easier: Create awesome 3D models from photos with Substance 3D Sampler

Summary

このビデオでは、Adobe 3D Samplerを使って写真から高品質の3Dアセットを作成する方法が紹介されています。ホストであるPablo Muñozは、写真を用いて植物の3Dオブジェクトを作り上げるプロセスをステップバイステップで解説しています。自動マスクや物体認識、そしてポイントクラウドからのメッシュ生成まで、簡単かつ自動化されたプロセスを紹介し、最終的な3Dモデルを3D Stagerでレンダリングする方法も学べます。

Takeaways

• 📷 Adobe 3D Samplerを使用して写真から高品質の3Dアセットを作成する方法を学べます。
• 🌿 ビデオでは、カメラで植物を取り囲って61枚の写真を撮影し、それらを3D Samplerにインポートします。
• 🔍 3D Samplerは自動マスク機能があり、写真からオブジェクトを認識してマスクを作成します。
• 💻 Photoshopと同様のアルゴリズムを使ってオブジェクトを選択し、3D Samplerはそれに類似した技術を利用してマスクを生成します。
• 🔄 高精度モードで処理を実行し、写真の順序は特に指定しなくても自動的に処理されます。
• 🌐 3D Samplerはポイントクラウドを作成し、それからメッシュを生成して3Dモデルを完成させます。
• 🌤️ 撮影時には日差しが強くない曇りの日に撮影すると、3D Samplerの処理を容易にします。
• 🛠️ 3D Samplerで生成されたメッシュにはギャップが生じる可能性があり、ZBrushなどのソフトウェアで修正できます。
• 🎨 Substance 3D Stagerを使用して3Dモデルに素材を適用し、シーンを構築してレンダリングできます。
• 🖼️ 3D Stagerではカメラの奥行きの効果を有効にし、フォーカスポイントを設定してよりリアルなレンダリングを作成できます。
• 🔧 3D Samplerと3D Stagerの組み合わせで、写真から3Dアセットを作成し、シーンに配置して高质感の写真を作成することが可能です。

Q & A

ビデオで紹介されている3Dアセットを作成するために必要な写真の枚数はどれくらいですか？

ビデオでは、合計で61枚の写真が必要であると述べています。これらの写真は、対象物を取り囲って異なる角度から撮影したものと、細かいテクスチャや詳細を捉えるためのクローズアップです。

Adobe 3D Samplerを使用する際のカメラの種類には特にこだわりがありますか？

特にDSLRカメラを使用することが推奨されていますが、ビデオでは特にカメラの種類にこだわりは見られません。重要なのは、高解像度の写真をとることと、撮影が均一な照明条件下で行われることです。

Adobe 3D Samplerでの写真をどのように取り込むのですか？

Adobe 3D Samplerのウィンドウで「新しい3Dオブジェクト」をクリックし、写真をドラッグ＆ドロップまたは取り込むことでインポートします。その後、グループ名や写真の解像度、センサーサイズ、焦点の長さを設定し、提出します。

自動マスク機能とは何であり、どのように動作しますか？

自動マスク機能は、ソフトウェアが写真内のオブジェクトを認識し、それに基づいてマスクを生成する機能です。Photoshopのオブジェクト選択ツールと同様のアルゴリズムを使って、高精度でオブジェクトを識別します。

3D Samplerで生成されたポイントクラウドはどのようなものか説明してください。

ポイントクラウドは、3D空間内のポイントの集合であり、ビデオではカメラのアイコンがそれらを表しています。これらのアイコンは、対象物を360度回転しながら撮影した結果として、対象物の形状を正確に再現しています。

ビデオで撮影された写真がうまくアライメントされなかった場合、どう対処しますか？

アライメントがうまくいかなかった写真は、警告として表示されます。通常、これはクローズアップ写真で、大きな問題ではありません。必要に応じて、これらの写真を手動で調整することができます。

3D Samplerでメッシュの解像度をどのように選択しますか？

メッシュの解像ドは「フル」、「ハイ」、「メディウムドラフト」などから選択できます。ビデオでは「フル」を選択して、高精度のメッシュを作成しています。

3D Samplerで生成された3Dモデルにギャップが存在する場合、どのように対処しますか？

ギャップが存在する場合は、ZBrushやBlenderなどの他のソフトウェアを使用して、ジオメトリをクリーンアップし、ギャップを修正することができます。

3D Stagerで3Dモデルに適用するマテリアルはどのように設定しますか？

3D Stagerでは、モデルを選択し、マテリアルパネルからベースカラーとして画像をドロップできます。その後、必要に応じてマテリアルの他のプロパティを調整して、よりリアルな外観を作成できます。

ビデオで紹介されている3D Stagerの機能には何がありますか？

3D Stagerでは、3Dモデルの配置、マテリアルの適用、カメラの設定、照明の調整などが可能です。また、レイトレーシングを使用して高品質のレンダリングを作成し、深度のフィールドを有効にすることで写真のように自然なブラーを追加できます。

Adobe 3D Samplerと3D Stagerを使用して3Dアセットを作成するプロセス全体について説明してください。

プロセスは以下の通りです。まずAdobe 3D Samplerで写真をインポートし、自動マスク機能を使用してポイントクラウドを作成します。次に、メッシュの解像度を選択し、ジオメトリを生成します。その後、3D Stagerでモデルにマテリアルを適用し、カメラや照明を調整してレンダリングを作成します。

Outlines

00:00

🌿 3Dアセット作成の基礎

この段落では、Adobe 3D Samplerを使用して写真から高品質の3Dアセットを作成する方法が紹介されています。講師のPablo Muñozは、ソフトウェアの操作方法を説明し、まず3Dオブジェクトを作成し、必要な写真データをインポートする方法を解説しています。61枚の写真を使用して、物体の周りを撮影し、詳細なテクスチャと細部を捉えるために様々な角度からの写真をとることに重点が置かれています。

05:03

🤖 自動マスクと3Dサンプリングの進化

この段落では、Adobe 3D Samplerの自動マスク機能とその精度について説明されています。ソフトウェアは写真を自動的に認識し、オブジェクトを選択する機能を備えており、Photoshopのアルゴリズムと同様の技術が使用されていると推測されています。さらに、高精度でのマスク生成や画像の並べ替えなど、3Dオブジェクトの生成プロセスにおける重要なステップが紹介されています。

10:04

🎨 3Dアセットの仕上げとマテリアルの適用

段落2では、3D Samplerを使用して作成された植物の3Dモデルの最終的なポストプロセスが紹介されています。モデルのローテーションと詳細の確認方法、および欠陥の補正について説明されています。ZBrushなどのソフトウェアを使用してジオメトリをクリーンアップする方法も提案されています。さらに、3D Stagerでアセットをレンダリングする方法や、マテリアルの適用と調整についても学ぶことができます。

15:05

🖼️ 3Dステージングと最終的なシーンの完成

最後の段落では、3D Stagerを使用して3Dモデルをシーンに配置し、カメラや照明を調整する方法が紹介されています。さまざまなマテリアルの適用、カメラの深遠焦点の設定、スポットライトの色と強度を調整することで、よりドラマチックなシーンを作成する方法が説明されています。最後に、短時間で写真から3Dアセットを作成し、シーンに組み込むプロセス全体が簡単にまとめられています。

Keywords

💡3Dアセット

3Dアセットとは、コンピュータグラフィックスにおいて、3次元空間内で表現される物体やキャラクターなどのデジタルモデルのことを指します。このビデオでは、写真から3Dアセットを作成する方法が紹介されており、特に植物の3Dモデルが作成の例として用いられています。

💡フォトグラメトリー

フォトグラメトリーは、複数の写真を元に3Dモデルを作成する技術です。ビデオでは、Adobe 3D Samplerを使用してこのプロセスを簡素化し、写真から3Dオブジェクトを作成する方法が説明されています。

💡Adobe 3D Sampler

Adobe 3D Samplerは、Adobe社が提供する3Dモデリングソフトウェアであり、写真を用いて3Dモデルを作成することができます。ビデオでは、このソフトウェアを使って植物の3Dモデルを作成する手順が紹介されています。

💡マスク

マスクは、デジタルイメージ編集において、特定の領域を選択的に操作できるようにする機能です。ビデオでは、Adobe 3D Samplerのマスク機能を使って、自動的にオブジェクトを認識し、モデルの特定部分を強調表示する方法が説明されています。

💡ポイントクラウド

ポイントクラウドは、3D空間上のポイントの集合であり、3Dモデルの初期段階を形成します。ビデオでは、写真から生成されたポイントクラウドが3D植物モデルの基礎となっています。

💡ジオメトリー

ジオメトリーは、3Dモデルの形状や構造を定義する要素のことで、ビデオでは、Adobe 3D Samplerで生成されたポイントクラウドから高解像度のメッシュを作成する際に、ジオメトリーの詳細を選択することができます。

💡マテリアル

マテリアルは、3Dモデルに適用される表面の特性を定義するもので、ビデオでは、植物のベースカラーや木材のテクスチャなど、異なるマテリアルを3Dモデルに割り当てる方法が紹介されています。

💡3D Stager

3D Stagerは、Adobeが提供する3Dシーンのビジュアライゼーションツールで、ビデオでは、このツールを使って3D植物モデルを組み立て、シーンを作成し、レンダリングする方法が説明されています。

💡U.V.マッピング

U.V.マッピングは、3Dモデルの表面を2次元の座標空間に投影するプロセスで、テクスチャを適切に適用するために使われます。ビデオでは、U.V.マッピングがどのように3Dモデルの表面にテクスチャを適応させるかが触れられています。

💡レンダリング

レンダリングは、3Dシーンやモデルを画像やアニメーションに変換するプロセスです。ビデオでは、3D Stagerを使用して3D植物モデルをレンダリングし、最終的なビジュアル表現を作成する方法が紹介されています。

💡ZBrush

ZBrushは、3Dデジタルスカルプティングソフトウェアであり、ビデオでは、モデルのジオメトリーを洗練させるためにZBrushを使用するオプションが触れられています。

Highlights

使用Adobe 3D Sampler从照片创建高质量的3D资产。

Pablo Muñoz展示如何简化基于照片的3D对象创建过程。

Adobe 3D Sampler界面的初次介绍。

创建3D对象的第一步是导入对象周围的照片。

共拍摄了61张照片，包括不同角度和特写，以捕捉细节和纹理。

3D Sampler能够自动导入并处理这些照片。

软件自动识别传感器尺寸和焦距。

自动遮罩功能可以智能识别对象。

3D Sampler使用类似于Photoshop的算法进行对象选择。

通过高精确度设置，可以获取更多细节。

2分钟生成点云，展示了3D Sampler的高效性。

在阴天拍摄照片有助于简化3D重建过程。

处理过程中的警告和未正确对齐的图像。

选择所需的几何细节，如高分辨率网格。

3D Sampler的最终后处理版本展示了植物的3D模型。

3D Sampler可以与ZBrush等软件结合使用以清理几何体。

导出设置包括FBX格式和材料作为PNG图像。

在Adobe 3D Stager中创建引人注目的3D图像。

3D Stager中导入FBX文件并调整大小。

使用3D Stager为3D模型添加材质和纹理。

通过3D Stager设置相机和深度场效果。

使用3D Stager添加灯光和调整光照效果。

整个过程展示了如何快速将照片转换成3D资产。

Transcripts

If you want to create your own high quality 3D assets from photographs, this video is for you.

I'm going to show you how to create something like this. The plant that you can see here on the screen.

And this was created using Adobe 3D Sampler, using just photographs.

Hey, what's up, guys!

Pablo Muñoz here

Today, I'm going to show you how to use Adobe 3D Sampler to simplify the process of photogrammetry

to create a 3D object based on photographs.

Let's jump straight into it. All right. So here we are in Adobe 3D Sampler.

This is what you should see once you open the software.

So the first thing I wanted to go ahead and do is click on this 3D object.

Currently it's in beta click on this Plus and click on new 3D object.

So once you click on the 3D object, this is the window that would appear.

And obviously you need to import some data.

So let me just switch to a different screen and the data that you need are just a few photos

around the object that you want to capture.

So I went around this pot plant and took a few photos.

I think in total were around 61 or 60 photos around the object

a different angles and close ups as well, so that I can capture some of the finer texture

and some of the details around the soil area and the leaves themselves.

So that's pretty much it.

Once that's ready, let me show you the window that I mentioned before

where we can just take that data, those photos, and drop them in.

And what I'm going to do is I'm going to take all of those 61 items.

Actually, I'm just going to drag them in here.

You see them, I have them selected.

And when I drop them in there and that's pretty much it, I'm just going to wait

until 3D sampler does its thing and it just imports all of these photographs.

We can just go ahead and name this group

3D plant

61 photos and the dimensions,

like I said, they're like, you know, high res, 4k, well, 4000 by 2000.

So that's pretty good. It recognizes the sensor size and the focal length.

So if you have a DSLR camera, I should do the same thing as well.

Now we can just go ahead and click submit and that's it.

There's now

a lot of like tweaking that you can do at this time, but that's kind of like what I wanted to show you.

It's very, very simple.

So one of the things that I found to be the, you know, mind blowing is the fact that you can do

automatic masking and the software is intelligent enough to recognize the objects.

So if I click on the mask here, I'm just going to go ahead and click on Generate.

Right.

And I'm going to click on new batch

and I'm just going to wait until it's sort of like process all the images from this batch.

And I believe I could be wrong on this one, but I believe is using a very similar algorithm

as what Photoshop uses, which allows you to select specific objects.

So while he's doing that, let me just show you what I mean.

When I bring in Photoshop here and drop in one of these photographs.

So I'm just going to go ahead and select these object selection.

So the object selection tool, and I'm going to go ahead and do this

right.

So this is kind of like the intelligent tool in Photoshop, as you can see, is pretty accurate.

I think the 3D sample is using

a very similar technology to do that, and it generated a mask for all of these images.

Let's go ahead and click on Submit and we're going to change the precision.

So you can just go for low play around with this.

I'm going to go for high precision.

I want to get all those details and the photo ordering.

There is no necessarily any order that I or it's not a sequence, but I'm just going to go for the default,

even though I did it kind of like in a sequence just walking around the model or the object.

So when I click on process

and this is just about waiting, so I'm just going to pause the video here and come back when it's ready.

All right. So we're back.

It took about two, 2 minutes to produce these sort of point cloud.

And if I move, I just with this scroll wheel on my mouse, you kind of see what I did with the camera.

So this is kind of like an important thing, just to highlight

the fact that I went around the object and each one of these icons is obviously a camera.

And yeah, I just took photos. Like three different levels.

So let's say a ground level this mid level here and then at top and all around the model.

And then I just went in with some close ups like I show you before,

and this is a pretty impressive and accurate representation of the model.

So there's just a point cloud at the moment, but it did a pretty good job isolating the rest of the model.

Now another thing that I need to mention at this point is that I took the photos in an overcast day,

so basically there was no contrast or harsh shadows, and that also helps to add to simplify the process a little bit more.

So if you want to go around and take some photos, make sure that they are either

in the shade or, you know, it's a cloudy day that works a lot better.

Now you see there's a few warnings.

So 4 images that were not aligned correctly or properly

so, these are just these four images that you see here, which is not a big deal, is just like close ups.

Anyway, I don't really mind and I don't have to do anything else.

Just go to the geometry details and choose what type of geometry you want.

So you want to go full high, medium draft and that sort of thing.

So I'm just going to go for full because I want a pretty high res mesh and that's it.

I'm going to click on Submit and then there is a another waiting game.

Alright.

And here we are with the final post process version of this plant.

So I'm just going to hold the alt key and the left click on my mouse just to rotate around

and show you what the result is.

I'm going to look closer here.

There are some gaps which I kind of like to be honest, and those are probably

because of the, you know, the lack of contrast in the photographs as well.

But yeah, it's an old part.

So there were actually some holes, I think.

And, you know, there's a bit of gaps

as well here between the leaves, but I can live with that.

And if I really wanted to, to fix that, I can do that in something like ZBrush

or any other software to clean the geometry. The same thing here at the bottom.

Obviously I didn't take photos at the bottom, so that's how it looks.

But yeah, it's a pretty impressive little tool that takes all the guessing work

out of the equation and you can just like drop some images in here and produce these type of assets.

Now, obviously, you can take these further

and polish them a little bit, which is a little bit out of the scope of this video.

But I just want to show you that this is with the material.

This is a solid mesh, so it's a pretty decent reconstruction of that set of photographs.

This is a wireframe, so it's relatively dense here.

And then the U.V. checker,

that's just basically how the U.V.’s are arranged, which is, you know,

not ideal, but you just cut it up into pieces so that you can actually see it in 2D.

Anyway, you have a few more options here and you can bake the normal, bake the ambient occlusion that sort of thing.

I'm just going to leave everything as the default, the resolution of the asset.

I'm going to set it to 4K

and that's about it really.

I'm going to click on Add to project and it's name it, 3D planned.

And keep in mind that this planned or this simple part is actually

a very complex object because there are a lot of gaps and things like this nature.

So in between these leaves and the pot, it's actually a gap that it sort of found out.

I mean, it did a pretty good job of sleep.

There's some little things here to fix, but

it's very impressive how from just a couple of clicks you get something like this.

So now we have these in substance to the sampler and we can go ahead and combine these

with a bunch of all the filters that you might have tried in the past that you're familiar with

in 3D Sampler, like creating dust or adding a bit of a specular already, all that good stuff.

I'm just going to keep it simple and just show you how you can render something like this straight away

using 3D stager.

So I'm going to go ahead and click on the shared button right here.

Then click on Export As and in here, I'm just going to select this folder where the plan is going to live.

So on the left hand side you have the mesh settings, which is an FBX,

which is great, and the material will be exported as a PNG, like a flat image.

That's about it.

Let's go ahead and click on Export and then just wait until this part finishes here.

All right. And that finished exporting.

Now, at this point, if you want, you can just go ahead and click on this

icon right here and, you know, produce another asset, another 3D object.

And now I'm going to go ahead and fire up Adobe 3D Stager.

All right.

So here we are inside substance 3D stager, and we can create very awesome looking images

with this application. And it's very intuitive, very easy to use.

So what I want to do is take that FBX that I export it.

I had one already for this tutorial that I'm going to just drop in here,

but it's essentially the same thing.

And when I click on import with the default settings and it imported it,

you know, it's a little bit too big.

So I'm just going to go ahead and select the object.

So I'm going to open up the folder here from the scene.

Select this mesh transform and then just scroll back a bit so that I can see it.

Maybe we can actually select the folder itself so that the pivot is at the bottom of that app

and then just scaling just the usual manipulation of the gizmo you can press F to frame it.

And there we go.

I don't see exactly how big this is.

I just know it is big.

So I'm just going to drop a object, any object really to compare it.

So if you go to the left hand side

and you click on this square or this cube, it will show you all the available 3D objects.

So I'm going to go ahead and find something,

something interesting, like this stool, for example, and then just drop it in here.

And you can see it's relatively big compared to the stool.

So I want to go ahead and take this scale down again.

And now I can just go ahead and place these.

All right.

So there's nothing fancy here, just moving things in place.

And this is going to be kind of like the way that I'm going to present this plant.

I'm actually going to get rid of the stool and, you know,

use the base as if it was just the pot or like base for the pot.

So let's go ahead and open up this tool here. And let's find

the cross mesh, I believe it's called let's say it's one of these ones.

It's not the ring, it's not the screw it’s the support mesh I think.

So when I select that one and I'm going to hide it, I need to delete it.

Select the pot again, bring it down.

I'm going to try to hide it.

Those meshes or those like little flicks of geometry inside this area.

Like I said, you can totally use something like blender or,

you know, ZBrush anything really to clean the geometry a little bit.

But in an effort to save some time

and just show you the entire process, I'm just going to leave it like that.

If I hold shift and right click, I can rotate the light around

and I think that's looking pretty decent and let's go ahead and add some material.

So for the for the plant, if I select it, let's go to the mesh transform this one right here.

I can also right click and rename it, let’s call it plant.

And let's go to the material here in the properties of that object.

And here is where we can drop in that base color.

So it's just an image really.

And I'm going to go ahead and drop that image into the base color.

So let's drop it in there.

And there we go.

So now we have a nice base color for this object.

Now, obviously, the material itself, So this could be like a concrete material.

This is a plastic material.

And of course, the plant material would have different properties.

So again, if you want to take this to the next level, you can just split these into parts

and assign different materials.

So let's say the leaves would have a little bit of translucency to make it more realistic.

You know, the plastic would be a bit shinier than the concrete and that sort of thing.

But I think it just it just works well for the sake of this tutorial,

which is basically showing you how quickly you can generate these type of things with Adobe 3D Sampler

and obviously with 3D Stager, you can present things quite nicely now for the chair or for this base.

Let's go ahead and find material by clicking on this icon right here.

And this type wood and let's just drop this Oakwood in there.

And now once we drop the material, you would have it in here.

Now you click on the sphere and the actual material and drop it to another leg.

What you're going to create is another instance of that material.

So I'm going to take the material itself.

So from here, not from here,

and just drop it into the leg so that I can sort of manipulate things like the UV

and at the count of these veins in one single material and affect the rest.

And I think that looks pretty decent actually. I mean, you can change things.

You can be a little bit more thorough

since the U.V.’s are slightly crooked, but you can select the material.

So let's select something like is go to the material

and you can change the projection from UV to triplanar like that.

But I think the U.V. works fine.

I mean, there are like little things that you can fix, but I think it works fine.

Now to complete the effect, let's go ahead and drop in some planes.

So there's going to be just a plane for the ground

and let's drop another one or actually you can just duplicate this one.

So let's select the plane and click on duplicate here in the actions.

And let's go ahead and rotated.

If you hold the shift key, you will be able to rotate it kind of like snap to integer numbers.

So 90 degrees or something like that. Perfect.

So the last thing I want to do is create a camera by clicking on this button right here,

and that creates that camera. And you see it's created here.

You can get out of the camera by clicking on this button out of the camera and back in.

I'm just going to frame it like so.

And also maybe let's find some concrete to add to the wall.

And also from this section right here, from the project materials,

I'm going to drop it to the floor and then go to the repeat section here, the material

just to increase that repeat so that this size kind of like makes sense.

All right.

So the other thing we can do with

the camera is selecting that camera and click on depth of field to enable it.

And then you can increase the amount of blurriness.

Now, you won't see anything right now because I've been showing you kind of like a preview

of the render, but you can click on this ray tracing by click on that.

It will give you a much nicer version of the render or like the actual render,

and then you can change all of that.

So I'm going to increase the blur amount.

And this little cross here is basically this focus point.

So if I click on set focus point, whatever I click next is going to be the focal point.

So when I click on the leaves right there and in fact, let's go ahead and select the whole pot.

I'm just going to rotate in.

I want to try to find a nicer looking angle for it.

All right.

So something like that, I think works well.

And I can see a little bit of the holes on that old plastic.

So that's kind of cool as well.

And that's pretty much it.

I mean, you can keep playing with these and if you want, you can add some lights.

If you click on the light icon here, let’s delete that concrete.

Let's get out of the camera by clicking on this dot in here

and let's drop a spotlight around here and let's just change the color to something more dramatic

just so that you can see the effect to red and increase the exposure, maybe the intensity as well.

And the cone angle. So to put it right on top of this splint

and let's go back into the camera

by clicking on that little circle and as you can see, sort of like reacts to that color.

Obviously, the color is not great.

I think that the default lighting works pretty well, but that's pretty much it.

Everything is very, very simple, automated for you.

There are obviously certain things that you can do to improve the look of the asset,

to minimize the gaps between the geometry and clean it up a little bit.

But if you think about it for a process that takes just a few minutes, taking some photos from your

you know, using a camera or your phone in, if you go for a walk and take a few photos of an asset,

then you can just go to your computer and turn it into a it's something that could work quite nicely.

So I'm going to leave this video here.

Hopefully you have found these useful and I'll see you in the next tutorial.

Cheers!