How to Edit Vision Pro Spatial Video in 3D with DaVinci Resolve

Summary

This tutorial teaches how to edit and enhance Apple Spatial Video using Davinci Resolve, including fixing stereo alignment issues, adjusting 3D depth and convergence distance, inserting properly placed 2D graphics, and encoding back to Apple MV-HEVC format for Vision Pro compatibility. It aims to help creators master end-to-end Spatial Video production for Apple's new immersive video standard.

Takeaways

• 😀 The video teaches how to edit and enhance Apple Spatial Videos using DaVinci Resolve
• 😊 It provides a free Apple Spatial Video file to follow along the tutorial
• 📹 It shows how to preview Spatial Videos easily on iPhone 15 with a supported 3D display
• 💡 It explains how to separate left and right eye videos using FFMPEG
• 👓 It demonstrates fixing stereo alignment issues in DaVinci Resolve
• 🔧 It covers adjusting 3D depth and convergence distance in post production
• 🎥 It shows inserting and adjusting 2D graphics in 3D space
• 📤 It explains exporting left/right eye videos and combining into side-by-side 3D
• 🔙 It provides instructions on converting back to Apple MV-HEVC format
• 🙌 It encourages viewers to subscribe for more Spatial Video tutorials

Q & A

如何使用Davinci Resolve Stereoscopic 3D工作流编辑Apple Spatial Video？

首先将MV-HEVC转换为传统的并排3D视频，然后使用Davinci Resolve的3D同步功能创建立体视频剪辑，并在剪辑和颜色标签中进行编辑和3D调整。

为什么要覆盖如何为Meta Quest 3和其他3D平台或XR眼镜编解码空间视频？

因为并非每个人都能负担得起3500美元的Apple Vision Pro，所以作者提供了如何为更广泛的设备，包括Meta Quest 3、YouTube VR和PSVR等平台编解码空间视频的指导。

为什么许多人报告说Vision Pro在Spatial Video的3D深度上比Meta Quest 3更好？

这可能是由于Vision Pro的显示和处理技术更高级，但视频制作者可以在后期制作中调整3D深度，以获得最佳的观看体验。

可以用哪些设备拍摄3D Spatial Video？

理论上，任何相机都可以拍摄3D Spatial Video，例如iPhone 15 Pro、Kandao EGO、Canon EOS VR系统和RED V-Raptor等。

为什么需要在后期制作中调整3D视频？

因为不同的拍摄设备可能会导致不同的深度质量，调整3D视频是确保在特定显示设备上获得舒适观看体验的关键步骤。

如何在iPhone 15上预览Spatial Video？

可以使用Spatialify应用将Spatial Video直接在iPhone上观看，或通过USB-C连接到外部3D显示设备或AR头盔。

如何使用FFMPEG分离Spatial Video的左右眼视频？

在包含视频文件的文件夹中创建左右两个子文件夹，然后在终端或命令提示符中使用FFMPEG命令将视频分离到这些文件夹。

Davinci Resolve如何处理3D视频编辑？

Davinci Resolve使用立体3D同步功能将左右眼视频同步，允许在编辑标签中像编辑2D视频一样处理它们，并在颜色标签中调整3D效果。

如何在3D视频中插入2D图形而避免立体视觉冲突？

应将2D图形放置在不会与前景或背景元素产生冲突的深度位置，并在Davinci Resolve中对其进行立体3D调整。

如何将编辑好的视频转换回Apple Vision Pro的Spatial Video格式？

将左右眼视频分别渲染出来后，在Resolve中重新组合，然后使用Halocline或Spatialify等服务将其转换回MV-HEVC格式。

Outlines

00:00

😄第一段介绍了教程的内容和目的

本段首先介绍了教程的主题是教大家如何编辑Apple Spatial视频,插入3D图形,编码传统3D视频到Apple MV-HEVC格式,以及如何在没有Apple Vision Pro设备的情况下解码和编码Spatial视频。教程的目的是让大家能够创建第一个Apple Spatial视频。

05:00

😎第二段详细介绍了视频编辑的流程

本段首先提到了使用Davinci Resolve Studio软件来编辑Spatial视频的原因。然后详细解释了编辑的每一步,包括设置项目参数,将左右眼视频分类到不同文件夹,使用软件自动生成立体视频片段,插入2D图形时考虑深度问题,使用色彩页面调整立体3D效果,输出视频等等。

10:06

😃第三段讲解了如何调整3D效果

本段着重讲解了在Davinci Resolve的立体页面中可以调整立体3D效果的相关设置,包括校准左右眼的误差,调整图像深度,确保整个场景的3D效果自然逼真。这可以修正拍摄Spatial视频时的问题,使3D效果更舒适。

15:09

😆第四段总结了教程的内容

本段对整个流程做了简要的总结,感谢大家的观看,并提到会继续更新相关教程内容。最后再次强调学习掌握Spatial视频的编辑技巧的重要性。

Keywords

💡Apple Spatial Video

Apple Spatial Video是一种利用MV-HEVC格式来编码的3D视频技术，旨在为观众提供更加沉浸式的观看体验。在这个视频中，讲解如何编辑和编码为Apple Vision Pro设备制作Spatial Video。通过使用Davinci Resolve软件的立体3D工作流程，可以将传统的3D视频转换回Apple MV-HEVC格式，使其兼容Vision Pro等设备。

💡Davinci Resolve Stereoscopic 3D

Davinci Resolve Stereoscopic 3D是一种强大的视频编辑工具，特别适用于处理和编辑立体3D视频。它提供了丰富的3D对齐工具，使得编辑者能够调整3D视频中的深度和对齐，以确保观看舒适度。视频中介绍了如何利用Davinci Resolve的这些功能来编辑Apple Spatial Video，包括插入3D图形和调整3D深度。

💡MV-HEVC

MV-HEVC是一种高效视频编码标准，特别用于编码空间视频（Spatial Video）。它支持3D内容的压缩，同时保持较小的文件大小和高质量的视频输出。视频脚本中提到如何将MV-HEVC格式的文件转换为传统的左右眼3D视频，以及如何将这些视频再编码回MV-HEVC格式，以便在Apple Vision Pro上播放。

💡立体3D同步

立体3D同步是在Davinci Resolve中用于将左眼和右眼的视频片段自动对齐的功能。通过选择左右眼文件夹并执行同步，软件能够创建立体的3D剪辑。这简化了编辑过程，因为编辑者可以像编辑2D视频一样处理这些3D剪辑，同时保持3D效果。

💡空间视频转换

空间视频转换指的是将MV-HEVC格式的空间视频转换为传统的左右眼3D视频的过程，或反之。视频中提到使用Spatialify iOS应用和Halocline工具来进行这种转换。这一步骤对于在不同的设备上编辑和观看空间视频至关重要，因为它使视频能夠在各种平台上兼容。

💡FFMPEG

FFMPEG是一个开源的多媒体框架，能够处理视频和音频的编码、解码、转换和流式传输。在这个视频脚本中，FFMPEG被用来分离空间视频的左右眼内容，以便在编辑过程中进行处理。通过特定的命令行操作，用户可以轻松地将视频文件分解为左眼和右眼的视图。

💡3D深度调整

3D深度调整是指在后期制作中改变3D视频中物体的视觉深度的过程。通过调整立体对齐和收敛距离，可以控制视频中的物体看起来是更靠近观众还是更远离观众。这在视频中被提到，作为一种方式来优化观看体验，确保3D效果既舒适又真实。

💡编码与解码

编码与解码是指将视频文件转换为特定格式（编码）和将其转换回可编辑或可观看格式（解码）的过程。视频中详细介绍了如何将MV-HEVC空间视频解码为传统的3D视频，以及如何将编辑后的视频重新编码为MV-HEVC格式，使其兼容Apple Vision Pro和其他3D平台。

💡Halocline与Spatialify

Halocline和Spatialify是两个用于处理空间视频的工具。Halocline提供了一个免费的解决方案，用于将MV-HEVC视频转换为传统的3D格式，而Spatialify是一个iOS应用，用于空间视频的观看和转换。这些工具在视频中被推荐，以帮助用户在不同设备上编码、解码和观看空间视频。

💡3D图形插入

3D图形插入是指在3D视频中添加图形元素的过程，如标题、图标或其他视觉效果。视频中讨论了如何使用MotionVFX提供的模板在Davinci Resolve中插入和调整这些图形，同时考虑到3D深度，以避免立体冲突并增强观众的沉浸感。

Highlights

使用 Halocline 免费将 MV-HEVC 转换为传统的左右眼 3D 视频

使用廉价的红蓝 3D 眼镜检查你的 3D 效果

Transcripts

Today, I will teach you step by step on how  to Edit Apple Spatial Video, how to insert  

3D graphics, and how to encode traditional 3D  video back to Apple MV-HEVC for Vision Pro,  

using the powerful Davinci Resolve Stereoscopic  3D workflow. Since not everyone can afford a  

$3500 Apple Vision Pro, we will also cover how to  decode and encode spatial video for Meta Quest 3,  

YouTube VR on Steam or PSVR, and other  compatible 3D platforms or XR Glasses. 

By the end of this in-depth tutorial, you  will be able to create your first Apple  

Spatial Video. It is actually easier  than you think, let's get started.

Hey, what's up everybody? It is your boi, Hugh,  here. If you have not already, check out my  

Spatial Video with Kimchi here. This tutorial will  teach you how to do that, and how to control the  

3D depth based on your 3D decoding systems. Lots  of people report that Vision Pro has better depth  

than Meta Quest 3 for Spatial Video. But in fact,  you can control that in post to get the perfect  

depth for your display. I personally think the 3D  depth should be close to real life, not more or  

not less. It is not a gimmicky but a new dimension  to help your viewers immerse into your stories. 

In theory, you can film 3D Spatial Video on  any camera - iPhone 15 Pro, the Kandao EGO,  

Canon EOS VR system, RED V-Raptor with Dual  Fisheye lens, and the list goes on. So you  

will get different quality of depth depending  on the lenses and sensors you use. Having  

the knowledge to fix it in post is crucial for  delivering on Vision Pro or your targeted device.

If you don't have a way to  shoot 3D or Spatial Video,  

I provided my Spatial Video shot on the  iPhone 15 Pro Max in native MV-HEVC free  

for download. Links in the description.  So download it and follow along.

If you don't know how to shoot  Spatial Video on your iPhone 15,  

check out this short tutorial right here.

Step one is to convert your MV-HEVC to  a traditional side-by-side 3D video. You  

can use the Spatialify iOs App, which is not FREE  anymore. If you prefer a FREE solution, Halocline  

is great for that. Please follow this tutorial  to learn how to use Halocline to convert MV-HEVC.

Before we even start editing Spatial  Video, we need an effective way to  

preview and select takes in 3D. Lucky, now,  you can easily watch Spatial Video directly  

on your iPhone 15 with any USB-C AR  glasses or AirPlay it on any 3D TV! 

Open Spatialify App and select a Spatial Video  on your iPhone; connect your external 3D Display  

or AR headset using a USB-C, you immediately see  this green label said "streaming media". Tap it,  

you can choose Full size Side by Side,  Half Size Side by Side like some of  

the older 3DTV, and even Anaglyph. A Red and Blue Anaglyph glasses cost  

less than $1 on amazon, so this is the  cheapest way to watch 3D Spatial Video. 

I have the Viture One XR Glasses here. Hold  this button will turn on 3D mode. You don't  

need it or you can use any AR glasses.  For me, it is just a more accurate way  

to preview the 3D depth before I decide which  takes get into my timeline and which are not.

Always preselect your takes to save time  in editing. 3D is double the amount of  

works compared to 2D editing. Take notes.

Next step, we need to separate the Left and Right  eye. Luckily, there is a very easy way to do it  

using FFMPEG. If you do not have FFMPEG,  follow this tutorial on how to install it.

Within your footage folder, create a  folder called Left and a folder called  

Right. click the command and space bar to  search for the terminal. Open Terminal. 

You can absolutely do it on PC as well  using CMD. But since we are editing  

Spatial Video for Apple Vision Pro, it  is better to use an Apple ecosystem.

Type CD with a space, then drag  the folder after the space bar.  

Hit enter. Now copy and paste this command  line exactly. There is a free text document  

available to download alongside the free  Spatial Videos. All the command lines are  

in it. So please download it and  copy the exact command line in.

Only thing you might need to change is mp4  to mov here. Halocine gives you MOV file,  

and Spatialify gives you mp4.  Now the terminal is running,  

you see the files are populated in the Left  and Right folders. It runs really fast.

We are going to use Davinci Resolve Studio to edit  Spatial Video because it has the most powerful 3D  

alignment tool I saw in the industry. Soon, you  see that the iPhone 15 Pro Max does not capture  

the perfect 3D, and you will need to post-align  to make the 3D look comfortable for your viewers.

Open Davinci Resolve, I am on 18.6. Step one  is to set your project settings.

Set your video to 1920 by 1080, which is the  exact same size as your iPhone 15 Pro Spatial  

Video 1 eye footage. Frame rate 30. Now you can  close project windows. Go to your Media Tab. Under  

Master, let's create a Left and Right folder.  Drag the left-eye files into the left folder and  

the right-eye files into the right folder. Now, here is the magic of Davinci Resolve.  

Right click Master, and select Stereo  3D Sync. Choose the left folder for left  

eye and right folder for right eye. Output  folder can just be Master. Click Sync. Now,  

8 stereo clips are created. Beautiful. if you pay attention, all these clips  

have the 3D icon here to indicate  you are working with a 3D clip.

Go to Edit tab and drag all the 3D clips into your  timeline. They just look like regular 2D videos,  

but trust me, they are 3D. The idea  of Davinci Resolve 3D editing is to  

make no difference to 2D editing. Your story  editor will still edit it like a 2D video,  

and we will handle the 3D in the color tab.

Now edit your video as usual. We are going to  insert a graphic here. I like to use MotionVFX  

for the title template. There are some  good free templates you can use, download,  

and use them absolutely free. Just search for  FREE. The mHello and mMatrix are really high  

quality free motion graphics templates, and you  actually saw some of them used in my video. In  

this travel base Spatial Video, I am going to  use mtrip, a Davinci Resolve template designed  

for the Insta360 camera - like the OneRS 1" I  have here. If you are interested in this unique  

template dedicated to 360 content creators, I have  a discount code below can save you some money.

I am going to use mTrip Title 02 here, and  modify the layout to fit my video. When you  

insert 2D graphics inside a 3D video,  you need to think about depth. Here,  

I want the title to appear closer to  viewers, but still behind the trees  

here. So make sure you do not place the  graphics on top of the tree. Push it up on  

the frame. The sky is usually a safe spot  to put graphics to avoid stereo conflict.

Now go to Color Tab to adjust stereo 3D. You can  still color grade as usual. But when you are done,  

go to the 3D tab here. This is only  available on the paid version of  

Resolve Studio. Sorry free users. The good  news is that Resolve Studio is still a lot  

cheaper than an annual subscription  to Adobe Premiere and After Effects.

Go ahead and select Stereo and Out select  Black and White Anaglyph. Now you can use  

the cheap Red and Blue 3D glasses to  check your 3D. Even Kimchi can do it!

If you zoom in on the Mountains in the distance,  you actually spot a vertical stereo problem! This  

can be an iPhone problem or a transcoder problem.  But we notice this problem in both Spatialify and  

Halocline render. So, we can assume the vertical  mismatch is embedded in the MV-HEVC metadata. 

No worry, we can easily fix it in post. Go to Stereo Alignment and try both  

stereo alignment methods. Until you see the  distance mountains has no vertical disparity.

Go to each clip to recalibrate  the stereo and check it with your  

3D Anaglyph glasses to ensure  the stereo looks comfortable.

One more thing I want to show you. Convergence  distance. If you do not like the 3D depth of  

the iPhone 15, you can actually adjust it here.  This is really for advanced users if you know  

what you are doing. For example here, I want  this pole next to Kimchi sit in the 0 plate.  

Anything behind the pole will look cave into the  screen, or behind the screen in 3D. Everything in  

front of the pole looks pop out from the screen.  Since I re-adjusted the convergence distance,  

the 3D of Kimchi now does not look so close in  your face. And now the background really sinks  

into the screen. The stereo 3D looks more  balanced. So, the end result is more 3D.

Finally, let's adjust the 2D graphics in  3D space. All inserted 2D graphics have to  

be adjusted in 3D - so don't forget about it  if you don't want your audiences cross-eyed.

We select the graphics and add positive  convergence value to make the graphics pop  

out of the screen. If you want it to go into the  screen, you can add a negative value instead. We  

do not have much of a negative budget here, so we  only stick to positive to avoid stereo conflict.

Again, check it with your cheap anaglyph  glasses or a VR headset like Meta Quest 3  

to make sure the stereo look good  and no stereo conflict problem.

Okay now we export the video. Go to the Deliver  tab. At the time of recording, there is no way  

for Davinci Resolve to export Full Size Side by  Side video, which is what Spatial Video requires.  

If you don't understand the difference,  here is a comparison. If you watch half  

size Side by side video inside Meta Quest 3, it  looks normal, but you will notice an aliasing  

issue because Quest 3 is re-stretching  your video to full size. It is bad.

I hope Blackmagic sees this and  fix this for the 3D community.

For now, we are going to export  the left and right eye separately  

in ProRes and recombine them in  Resolve. I use ProRes 422 as this  

is a lossless codec. You can delete  the single-eye ProRes files later.

Render Stereoscopic 3D. first, select the  Left eye and render it out. Come back,  

select the right eye, and also render it out.

Now import the renders back and ensure your  timeline sequence is 3840 by 1080 this time.

Remove the duplicated audio. Oh, make sure your  timeline scaling is Center Crop with no Resizing.  

Set your left eye Position X as minor 1920 and  the Right eye footage Position X as positive 1920.

You can not go directly to Deliver  tab and this time you can render  

out either H.264 or HEVC. I recommand H.265, HEVC.

This 3D video file will work on Meta Quest 3  or any other 3D display you have. But if you  

want it to play on Apple Vision Pro, you need to  still convert it back to Spatial Video format.

You can use the Halocline web service again.  The free account has 3 min monthly limit on  

MV-HEVC conversion. As you see here,  I only have 14 seconds left before I  

need to pay. Besides that, it is pretty  easy. You just upload your 3D file and  

it will split out a MV-HEVC file back to  you that will play on Apple Vision Pro.

If you found a free solution, don't forget  to comment and let the community know.

Future me here. So, I just found a relatively free  

solution.

Open the Spatialify App and tap Create Spatial  

Video; this supports lots of input formats,  which, for us, is Full Side by side. Then  

you can airdrop the Resolve render here. Pick  from Photo Library and select the side by side  

render. Main View is Left Eye View. One of the  benefits of Spatial Video is it will be backward  

compatible with all screens. A 2D screen like  iPhone will just show the Left view. But for  

some reason you want to show Right eye instead,  you can set it in the MV-HEVC Metadata here. You  

can even set your IPD distance here. I set it to  65mm as that is the most common IPD. Hit Create,  

and it will run. This is not re-encoding as it  is very fast. If you don't know the benefit of  

MV-HEVC, it allows the video to play in 2D and  3D, with smaller file sizes and accessible for  

streaming. It is really the true of 3D should  be. Not being an Apple fanboy here. I just  

want to credit what Apple did as people keep  attacking Apple just rebranded 3D video. Well,  

it is not that simple. This move set the  foundation for VR180 and 3D 360 distribution,  

so we can stream 8K media more easily in the  foreseeable future. Kinda a big deal. Okay,  

now the render is done. The output is a new  Spatial Video, just like how you originally  

capture with the iPhone 15 Pro or your Apple  Vision Pro built-in camera. This is how you  

will make commercials in Spatial Video as  well. If you are an advertiser, take notes!

This is a long tutorial. Thank you for sticking  around. We will continue to update this tutorial  

when there is an easier workflow or Apple  releases some official support on Spatial  

Video editing. So don't forget to subscribe  and hit the notification bell so you don't  

miss a thing. Together, let's master Spatial Video  for Apple Vision Pro, I will see you next time!