Create FPV-Like Videos with Your Phone | 3D Scan Tutorial with Luma AI

This tutorial video demonstrates how to use your smartphone to scan your surroundings and create cinematic camera movements using Luma AI. It guides you through the process of capturing video loops from different heights and provides tips for achieving the best quality. The video also covers editing and animating the camera in Luma's browser-based editor, using keyframes and camera tools to create dynamic movements. Additionally, it discusses how to fill in uncapture areas with a solid color and offers a trick for maximizing output quality when exporting vertical videos. The tutorial concludes with a mention of combining Luma scans with other AI video tools for unique effects.

Takeaways

• 📱 Use your smartphone to scan surroundings and create cinematic camera movements with Luma AI.
• 📷 For iPhone users, the Luma app provides real-time guidelines for easier scanning.
• 🤖 Android users can upload videos to Luma through a web browser after capturing footage.
• 🎥 Recommended camera settings include shooting in 4K, disabling HDR, and video stabilization.
• 📶 Capture video loops from three different heights: chest level, above head, and knee level, keeping the subject centered.
• 👥 Acknowledge the assistance of friends Umar and Tarving from Product Nation for their help and behind-the-scenes footage.
• 💻 After recording, upload the video to lumalabs.ai, name the project, and wait for processing.
• 🌐 The processed 3D scene can be downloaded for use in other 3D software or edited in a browser-based editor.
• 📹 Use camera tools and keyframes to animate and manipulate camera movements within the Luma editor.
• 🔄 Switch between preset camera trajectories or create custom animations for dynamic effects.
• 🖼️ Fill in uncapture areas with a solid background color and adjust video resolution before exporting.
• 📱 For social media, render videos in landscape mode and then rotate and crop for vertical orientation.

Q & A

What is the main purpose of using Luma AI as described in the video?

The main purpose of using Luma AI is to scan surroundings with a phone and create cinematic camera movements in post-production, allowing for the creation of FPV-like videos.

Is there a specific app recommended for iPhone users to use with Luma AI?

Yes, for iPhone users, the dedicated Luma app is recommended as it provides real-time guidelines.

Can Android users also use Luma AI to capture videos?

Yes, Android users can capture videos and upload them directly to Luma from their browser.

What are the recommended camera settings for shooting videos to be used with Luma AI?

The recommended settings are to shoot in 4K, disable HDR, and disable video stabilization. Either a wide or normal focal length can be used.

How many loops should one capture from different heights when recording for Luma AI?

One should capture a single video in loops from three different heights: chest level, above the head, and knee level.

What should one do after recording the video for Luma AI processing?

After recording, one should go to lumalabs.ai, create an account, upload the video, give the project a descriptive name, and wait for it to process.

How can the 3D scene created by Luma AI be used after processing?

The 3D scene can be downloaded as an object or mesh scene for use in other 3D software, or one can use the browser-based editor to manipulate camera movements.

What are the two preset trajectories available in the Luma AI editor for simple camera movements?

The two preset trajectories available are 'orbit' and 'oscillate'.

How can one adjust the camera roll and focal length between keyframes in Luma AI?

One can adjust the camera roll and focal length by inserting new keyframes and making the desired adjustments within the custom mode of the motion tab.

What is the recommended method to maximize the output quality when exporting a vertical video from Luma AI?

The recommended method is to edit each keyframe and add 90 degrees to the camera roll setting, which can be time-consuming but improves quality.

How can one upscale a video to 4K before processing it through Luma AI, as mentioned in the script?

One can use a tool like Topaz Video AI to upscale the video to 4K before processing it through Luma AI.

What additional AI video tool is mentioned in the video that can be combined with Luma AI scans?

The additional AI video tool mentioned is gen 1 from RunwayML.

Outlines

00:00

📱 Using Your Phone for Cinematic Camera Movements with Luma AI

This paragraph introduces the video's focus on utilizing a smartphone to capture surroundings and create cinematic camera movements using Luma AI. It emphasizes the potential of using a DJI drone for a first-person view (FPV) and discusses the importance of video quality and the tricks to enhance it. The speaker recommends shooting in 4K with HDR and video stabilization turned off, and provides a method to capture video loops from different heights. The process of uploading videos to Luma, using the Luma editor for camera manipulation, and exporting the final video is explained. The paragraph also highlights the option to fill unrecorded areas with a solid color and adjust video resolution before exporting. A tip for maximizing output quality by editing keyframes and adding a camera roll is shared, and the process of exporting vertical videos for social platforms is briefly discussed.

05:02

🤖 Creating Dynamic FPV Videos with a Drone and Luma AI

The second paragraph delves into the process of using a DJI drone to capture FPV-looking videos. It explains how the built-in orbit feature of the DJI Mini 3 Pro can be used, despite its limitation to 1080p. The speaker shares a workaround by using Topaz Video AI to upscale the video to 4K before processing it through Luma, which improves the render quality. The paragraph also suggests combining Luma scans with AI video tools like Gen 1 from RunwayML for unique creations. The speaker encourages viewers to stay creative and promises to share more in the next video, ending with a sign-off and background music.

Keywords

FPV-Like Videos

FPV stands for 'First Person View,' which refers to the immersive perspective that a drone pilot experiences while flying a drone. In the context of the video, it describes the type of videos that can be created using a phone and Luma AI, which mimic the dynamic and engaging viewpoint typically associated with drone footage.

3D Scan

3D scanning is the process of capturing the shape and appearance of a real-world object or environment and translating it into a three-dimensional digital model. In the video, the user demonstrates how to use a phone to perform a 3D scan of surroundings, which is then used to create cinematic camera movements in post-production.

Luma AI

Luma AI is a technology or software mentioned in the video that facilitates the creation of cinematic camera movements from phone-captured videos. It appears to use artificial intelligence to analyze the video and generate 3D scenes that can be edited for dynamic camera angles and movements.

DJI Drone

A DJI Drone is a brand of unmanned aerial vehicles (UAVs), commonly known as drones, that are used for various purposes including photography and videography. In the video, the creator discusses using a DJI drone to capture footage for creating FPV-looking videos.

4K Video

4K video refers to a resolution of 3840 x 2160 pixels, which is one of the highest resolutions available for consumer video recording. The video script recommends shooting in 4K to ensure high-quality footage for post-production editing with Luma AI.

HDR

HDR stands for High Dynamic Range, a technology that enhances the contrast between the brightest and darkest parts of an image. The script advises disabling HDR when shooting videos for use with Luma AI to maintain a certain level of control over the footage's lighting.

Video Stabilization

Video stabilization is a technique used to minimize the undesired effects of camera shake in video footage. The script suggests disabling video stabilization when recording, as Luma AI is expected to handle the stabilization in post-production.

Keyframes

Keyframes are frames in an animation or video editing that define the start and end states of a transition or animation. In the context of the video, keyframes are used to animate the camera movements within the 3D scene created by Luma AI.

Orbit Mode

Orbit mode is a camera tool that allows the camera to move around a subject in a circular path. The video demonstrates using orbit mode to create smooth, circular camera movements that are typical in FPV-style videography.

Motion Blur

Motion blur is a visual effect that occurs in still images or video when an object in motion is captured. In the video, the creator recommends adding motion blur to the final render for a more realistic and professional look, using a plugin called RSMB.

Upscaling

Upscaling is the process of increasing the resolution of a video or image. The script mentions using Topaz Video AI to upscale a 1080p video captured by a DJI Mini 3 Pro drone to 4K before processing it through Luma AI to improve the final render's quality.

RunwayML

RunwayML is an AI tool mentioned in the video that can be used to create unique and visually impressive effects in videos. The script suggests combining Luma scans with AI video tools like RunwayML to enhance the creative output.

Highlights

Use your phone to scan surroundings and create cinematic camera movements with Luma AI.

Use a regular DJI drone to scan and create FPV (First Person View) looking videos.

For iPhone users, a dedicated Luma app provides real-time guidelines.

Android users can upload videos directly to Luma from their browser.

Shoot in 4K, disable HDR and video stabilization for best results.

Capture video loops from three different heights: chest level, above head, and knee level.

Keep the subject in frame and centered during shooting.

After recording, upload the video to lumalabs.ai to process the 3D scene.

Edit camera movements and access camera tools in a browser-based editor provided by Luma.

Use preset trajectories like 'orbit' and 'oscillate' or create custom camera animations.

Switch to first-person view for a more immersive editing experience.

Add motion blur using plugins like RSMB for more realistic renders.

If using a drone, manually orbit around the subject for better data capture.

Upscale videos to 4K using tools like Topaz Video AI before processing with Luma.

Combine Luma scans with AI video tools like Gen 1 from RunwayML for unique effects.

Luma AI technology shows promise despite average video quality.

Share tricks and tips for achieving the best quality possible with Luma AI.

Fill uncapture areas with a solid background color or change video resolution before exporting.

Edit keyframes and add 90 degrees to the camera roll setting for maximizing output quality.

Render and export videos directly from the Luma platform.

Rotate vertical videos to landscape mode for social media platforms with some quality sacrifice.