This is Changing 3D Scanning!!

The video discusses the advancements in 3D scanning technology, highlighting the Kiri Engine as a notable tool for both AR technology and 3D scanning. It introduces a new feature called virtual scanning using NeRF technology, specifically the norlandulo technique, which aims to overcome the limitations of photogrammetry, such as difficulties in scanning reflective surfaces or objects with a single color. The Kiri Engine is now available on both iPhone and Android and offers a way to create 3D models from videos, a process that involves recording a steady video of the object from different angles and submitting it for cloud processing. While NeRF is not expected to replace photogrammetry due to its current limitations, the norlandulo technique, which the Kiri Engine's featureless object mode is based on, shows promise in addressing these shortcomings and could be a strong contender in the future. The video also mentions other features of the Kiri Engine, such as a web app, access library, and in-app editing tools.

Takeaways

• 📈 3D scanning and photogrammetry are gaining attention as the market shifts towards AI and AR technologies.
• 📱 Kiri Engine is a versatile tool for 3D scanning and AR, available on both iPhone and Android, offering alternatives to apps like Polycam.
• 🔍 The new feature in Kiri Engine, virtual scanning using NeRF (Neural Radiance Fields) technology, aims to overcome some limitations of traditional photogrammetry.
• 🚀 NeRF technology is impressive as it can reconstruct 3D scenes from a set of images or video, even when there aren't enough feature points for photogrammetry.
• 🌟 Norlandulo is an advancement over NeRF, generating not just rendered scenes but also usable 3D objects for software like Blender.
• 🚫 A limitation of photogrammetry is its reliance on distinct features like color or shape changes, which can hinder scanning of objects with few features.
• 🔄 NeRF and Norlandulo technologies do not rely on such distinct features, using AI to generate coherent point clouds and 3D models.
• 📹 Using Kiri Engine's featureless object mode involves recording a video of the object from different angles for scanning.
• ⏰ Kiri Engine limits the video length for scanning to 2 minutes due to server limitations, but this duration is typically sufficient for scanning an object.
• 🔍 Norlandulo 2.0 is expected to be a stronger contender for replacing photogrammetry as it addresses the shortcomings of both NeRF and photogrammetry.
• 🔗 Kiri Engine offers additional features beyond the featureless mode, including a web app, access library, in-app editing, and more.
• 📢 The video encourages viewers to subscribe for more content and provides a link to try Kiri Engine for free.

Q & A

What is the current state of 3D scanning in the industry?

3D scanning is one of the most challenging subjects in 3D and is gaining more attention daily, especially with the market moving towards artificial intelligence and augmented reality. Tools, hardware, and apps are making these technologies more accessible.

What is Kiri Engine and how does it relate to 3D scanning?

Kiri Engine is a tool for 3D scanning and AR technology that was reviewed as a great alternative to iPhone 3D scanning apps like Polycam. It is also available for Android and supports QR, offering a solution for those without the hardware necessary for Real Time 3D scanning.

What is the new feature in Kiri Engine that the speaker is particularly interested in?

The speaker is particularly interested in the new feature of virtual scanning using NeRF technology, specifically a technique called Norlandulo, which aims to mitigate some of the shortcomings of photogrammetry.

What are some limitations of photogrammetry?

Photogrammetry requires distinct features in an image of an object, such as changes in color or shape, to create a complete shape. It struggles with objects that don't have many feature points, like objects with one color, transparent, or extremely reflective surfaces.

How does NeRF technology differ from photogrammetry?

NeRF, which stands for Neural Radiance Field, is a machine learning technology that uses AI to reconstruct an entire 3D scene from a set of images or a video. It can reconstruct scenes and objects that don't have enough feature points for photogrammetry.

What is Norlandulo and how does it improve upon NeRF?

Norlandulo is a technique that not only generates neural rendered scenes like NeRF but also produces a high-quality mesh of the object that is usable in 3D software like Blender. It addresses most of the shortcomings of both NeRF and photogrammetry.

How does one use the featureless object mode in Kiri Engine?

To use the featureless object mode, you click the big plus button, select the featureless option, and start recording a video of the object. You should circle around the object, trying to be steady and consistent, and perform the scan in different layers (top, middle, bottom). Then, submit the video to the cloud for processing.

What is the current limitation of the video length for scanning in Kiri Engine?

Kiri Engine limits the video length for scanning to 2 minutes due to server limitation purposes.

Will NeRF technology replace photogrammetry?

NeRF technology will not replace photogrammetry. While NeRF can handle scenes and objects that photogrammetry cannot due to lack of feature points, it currently can't produce high-quality 3D models and textures suitable for a typical 3D pipeline.

What are some potential use cases for 3D scanning or photogrammetry?

Use cases for 3D scanning or photogrammetry include entertainment projects like game development and VFX for movies, as well as applications in the medical field, engineering, and more.

How can I try Kiri Engine for free?

You can try Kiri Engine for free by downloading it from the provided link in the video description. It is compatible with both Android and iPhone devices.

What additional features does Kiri Engine offer besides the featureless mode?

Besides the featureless mode, Kiri Engine offers a web app, access to a library, the ability to create a floor plane, in-app editing, texture toning, and more.

Outlines

00:00

📐 Introduction to 3D Scanning and Kiri Engine's Advancements

The first paragraph introduces 3D scanning as a complex and increasingly popular subject within the 3D industry, gaining attention due to the growing focus on artificial intelligence (AI) and augmented reality (AR). It highlights the Kiri engine as a notable tool for 3D scanning and AR, which has been reviewed as an alternative to iPhone 3D scanning apps like Polycam. The Kiri engine now supports Android and offers a new feature called virtual scanning using NeRF (Neural Radiance Fields) technology, which is a significant advancement in the field. The speaker expresses excitement about this feature, especially for scanning challenging surfaces like reflective or black objects. The paragraph also touches on the use of 3D scanning in various industries, such as entertainment, medical, and engineering, and how it is commonly used in creating characters for video games and movies.

05:01

🚀 NeRF Technology and Kiri Engine's Featureless Mode

The second paragraph delves into the pros and cons of photogrammetry, a technique used to create 3D models from photographs. It contrasts this with NeRF, a machine learning technology that reconstructs 3D scenes from a series of images or video, even when the subjects lack distinct features. The paragraph introduces Norlandulo, a technique that builds upon NeRF to produce usable 3D models with better mesh quality. Norlandulo is based on a research paper by Nvidia and is now implemented in the Kiri engine, making it accessible on both iPhone and Android devices. The featureless mode in Kiri engine allows users to scan objects by recording a video, which is then processed in the cloud. The paragraph concludes by addressing the question of whether NeRF will replace photogrammetry, stating that while NeRF is impressive, it is not yet capable of producing high-quality models and textures suitable for a typical 3D pipeline. However, Norlandulo 2.0 is seen as a stronger contender for this role.

Keywords

💡3D Scanning

3D scanning is a process that captures the shape of an object or environment and converts it into a three-dimensional digital model. It is a crucial technology in fields such as gaming, film, and medical imaging. In the video, 3D scanning is highlighted as a growing subject within the 3D industry, with increasing attention due to advancements in artificial intelligence and augmented reality.

💡Photogrammetry

Photogrammetry is a technique that uses photographs to create 3D models. It requires the object to have distinct features, such as color or shape changes, to create a complete model. The video discusses how photogrammetry is a common method used in the creation of game characters and movie characters, like those in 'The Matrix' and 'Call of Duty'.

💡Kiri Engine

Kiri Engine is a tool for 3D scanning and augmented reality technology. It is mentioned in the video as an alternative to iPhone 3D scanning apps and is now available for Android as well. Kiri Engine is significant because it incorporates neural radiance fields (NeRF) technology, allowing it to scan objects that are difficult for traditional photogrammetry to capture.

💡NeRF (Neural Radiance Fields)

NeRF is a machine learning technology that uses artificial intelligence to reconstruct a 3D scene from a set of images or a video. Unlike photogrammetry, NeRF does not rely on distinct features of an object and can handle objects with fewer features, such as a single color or reflective surfaces. The video explains that Kiri Engine has integrated NeRF technology, making it a powerful tool for 3D scanning.

💡Nerf Technology

Nerf technology, as discussed in the video, refers to the use of NeRF for 3D scanning purposes. It is a newer technique that aims to overcome some of the limitations of photogrammetry, such as the inability to scan reflective or black surfaces. The video highlights a video made about Nerf technology and how it works, indicating its relevance to the theme of 3D scanning advancements.

💡Norlandulo

Norlandulo is a technique that builds upon NeRF by not only generating neural rendered scenes but also producing high-quality meshes that are usable in 3D software like Blender. It is an advancement that addresses some of the shortcomings of NeRF and photogrammetry. The video mentions that the algorithm behind Kiri Engine's featureless object mode is based on Norlandulo, emphasizing its significance in the evolution of 3D scanning.

💡Featureless Object Mode

Featureless Object Mode is a new feature in Kiri Engine that allows for the scanning of objects that lack distinct features, which traditional photogrammetry struggles with. The video demonstrates how this mode works by recording a video of the object from different angles and then submitting it to the cloud for processing. This feature is based on Norlandulo, making it a powerful addition to the Kiri Engine's capabilities.

💡Artificial Intelligence (AI)

AI is a field of computer science that focuses on the creation of intelligent machines capable of performing tasks that typically require human intelligence. In the context of the video, AI is integral to the functioning of NeRF and Norlandulo technologies, which use machine learning to reconstruct 3D scenes from images or videos.

💡Augmented Reality (AR)

Augmented Reality is a technology that overlays digital information or objects onto the real world, enhancing the user's perception of reality. The video discusses how the market is increasingly moving towards AR, and tools like Kiri Engine are becoming more accessible, indicating the growing importance of AR in various applications.

💡Texture Quality

Texture quality refers to the clarity and detail of the surface textures in a 3D model. The video contrasts photogrammetry, which usually captures high-quality textures, with NeRF, which initially may not generate as high-quality meshes. However, advancements like Norlandulo aim to improve the texture quality of the resulting 3D models.

💡Point Cloud

A point cloud is a collection of data points in three-dimensional space, often used to represent the external surface of an object. In the video, it is mentioned in the context of how photogrammetry uses point clouds to create 3D models. If an object lacks feature points, it cannot generate a coherent point cloud, which is a limitation that NeRF technology aims to overcome.

Highlights

3D scanning is gaining more attention with the market shifting towards AI and AR.

Kiri Engine is a tool for 3D scanning and AR technology, offering an alternative to iPhone 3D scanning apps like Polycam.

Kiri Engine now supports Android and has QR code support for those without the hardware for Real Time 3D scanning.

A new feature in Kiri Engine is virtual scanning using NeRF technology, specifically the norlandulo technique.

NeRF technology aims to mitigate some of the shortcomings of photogrammetry.

Kiri Engine is the only app currently offering NeRF technology on both iPhone and Android phones.

NeRF doesn't require distinct features for 3D model generation, overcoming a limitation of photogrammetry.

Photogrammetry struggles with objects that lack feature points, such as single-color, transparent, or reflective objects.

Kiri Engine is free to download and compatible with both Android and iPhones.

Nerf technology uses AI to reconstruct 3D scenes from a set of images or video.

Norlandulo is a technique that generates neural rendered scenes and produces usable 3D models in software like Blender.

The featureless object mode in Kiri Engine is based on the Orlando algorithm, making it a powerful tool for 3D scanning.

Kiri Engine's featureless scanning requires recording a video of the object from different angles.

The video length for scanning with Kiri Engine is limited to 2 minutes due to server limitations.

Processing time for featureless scanning may be longer than photogrammetry as the feature is new and undergoing optimization.

NeRF is not expected to replace photogrammetry due to its limitations with high-quality 3D models and textures.

Norlandulo 2.0 is a stronger contender to replace photogrammetry as it addresses the shortcomings of both NeRF and photogrammetry.

Kiri Engine offers more than just featureless mode, including a web app, access library, in-app editing, and more.