This is Changing 3D Scanning!!
TLDRThe video discusses the advancements in 3D scanning technology, highlighting the Kiri Engine as a notable tool for both AR technology and 3D scanning. It introduces a new feature called virtual scanning using NeRF technology, specifically the norlandulo technique, which aims to overcome the limitations of photogrammetry, such as difficulties in scanning reflective surfaces or objects with a single color. The Kiri Engine is now available on both iPhone and Android and offers a way to create 3D models from videos, a process that involves recording a steady video of the object from different angles and submitting it for cloud processing. While NeRF is not expected to replace photogrammetry due to its current limitations, the norlandulo technique, which the Kiri Engine's featureless object mode is based on, shows promise in addressing these shortcomings and could be a strong contender in the future. The video also mentions other features of the Kiri Engine, such as a web app, access library, and in-app editing tools.
Takeaways
- ๐ 3D scanning and photogrammetry are gaining attention as the market shifts towards AI and AR technologies.
- ๐ฑ Kiri Engine is a versatile tool for 3D scanning and AR, available on both iPhone and Android, offering alternatives to apps like Polycam.
- ๐ The new feature in Kiri Engine, virtual scanning using NeRF (Neural Radiance Fields) technology, aims to overcome some limitations of traditional photogrammetry.
- ๐ NeRF technology is impressive as it can reconstruct 3D scenes from a set of images or video, even when there aren't enough feature points for photogrammetry.
- ๐ Norlandulo is an advancement over NeRF, generating not just rendered scenes but also usable 3D objects for software like Blender.
- ๐ซ A limitation of photogrammetry is its reliance on distinct features like color or shape changes, which can hinder scanning of objects with few features.
- ๐ NeRF and Norlandulo technologies do not rely on such distinct features, using AI to generate coherent point clouds and 3D models.
- ๐น Using Kiri Engine's featureless object mode involves recording a video of the object from different angles for scanning.
- โฐ Kiri Engine limits the video length for scanning to 2 minutes due to server limitations, but this duration is typically sufficient for scanning an object.
- ๐ Norlandulo 2.0 is expected to be a stronger contender for replacing photogrammetry as it addresses the shortcomings of both NeRF and photogrammetry.
- ๐ Kiri Engine offers additional features beyond the featureless mode, including a web app, access library, in-app editing, and more.
- ๐ข The video encourages viewers to subscribe for more content and provides a link to try Kiri Engine for free.
Q & A
What is the current state of 3D scanning in the industry?
-3D scanning is one of the most challenging subjects in 3D and is gaining more attention daily, especially with the market moving towards artificial intelligence and augmented reality. Tools, hardware, and apps are making these technologies more accessible.
What is Kiri Engine and how does it relate to 3D scanning?
-Kiri Engine is a tool for 3D scanning and AR technology that was reviewed as a great alternative to iPhone 3D scanning apps like Polycam. It is also available for Android and supports QR, offering a solution for those without the hardware necessary for Real Time 3D scanning.
What is the new feature in Kiri Engine that the speaker is particularly interested in?
-The speaker is particularly interested in the new feature of virtual scanning using NeRF technology, specifically a technique called Norlandulo, which aims to mitigate some of the shortcomings of photogrammetry.
What are some limitations of photogrammetry?
-Photogrammetry requires distinct features in an image of an object, such as changes in color or shape, to create a complete shape. It struggles with objects that don't have many feature points, like objects with one color, transparent, or extremely reflective surfaces.
How does NeRF technology differ from photogrammetry?
-NeRF, which stands for Neural Radiance Field, is a machine learning technology that uses AI to reconstruct an entire 3D scene from a set of images or a video. It can reconstruct scenes and objects that don't have enough feature points for photogrammetry.
What is Norlandulo and how does it improve upon NeRF?
-Norlandulo is a technique that not only generates neural rendered scenes like NeRF but also produces a high-quality mesh of the object that is usable in 3D software like Blender. It addresses most of the shortcomings of both NeRF and photogrammetry.
How does one use the featureless object mode in Kiri Engine?
-To use the featureless object mode, you click the big plus button, select the featureless option, and start recording a video of the object. You should circle around the object, trying to be steady and consistent, and perform the scan in different layers (top, middle, bottom). Then, submit the video to the cloud for processing.
What is the current limitation of the video length for scanning in Kiri Engine?
-Kiri Engine limits the video length for scanning to 2 minutes due to server limitation purposes.
Will NeRF technology replace photogrammetry?
-NeRF technology will not replace photogrammetry. While NeRF can handle scenes and objects that photogrammetry cannot due to lack of feature points, it currently can't produce high-quality 3D models and textures suitable for a typical 3D pipeline.
What are some potential use cases for 3D scanning or photogrammetry?
-Use cases for 3D scanning or photogrammetry include entertainment projects like game development and VFX for movies, as well as applications in the medical field, engineering, and more.
How can I try Kiri Engine for free?
-You can try Kiri Engine for free by downloading it from the provided link in the video description. It is compatible with both Android and iPhone devices.
What additional features does Kiri Engine offer besides the featureless mode?
-Besides the featureless mode, Kiri Engine offers a web app, access to a library, the ability to create a floor plane, in-app editing, texture toning, and more.
Outlines
๐ Introduction to 3D Scanning and Kiri Engine's Advancements
The first paragraph introduces 3D scanning as a complex and increasingly popular subject within the 3D industry, gaining attention due to the growing focus on artificial intelligence (AI) and augmented reality (AR). It highlights the Kiri engine as a notable tool for 3D scanning and AR, which has been reviewed as an alternative to iPhone 3D scanning apps like Polycam. The Kiri engine now supports Android and offers a new feature called virtual scanning using NeRF (Neural Radiance Fields) technology, which is a significant advancement in the field. The speaker expresses excitement about this feature, especially for scanning challenging surfaces like reflective or black objects. The paragraph also touches on the use of 3D scanning in various industries, such as entertainment, medical, and engineering, and how it is commonly used in creating characters for video games and movies.
๐ NeRF Technology and Kiri Engine's Featureless Mode
The second paragraph delves into the pros and cons of photogrammetry, a technique used to create 3D models from photographs. It contrasts this with NeRF, a machine learning technology that reconstructs 3D scenes from a series of images or video, even when the subjects lack distinct features. The paragraph introduces Norlandulo, a technique that builds upon NeRF to produce usable 3D models with better mesh quality. Norlandulo is based on a research paper by Nvidia and is now implemented in the Kiri engine, making it accessible on both iPhone and Android devices. The featureless mode in Kiri engine allows users to scan objects by recording a video, which is then processed in the cloud. The paragraph concludes by addressing the question of whether NeRF will replace photogrammetry, stating that while NeRF is impressive, it is not yet capable of producing high-quality models and textures suitable for a typical 3D pipeline. However, Norlandulo 2.0 is seen as a stronger contender for this role.
Mindmap
Keywords
3D Scanning
Photogrammetry
Kiri Engine
NeRF (Neural Radiance Fields)
Nerf Technology
Norlandulo
Featureless Object Mode
Artificial Intelligence (AI)
Augmented Reality (AR)
Texture Quality
Point Cloud
Highlights
3D scanning is gaining more attention with the market shifting towards AI and AR.
Kiri Engine is a tool for 3D scanning and AR technology, offering an alternative to iPhone 3D scanning apps like Polycam.
Kiri Engine now supports Android and has QR code support for those without the hardware for Real Time 3D scanning.
A new feature in Kiri Engine is virtual scanning using NeRF technology, specifically the norlandulo technique.
NeRF technology aims to mitigate some of the shortcomings of photogrammetry.
Kiri Engine is the only app currently offering NeRF technology on both iPhone and Android phones.
NeRF doesn't require distinct features for 3D model generation, overcoming a limitation of photogrammetry.
Photogrammetry struggles with objects that lack feature points, such as single-color, transparent, or reflective objects.
Kiri Engine is free to download and compatible with both Android and iPhones.
Nerf technology uses AI to reconstruct 3D scenes from a set of images or video.
Norlandulo is a technique that generates neural rendered scenes and produces usable 3D models in software like Blender.
The featureless object mode in Kiri Engine is based on the Orlando algorithm, making it a powerful tool for 3D scanning.
Kiri Engine's featureless scanning requires recording a video of the object from different angles.
The video length for scanning with Kiri Engine is limited to 2 minutes due to server limitations.
Processing time for featureless scanning may be longer than photogrammetry as the feature is new and undergoing optimization.
NeRF is not expected to replace photogrammetry due to its limitations with high-quality 3D models and textures.
Norlandulo 2.0 is a stronger contender to replace photogrammetry as it addresses the shortcomings of both NeRF and photogrammetry.
Kiri Engine offers more than just featureless mode, including a web app, access library, in-app editing, and more.