Adam Savage Reacts to Apple Vision Pro's New Personas!

Summary

This video delves into the innovative use of immersive technology for live stage events. It highlights the use of dual 6K ZCAM cameras, capturing footage in stereo with spatial audio, delivering a highly immersive front-row experience. The production combines real-time streaming with community-driven elements, making viewers feel present with the live audience. The project also explores future plans to capture and stream various live events in a similar immersive manner, aiming to prove the value of cutting-edge devices like the Vision Pro. As technology matures, these experiences are expected to become more accessible to a wider audience.

Takeaways

• 😀 Two ZCAM bodies with 6K Super 35mm sensors and 20mm prime lenses are used for an immersive front-row experience.
• 😀 Cameras are placed 13-14 feet from the stage, simulating the view from a front-row seat.
• 😀 The content is captured in 3D, enhancing the feeling of presence and immersion during the live show.
• 😀 OBS (Open Broadcaster Software) is used to align and process the stereo feeds, ensuring a smooth immersive experience.
• 😀 Spatial Gen is responsible for encoding the 3D video and distributing it as a live stream to viewers worldwide.
• 😀 A free 2D stream is available, while viewers can opt for a paid 3D version for a more immersive experience.
• 😀 Audio from the live audience is captured and mixed into the stream, enhancing the communal feel of the event.
• 😀 Immersive streaming offers more than just a flat video stream, allowing viewers to feel like they are present in the event.
• 😀 The live, real-time streaming aspect adds to the immersion, making viewers feel like they are part of a global audience.
• 😀 Future plans include capturing and streaming events like Q&As, director commentaries, and live shows to showcase immersive theater experiences.
• 😀 The goal is to prove the value of immersive experiences on high-end devices like the Apple Vision Pro, making it worth the investment for users.

Q & A

What camera system is being used for the immersive theater production?

The production uses two ZCAM E2 S6 bodies, which have a 6K Super 35mm sensor and 20mm prime lenses to capture the performance.

Why was the Super 35mm sensor chosen for this production?

The Super 35mm sensor was selected because it closely approximates human vision, creating a more natural and immersive experience for viewers.

How far are the cameras placed from the stage?

The cameras are positioned around 13-14 feet from the stage, simulating the experience of sitting in the front row of the theater.

How is the 3D streaming experience created for viewers?

The two camera feeds are sent through capture cards, processed in OBS software to create a stereo left-right image, and then streamed in an HEVC format to viewers, offering a 3D immersive experience.

What role does the Spatial Gen company play in the streaming process?

Spatial Gen processes the stereo video feeds, combines them into a streaming MVHEVC format, and delivers the stream to the app for users to access the immersive experience.

How does the production enhance the immersive experience beyond just the visual aspects?

The production adds spatial audio, capturing audience sounds, which helps make the experience feel more communal, as if the viewer is part of the live event.

What is the difference between the 2D and 3D versions of the stream?

The 2D version provides a flat viewing experience, while the 3D version offers a more immersive experience through stereo sound and visuals, making it feel as if you're sitting in the front row of the theater.

What other types of live events are being considered for this immersive technology?

The team plans to capture and stream events such as Q&As with directors and cast members, and performances like Rift Tracks shows, using the immersive technology.

How does live-streaming theater performances enhance the viewer's experience compared to traditional video on demand?

Live-streaming allows viewers to experience the performance in real time, making them feel more connected to the event and its global audience, compared to watching a recorded video later.

What is the long-term goal of the immersive streaming technology?

The goal is to prove the value of immersive streaming and show that it is worth the investment in devices like the Vision Pro, particularly as the technology matures and becomes more accessible to a wider audience.