Nvidia's Breakthrough AI Chip Defies Physics (GTC Supercut)

Summary

The transcript discusses the rapid advancements in computing, highlighting the increase in computation by 1,000 times in 8 years and the introduction of the Hopper chip and Blackwell GPU. It emphasizes the transformative impact of these technologies on AI and robotics, showcasing the development of the Jetson autonomous processor, the Omniverse simulation engine, and the potential for humanoid robotics. The speaker predicts a future where everything that moves will be robotic, requiring a digital platform like Omniverse for coordination and development.

Takeaways

• 🚀 Computing power has increased by 1,000 times in the last 8 years, far surpassing Moore's Law's prediction of 10x every 5 years.
• 🌟 NVIDIA has introduced Hopper, a new advanced GPU with 28 billion transistors, marking a significant leap in computing capabilities.
• 🔗 The Blackwell chip features a unique design where two dies are abutted, allowing for 10 terabytes per second of data transfer without memory locality or cache issues.
• 💡 Blackwell is part of a new platform that redefines what GPUs look like, offering unprecedented computation and networking capabilities.
• 🔧 The new Transformer engine in Blackwell is 2.5 times more powerful than Hopper for training per chip and introduces a new format called FP6 for improved inference capability.
• 📈 Blackwell's energy efficiency and networking bandwidth optimizations are set to save significant amounts of time and resources in computation.
• 🤖 NVIDIA envisions a future where everything that moves will be robotic, with a focus on AI robotics and the development of transformative technologies.
• 🏭 The company is building end-to-end systems for robotics, including the Jetson autonomous processor, Omniverse for simulation, and the DGX AI system for training.
• 🚗 NVIDIA's technology is being adopted by major automotive companies like Mercedes and BYD, with the Thor platform designed for the next generation of robotics.
• 🌐 The Omniverse platform is presented as the digital twin platform and operating system for the robotics world, essential for the next Industrial Revolution.

Q & A

How has the rate of computing advancement changed over the last 8 years compared to the past?

Over the last 8 years, computing has increased by 1,000 times, which is a significant acceleration compared to the historical rate of 10 times every 5 years as per Moore's law during the PC revolution.

What is the significance of the Hopper chip in the context of GPU advancement?

The Hopper chip represents a significant leap in GPU technology, being the most advanced GPU in the world at the time of the transcript. It features 28 billion transistors and enables two dies to work together as one chip, with 10 terabytes of data transfer per second.

What is the Blackwell chip and how does it differ from traditional GPUs?

The Blackwell chip is a revolutionary GPU platform that has redefined what a GPU looks like. It is not just a single chip but a system that includes advanced features like two abutting dies that function as one, with no memory locality or cache issues, essentially forming one giant chip.

How does the new Transformer engine in the Blackwell chip enhance performance?

The new Transformer engine in the Blackwell chip features a fifth-generation MV link that is twice as fast as Hopper. It introduces computation in the network, allowing for faster information sharing and synchronization among multiple GPUs, which amplifies overall performance.

What is the fp6 format and how does it benefit the chip's performance?

The fp6 format is a new computational format that allows the chip to store more parameters in memory without changing the computation speed. This effectively doubles the throughput, which is crucial for inference tasks and significantly improves the chip's performance.

What is the significance of the mvlink switch chip with 50 billion transistors?

The mvlink switch chip is significant because it enables every single GPU to communicate with every other GPU at full speed simultaneously. With four MV links each capable of 1.8 terabytes per second, this chip is essential for building a system where GPUs can interact at maximum efficiency.

How does the DGX system exemplify the power of the Blackwell chip and MV link technology?

The DGX system, with its MV link spine capable of 130 terabytes per second, showcases the power of the Blackwell chip and MV link technology by providing a system that can handle immense computational tasks. It represents a leap from 170 teraflops to 720 petaflops, almost reaching an exaflop for training, all in a single rack.

What are the key components of the end-to-end system for AI robotics?

The key components of the end-to-end system for AI robotics include the DGX system for training the AI, the AGX system as the autonomous processor, and the Omniverse as the digital representation of the world for the robot to learn and interact with.

How does the Jetson AGX system support autonomous systems?

The Jetson AGX system is designed to be a low-power, high-speed processor for sensor processing and AI, making it ideal for autonomous systems that require real-time decision-making and action, such as self-driving cars or robots.

What is the potential impact of the Thor platform on the future of robotics?

The Thor platform is designed for Transformer engines and is expected to be used in the next generation of robotics, including humanoid robots. It signifies a shift towards more generalized and adaptable robotic systems, capable of learning and functioning in a variety of environments with human-like adaptability.

How does the Isaac simulation engine contribute to the development of robotics?

The Isaac simulation engine provides a virtual environment where humanoid robots can learn and adapt to the physical world. It serves as a 'gym' for robots, allowing them to develop and refine their capabilities in a controlled and safe digital setting before real-world application.