Accidentally Built a Nuclear Supercomputer.

Summary

In this video, the creator embarks on an ambitious journey to build an extreme gaming PC, overcoming hardware challenges, GPU shortages, and BIOS limitations. With creativity and persistence, they design a custom open-air case, optimize GPU placement, and achieve full TP8 tensor parallelism with eight GPUs. Along the way, they share humor, technical insights, and sponsor promotions for G-Fuel 2.0 and SY eSIM. The build, named 'Computer Odysius,' symbolizes perseverance and problem-solving, combining DIY ingenuity with high-performance computing, ultimately demonstrating the satisfaction of tackling seemingly impossible technical challenges without overspending.

Takeaways

• 💻 Felix built his first high-end gaming PC, starting a journey into Linux, coding, and self-hosting.
• ⚡ He aimed for massive computing power, ultimately using two AMD Threadripper 7975 CPUs and multiple GPUs.
• 🖥️ GPU sourcing was extremely challenging due to high prices and market complexity, leading him to use a bot and manual search.
• 🔧 He custom-built an open-air aluminum PC case to accommodate airflow, GPU layout, and personal design preferences.
• 🛠️ The build process involved repeated trial-and-error with mounting, drilling, tapping, and adjusting components for optimal performance.
• 🔥 Heat, noise, and power consumption were carefully managed, including plans for solar energy to offset high power draw.
• 🖱️ Felix faced software challenges like driver issues and configuring tensor parallelism, ultimately running eight GPUs efficiently.
• 🎯 Persistence and problem-solving were key, including flashing a BIOS from a random forum user to enable 8x8 GPU bifurcation.
• 🎮 Felix compared the technical challenge to a 'Dark Souls' experience, emphasizing personal goals and overcoming difficulty.
• 💰 Sponsorships from G-Fuel and SY eSIM were integrated into the video, highlighting product promotion alongside the build narrative.
• 🏆 The final result, named Odysius, is a fully functioning, high-performance system capable of massive parallel computations.

Q & A

What was the main reason the speaker decided to build a new computer?

The speaker needed more computing power to run advanced workloads, including self-hosting and parallel GPU computations, which their first PC could not handle.

What were some of the key specifications of the new computer?

The new computer included an AMD Threadripper 7975 CPU (x2), 96 GB of RAM, and seven RTX 4000 GPUs with 20 GB of VRAM each. The build also used a Pro VS X90E motherboard, an all-in-one cooler, and a custom open-air case.

Why did the speaker create their own case for the computer?

The speaker wanted full freedom in design and compatibility, as previous experiences with standard cases caused fit and airflow problems. The custom case allowed optimal GPU placement and proper airflow.

What challenges did the speaker encounter when installing the GPUs?

Challenges included sourcing GPUs at reasonable prices, fitting multiple GPUs into the motherboard, and configuring tensor parallelism. Ultimately, they had to flash a BIOS from a stranger online to enable 8x8 bifurcation to fit all GPUs.

How did the speaker solve the issue of running eight GPUs with tensor parallelism?

The motherboard initially could not run eight GPUs in TP mode because tensor parallelism works in powers of two. The speaker used a BIOS from another user to enable 8x8 bifurcation, allowing all eight GPUs to work together.

Why did the speaker compare building the computer to Dark Souls?

They compared it to Dark Souls because both involve self-imposed difficulty and the satisfaction comes from overcoming complex challenges, which makes the process enjoyable and rewarding.

What does the name 'Odysius' signify for the computer build?

The name 'Odysius' is inspired by *The Iliad* and represents a long, challenging journey. It reflects the build's difficulty, setbacks, and eventual success, much like the epic journey of Odysseus.

What were the speaker's concerns about power, noise, and temperature?

Initially, the speaker worried about high power consumption, excessive noise, and overheating. After the build, they found the open-air design and staggered GPU placement kept temperatures manageable, and the system idled at only 150 watts per GPU, which was efficient.

What role did sponsorships play in this video?

Sponsorships from G-Fuel and SY eSIM helped fund the project and were promoted within the video. G-Fuel was highlighted for its improved formula, while SY eSIM was recommended for convenient travel internet access.

How did the speaker ensure privacy and cost-effectiveness with the new computer?

By building a powerful in-house system, the speaker avoided paying for cloud computation, retained full control over their hardware, and reduced privacy risks, such as being throttled or restricted by cloud providers.

What lesson does the speaker emphasize about tackling complex technical challenges?

The speaker emphasizes perseverance, problem-solving, and learning through trial and error. Even unexpected challenges like BIOS limitations or hardware compatibility can be overcome with creativity and determination.

What travel problem does the SY eSIM solve for the speaker and Marzia?

SY eSIM allows them to have seamless internet access abroad without renting Wi-Fi, buying local SIM cards, or dealing with multiple SIMs. It automatically connects to the chosen country and supports privacy through the Nord umbrella.