Meta ORv3N Open Rack v3 Networking Solution

Summary

In this presentation, Sean, Dimitri, and Yan discuss the development of the Open Rack V3 for networking at Meta. They highlight the need for an updated network design to accommodate the rapid advancements in AI technology and facility liquid cooling. The new rack design addresses serviceability, power requirements, and high fiber count connectivity. Key features include a 48-volt DC bus bar, optimized canopy cutouts, and airflow containment panels. The team emphasizes the advantages of integrating networking and compute processes, aiming for a streamlined and efficient data center infrastructure. The presentation concludes with a Q&A session, clarifying the synergy between battery backup and generator systems.

Takeaways

• 😀 Sean and his team presented the Open Rack V3 for networking, emphasizing its evolution due to the rapid advancement in AI technology.
• 😀 The existing DC Type 1 network was designed for separate network rooms, which limited flexibility and scalability.
• 😀 New network designs integrate networking switches directly into data halls, enhancing operational efficiency and adaptability.
• 😀 The OCP (Open Compute Project) community has played a crucial role in shaping the network solutions for Meta, providing valuable support and resources.
• 😀 The OR3 network rack is designed to address serviceability and compatibility issues with existing designs, accommodating up to eight network switches.
• 😀 Enhanced airflow containment and optimized cable management are key features of the OR3, facilitating higher fiber counts and easier maintenance.
• 😀 The rack incorporates a 48-volt DC offset bus bar to improve power management and serviceability compared to previous models.
• 😀 The integration of network and compute racks streamlines installation and ordering processes, reducing operational complexity.
• 😀 Rigorous testing of the OR3 rack included transportation, stability, and electrical tests, confirming its robustness and reliability.
• 😀 The presentation highlighted the importance of collaboration within the OCP community, showcasing innovations that meet the needs of modern data centers.

Q & A

What is the primary purpose of the open rack V3 (ORV3) discussed in the presentation?

The ORV3 is designed to address the changing needs of data center networking, particularly in accommodating high-density networking equipment and facilitating liquid cooling.

What challenges did Sean mention regarding the existing DC Type 1 Network at Meta?

The existing network racks were dedicated and lacked in-rack battery backup, which limited flexibility and scalability as AI technologies rapidly evolved.

How does the ORV3 enhance serviceability compared to previous rack designs?

The ORV3 allows for direct installation of network gears without needing additional trays, optimizing rear access for servicing and improving airflow management.

What significant change in network design was implemented with the new DC network?

The new DC network design involved moving networking switches into the data hall rather than keeping them in separate dedicated rooms, promoting a more integrated approach.

What modifications were made to the bus bar in the ORV3?

The bus bar was shifted to the side of the rack to improve serviceability and allow more space for network gear connections.

What is the importance of the canopy cutouts in the ORV3 design?

The canopy cutouts were optimized to support higher fiber counts, accommodating the significant cabling needs of modern networking equipment.

What are the benefits of using a 48V DC offset bus bar in the ORV3?

The 48V DC offset bus bar enhances serviceability and compatibility with various networking gear, facilitating efficient power distribution.

How does the rack design improve fiber and cable management?

The ORV3 includes 10U pitch cable fingers and vertical cable managers that help maintain organization and manage high fiber counts effectively.

What testing did the ORV3 undergo to ensure its reliability and safety?

The ORV3 underwent various tests including package transportation testing, rack stability testing, and bonding and grounding testing, all of which were passed successfully.

What was the key takeaway from the presentation regarding the deployment of the ORV3?

The ORV3 aims to streamline deployment processes and improve efficiency in data centers, reducing the need for extensive AC cabling and simplifying installation.