Systems Engineering at Automattic

Summary

Rudy, a systems Wrangler at Automattic, discusses the intricacies of the company’s globally distributed network supporting services like WordPress.com and Tumblr. David Newman explains how the Global Anycast Network works, emphasizing its power and complexity. The network utilizes hop-length routing to deliver content from nearby data centers, ensuring fast and efficient service. They also showcase a live map tracking internet queries, helping diagnose issues visually. The video highlights the technical details of internet routing and how real-time data helps maintain network performance.

Takeaways

• 😀 Rudy works as a Systems Wrangler at Automattic, the company behind major platforms like WordPress.com, WooCommerce, and Tumblr.
• 🌍 Automattic operates a global network with infrastructure across 28 data centers on six continents.
• 🖥️ The global network uses anycast technology, allowing users to connect to the nearest data center for faster service.
• 🌐 The network operates on hop lengths, where requests are routed to the nearest point of presence (POP) in the network.
• 📍 When a user requests data, the internet routing table directs them to the closest available POP based on the hop distance.
• 🗺️ The company's network uses a live map to visualize traffic, showing the location of each request in real-time.
• 🔴 The map highlights which POP serves each request, helping to quickly identify any issues with the global anycast network.
• 📊 Automattic uses detailed stats, triggers, and graphs to monitor the network, though these are more technical and less visually appealing than the map.
• 💻 Looking Glass servers are available globally, allowing anyone to stream the full internet routing table and examine IP addresses and AS numbers.
• 🌐 These Looking Glass servers help to identify routing issues and are useful tools for those interested in the technical aspects of internet routing.
• 🔧 The network infrastructure is powerful but requires precise setup and management to ensure global service consistency and performance.

Q & A

What is the role of Rudy in the company?

Rudy is a Systems Wrangler at Automattic, the company behind WordPress.com, WooCommerce, Tumblr, and other products.

What is the global infrastructure that powers Automattic’s products?

Automattic’s products are powered by a global network of infrastructure spanning 28 data centers across six continents.

How does the Global Anycast Network work for serving customers?

The Global Anycast Network operates on a hop length system. Each Point of Presence (POP) around the world broadcasts a certain subnet, and when a request is made, the system chooses the closest POP based on the routing table, ensuring that the request is served from the nearest available location.

What is the role of hops in the network?

Hops refer to the number of steps it takes for data to travel through the network from one point to another. The system selects the POP with the least hops for faster delivery of the request.

How can users see the routing of network traffic in real-time?

Automattic has a live map that samples every 100,000th query. The map colors each query based on which POP it is served from, helping visualize the global distribution and any potential routing issues.

What does the Looking Glass server allow users to do?

The Looking Glass server allows users to view the internet’s routing table and see where specific subnets are located, giving them access to global routing data.

What is the advantage of the 'hop length' approach in the Anycast Network?

The 'hop length' approach helps direct traffic to the nearest POP, reducing latency and improving the speed and efficiency of delivering content to users.

What type of data is shown in the Looking Glass server?

The Looking Glass server streams the internet routing table, displaying subnets of IP addresses and their associated Autonomous System (AS) numbers, showing where they are linked.

How does Automattic monitor its global network?

Automattic uses a combination of live maps, triggers, stats, and graphs to monitor the global network and detect any issues, particularly with BGP (Border Gateway Protocol).

What is BGP and why is it important in the Anycast Network?

BGP (Border Gateway Protocol) is a protocol that manages the routing of data across the internet. It's important for ensuring that traffic is directed efficiently across different POPs and that issues can be quickly identified and addressed.