oversubscription

AI infra interview questions tagged oversubscription, across every topic.

2 questions · 1 unlocked for you

Open full answer →

Open full answer →

Concepts behind "oversubscription"

The curriculum that explains the ideas these questions test.

🔌 Networking & Storage🔒 Premium

Rail-Optimized and Fat-Tree FabricsA GPU cluster's network is built from two ideas: a fat tree (Clos) that gives every node a path to every other node with a chosen amount of oversubscription, and rail optimization, which wires GPU i of every node to the same leaf switch so the collectives that dominate training stay one hop away. Sizing one is arithmetic on port counts, and the interview question is usually that arithmetic: how many switches, what oversubscription, and where the NVLink domain ends and the fabric begins.

Explore the full curriculum →