8,192 GPUs exceeds what a two-tier Clos of 64-port switches supports. Compare adding a tier against using higher-radix switches.

Derive the two-tier endpoint limit, audit explicit 8,192-endpoint constructions and compare switches, links, optical modules and failure paths.

Updated Oct 2026 · Learn how AI infrastructure works through explanations, worked examples and diagrams, then practise applying it to interview questions.

Derive the two-tier endpoint limit, audit explicit 8,192-endpoint constructions and compare switches, links, optical modules and failure paths.

The full answer is part of Premium. A free account includes more answers in each topic, but does not unlock this one.

20 answers per topic instead of 10, plus saved progress and bookmarks · no cardor unlock all 316 remaining answers · ₹2,000 / $25

The concepts behind this question

Use these concept explanations to review the ideas behind this question.

Advanced

🔌 Networking & Storage🔒 Premium

Rail-Optimized and Fat-Tree FabricsRail-optimized and Clos fabrics organize traffic between GPU nodes. Port counts, placement and oversubscription determine which paths are available to collectives.

Foundational

🖧 Hardware & Cluster Build-Out

Cables, Transceivers and the Optics Power BudgetCable selection depends on distance, port compatibility and power. Count both ends of optical links and check the exact part numbers before ordering.

Advanced

🚀 Inference & Serving🔒 Premium

Reasoning Budgets and Answer LatencyReasoning tokens consume generation time and retained state before an answer becomes usable. Separate the first generated token from the first answer token, reserve output capacity, and evaluate reasoning limits against task success.

Advanced

🚀 Inference & Serving🔒 Premium

Reranking and Retrieval BudgetsA reranker spends extra computation on retrieved candidates. Count query-document pairs, protect permission boundaries and measure whether better evidence justifies its added queueing and latency.

Explore the full curriculum →

UP NEXT ON YOUR JOURNEY

Next in this trackHow would you know GPUDirect RDMA is not being used, given that nothing reports an error when it is disabled?Next in this trackDesign storage for a multi-tenant GPU cloud. How do you keep one customer's checkpoint burst from slowing another's training run?Next in this trackAfter a switch firmware update, all-reduce bandwidth across the cluster fell 20 percent. Every link is up and no errors are logged. Find it.

FEDITOR'S NOTE

Show both ends of every upper-stage link. Keep the radix limit, transceiver count and hypothetical latency or power assumptions internally consistent.

DISCUSSION · 0

No comments yet — be the first to share your approach.