A GPU cluster has four separate networks. Name them and say what each one carries.

Separate compute, storage and management responsibilities, then decide which need independent physical paths and count their endpoints correctly.

Updated Sep 2026 · Learn how AI infrastructure works through explanations, worked examples and diagrams, then practise applying it to interview questions.

Separate compute, storage and management responsibilities, then decide which need independent physical paths and count their endpoints correctly.

This answer is included with a free account. Sign in to read it and save your progress.

free account · no card needed

The concepts behind this question

Use these concept explanations to review the ideas behind this question.

Foundational

🖧 Hardware & Cluster Build-Out

The Bill of Materials for a Training ClusterA cluster bill of materials includes networking, storage, management, power, cooling and spares as well as GPUs. Size each from the workload and topology.

Advanced

🚀 Inference & Serving🔒 Premium

Inside a Transformer BlockTrace one token through attention, a residual connection, normalization and a feed-forward network. See which operations mix token positions, which transform features, and why model layers and GPU execution units are different things.

Foundational

📐 AI Systems Design

Inference Platform ArchitectureAn inference platform connects API requests to model replicas. Learn how routing, batching, memory limits and scaling work together to meet a latency target.

Foundational

📐 AI Systems Design

Multi-Region Serving and FailoverMulti-region serving can improve geographic reach and survive a regional outage. It requires enough remaining capacity and a clear plan for state, routing and degraded service.

Explore the full curriculum →

UP NEXT ON YOUR JOURNEY

Next in this trackDesign the fabric for 10,000 GPUs. Two tiers or three, and what does the choice cost?Next in this trackFor 64 to 72 GPUs, is one GB300 NVL72 rack better than eight HGX B300 nodes?Next in this trackBuy hardware, colocate, or rent from a GPU cloud? Work the decision for a 512-GPU need.

FEDITOR'S NOTE

Explain traffic and failure domains before choosing physical separation. Distinguish host-facing ports, inter-switch links and both link endpoints.

DISCUSSION · 0

No comments yet — be the first to share your approach.