hardNVIDIACoreWeaveMicrosoft

What actually changes with Blackwell and the NVL72 rack, and what does it do to how you would serve a large MoE model?

Separate Blackwell chip gains from the 72-GPU domain, follow a token to its expert owners, and test placement instead of dividing model bytes by 72.

Updated Oct 2026 · Learn how AI infrastructure works through explanations, worked examples and diagrams, then practise applying it to interview questions.

Separate Blackwell chip gains from the 72-GPU domain, follow a token to its expert owners, and test placement instead of dividing model bytes by 72.

This answer is included with a free account. Sign in to read it and save your progress.

free account · no card needed

Work through the numbers

Change the assumptions in a free calculator, then explain what the result establishes and what still needs measurement.

The concepts behind this question

Use these concept explanations to review the ideas behind this question.

Advanced

🧩 GPU & Accelerator Architecture🔒 Premium

GPU Generations: A100 to BlackwellGPU generations change memory, arithmetic support and interconnect capacity at different rates. Compare the specification that limits your workload rather than the generation name.

Advanced

🧩 GPU & Accelerator Architecture🔒 Premium

NVLink, NVSwitch and PCIeNVLink, NVSwitch and PCIe provide different GPU communication paths. Learn how their topology and bandwidth affect the placement of parallel work.

Foundational

🧮 Open Weights & Serving Engines

Expert Parallel and All-to-All BackendsCompare tensor and expert placement without confusing either with sparsity. Derive logical dispatch traffic and redundant-expert memory, then choose backends and balancing from per-rank measurements.

Foundational

🖧 Hardware & Cluster Build-Out

NVLink Domains and the NVL72 RackAn NVLink domain connects a group of GPUs through a scale-up fabric. Its boundary helps determine where to place communication-heavy parallel groups.

Explore the full curriculum →

UP NEXT ON YOUR JOURNEY

Next in this trackYou have trained on GPUs. What transfers to training on TPUs, and what do you have to relearn?Next in this trackExplain how a systolic array computes a matrix multiply. Why is it efficient, and why does it want big square tiles?Next in this trackWould you move a cost-sensitive training and serving fleet from H100 to Trainium2? What do you gain, and what do you have to plan for?

FEDITOR'S NOTE

Keep the chip, eight-GPU system and rack specifications separate. Follow one token to its expert owners, and verify the engine supports the proposed rank groups.

DISCUSSION · 0

No comments yet — be the first to share your approach.