The facility asks you to cap GPU power by 30 percent for the summer. What does that cost a training run, and how would you do it?

Measure throughput at several power limits, translate the facility target into a GPU budget, and account for slower ranks before changing the fleet.

Updated Oct 2026 · Learn how AI infrastructure works through explanations, worked examples and diagrams, then practise applying it to interview questions.

Measure throughput at several power limits, translate the facility target into a GPU budget, and account for slower ranks before changing the fleet.

The full answer is part of Premium. A free account includes more answers in each topic, but does not unlock this one.

20 answers per topic instead of 10, plus saved progress and bookmarks · no cardor unlock all 316 remaining answers · ₹2,000 / $25

The concepts behind this question

Use these concept explanations to review the ideas behind this question.

Advanced

🩺 Fleet Reliability & Observability🔒 Premium

Stragglers and HangsTrace how a late worker reaches the critical path, distinguish longer steps from lower throughput, and separate ordinary jitter from a stalled job. Worked examples show when delay is hidden, how shared jitter changes the math, and what evidence supports a repair.

Advanced

🧮 Napkin Math & Capacity🔒 Premium

Power and Datacenter ConstraintsGPU capacity also needs electrical and cooling capacity. Build the facility estimate from complete system loads, rack density and the site’s operating limits.

Advanced

🚀 Inference & Serving🔒 Premium

Reasoning Budgets and Answer LatencyReasoning tokens consume generation time and retained state before an answer becomes usable. Separate the first generated token from the first answer token, reserve output capacity, and evaluate reasoning limits against task success.

Advanced

🚀 Inference & Serving🔒 Premium

Reranking and Retrieval BudgetsA reranker spends extra computation on retrieved candidates. Count query-document pairs, protect permission boundaries and measure whether better evidence justifies its added queueing and latency.

Explore the full curriculum →

UP NEXT ON YOUR JOURNEY

Next in this trackA GPU computes the wrong answer and reports no error. How would you detect that, and what does it look like in a training run?Next in this trackDesign the alerting rules for a GPU platform so that a page is always worth waking for. What are the mechanics?Next in this trackCoolant flow to a rack stops. What happens in the next sixty seconds, and what has to be automatic because a human cannot act in time?

FEDITOR'S NOTE

Look for measured power-performance curves, facility overhead, synchronized-job effects, and verification of the applied policy.

DISCUSSION · 0

No comments yet — be the first to share your approach.