AI Infra Interviews logo
← Napkin Math, Cost & Capacity / 15
mediumMetaMicrosoft

Estimate how long it takes to write a checkpoint for a 405B training run

Inventory a resumable checkpoint instead of rounding its bytes per parameter. Trace snapshot stall, durable drain and publication, then calculate the storage floor.

Updated Oct 2026 · Learn how AI infrastructure works through explanations, worked examples and diagrams, then practise applying it to interview questions.

Inventory a resumable checkpoint instead of rounding its bytes per parameter. Trace snapshot stall, durable drain and publication, then calculate the storage floor.

This answer is included with a free account. Sign in to read it and save your progress.

free account · no card needed

Work through the numbers

Change the assumptions in a free calculator, then explain what the result establishes and what still needs measurement.

The concepts behind this question

Use these concept explanations to review the ideas behind this question.

Advanced
🔌 Networking & Storage🔒 Premium
Checkpoint I/OTrace checkpoint bytes through staging and storage, calculate when background saves fall behind, and distinguish upload completion from recoverable-state age. Includes an executable queue example and restore budget.
Core
🧮 Napkin Math & CapacitySign in
GPU-Hours and Time to TrainConvert a stated work budget into elapsed time and GPU-hours. Vary utilization, invert for a deadline, and separate productive time from calendar delays without counting them twice.
Foundational
🩺 Fleet Reliability & Observability
Alert Design and On-Call LoadUseful alerts identify a condition that needs a timely response. Connect pages to user impact or imminent risk, and reduce duplicate noise without hiding failures.
Foundational
🧭 Ownership & Judgment
The Reliability Pushback StoryA reliability pushback story explains the risk you saw, the evidence available, and the cost of delaying or stopping work. Make your responsibility clear and describe what would have changed your decision.
Explore the full curriculum →
UP NEXT ON YOUR JOURNEY
Next in this trackWhat is the power budget for a cluster of 1,024 H100s?Next in this trackShould we buy or rent 1,000 H100s for the next two years?Next in this trackHow much does moving from bf16 to fp8 save in serving cost?
FEDITOR'S NOTE

Trace the example, state its assumptions, and distinguish the estimate from measured behavior.

DISCUSSION · 0

No comments yet — be the first to share your approach.