sizing
AI infra interview questions tagged sizing, across every topic.
7 questions · 4 unlocked for you
Concepts behind "sizing"
Review the concepts used in these questions.
Foundational
Reading config.json to Size a Model You Have Never RunRead a model configuration as an architecture description, then combine it with tensor metadata and engine allocation rules. Learn which fields determine attention state, why mixed precision needs tensor-level accounting, and how to turn a first estimate into a testable per-GPU capacity plan.🧮 Open Weights & Serving Engines
Foundational
Capacity Planning for Open-Weights FleetsMatch forecast traffic to a measured replica operating envelope, then check failure domains, rollout capacity, readiness time and cost. Output tokens alone omit prompt work and live state; total parameter count alone does not determine a replica's throughput.🧮 Open Weights & Serving Engines
