← Napkin Math & Capacity
Core
GPU-Hours and Time to Train
Convert a stated work budget into elapsed time and GPU-hours. Vary utilization, invert for a deadline, and separate productive time from calendar delays without counting them twice.
This concept is included with a free account. Sign in to continue reading.
free account · no card needed
RELATED CONCEPTS
PRACTICE THIS IN REAL QUESTIONS
Napkin Math, Cost & CapacityHow many H100s do you need to train a 70B model on 15 trillion tokens in 30 days?→Napkin Math, Cost & CapacityHow long does that 70B run take on 16,384 H100s at 40% MFU?→Napkin Math, Cost & CapacityEstimate how many H100-hours it took to train Llama 3.1 405B, then check it against the paper→Napkin Math, Cost & CapacityA startup wants to train a 7B model on 1 trillion tokens in three weeks. What cluster do they rent?→Napkin Math, Cost & CapacityWhat does one training token cost?→Napkin Math, Cost & CapacitySize an inference fleet for a 70B model serving 1,000 concurrent users→