AI Infra Interviews logo

Size the fleet from active work and failure requirements

Fleet size must satisfy both measured serving capacity and active-sequence memory. In the worked example, 30 requests/s needs eight working replicas at 4 requests/s each, plus one spare to survive a replica failure.

15 MIN · PLUS

This lesson is included with a free account. Sign in to continue reading.

free account · no card needed