Concurrency is set by whichever cap binds first

Four limits decide how many requests a replica runs at once: the sequence cap, the per-step token budget, free cache blocks and, with adapters, the number of distinct adapters per step. Measured runs show each one binding, and why raising the wrong one does almost nothing.

22 MIN · PLUS