The KV cache is what actually decides how many users fit

The mental model interviewers reward starts one level deeper than the definition: what the concept buys you, what it costs, and the single trade-off that decides when to reach for it.

Work the concrete example end to end, then name the failure mode it hides. That is the signal you have used this in production rather than read about it.