Eviction is not free: recompute is a prefill in disguise

When the cache is full the engine can refuse, evict and recompute later, or move blocks to slower memory. All three cost something, and the one that looks free is the most expensive under sustained pressure because it converts a memory shortage into a compute shortage.

14 MIN · PREMIUM