IO-aware attention is a memory-traffic algorithm, not a faster matmul

Count attention work and traffic separately. A dense worked example compares materialized intermediates, tiled rereads and ideal cache reuse; a numerical online-softmax trace explains how to combine tiles correctly before diagnosing the next bottleneck.

29 MIN · PREMIUM