Reuse is the only thing that moves a kernel up the roofline

A kernel's work is fixed by the algorithm and its minimum traffic by the data, so intensity rises only when each fetched byte is used more times. Reuse is layered in registers, shared memory and the last-level cache, and the ridge point says how much is needed. Reuse-of-one kernels can only be fused.

16 MIN · PREMIUM