Coalescing is the whole of memory performance, stated once

The memory system serves a warp's request in fixed-size sectors, so a kernel's traffic is the sum over its loads and stores of useful bytes over sector efficiency. Predict that sum from the index expression before running anything, and fix it by changing which index varies across lanes, not by adding a cache.

15 MIN · PLUS