A tiled matrix multiply connects ownership, reuse and synchronization

A tiled matmul has six parts: an owned output tile, a slice loop, coalesced staging into shared memory, compute into register accumulators, two barriers per slice, and an epilogue. Attention, convolution and grouped expert matmuls are this shape with different answers to what is owned, streamed and finished.

18 MIN · PREMIUM