On a compiled accelerator, the program is the unit, not the kernel

On a GPU you reason about one kernel launch at a time. On a compiler-scheduled accelerator such as a TPU, the compiler sees the whole step, so input shapes become separate programs and array layouts become communication. Measured demos show 193 programs collapsing to 5, and a sharding change inserting an all-reduce.

22 MIN · PLUS