Sharding trades persistent memory for a materialization schedule

Continue the four-rank reduction through a sharded optimizer update and identify what the next all-gather actually contains. Derive recipe-specific memory, gather schedules and a transient peak before choosing retention or prefetch.

22 MIN · PREMIUM