Price parallelism by message size, frequency and exposed time

Follow four ranks through every reduce-scatter and all-gather round, then derive bytes and startup time from that trace. Use an executable simulator and consistent per-update accounting to compare parallel layouts without confusing volume with exposed time.

26 MIN · PLUS