Mixed precision is a numerics contract, not a speed setting
Distinguish range, rounding, accumulation and update precision. Run a small rounding experiment, trace loss scaling in the right order, and diagnose numerical problems from gradients and updates instead of the loss curve alone.
14 MIN · PLUS
This lesson is included with a free account. Sign in to continue reading.
free account · no card needed
