A loss curve that goes wrong is a systems bug until proven otherwise

When a run stops improving, the instinct is to question the recipe, and the prior should sit on the infrastructure instead: it changed more recently, it has more moving parts, and its hypotheses are falsifiable in minutes rather than in days. The shape of the curve and whether the failure reproduces narrow it fast.

16 MIN · PREMIUM