34Your next hardware generation doubles power per rack. Plan the hall's upgrade.▼hardNewMicrosoftCrusoeCoreWeave4 replies◆ premiumDoubling per-rack density is four separate upgrades with different lead times, and the electrical one usually cannot be done while the hall runs. The phasing that keeps capacity available through it, the constraint that decides whether it is possible at all, and the number that says whether to upgrade or move.Open full answer →
26You upgraded the serving engine and throughput fell 15 percent. Find the cause.▼hardNewFireworks AITogether AIBaseten4 replies◆ premiumEngine upgrades change defaults, kernel selection and scheduling at once, so attribution is the whole problem. The bisection that works on a version rather than a commit, the four categories of cause, and the pre-upgrade baseline without which none of this is possible.Open full answer →