38A vendor offers 15 percent off if you take their Ethernet fabric instead of InfiniBand. Decide.▼hardNewCrusoeCoreWeaveMeta4 replies◆ premiumBoth run at the same port speed, so the discount is not buying slower hardware. It is buying a different operational model and a different failure mode, and whether that is worth 15 percent depends on what your team already runs and what the fabric has to carry.Open full answer →
03InfiniBand or RoCE version 2 for a new GPU training cluster. Make the call and say what would reverse it.▼medium★ EssentialNewNVIDIACrusoexAI4 repliesunlockedBoth carry RDMA at the same line rate. One arrives lossless because the transport was designed that way, the other becomes lossless only if a set of switch settings is correct on every port. What that difference costs in operations, what it saves in money and hiring, and the fleet size where the answer flips.Open full answer →
08What is incast, why does it break an RDMA fabric, and what do ECN and priority flow control each do about it?▼hardNewxAINVIDIAMeta4 repliesunlockedThirty-two senders aimed at one port fill a switch buffer in microseconds, and what happens next depends on which of two mechanisms fires first. The buffer arithmetic, why the slow mechanism is the safe one and the fast one is the dangerous one, and the counters that tell you which is happening.Open full answer →