28Port a hand-written CUDA kernel to MI300X. What translates mechanically, and what silently computes the wrong answer?▼hardNewAMD4 replies◆ premiumThe source translation is a script and takes an afternoon. The assumptions underneath it are the problem: a wavefront is 64 lanes rather than 32, so a warp-level reduction written for 32 ports cleanly and reduces half the data. What breaks silently, what breaks loudly, and the numbers that change every tuning decision.Open full answer →
40You must serve a frontier open-weights model on non-NVIDIA accelerators. Plan it.▼expert★ EssentialNewAMDGoogleAmazon Web Services4 replies◆ premiumThe weights are portable and almost nothing else is. Four layers have to exist before the model runs at all, the quantization format is the one most likely to be missing, and the honest plan states what will not work in the first quarter rather than promising parity.Open full answer →