30A new GPU generation is arriving. Plan the migration of a live 2,048-GPU cluster.▼expert★ EssentialMetaMicrosoftCoreWeave4 replies◆ premiumPlan a GPU-generation migration around usable workload capacity, site readiness, compatibility and a tested rollback path.Open full answer →
34A PyTorch team wants to train on TPUs. Do they rewrite in JAX with MaxText, use PyTorch/XLA, or wait for TorchTPU?▼hardNewGoogleGoogle DeepMindAnthropic2 replies◆ premiumThree routes with different costs: keep PyTorch through XLA, bet on the native backend, or adopt the JAX reference trainer. Choose from the model's custom code and the timeline, then prove parity before scaling.Open full answer →
40You must serve a frontier open-weights model on non-NVIDIA accelerators. Plan it.▼expert★ EssentialAMDGoogleAmazon Web Services4 replies◆ premiumValidate the exact model, accelerator generation and serving features. Separate packed storage from kernel execution, derive the real memory fallback, and compare qualified throughput and total migration cost.Open full answer →
48You serve a model with vLLM on GPUs. What changes when you move the same model to TPUs?▼hardNewGoogleGoogle DeepMindAnthropic2 replies◆ premiumSame model, same engine name, different execution model. Trace what moves into compilation, how shape buckets trade compile time for padding, and how per-device memory decides the slice.Open full answer →