Advanced

AMD Instinct and ROCm

AMD Instinct GPUs offer substantial memory capacity and bandwidth. Workload performance also depends on ROCm, the model implementation and the kernels available for the chosen device.

This concept is part of Premium, which includes all concepts, course lessons and answers.

Get Premium · ₹2,000 / $256 months of access · one payment · no auto-renew

RELATED CONCEPTS

GPU Generations: A100 to Blackwell GPU Execution Model Numerics: FP32, BF16, FP8 and FP4 Serving Engines: vLLM, SGLang and TensorRT-LLM Tensor Cores and Matrix Units TCO: Buy vs Rent

PRACTICE THIS IN REAL QUESTIONS

GPU & Accelerator ArchitectureThe MI300X has 192 GB per card. When does AMD actually win against an H100 for LLM serving, and what would you check before betting on it?→CUDA, Triton & Kernel EngineeringPort a hand-written CUDA kernel to MI300X. What translates mechanically, and what silently computes the wrong answer?→Napkin Math, Cost & CapacityRank the H100, MI300X and Trainium2 by cost per token for decode→Open-Weights Models & Serving EnginesYou must serve a frontier open-weights model on non-NVIDIA accelerators. Plan it.→Hardware, Cabling & Cluster Build-OutA vendor claims their accelerator beats an H100 at half the price. How do you evaluate that?→GPU & Accelerator ArchitectureWalk me through the CUDA execution model: what are grids, blocks and warps, and what does the hardware actually schedule?→