Advanced

GPU Generations: A100 to Blackwell

GPU generations change memory, arithmetic support and interconnect capacity at different rates. Compare the specification that limits your workload rather than the generation name.

This concept is part of Premium, which includes all concepts, course lessons and answers.

Get Premium · ₹2,000 / $256 months of access · one payment · no auto-renew

RELATED CONCEPTS

GPU Memory Hierarchy Tensor Cores and Matrix Units Numerics: FP32, BF16, FP8 and FP4 NVLink, NVSwitch and PCIe Roofline Model TCO: Buy vs Rent

PRACTICE THIS IN REAL QUESTIONS

GPU & Accelerator ArchitectureCompare A100, H100 and B200 for a 70B serving fleet. Which gives the most tokens per dollar, and where do fp8 and fp4 change the ranking?→Hardware, Cabling & Cluster Build-OutYour fleet is decode-heavy. Is a B300 worth 1.4 times a B200's power for 1.6 times the memory?→GPU & Accelerator ArchitectureHow much faster is an H200 than an H100, really? Which workloads see the gain and which do not?→GPU & Accelerator ArchitectureWhat actually changes with Blackwell and the NVL72 rack, and what does it do to how you would serve a large MoE model?→Napkin Math, Cost & CapacityHow many tokens per second can one B200 decode for a 70B model?→Open-Weights Models & Serving EnginesWhich GPUs can run an FP8 or AWQ checkpoint, and what do you actually get on an older card?→