Advanced

Inside a Transformer Block

Trace one token through attention, a residual connection, normalization and a feed-forward network. See which operations mix token positions, which transform features, and why model layers and GPU execution units are different things.

Unlock the full curriculum — ₹2,000 / $25every concept + every answer · 6 months · no auto-renew

RELATED CONCEPTS

Tokens, Embeddings and Logits Tensors, Shapes and Dtypes Attention Variants: MHA, GQA, MQA and MLA The KV Cache Tensor Cores and Matrix Units Expert Parallelism for MoE

LESSONS THAT TEACH THIS

Foundations of AI InfrastructureA request becomes tokens, and tokens become two different workloads12 min→

PRACTICE THIS IN REAL QUESTIONS

LLM Inference & ServingWhat is the KV cache, and why does it keep growing while a request is being served?→Hardware, Cabling & Cluster Build-OutA GPU cluster has four separate networks. Name them and say what each one carries.→LLM Inference & ServingYou need to serve 128k-token contexts. What breaks first, and what do you change?→LLM Inference & ServingCompare the KV cache footprint of multi-head, grouped-query and multi-head latent attention with numbers.→Open-Weights Models & Serving EnginesThe model advertises a million tokens of context. What actually breaks when you serve it?→Open-Weights Models & Serving EnginesYour deployment is limited by KV cache rather than by compute. What are the options?→