← CUDA, Triton & Kernel Engineering / 31

hard

Map a fused bias-GELU kernel to threads and verify the final partial block

Derive row-major offsets, broadcast the bias correctly, and compare a lane-by-lane CPU reference with a vector expression. Explain when shared memory adds no reuse.

Updated Sep 2026 · Learn how AI infrastructure works through explanations, worked examples and diagrams, then practise applying it to interview questions.

Derive row-major offsets, broadcast the bias correctly, and compare a lane-by-lane CPU reference with a vector expression. Explain when shared memory adds no reuse.

The full answer is part of Premium. A free account includes more answers in each topic, but does not unlock this one.

20 answers per topic instead of 10, plus saved progress and bookmarks · no cardor unlock all 318 remaining answers · ₹2,000 / $25

Work through the numbers

Change the assumptions in a free calculator, then explain what the result establishes and what still needs measurement.

Roofline calculator

The concepts behind this question

Use these concept explanations to review the ideas behind this question.

⚡ Kernels & Compilers

Kernel FusionKernel fusion combines operations so intermediate results can stay on-chip. It can reduce memory traffic and launch overhead, but may increase resource pressure.

⚡ Kernels & Compilers🔒 Premium

Kernel Correctness ContractsA fast GPU kernel is useful only for inputs it handles correctly. Define shapes, strides, dtypes, numerical tolerance, storage ownership and synchronization before timing a replacement.

🧮 Open Weights & Serving Engines

Weight Formats: FP8 Blocks, MXFP4 and AWQDerive the storage cost of low-precision tensors, including scales, zero points and higher-precision exceptions. Distinguish formats from quantization methods, understand fused dequantization, and test whether a smaller checkpoint actually improves serving capacity without unacceptable quality loss.

🧩 GPU & Accelerator ArchitectureSign in

Numerics: FP32, BF16, FP8 and FP4Floating-point formats trade range and precision for storage and compute cost. Understand exponent bits, significand bits, scaling and accumulation before choosing a format.

Explore the full curriculum →

UP NEXT ON YOUR JOURNEY

Next in this trackCan you reuse a GPU buffer after the request is canceled?Next in this trackA CUDA upgrade improves warm runs but slows the first request. Would you ship it?Next in this trackA GEMM launches 96 tiles into 80 execution slots. Should you split K?

DISCUSSION · 0

No comments yet — be the first to share your approach.