tiling
AI infra interview questions tagged tiling, across every topic.
6 questions · 3 unlocked for you
Concepts behind "tiling"
Review the concepts used in these questions.
Advanced
Shared Memory and Bank ConflictsShared memory lets threads in a block exchange and reuse data. Bank conflicts occur when an access needs multiple distinct words from the same bank.⚡ Kernels & Compilers🔒 Premium
Advanced
Tiled Matrix MultiplicationTiled matrix multiplication reuses input values across many output calculations. Shared-memory and register tiles reduce repeated data movement while consuming limited on-chip resources.⚡ Kernels & Compilers🔒 Premium
Advanced
FlashAttention InternalsFlashAttention computes exact attention in tiles without storing the full score or probability matrix in device memory. Follow the running softmax state, understand why inputs can still be reread, and distinguish the mechanisms introduced in the first three papers.⚡ Kernels & Compilers🔒 Premium
