Advanced

CUDA Compilation: PTX, Cubins and SASS

CUDA source, PTX and native GPU instructions describe different stages of execution. Inspect the selected binary and its resource use before explaining a performance change.

This concept is part of Premium, which includes all concepts, course lessons and answers.

Get Premium · ₹2,000 / $256 months of access · one payment · no auto-renew

RELATED CONCEPTS

CUDA Programming Model Occupancy and Register Pressure Profiling with Nsight Containers, Images and GPU Cold Starts Tiled Matrix Multiplication

LESSONS THAT TEACH THIS

Kernels and the MachineTrace the kernel that actually runs18 min→

PRACTICE THIS IN REAL QUESTIONS

CUDA, Triton & Kernel EngineeringA CUDA upgrade improves warm runs but slows the first request. Would you ship it?→Open-Weights Models & Serving EnginesExplain what ONNX Runtime and TensorRT optimize, then diagnose a slower compiled model→CUDA, Triton & Kernel EngineeringA GEMM launches 96 tiles into 80 execution slots. Should you split K?→CUDA, Triton & Kernel EngineeringAn AI-generated kernel passes random tests and claims a 3x speedup. What would you verify?→Napkin Math, Cost & CapacityA kernel does 4 TFLOP and moves 40 GB in one call. On an H100, is it memory-bound or compute-bound?→Open-Weights Models & Serving EnginesYou serve a model with vLLM on GPUs. What changes when you move the same model to TPUs?→