← CUDA, Triton & Kernel Engineering / 32

hardNew

Can you reuse a GPU buffer after the request is canceled?

A canceled request returns its buffers to a pool while device work is still outstanding. Trace ownership through two streams and design a safe reclamation path.

Updated Oct 2026 · Learn how AI infrastructure works through explanations, worked examples and diagrams, then practise applying it to interview questions.

A canceled request returns its buffers to a pool while device work is still outstanding. Trace ownership through two streams and design a safe reclamation path.

The full answer is part of Premium. A free account includes more answers in each topic, but does not unlock this one.

20 answers per topic instead of 10, plus saved progress and bookmarks · no cardor unlock all 316 remaining answers · ₹2,000 / $25

Work through the numbers

Change the assumptions in a free calculator, then explain what the result establishes and what still needs measurement.

Roofline calculator

The concepts behind this question

Use these concept explanations to review the ideas behind this question.

💻 Coding for Infra🔒 Premium

Asynchronous GPU Buffer OwnershipA host function can return while a GPU still uses its pointers. Tie buffer reuse to device completion, including cancellation, cross-stream consumers and foreign-function boundaries.

⚡ Kernels & Compilers

CUDA Programming ModelCUDA programs launch GPU kernels from host code. Thread indexing, memory access and stream ordering determine whether the result is correct.

💻 Coding for Infra

Cache-Friendly Data StructuresData layout affects cache misses and communication between CPU cores. Pointer chasing and false sharing explain why equivalent operations can have different memory costs.

⚡ Kernels & Compilers🔒 Premium

CUDA Compilation: PTX, Cubins and SASSCUDA source, PTX and native GPU instructions describe different stages of execution. Inspect the selected binary and its resource use before explaining a performance change.

Explore the full curriculum →

UP NEXT ON YOUR JOURNEY

Next in this trackA CUDA upgrade improves warm runs but slows the first request. Would you ship it?Next in this trackA GEMM launches 96 tiles into 80 execution slots. Should you split K?Next in this trackEach GPU block computes correct local offsets, but output ranges overlap. What is missing?

DISCUSSION · 0

No comments yet — be the first to share your approach.