AI Infra Interviews logo
← All missions

CHAPTER 05 / Serving engineer

Spend the KV budget

Trade concurrency for longer contexts using explicit arithmetic.

KV cache sizingCapacity tradeoffs

Intermediate · About 20 minutes · Included with active Premium

Your mission environment

Our in-house GPU lab engine connects your terminal to an eight-GPU sandbox: device inventory, process ownership, memory allocation, editable configuration and service state. Each supported command reads or changes the same machine.

Practice NVIDIA command-line workflows entirely in your browser. The command emulator covers the missions in this lab; CUDA kernel execution and performance benchmarking require real hardware. Reset any time for a fresh node.

Completed mission IDs and run summaries are saved on this device. Machine state and terminal history disappear when you leave or reload.

GPU command emulator · no hardware to rent