04Explain shared memory bank conflicts with the bank arithmetic, show a kernel that has them, and fix it with padding.▼mediumNewNVIDIATogether AI4 repliesunlockedShared memory has 32 banks, each 4 bytes wide, and a warp's access is as slow as the most-loaded bank. The bank of an address, why a column walk down a 32-wide tile puts all 32 lanes in one bank, the padding by one column that spreads them across all 32, and the profiler counter that confirms the fix.Open full answer →
13You have one GPU and a synchronous API that receives 100 documents at once. Design the batching, and show the latency math.▼medium★ EssentialNewAnthropic4 replies○ sign inSequential is fifty seconds; one batch is four. In between are the questions the interviewer is holding: how you pack ragged inputs, what a batch window costs, and where the memory stops you.Open full answer →
