Chunked prefill controls interference on a shared execution path

Follow an unfinished prompt across scheduling steps, then compare chunk sizes using a timed example. Smaller chunks give decode more chances to run, but the right budget must also meet first-token and completion targets.

21 MIN · PREMIUM