Measure the first token, later gaps and completion together

Time to first token, later token gaps and completion time describe different parts of a response. Averages can hide stalls; goodput counts requests that meet the targets, alongside reporting rejected demand.

17 MIN · PLUS