Build retrieval as a budgeted pipeline

Retrieval creates several kinds of work: encoding queries, searching documents and scoring candidate passages. Size each stage in its own units, and check that bulk indexing leaves enough time for live queries.

22 MIN · PREMIUM