How a language model serves your prompt
Follow one prompt through a real model running in your browser: tokens, prefill, the KV cache, decode and sampling, with the time, bytes and memory each step costs.
- Tokens
- Prefill
- KV cache
- Decode
- Sampling
- Production scale
Free to explore; the production-scale stage is Premium.
