The serving engine's memory: token streams allocate KV-cache pages while ghosts race ahead.
Drag to turn it any way · shift-drag to roll · scroll to zoom · double-click to reset
This visualization needs WebGL, which is unavailable here. A screenshot of it lives on the project page.