Repository navigation

[Engine] metal: the conversation cache and session files keep the decode window's own K/V (#2502) - #3541

Draft

oceanio wants to merge 11 commits into

Niko1221:mainfrom

oceanio:pr/metal-window-snapshots-solo

Draft

[Engine] metal: the conversation cache and session files keep the decode window's own K/V (#2502)#3541
oceanio wants to merge 11 commits into
Niko1221:mainfrom
oceanio:pr/metal-window-snapshots-solo

Commits on Oct 28, 2026
- metal: the session's QSA states carry no K/V pools or pooled indexer keys (the decode window keeps its own)
  
  oceanio
  and
  claude
  committed
  ac00ff5
- docs (Mac): the engine's own memory grows with --max-context; what it was before the session K/V change
  
  oceanio
  and
  claude
  committed
  75a73bb
- metal: the decode window's per-conversation state in one SlotState (slot 0 only, the same buffers)
  
  oceanio
  and
  claude
  committed
  0fe9a59
- metal: one reading of the free memory on macOS (host_memory_now, sample_arena_mem), used by the streaming arena
  
  oceanio
  and
  claude
  committed
  946a1c9
- memory guard: a free-memory reading on macOS, so parking and session files are not refused on the Metal engine (#2502)
  
  oceanio
  and
  claude
  committed
  5bae944
- metal: parking and session files carry the decode window's own K/V and running state (#2502)
  
  oceanio
  and
  claude
  committed
  96c6889
- metal: a session file's fingerprint carries the decode window's K/V and running-state layout; a file from another layout is refused
  
  oceanio
  and
  claude
  committed
  0be11be
- tools: session_restart_test.py and metal_snapshot_test.py; parking_test.py reads the engine's own log
  
  oceanio
  and
  claude
  committed
  725200d
- docs: the conversation cache and session files on the Mac (MAC.md, DETAILS.md), measured at 29K tokens
  
  oceanio
  and
  claude
  committed
  18a20cd
- tools: metal_snapshot_test.py passes its own --conversation-cache-min-tokens after the config's arguments
  
  oceanio
  and
  claude
  committed
  cdf1da9
- tools: batch_test.py's Engine starts the engine with the config's env, as serve does
  
  oceanio
  and
  claude
  committed
  450e962

Commits

Commits on Oct 28, 2026