Tag
#context-window
2 posts, earliest first
-
The Context Window Is the Workspace, Not a Buffer
The folk model treats the context window as storage you load before the model knows things. The mechanism is the opposite: the window is the workspace itself, and every token in it shapes every answer the model gives.
-
Attention Is Not Memory: Why Models Re-Read Everything Every Turn
The model doesn't remember earlier turns. It re-reads the full transcript from scratch every turn. What feels like memory is re-reading, and the failure modes follow directly from that.