Context Window
Short definition
Context window — maximum tokens an LLM keeps in memory.
Full definition
The context window is the number of tokens a model can consider in one request (input + output); larger windows allow longer documents and history, modern models ranging from 8K to 1M+ tokens, affecting cost and speed.
Examples
A 128K context window fits an entire training log.