What is a context window?
The fixed size of what a model can read at once. It explains most of what people assume is intelligence or laziness in AI answers.
The context window is a model's working memory: everything it can read at once, measured in tokens. Your question, the passages placed in front of it, and the answer being written all share one fixed space. What does not fit might as well not exist for that answer. Retrieval is how a small window gets used well: only the passages that matter go in, and the rest of the library stays on disk.
The working memory of a model.
When a model answers, it reads a block of text: your question, whatever context was added, and its own answer so far. That block is the context window, and it has a hard ceiling. Text beyond it is invisible, not compressed or remembered. This is why a model can lose the thread of a long chat, why it does not know about documents you never gave it, and why a two-hundred-page PDF cannot be summarized in one gulp. The window is not ignorance; it is a budget.
How retrieval spends the budget well.
This constraint is exactly why retrieval-augmented generation exists. Rather than stuffing a whole library into the window, a retrieval step picks the handful of passages most relevant to your question and places only those in front of the model. The window fills with the right text instead of all the text. On local hardware this matters twice over: a larger window needs more memory and more time for every answer, so the skill is in choosing well rather than in choosing everything.
Why bigger is not automatically better.
Large windows are real and useful, but two honest caveats follow them. First, models attend less reliably in the middle of very long contexts, so what goes in is not all equally read. Second, memory and speed costs grow with the window, which is the same memory the model itself competes for on a local machine. The practical takeaway for research work is unchanged by either trend: put the right passages in a modest window, verify the claims against them, and treat the context window as the boundary that makes retrieval a discipline rather than a limitation to apologize for.