What is an AI context window?
An AI context window is the amount of text, files, conversation, and tool output a model can consider at one time.
The short version
The context window is the model's working space. It includes your prompt, recent conversation, pasted documents, retrieved sources, tool results, and the model's own response. If the conversation grows beyond the limit, older details must be summarized, dropped, or retrieved from memory.
Why it matters
A larger context window can help with long documents, codebases, research threads, and multi-step tasks. But more context is not automatically better. Irrelevant context can distract the model or bury the important detail.
Context is not memory
Context is what the model sees right now. Memory is information stored outside the current prompt and retrieved later. A chatbot can have a huge context window and still forget something if it was never included or retrieved.
Why models miss details
Even inside the window, models may overweight recent text, instructions, headings, or repeated claims. Long prompts need structure: clear goals, source labels, and the exact details that matter.
How to use it well
Put the task first, include only relevant material, label sources, and ask the model to cite the part of the context it used. For code, include exact files and errors instead of dumping the whole project.
Related questions to ask AskClash
- Why does ChatGPT forget earlier messages?
- Is a bigger AI context window always better?
- How should I structure long prompts?