Definition
The maximum amount of text (measured in tokens) that a language model can process in a single request.
In Depth
Context windows range from 4K tokens (older models) to 200K+ tokens (Claude 3.5, Gemini 1.5). A larger context window allows processing longer documents, more conversation history, and richer prompts, but costs more per request.
Example Usage
Using Claude's 200K context window to analyze an entire codebase in one request, versus needing to chunk documents for models with smaller windows.
Business Context
Context window size directly affects which AI tasks are feasible. Larger windows allow whole-document analysis, multi-file code review, and complex reasoning without information loss.
Related Terms
Agentic AI
AI systems that can autonomously plan, execute, and iterate on multi-step tasks with minimal human i...
Function Calling
An LLM capability that allows the model to invoke predefined functions or APIs as part of its respon...
Large Language Model
An AI model trained on vast amounts of text data capable of understanding and generating human-like ...
Prompt Engineering
The practice of designing and optimizing input prompts to get desired outputs from AI models.
Prompt Injection
A security attack where malicious instructions are embedded in user input to manipulate an AI model ...
Also Known As
Tags
Quick Info
Need help implementing this in your business?
Get Started