The maximum amount of text (measured in tokens) that a language model can process in a single request.
Context windows range from 4K tokens (older models) to 200K+ tokens (Claude 3.5, Gemini 1.5). A larger context window allows processing longer documents, more conversation history, and richer prompts, but costs more per request.
Using Claude's 200K context window to analyze an entire codebase in one request, versus needing to chunk documents for models with smaller windows.
Context window size directly impacts what AI tasks are feasible — larger windows enable whole-document analysis, multi-file code review, and complex reasoning without information loss.
AI systems that can autonomously plan, execute, and iterate on multi-step tasks with minimal human i...
An LLM capability that allows the model to invoke predefined functions or APIs as part of its respon...
An AI model trained on vast amounts of text data capable of understanding and generating human-like ...
The practice of designing and optimizing input prompts to get desired outputs from AI models.
A security attack where malicious instructions are embedded in user input to manipulate an AI model ...
Need help implementing this in your business?
Get Started