AI Garage Jargons

Context Window

The amount of information (in tokens) a model can consider in one request.

Use Cases

  • Long document summarization
  • Conversation memory
  • Complex planning prompts

ELI5

How much the AI can keep in mind at one time.

Why it matters

Exceeding context limits causes truncation and quality loss.

Back to glossary/context-window