Long context refers to the ability of modern LLMs to process inputs of hundreds of thousands or even millions of Tokens in a single pass. The trend kicked off with Anthropic's Claude 100K in 2023, then escalated to Gemini 1.5's 1M-2M Context Window and dedicated long-context SKUs from most major labs — 'the whole book, the whole codebase, the whole financial report' scenarios are no longer demos. But long context is more than a number on a spec sheet: 'needle in a haystack' tests and long-context reasoning benchmarks reveal how much of the window the model actually attends to. Without system-level innovations like PagedAttention and efficient KV Cache management, those numbers could never be served economically.
MEVZU N°124ISTANBULYEAR I — VOL. III
Glossary · Intermediate · 2023
Long Context
Next-generation LLMs that can process hundreds of thousands — sometimes millions — of tokens in a single context.
- EN — English term
- Long Context
- TR — Turkish term
- Uzun Bağlam