Skip to content
ahead x

Language models

Context Window

The context window is the amount of text a language model can read at once. It is measured in tokens. If the window is exceeded, the model forgets the beginning. Modern models have very large windows.

Related terms

← Back to the glossary