Glossary / Context window

Context window

The amount of text, measured in tokens, that a model can consider at once, including the conversation so far and any documents given to it.

In the news