config: update default context length to 4096

This commit is contained in:
Devon Rifkin
2025-04-28 17:03:23 -07:00
parent a25f3f8260
commit 44b466eeb2
3 changed files with 5 additions and 5 deletions

View File

@@ -20,7 +20,7 @@ Please refer to the [GPU docs](./gpu.md).
## How can I specify the context window size?
By default, Ollama uses a context window size of 2048 tokens.
By default, Ollama uses a context window size of 4096 tokens.
This can be overridden with the `OLLAMA_CONTEXT_LENGTH` environment variable. For example, to set the default context window to 8K, use: