highperfocused/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2025-04-14 06:39:30 +02:00
Code Issues Packages Projects Releases Wiki Activity
ollama/runner/llamarunner
History
Bruce MacDonald 66b2539238
runner: clear cache when shift is not possible (#9433) 
Clear KV cache when shift operation is not supported by model.
Added KvCacheCanShift() check to handle models that can't perform cache shifts,
falling back to full cache clear while preserving logical token history to
maintain expected behavior when context window fills up.
2025-03-31 12:54:45 -07:00
..
cache_test.go
Runner for Ollama engine
2025-02-13 17:09:26 -08:00
cache.go
runner: clear cache when shift is not possible (#9433)
2025-03-31 12:54:45 -07:00
image_test.go
Runner for Ollama engine
2025-02-13 17:09:26 -08:00
image.go
Runner for Ollama engine
2025-02-13 17:09:26 -08:00
runner.go
runner: clear cache when shift is not possible (#9433)
2025-03-31 12:54:45 -07:00