highperfocused/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2025-04-14 06:39:30 +02:00
Code Issues Packages Projects Releases Wiki Activity
ollama/runner/ollamarunner
History
Bruce MacDonald 66b2539238
runner: clear cache when shift is not possible (#9433) 
Clear KV cache when shift operation is not supported by model.
Added KvCacheCanShift() check to handle models that can't perform cache shifts,
falling back to full cache clear while preserving logical token history to
maintain expected behavior when context window fills up.
2025-03-31 12:54:45 -07:00
..
cache_test.go
runner: clear cache when shift is not possible (#9433)
2025-03-31 12:54:45 -07:00
cache.go
runner: clear cache when shift is not possible (#9433)
2025-03-31 12:54:45 -07:00
runner.go
runner: clear cache when shift is not possible (#9433)
2025-03-31 12:54:45 -07:00