highperfocused/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2025-07-12 20:32:49 +02:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #306 from jmorganca/default-keep-system

Browse Source 
automatically set num_keep if num_keep < 0
This commit is contained in:
Michael Yang
2023-08-08 09:25:34 -07:00
committed by GitHub
parent 34a13a9d05 4dc5b117dd
commit f2074ed4c0
3 changed files with 28 additions and 14 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
api/types.go
View File

@ -266,6 +266,7 @@ func DefaultOptions() Options {
UseNUMA: false,
NumCtx: 2048,
NumKeep: -1,
NumBatch: 512,
NumGPU: 1,
NumGQA: 1,