highperfocused/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2025-11-10 21:37:14 +01:00
Code Issues Packages Projects Releases Wiki Activity
Files
parth/move-parsing
ollama/model
History
Daniel Hiltgen 31f64183dc perf: build graph for next batch in parallel to keep GPU busy 
This refactors the main run loop of the ollama runner to perform the main GPU
intensive tasks (Compute+Floats) in a go routine so we can prepare the next
batch in parallel to reduce the amount of time the GPU stalls waiting for the
next batch of work.
2025-08-19 12:33:03 -07:00
..
imageproc
…
input
…
models
perf: build graph for next batch in parallel to keep GPU busy
2025-08-19 12:33:03 -07:00
testdata
…
bytepairencoding_test.go
model: handle multiple eos tokens (#10577)
2025-05-16 13:40:23 -07:00
bytepairencoding.go
gpt-oss (#11672)
2025-08-05 12:21:16 -07:00
model_test.go
update vendored llama.cpp and ggml (#11823)
2025-08-14 14:42:58 -07:00
model.go
perf: build graph for next batch in parallel to keep GPU busy
2025-08-19 12:33:03 -07:00
sentencepiece_test.go
model: handle multiple eos tokens (#10577)
2025-05-16 13:40:23 -07:00
sentencepiece.go
model: handle multiple eos tokens (#10577)
2025-05-16 13:40:23 -07:00
textprocessor.go
model: handle multiple eos tokens (#10577)
2025-05-16 13:40:23 -07:00
vocabulary_test.go
model: treat 'user defined' tokens as special tokens (#11077)
2025-06-16 16:03:16 -07:00
vocabulary.go
model: treat 'user defined' tokens as special tokens (#11077)
2025-06-16 16:03:16 -07:00