highperfocused/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2025-11-10 17:38:26 +01:00
Code Issues Packages Projects Releases Wiki Activity
4,572 Commits 269 Branches 329 Tags
a40d427bcea52ad5c7e93780564fc15e5ef80473
Commit Graph

3 Commits

Author SHA1 Message Date
Michael Yang
a40d427bce multi-regexp pretokenizer (#12325) 2025-09-23 13:21:47 -07:00
Devon Rifkin
463a6caad8 model: add bpe roundtripping tests 2025-08-19 22:05:48 -07:00
Michael Yang
333e360422 model: handle multiple eos tokens (#10577) 
* get eos_token_id from generation_config.json

* refactor

* include both ids and strings in trace

* comments

* remove special case for gemma3 special vocab (#10743)
 2025-05-16 13:40:23 -07:00