highperfocused/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2025-11-12 00:27:45 +01:00
Code Issues Packages Projects Releases Wiki Activity
4,403 Commits 269 Branches 329 Tags
d73f8aa8c3979b33f5ea19b80406c20e88ee3b1b
Commit Graph

15 Commits

Author SHA1 Message Date
Michael Yang
333e360422 model: handle multiple eos tokens (#10577) 
* get eos_token_id from generation_config.json

* refactor

* include both ids and strings in trace

* comments

* remove special case for gemma3 special vocab (#10743)
 2025-05-16 13:40:23 -07:00
Bruce MacDonald
f6f3713001 convert: qwen2 from safetensors (#8408) 
Add native support for converting Qwen2 family models (including Qwen2.5)
from safetensors to gguf format so we can run it.
 2025-01-14 10:34:37 -08:00
Michael Yang
4456012956 fix unmarshaling merges 2024-12-04 09:21:56 -08:00
Michael Yang
eae3af6807 clean up convert tokenizer 2024-08-27 11:11:43 -07:00
Michael Yang
3eb08377f8 detect chat template from configs that contain lists 2024-08-27 10:49:33 -07:00
Michael Yang
5a28b9cf5f bert 2024-08-20 17:27:34 -07:00
Michael Yang
d8e2664c33 convert: fix parse functions 2024-07-31 15:58:55 -07:00
Michael Yang
eafc607abb convert: only extract large files 2024-07-31 15:58:55 -07:00
Michael Yang
df993fa37b comments 2024-07-31 15:58:55 -07:00
Michael Yang
5e9db9fb0b refactor convert 2024-07-31 15:58:33 -07:00
Michael Yang
c895a7d13f some gocritic 2024-06-04 11:13:30 -07:00
Ikko Eltociear Ashimine
955c317cab chore: update tokenizer.go (#4571) 
PreTokenziers -> PreTokenizers
 2024-05-22 00:25:23 -07:00
Michael Yang
bbbd9f20f3 cleanup 2024-05-20 16:13:57 -07:00
Michael Yang
547132e820 bpe pretokenizer 2024-05-20 16:13:57 -07:00
Patrick Devine
2d315ba9a9 add missing file 2024-05-20 16:13:57 -07:00