highperfocused/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2025-11-10 15:57:58 +01:00
Code Issues Packages Projects Releases Wiki Activity
Files
030e765e7667526e6ee6f3fba2074bee3092a009
ollama/llm/llm.go
Michael Yang 829ff87bd1 revert tokenize ffi (#4761) 
* Revert "use `int32_t` for call to tokenize (#4738)"

This reverts commit 763bb65dbb.

* Revert "vocab only"

This reverts commit bf54c845e9.

* Revert "use ffi for tokenizing/detokenizing"

This reverts commit 26a00a0410.
2024-05-31 18:54:21 -07:00

1.2 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink