mirror of
https://github.com/ollama/ollama.git
synced 2025-03-27 02:01:56 +01:00
7916f55009
Special tokens are currently read as uint32 from the model metadata. However, all other parts of the system (including the tokenizer) use int32 to represent tokens so it is impossible to represent the high portion of the unsigned range. For consistency and to avoid casts, we should just use int32 everywhere.