mirror of
https://github.com/ollama/ollama.git
synced 2025-04-03 17:39:05 +02:00
d773b7d671
Most tensor backends try to optimize performance by using a lower precision for matmuls. However, some operations (such as kq) on some models are sensitive to this and require full precision.