highperfocused/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2025-11-18 21:41:37 +01:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #209 from jmorganca/k-quants

Browse Source 
enable k quants
This commit is contained in:
Michael Yang
2023-07-25 11:53:29 -07:00
committed by GitHub
parent 5614984f06 726bc647b2
commit 8a86aae019
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
llama/llama.go
View File

@@ -1,7 +1,7 @@
package llama
/*
#cgo CPPFLAGS: -O3 -DNDEBUG=1
#cgo CPPFLAGS: -O3 -DNDEBUG=1 -DGGML_USE_K_QUANTS
#cgo CXXFLAGS: -std=c++11
#cgo darwin CPPFLAGS: -DGGML_USE_ACCELERATE -DGGML_USE_METAL -DGGML_METAL_NDEBUG
#cgo darwin LDFLAGS: -framework Accelerate -framework Foundation -framework Metal -framework MetalKit -framework MetalPerformanceShaders