highperfocused/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2025-09-27 22:46:59 +02:00
Code Issues Packages Projects Releases Wiki Activity

Bump llama.cpp to b1842 and add new cuda lib dep

Browse Source 
Upstream llama.cpp has added a new dependency with the
NVIDIA CUDA Driver Libraries (libcuda.so) which is part of the
driver distribution, not the general cuda libraries, and is not
available as an archive, so we can not statically link it.  This may
introduce some additional compatibility challenges which we'll
need to keep an eye on.
This commit is contained in:
Daniel Hiltgen
2024-01-10 15:52:35 -08:00
parent 598d6d5572
commit 795674dd90
2 changed files with 2 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
llm/generate/gen_linux.sh
View File

@@ -141,6 +141,7 @@ if [ -d "${CUDA_LIB_DIR}" ]; then
${CUDA_LIB_DIR}/libcublasLt_static.a \ ${CUDA_LIB_DIR}/libcublasLt_static.a \
${CUDA_LIB_DIR}/libcudadevrt.a \ ${CUDA_LIB_DIR}/libcudadevrt.a \
${CUDA_LIB_DIR}/libculibos.a \ ${CUDA_LIB_DIR}/libculibos.a \
-lcuda \
-lrt -lpthread -ldl -lstdc++ -lm -lrt -lpthread -ldl -lstdc++ -lm
fi fi

2
llm/llama.cpp

Submodule llm/llama.cpp updated: 328b83de23...584d674be6