Revert "remove cuda v11 (#10569)" (#10692)

Bring back v11 until we can better warn users that their driver
is too old.

This reverts commit fa393554b9.
This commit is contained in:
Daniel Hiltgen
2025-05-13 13:12:54 -07:00
committed by GitHub
parent 4b903f088a
commit c6bcdc4223
11 changed files with 58 additions and 11 deletions

View File

@@ -311,7 +311,7 @@ func NewLlamaServer(gpus discover.GpuInfoList, modelPath string, f *ggml.GGML, a
params = append(params, "--mmproj", projectors[0])
}
// iterate through compatible GPU libraries such as 'cuda_v12', 'rocm', etc.
// iterate through compatible GPU libraries such as 'cuda_v12', 'cuda_v11', 'rocm', etc.
// adding each library's respective path to the LD_LIBRARY_PATH, until finally running
// without any LD_LIBRARY_PATH flags
for {