4 Commits

Author	SHA1	Message	Date
Daniel Hiltgen	987c16b2f7	Report more information about GPUs in verbose mode ... This adds additional calls to both CUDA and ROCm management libraries to discover additional attributes about the GPU(s) detected in the system, and wires up runtime verbosity selection. When users hit problems with GPUs we can ask them to run with `OLLAMA_DEBUG=1 ollama serve` and share the results.	2024-01-23 11:37:02 -08:00
Jeffrey Morgan	c336693f07	calculate overhead based number of gpu devices (#1875)	2024-01-09 15:53:33 -05:00
Daniel Hiltgen	a2ad952440	Fix windows system memory lookup ... This refines the gpu package error handling and fixes a bug with the system memory lookup on windows.	2024-01-03 08:50:01 -08:00
Daniel Hiltgen	35934b2e05	Adapted rocm support to cgo based llama.cpp	2023-12-19 09:05:46 -08:00