ollama/gpu/types.go

package gpu

// Beginning of an `ollama info` command
type GpuInfo struct {
	Library     string `json:"library,omitempty"`
	TotalMemory uint64 `json:"total_memory,omitempty"`
	FreeMemory  uint64 `json:"free_memory,omitempty"`

	// TODO add other useful attributes about the card here for discovery information
}
Adapted rocm support to cgo based llama.cpp 2023-11-29 11:00:37 -08:00			`package gpu`

			// Beginning of an `ollama info` command
			`type GpuInfo struct {`
Revamp the dynamic library shim This switches the default llama.cpp to be CPU based, and builds the GPU variants as dynamically loaded libraries which we can select at runtime. This also bumps the ROCm library to version 6 given 5.7 builds don't work on the latest ROCm library that just shipped. 2023-12-20 10:36:01 -08:00			Library string `json:"library,omitempty"`
Adapted rocm support to cgo based llama.cpp 2023-11-29 11:00:37 -08:00			TotalMemory uint64 `json:"total_memory,omitempty"`
			FreeMemory uint64 `json:"free_memory,omitempty"`

			`// TODO add other useful attributes about the card here for discovery information`
			`}`