Daniel Hiltgen 434dfe30c5 Reintroduce nvidia nvml library for windows ...

This library will give us the most reliable free VRAM reporting on windows
to enable concurrent model scheduling.

2024-06-14 14:51:40 -07:00

..

amd_common.go

Support Fedoras standard ROCm location

2024-05-01 15:47:12 -07:00

amd_hip_windows.go

Record more GPU information

2024-05-09 14:18:14 -07:00

amd_linux.go

Improve multi-gpu handling at the limit

2024-06-14 14:51:40 -07:00

amd_windows.go

Refine GPU discovery to bootstrap once

2024-06-14 14:51:40 -07:00

assets.go

lint

2024-06-04 11:13:30 -07:00

cpu_common.go

Refine GPU discovery to bootstrap once

2024-06-14 14:51:40 -07:00

cuda_common.go

lint linux

2024-06-04 11:13:30 -07:00

gpu_darwin.go

Bump VRAM buffer back up

2024-05-10 09:15:28 -07:00

gpu_info_cpu.c

Record more GPU information

2024-05-09 14:18:14 -07:00

gpu_info_cudart.c

Reintroduce nvidia nvml library for windows

2024-06-14 14:51:40 -07:00

gpu_info_cudart.h

Refine GPU discovery to bootstrap once

2024-06-14 14:51:40 -07:00

gpu_info_darwin.h

darwin: no partial offloading if required memory greater than system

2024-04-16 11:22:38 -07:00

gpu_info_darwin.m

darwin: no partial offloading if required memory greater than system

2024-04-16 11:22:38 -07:00

gpu_info_nvcuda.c

Reintroduce nvidia nvml library for windows

2024-06-14 14:51:40 -07:00

gpu_info_nvcuda.h

Reintroduce nvidia nvml library for windows

2024-06-14 14:51:40 -07:00

gpu_info_nvml.c

Reintroduce nvidia nvml library for windows

2024-06-14 14:51:40 -07:00

gpu_info_nvml.h

Reintroduce nvidia nvml library for windows

2024-06-14 14:51:40 -07:00

gpu_info_oneapi.c

Refactor intel gpu discovery

2024-06-14 14:51:40 -07:00

gpu_info_oneapi.h

Refactor intel gpu discovery

2024-06-14 14:51:40 -07:00

gpu_info.h

Reintroduce nvidia nvml library for windows

2024-06-14 14:51:40 -07:00

gpu_oneapi.go

support ollama run on Intel GPUs

2024-05-24 11:18:27 +08:00

gpu_test.go

lint

2024-06-04 11:13:30 -07:00

gpu.go

Reintroduce nvidia nvml library for windows

2024-06-14 14:51:40 -07:00

types.go

Refactor intel gpu discovery

2024-06-14 14:51:40 -07:00