peanut256 a189810df6

Determine max VRAM on macOS using recommendedMaxWorkingSetSize (#2354) ...

* read iogpu.wired_limit_mb on macOS

Fix for https://github.com/ollama/ollama/issues/1826

* improved determination of available vram on macOS

read the recommended maximal vram on macOS via Metal API

* Removed macOS-specific logging

* Remove logging from gpu_darwin.go

* release Core Foundation object

fixes a possible memory leak

2024-02-25 18:16:45 -05:00

..

amd.go

Harden AMD driver lookup logic

2024-02-16 16:20:16 -08:00

cpu_common.go

Mechanical switch from log to slog

2024-01-18 14:12:57 -08:00

gpu_darwin.go

Determine max VRAM on macOS using recommendedMaxWorkingSetSize (#2354)

2024-02-25 18:16:45 -05:00

gpu_info_cpu.c

calculate overhead based number of gpu devices (#1875)

2024-01-09 15:53:33 -05:00

gpu_info_cuda.c

Fix crash on cuda ml init failure

2024-01-26 09:18:33 -08:00

gpu_info_cuda.h

More logging for gpu management

2024-01-24 10:32:36 -08:00

gpu_info_darwin.h

Determine max VRAM on macOS using recommendedMaxWorkingSetSize (#2354)

2024-02-25 18:16:45 -05:00

gpu_info_darwin.m

Determine max VRAM on macOS using recommendedMaxWorkingSetSize (#2354)

2024-02-25 18:16:45 -05:00

gpu_info_rocm.c

Update gpu_info_rocm.c

2024-01-26 22:08:27 -08:00

gpu_info_rocm.h

More logging for gpu management

2024-01-24 10:32:36 -08:00

gpu_info.h

Ignore AMD integrated GPUs

2024-01-26 09:21:35 -08:00

gpu_test.go

Merge pull request #1819 from dhiltgen/multi_variant

2024-01-11 14:00:48 -08:00

gpu.go

Harden AMD driver lookup logic

2024-02-16 16:20:16 -08:00

types.go

Detect AMD GPU info via sysfs and block old cards

2024-02-12 08:19:41 -08:00