Daniel Hiltgen aab2190420 implement nvml for linux (#12517) ...

* implement nvml for linux

* Improve scheduler logging when VRAM doesn't recover

2025-10-10 15:15:56 -07:00

..

.gitignore

update vendored llama.cpp and ggml (#11823)

2025-08-14 14:42:58 -07:00

0001-ggml-backend-malloc-and-free-using-the-same-compiler.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0002-pretokenizer.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0003-clip-unicode.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0004-solar-pro.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0005-fix-deepseek-deseret-regex.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0006-maintain-ordering-for-rules-for-grammar.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0007-sort-devices-by-score.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0008-add-phony-target-ggml-cpu-for-all-cpu-variants.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0009-remove-amx.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0010-fix-string-arr-kv-loading.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0011-ollama-debug-tensor.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0012-add-ollama-vocab-for-grammar-support.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0013-add-argsort-and-cuda-copy-for-i32.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0014-graph-memory-reporting-on-failure.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0015-ggml-Export-GPU-UUIDs.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0016-add-C-API-for-mtmd_input_text.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0017-no-power-throttling-win32-with-gnuc.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0018-BF16-macos-version-guard.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0019-Enable-CUDA-Graphs-for-gemma3n.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0020-Disable-ggml-blas-on-macos-v13-and-older.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0021-fix-mtmd-audio.cpp-build-on-windows.patch

llm: New memory management

2025-08-14 15:24:01 -07:00

0022-ggml-No-alloc-mode.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0023-decode-disable-output_all.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0024-ggml-Enable-resetting-backend-devices.patch

Update GGML to b6646 (#12245)

2025-10-02 14:47:10 -07:00

0025-harden-uncaught-exception-registration.patch

harden uncaught exception registration (#12120)

2025-09-02 09:43:55 -07:00

0026-GPU-discovery-enhancements.patch

implement nvml for linux (#12517)

2025-10-10 15:15:56 -07:00