Daniel Hiltgen 58888a74bc Detect and recover if runner removed ...

Tmp cleaners can nuke the file out from underneath us.  This detects the missing
runner, and re-initializes the payloads.

2024-04-23 10:05:26 -07:00

..

ext_server

Support unicode characters in model path (#3681)

2024-04-16 17:00:12 -04:00

generate

Merge pull request #3709 from remy415/custom-gpu-defs

2024-04-23 09:28:34 -07:00

llama.cpp @ 7593639ce3

update llama.cpp submodule to 7593639 (#3665)

2024-04-15 23:04:43 -04:00

patches

Bump to b2581

2024-04-02 11:53:07 -07:00

ggla.go

refactor tensor query

2024-04-10 11:37:20 -07:00

ggml.go

fix: mixtral graph

2024-04-22 17:19:44 -07:00

gguf.go

fix padding to only return padding

2024-04-16 15:43:26 -07:00

llm_darwin_amd64.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

llm_darwin_arm64.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

llm_linux.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

llm_windows.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

llm.go

cgo quantize

2024-04-08 15:31:08 -07:00

memory.go

Request and model concurrency

2024-04-22 19:29:12 -07:00

payload.go

Request and model concurrency

2024-04-22 19:29:12 -07:00

server.go

Detect and recover if runner removed

2024-04-23 10:05:26 -07:00

status.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00