Michael Yang ac7a842e55 fix model reloading ...

ensure runtime model changes (template, system prompt, messages,
options) are captured on model updates without needing to reload the
server

2024-07-05 13:17:25 -07:00

..

ext_server

update llama.cpp submodule to d7fd29f (#5475)

2024-07-05 13:25:58 -04:00

generate

update llama.cpp submodule to d7fd29f (#5475)

2024-07-05 13:25:58 -04:00

llama.cpp @ d7fd29fff1

update llama.cpp submodule to d7fd29f (#5475)

2024-07-05 13:25:58 -04:00

patches

update llama.cpp submodule to d7fd29f (#5475)

2024-07-05 13:25:58 -04:00

filetype.go

Add support for IQ1_S, IQ3_S, IQ2_S, IQ4_XS. IQ4_NL (#4322)

2024-05-23 13:21:49 -07:00

ggla.go

llm: speed up gguf decoding by a lot (#5246)

2024-06-24 21:47:52 -07:00

ggml_test.go

llm: speed up gguf decoding by a lot (#5246)

2024-06-24 21:47:52 -07:00

ggml.go

gemma2 graph

2024-06-27 13:34:52 -07:00

gguf.go

llm: speed up gguf decoding by a lot (#5246)

2024-06-24 21:47:52 -07:00

llm_darwin_amd64.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

llm_darwin_arm64.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

llm_linux.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

llm_windows.go

Move nested payloads to installer and zip file on windows

2024-04-23 16:14:47 -07:00

llm.go

fix typo in cgo directives in llm.go (#5501)

2024-07-05 15:18:36 -04:00

memory_test.go

llm: speed up gguf decoding by a lot (#5246)

2024-06-24 21:47:52 -07:00

memory.go

handle asymmetric embedding KVs

2024-06-20 09:57:27 -07:00

payload.go

Fix corner cases on tmp cleaner on mac

2024-07-03 13:10:14 -07:00

server.go

fix model reloading

2024-07-05 13:17:25 -07:00

status.go

fix error detection by limiting model loading error parsing (#5472)

2024-07-03 20:04:30 -04:00