Jeffrey Morgan 993cf8bf55

llm: limit generation to 10x context size to avoid run on generations (#3918) ...

* llm: limit generation to 10x context size to avoid run on generations

* add comment

* simplify condition statement

2024-04-25 19:02:30 -04:00

..

ext_server

Support unicode characters in model path (#3681)

2024-04-16 17:00:12 -04:00

generate

Remove trailing spaces (#3889)

2024-04-25 14:32:26 -04:00

llama.cpp @ 7593639ce3

update llama.cpp submodule to 7593639 (#3665)

2024-04-15 23:04:43 -04:00

patches

Bump to b2581

2024-04-02 11:53:07 -07:00

ggla.go

refactor tensor query

2024-04-10 11:37:20 -07:00

ggml.go

fix: mixtral graph

2024-04-22 17:19:44 -07:00

gguf.go

fixes for gguf (#3863)

2024-04-23 20:57:20 -07:00

llm_darwin_amd64.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

llm_darwin_arm64.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

llm_linux.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

llm_windows.go

Move nested payloads to installer and zip file on windows

2024-04-23 16:14:47 -07:00

llm.go

cgo quantize

2024-04-08 15:31:08 -07:00

memory.go

Add back memory escape valve

2024-04-23 17:09:02 -07:00

payload.go

Move nested payloads to installer and zip file on windows

2024-04-23 16:14:47 -07:00

server.go

llm: limit generation to 10x context size to avoid run on generations (#3918)

2024-04-25 19:02:30 -04:00

status.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00