Bruce MacDonald d6f692ad1a

Add support for IQ1_S, IQ3_S, IQ2_S, IQ4_XS. IQ4_NL (#4322) ...

Co-authored-by: ManniX-ITA <20623405+mann1x@users.noreply.github.com>

2024-05-23 13:21:49 -07:00

..

ext_server

feat: add support for flash_attn (#4120)

2024-05-20 13:36:03 -07:00

generate

Port cuda/rocm skip build vars to linux

2024-05-15 15:56:43 -07:00

llama.cpp @ 614d3b914e

set llama.cpp submodule commit to 614d3b9

2024-05-20 15:28:17 -07:00

patches

update llama.cpp submodule to 614d3b9 (#4414)

2024-05-16 13:53:09 -07:00

filetype.go

Add support for IQ1_S, IQ3_S, IQ2_S, IQ4_XS. IQ4_NL (#4322)

2024-05-23 13:21:49 -07:00

ggla.go

simplify safetensors reading

2024-05-21 11:28:22 -07:00

ggml.go

Add support for IQ1_S, IQ3_S, IQ2_S, IQ4_XS. IQ4_NL (#4322)

2024-05-23 13:21:49 -07:00

gguf.go

simplify safetensors reading

2024-05-21 11:28:22 -07:00

llm_darwin_amd64.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

llm_darwin_arm64.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

llm_linux.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00

llm_windows.go

Move nested payloads to installer and zip file on windows

2024-04-23 16:14:47 -07:00

llm.go

comments

2024-05-06 15:24:01 -07:00

memory.go

typo

2024-05-13 14:18:34 -07:00

payload.go

Move nested payloads to installer and zip file on windows

2024-04-23 16:14:47 -07:00

server.go

Use flash attention flag for now (#4580)

2024-05-22 21:52:09 -07:00

status.go

Switch back to subprocessing for llama.cpp

2024-04-01 16:48:18 -07:00