Jesse Gross b70fc4d51e model: Don't unconditionally add special tokens ...

We sometimes tokenize partial strings. For example, with
multimodal inputs, we split the input string around the images
and then tokenize each piece. In these cases, we should only add
the special tokens on the first piece.

2025-03-06 16:54:16 -08:00

..

llm_darwin.go

Optimize container images for startup (#6547)

2024-09-12 12:10:30 -07:00

llm_linux.go

Optimize container images for startup (#6547)

2024-09-12 12:10:30 -07:00

llm_windows.go

runner: Set windows above normal priority (#6905)

2024-09-21 16:54:49 -07:00

memory_test.go

config: allow setting context length through env var (#8938)

2025-02-24 13:26:35 -08:00

memory.go

New engine: vision models and auto-fallback (#9113)

2025-03-04 09:03:46 -08:00

server_test.go

llm: do not error on "null" format (#8139)

2024-12-17 09:49:37 -08:00

server.go

model: Don't unconditionally add special tokens

2025-03-06 16:54:16 -08:00

status.go

Improve crash reporting (#7728)

2024-11-19 16:26:57 -08:00