Jesse Gross 06007c0a18 Allow models to force a new batch ...

This is useful for a few things:
 - Work around bugs, such as having 2 images in one batch
 - Keep the image in a single batch for fully connected attention
 - Improve performance by not evaluating embeddings multiple times

2025-03-11 14:49:20 -07:00

..

imageproc

imageproc mllama refactor (#7537)

2024-12-14 19:50:15 -08:00

input

Allow models to force a new batch

2025-03-11 14:49:20 -07:00

models

Allow models to force a new batch

2025-03-11 14:49:20 -07:00

testdata

gemma2 impl

2025-03-11 14:35:08 -07:00

model_test.go

model: Update encoder cache to use multimodal input processing handler

2025-03-09 17:05:26 -07:00

model.go

model: Update encoder cache to use multimodal input processing handler

2025-03-09 17:05:26 -07:00

process_text_spm_test.go

fix drift from main

2025-03-11 14:49:18 -07:00

process_text_spm.go

add gemma vision encoder

2025-03-11 14:49:17 -07:00

process_text_test.go

model: Don't unconditionally add special tokens

2025-03-06 16:54:16 -08:00

process_text.go

set non-causal attention

2025-03-11 14:49:18 -07:00