3 Commits

Author	SHA1	Message	Date
Michael Yang	6f7117145f	batch: use tensors for outputs (#12185) ... this cleans up the model interface slightly without too much impact in other areas	2025-09-15 14:33:06 -07:00
Oliver Simons	ea85e27bbd	Increase performance for Gemma3n models on NVGPUs by enabling CUDA Graph execution (#11525) ... * Enable CUDA Graphs for gemma3n. Similar to https://github.com/ggml-org/llama.cpp/pull/14741, though ollama has a slightly different model graph than llama.cpp which requires different workaround checks. * Remove residual check by reshaping differently in gemma3n model This should make the heuristics more robust	2025-07-29 12:37:06 -07:00
Michael Yang	73b642e6f3	add new gemma model (#11204) ... * update patches * cherry pick metal mean kernel * cherry pick cuda mean kernel * gemma3n	2025-06-25 21:47:09 -07:00