Jesse Gross 9679f40146 ml: Allow models to constrain inputs to a single batch ...

Models may require that a set of inputs all be processed as part
of the same batch. For example, if an image has multiple patches
with fully connected attention between them, we should not split
the batch in the middle of an image.

Fixes #9697

2025-03-14 15:38:54 -07:00

..

input.go

ml: Allow models to constrain inputs to a single batch

2025-03-14 15:38:54 -07:00