highperfocused/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2025-11-11 17:26:58 +01:00
Code Issues Packages Projects Releases Wiki Activity

ml: Remove Output from Context interface

Browse Source 
Model implementations should use Input for all of their tensors
supplied to the model. This includes tensors that relate to the
outputs, which is confusing since there is also an Output funciton.

Since Output is only used internally in GGML and not used by any
model implementations, we can remove it from the interface to
reduce confusion.
This commit is contained in:
Jesse Gross
2025-03-27 11:52:09 -07:00
committed by Jesse Gross
parent ead27aa9fe
commit 01aa788722
3 changed files with 3 additions and 23 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
kvcache/causal_test.go
View File

@@ -362,7 +362,6 @@ func (c *testContext) FromIntSlice(s []int32, shape ...int) (ml.Tensor, error) {
}
func (c *testContext) Input() ml.Context { return c }
func (c *testContext) Output() ml.Context { return c }
func (c *testContext) Layer(int) ml.Context { return c }
func (c *testContext) Forward(...ml.Tensor) ml.Context { return c }