ollama/llm/llm_linux.go

mirror of https://github.com/ollama/ollama.git synced 2025-03-24 08:41:54 +01:00
package llm

import "embed"

//go:embed build/linux/*/*/bin/*
var libEmbed embed.FS
Switch back to subprocessing for llama.cpp This should resolve a number of memory leak and stability defects by allowing us to isolate llama.cpp in a separate process and shutdown when idle, and gracefully restart if it has problems. This also serves as a first step to be able to run multiple copies to support multiple models concurrently. 2024-03-14 10:24:13 -07:00			`package llm`

			`import "embed"`

			`//go:embed build/linux///bin/*`
			`var libEmbed embed.FS`