4 Commits

Author	SHA1	Message	Date
Daniel Hiltgen	34b9db5afc	Request and model concurrency ... This change adds support for multiple concurrent requests, as well as loading multiple models by spawning multiple runners. The default settings are currently set at 1 concurrent request per model and only 1 loaded model at a time, but these can be adjusted by setting OLLAMA_NUM_PARALLEL and OLLAMA_MAX_LOADED_MODELS.	2024-04-22 19:29:12 -07:00
Patrick Devine	1b272d5bcd	change github.com/jmorganca/ollama to github.com/ollama/ollama (#3347)	2024-03-26 13:04:17 -07:00
Daniel Hiltgen	7b6cbc10ec	Integration tests conditionally pull ... If images aren't present, pull them. Also fixes the expected responses	2024-03-25 08:57:45 -07:00
Daniel Hiltgen	949b6c01e0	Revamp go based integration tests ... This uplevels the integration tests to run the server which can allow testing an existing server, or a remote server.	2024-03-23 14:24:18 +01:00