5 Commits

Author	SHA1	Message	Date
Daniel Hiltgen	909a88c5c0	Improve crash reporting (#7728) ... Many model crashes are masked behind "An existing connection was forcibly closed by the remote host" This captures that common error message and wires in any detected errors from the log. This also adds the deepseek context shift error to the known errors we capture.	2024-11-19 16:26:57 -08:00
Daniel Hiltgen	04210aa6dd	Catch one more error log	2024-08-05 09:28:07 -07:00
Jeffrey Morgan	4d71c559b2	fix error detection by limiting model loading error parsing (#5472)	2024-07-03 20:04:30 -04:00
Josh Yan	33a65e3ba3	error	2024-07-01 16:04:13 -07:00
Daniel Hiltgen	58d95cc9bd	Switch back to subprocessing for llama.cpp ... This should resolve a number of memory leak and stability defects by allowing us to isolate llama.cpp in a separate process and shutdown when idle, and gracefully restart if it has problems. This also serves as a first step to be able to run multiple copies to support multiple models concurrently.	2024-04-01 16:48:18 -07:00