Jesse Gross 93ac3760cb runner: Flush pending responses before returning ...

If there are any pending reponses (such as from potential stop
tokens) then we should send them back before ending the sequence.
Otherwise, we can be missing tokens at the end of a response.

Fixes #6707

2024-09-11 16:39:32 -07:00

..

CMakeLists.txt

llm: use json.hpp from common (#6642)

2024-09-04 19:34:42 -04:00

httplib.h

Import server.cpp as of b2356

2024-03-12 13:58:06 -07:00

server.cpp

runner: Flush pending responses before returning

2024-09-11 16:39:32 -07:00

utils.hpp

log clean up

2024-05-09 14:55:36 -07:00