5 Commits

Author SHA1 Message Date
Richard Kuo (Danswer)
bc2c56dfb6 improve gpu detection functions and logging in model server 2025-02-07 16:59:02 -08:00
Yuhong Sun
6026536110
Model Server Async (#3386)
* need-verify

* fix some lib calls

* k

* tests

* k

* k

* k

* Address the comments

* fix comment
2024-12-11 01:33:44 +00:00
Yuhong Sun
8de04acb7f k 2024-08-20 14:06:49 -07:00
Yuhong Sun
8cd1eda8b1
Rework Rerankers (#2093) 2024-08-08 21:33:49 -07:00
Yuhong Sun
e361e92230
Healthcheck for model server (#1350) 2024-04-18 16:22:38 -07:00