742 Commits

Author SHA1 Message Date
Weves
f135ba9c0c Rework LLM answering flow 2024-03-25 13:34:03 -07:00
Weves
1ba74ee4df Refactor search pipeline 2024-03-25 13:34:03 -07:00
Yuhong Sun
7a861ecec4
Session Dependency for Chat Streaming (#1256) 2024-03-24 19:40:06 -07:00
Johannes Vass
3107edc921
Do not obtain DB session via Depends() (#1238)
Endpoints that use Depends(get_session) with a StreamingResponse have
the problem that Depends() releases the session again after the endpoint
function returns. At that point, the streaming response is not
finished yet but still holds a reference to the session and uses it.
However, there is no cleanup of the session after the answer stream
finishes which leads to the connections accumulating in state "idle in
transaction".

This was due to a breaking change in FastAPI 0.106.0
https://fastapi.tiangolo.com/release-notes/#01060

Co-authored-by: Johannes Vass <johannes.vass@cloudflight.io>
2024-03-24 19:31:07 -07:00
Yuhong Sun
49263ed146
Linting (#1255) 2024-03-24 19:07:57 -07:00
Matthew Holland
bd1df9649b
Added check for internet connection (#1214) 2024-03-24 19:04:40 -07:00
Yuhong Sun
d3674b02e6
Add Llama2 Prompt Option (#1254) 2024-03-24 19:01:38 -07:00
Arslan
b28b3cfa37
Making searching docs as a default option (#904) 2024-03-24 18:54:38 -07:00
Arthur De Kimpe
920d059da5
Bugfix: Support more Confluence Cloud hostname (*.jira.com) (#1244) 2024-03-23 14:04:26 -07:00
Yuhong Sun
aaa7b26a4d
Remove All Enums from Postgres (#1247) 2024-03-22 23:01:05 -07:00
Weves
89e72783a7 Add some private Persona / Document Set stuff 2024-03-22 21:44:31 -07:00
Weves
ec48142a2d Move some of the user re-work stuff to MIT repo 2024-03-22 16:29:24 -07:00
Yuhong Sun
c28a95e367
Port File Store from Volume to PG (#1241) 2024-03-21 20:10:08 -07:00
Weves
8dbe5cbaa6 Add private Persona / Document Set migration 2024-03-21 19:57:51 -07:00
Yuhong Sun
d66b6c0559
Fix Tag Document Source Enum (#1240) 2024-03-21 12:27:56 -07:00
Weves
6a776648b3 Fix LLM max tokens 2024-03-19 18:02:28 -07:00
Yuhong Sun
3a6d32da7c
Port KV Store to Postgres (#1227) 2024-03-19 16:21:22 -07:00
Weves
04ae8b1bf9 Increase SQLAlchemy pool size 2024-03-18 12:19:49 -07:00
Weves
4b9c4667f6 Increase connection pool size 2024-03-18 12:19:49 -07:00
Weves
8e89d00e32 Improve Confluence rate limit handling 2024-03-14 19:33:16 -07:00
Yuhong Sun
f45e2476d0
Sharepoint Logging (#1218) 2024-03-14 18:35:31 -07:00
Yuhong Sun
4036e7c6c6
Remove DocumentSource Enum from postgres (#1217) 2024-03-14 18:19:40 -07:00
Kevin Shi
2a8e53c94f Skip draft zendesk articles 2024-03-11 12:00:18 -07:00
Yuhong Sun
90a6e23546
Jira Version Option (#1205) 2024-03-10 12:30:47 -07:00
teocns
19c7ebdc26
connector: ensure absolute URL integrity (#1196) 2024-03-10 01:04:05 -08:00
George 
f292ede85a
Jira connector improvements (#1199)
* Jira connector:
- Add feature exclude comments from particular users
- Add feature common and custom fields to jira tasks

Fix bug on web in ConfigDisplay.tsx

* Mypy fixes

* move to metadata field

* k

---------

Co-authored-by: Yuhong Sun <yuhongsun96@gmail.com>
2024-03-10 01:00:19 -08:00
Riccardo Schirone
0442513539 backend: remove duplicated word in ANSWER_VALIDITY_PROMPT 2024-03-09 16:14:39 -08:00
Yuhong Sun
db77d8d7cc
File connector metadata (#1203) 2024-03-09 16:13:37 -08:00
Dan Brown
fd5294ed82
Fix broken link when specified in metadata (#1200) 2024-03-09 12:49:15 -08:00
Yuhong Sun
3f1cd1ad12
Better description of the document index interfaces (#1188) 2024-03-06 00:07:12 -08:00
Chris Weaver
2ace03081c
More fetch_versioned_implementation logging (#1187)
---------

Co-authored-by: Kevin Shi <kevinshisvf@gmail.com>
2024-03-05 09:46:02 -08:00
Weves
7869f23e12 Improve slack flow 2024-03-04 19:22:46 -08:00
Kevin Shi
0b0665044f
@lru_cache on fetch_versioned_implementation (#1178) 2024-03-04 14:50:51 -08:00
Chris Weaver
a7c820147e
Add confluence rate limit handling (#1174) 2024-03-04 01:02:57 -08:00
Weves
a8cc3d5a07 Add ability to add starter messages 2024-03-03 14:23:34 -08:00
Yuhong Sun
81cb1ae399
Fix fail case when conf empty (#1163) 2024-03-02 18:10:37 -08:00
Yuhong Sun
f934e0a5ce
Fix Ollama (#1162) 2024-03-02 17:35:41 -08:00
Weves
0366f3313a Fix gen ai model correctness check frequency 2024-03-01 21:59:18 -08:00
Matthew Holland
ddc8640504 Skip indexing pages returning HTTP 4XX & 5XX codes 2024-02-29 16:54:26 -08:00
dependabot[bot]
5e7d740814 Bump aiohttp from 3.9.0rc0 to 3.9.2 in /backend/requirements
Bumps [aiohttp](https://github.com/aio-libs/aiohttp) from 3.9.0rc0 to 3.9.2.
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.9.0rc0...v3.9.2)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
2024-02-29 16:52:31 -08:00
Bijay Regmi
cfcc1db338 add back line 2024-02-29 16:44:41 -08:00
Bijay Regmi
05f0ed6414 fix #955 2024-02-29 16:44:41 -08:00
Weves
c65e862adc Add option to disable document cleanup 2024-02-29 16:33:03 -08:00
Weves
7b7561533f Fix early breakout causing us to not update ConnectorByCredentialPair 2024-02-29 13:54:37 -08:00
Weves
2331bf9b36 Add trace for db session creation 2024-02-29 13:54:11 -08:00
Yuhong Sun
31d3ae0e3e
Fix Slack Document Only Persona (#1150) 2024-02-29 13:53:37 -08:00
Weves
10cb4ab1d2 Revert "Trace sqla get_session"
This reverts commit d07345c5330605c17f4ba66b71b32e4384541f2f.
2024-02-29 13:41:28 -08:00
Kevin Shi
d07345c533 Trace sqla get_session 2024-02-29 13:33:04 -08:00
Yuhong Sun
c7d228e292
Trim Chunks if LLM tokenizer differs from Embedding tokenizer (#1143) 2024-02-28 13:01:32 -08:00
Weves
cd198ba368 mypy fixes 2024-02-27 16:02:24 -08:00