30 Commits

Author SHA1 Message Date
Yuhong Sun
e90c66c1b6
Include Titles in Chunks (#1817) 2024-07-12 09:42:24 -07:00
Yuhong Sun
08c6e821e7
Merge Sections Logic (#1801) 2024-07-10 20:14:02 -07:00
pablodanswer
09a11b5e1a
Fix citations + unit tests (#1760) 2024-07-10 10:05:20 -07:00
Weves
97d058b8b2 Fix mypy for mediawiki tests 2024-05-25 17:16:47 -07:00
Andrew Sansom
94018e83b0
Add MediaWiki and Wikipedia Connectors (#1250)
* Add MediaWikiConnector first draft

* Add MediaWikiConnector first draft

* Add MediaWikiConnector first draft

* Add MediaWikiConnector sections for each document

* Add MediaWikiConnector to constants and factory

* Integrate MediaWikiConnector with connectors page

* Unit tests + bug fixes

* Allow adding multiple mediawikiconnectors

* add wikipedia connector

* add wikipedia connector to factory

* improve docstrings of mediawiki connector backend

* improve docstrings of mediawiki connector backend

* move wikipedia and mediawiki icon locations in admin page

* undo accidental commit of modified docker compose yaml
2024-05-24 08:51:20 -07:00
Yuhong Sun
546815dc8c
Consolidate File Processing (#1449) 2024-05-11 23:11:22 -07:00
Yuhong Sun
a17060af5a
Provide Additional Context for Chunk Options in APIs (#1330) 2024-04-14 18:32:22 -07:00
Weves
f135ba9c0c Rework LLM answering flow 2024-03-25 13:34:03 -07:00
Itay
a4053501d0
CI: adding prettier to pre-commit (#1009) 2024-01-28 13:03:39 -08:00
Itay
0ce992e22e
CI: Run Python tests (#1001) 2024-01-28 12:59:51 -08:00
Jeremi Joslin
d07647c597
Fix typo in gmail test connector (#981) 2024-01-24 12:01:26 -08:00
Itay
692fdb4597
Gmail Connector (#946)
---------

Co-authored-by: Yuhong Sun <yuhongsun96@gmail.com>
2024-01-22 16:25:10 -08:00
Yuhong Sun
65fde8f1b3
Chat Backend (#801) 2023-12-14 22:14:37 -08:00
Weves
08909b40b0 Add rate limiting wrapper + add to Document360 2023-10-29 18:00:17 -07:00
Yuhong Sun
fe117513b0
Reorganize and Cleanup for Hybrid Search (#643) 2023-10-28 14:24:28 -07:00
Weves
3554e29b8d Add updated_at to UI + add time range selector 2023-10-23 23:32:16 -07:00
Yuhong Sun
6a449f1fb1
Introduce Recency Bias (#592) 2023-10-19 12:54:35 -07:00
Chris Weaver
1bd76f528f
Document explorer admin page (#590) 2023-10-18 18:41:39 -07:00
Yuhong Sun
a5d2759fbc
Recreate Tables from HTML (#588) 2023-10-18 11:16:40 -07:00
Yuhong Sun
595f61ea3a
Add Retrieval to Chat History (#577) 2023-10-15 13:40:07 -07:00
Yuhong Sun
6b305c56b3
Use Sentence Aware Splitter (#452) 2023-09-16 16:28:16 -07:00
Weves
cf2bd8a40c highlighting 2023-09-12 11:35:37 -07:00
Yuhong Sun
ec4d0b856c
Added boost to rerank step (#360) 2023-08-30 23:12:55 -07:00
Yuhong Sun
2a339ec34b
Prevent too many tokens to GPT (#245) 2023-07-28 16:00:26 -07:00
Yuhong Sun
d6ca865034
Support GPT4All in memory (#230) 2023-07-23 12:26:14 -07:00
Yuhong Sun
e4820045f9
Add metadata to GPT (#140) 2023-07-14 16:54:42 -07:00
Chris Weaver
2f54795631
Basic Slack Bot Support (#128) 2023-07-03 14:26:33 -07:00
Yuhong Sun
6d1b750077
DAN-59 Fix all the mypy issues (#38) 2023-05-12 20:37:52 -07:00
Chris Weaver
e390906ac1
Make Document source required (#4) 2023-04-29 16:49:27 -07:00
Yuhong Sun
402b89b6ec Initial Commit 2023-04-28 22:40:46 -07:00