1497 Commits

Author SHA1 Message Date
Weves
7874862902 Proper slack message batching 2023-07-06 21:33:33 -07:00
Dan Brown
019e474a4e
BookStack connector: Changed to use id-based document ids 2023-07-06 17:04:31 +01:00
Dan Brown
44f905ef80
Added BookStack connector code
Got to the point of working sync for shelves, books, chapters and pages.
2023-07-06 14:56:28 +01:00
Dan Brown
bfde5fd809
Got basic bookstack connector setup UI/backend working 2023-07-06 10:50:27 +01:00
Weves
07fd7246d4 Fix link 2023-07-03 17:37:03 -07:00
Weves
967f9294f7 Fix duplicated docs for non-quoted docs 2023-07-03 17:34:43 -07:00
Chris Weaver
10b36f4ce9
Slab connector UI (#130)
Also added in missing dateutil req
2023-07-03 15:57:22 -07:00
Yuhong Sun
675a5aec9e
DAN-158 Slab Connector (#129)
No support for comments or topics
2023-07-03 14:27:23 -07:00
Chris Weaver
2f54795631
Basic Slack Bot Support (#128) 2023-07-03 14:26:33 -07:00
Yuhong Sun
381b3719c9
DAN-139 web connector recursion (#126)
Now handled by checking final page after redirects
2023-07-02 19:01:13 -07:00
Weves
cb59e77278 Fix weird typesense search behavior 2023-06-29 18:02:28 -07:00
Weves
858b0582aa Fix slack message filtering 2023-06-29 17:54:47 -07:00
Yuhong Sun
03006743ab
DAN-118 Jira connector (#102)
* Small confluence page QoL changes

* Prevent getting into a bad state with orphan connectors for Jira / Confluence

* Jira connector + admin page
---------

Co-authored-by: Weves <chrisweaver101@gmail.com>
2023-06-24 18:48:38 -06:00
Yuhong Sun
3701239283
DAN-141 Confluence Poll Connector (#114) 2023-06-24 00:01:09 -07:00
Yuhong Sun
34861013f8
DAN-142 OpenAI key once a day (#113) 2023-06-24 00:00:43 -07:00
Yuhong Sun
2fb2c40851
DAN-145 Danswer save state (#115) 2023-06-24 00:00:06 -07:00
Yuhong Sun
4bddafe297
DAN-136 Fix incorrect num of github docs (#112) 2023-06-22 01:19:55 -07:00
Chris Weaver
5a04df7eb0
Fix typesense search when auth is on (#108) 2023-06-20 20:27:09 -07:00
Weves
620579cbec Fix connection pooling 2023-06-19 14:45:26 -06:00
Weves
490d39f081 Removing deprecated field 2023-06-19 14:45:26 -06:00
Yuhong Sun
02f79c3357
Enable typo search typesense (#101) 2023-06-15 22:46:43 -07:00
Yuhong Sun
6fe54a4eed
DAN-115 Document Polling (#91)
Includes updated document counting for polling
2023-06-15 21:07:05 -07:00
Yuhong Sun
590fbbc253
DAN-120 Kubernetes (#98)
Sample Kubernetes deployment with Auth default on
Also includes a bugfix for credentialed connectors with Auth turned on
2023-06-14 00:11:25 -07:00
Chris Weaver
8f5b9c0bcd
Danswer assistant (#96)
Add helper!
2023-06-11 17:54:41 -07:00
Yuhong Sun
2bfbf037ee
Set a minimum distance angle cutoff (#95) 2023-06-11 17:36:05 -07:00
Chris Weaver
f20563c9bc
File connector (#93)
* Initial backend changes for file connector

* Add another background job to clean up files

* UI + tweaks for backend
2023-06-09 21:28:50 -07:00
Yuhong Sun
f10ece4411
Danswer Helper QA Flow Backend (#90) 2023-06-09 17:48:17 -07:00
Weves
1facd58938 Fix bug with get_connector_indexing_status 2023-06-09 01:33:03 -07:00
Yuhong Sun
7c97cc4626
DAN-55 Intent Model (#89)
Includes:
- Intent Model
- Heuristic Classifications
- GPT self error classification
- Bugfix on finding end of answer stream
2023-06-07 15:27:06 -07:00
Chris Weaver
e0ebdc2fc1
Keyword search (#88)
* Add keyword search support

* Fix filters display

* Make documents appear immediately
2023-06-05 22:25:15 -07:00
Chris Weaver
711e66184e
Add Filters to UI (#86)
* Adding filters

* Fix get_connector_indexing_status endpoint bug
2023-06-05 00:41:48 -07:00
Yuhong Sun
c4e8afe4d2
DAN-81 Improve search round 2 (#82)
Includes:
- Multi vector indexing/search
- Ensemble model reranking
- Keyword Search backend
2023-06-04 20:02:32 -07:00
Chris Weaver
7cc64efc3a
Enable non-admin credentials + add page for google drive (#84)
* Enable non-admin credentials + add page for google drive

* Return one indexing status entry for each connector / credential pair

* Remove some logs

* Small fixes

* Sort index status by source
2023-06-04 11:26:50 -07:00
Yuhong Sun
8c9b3079aa
Delete conflicting records from IndexAttempt on upgrade/downgrade (#83) 2023-05-31 08:54:09 -07:00
Yuhong Sun
6891e4f198
Standardize connectors + permissioning + new frontend for admin pages + small fixes / improvements (#75)
Introducing permissioning, standardize onboarding for connectors, re-make the data model for connectors / credentials / index-attempts, making all environment variables optional, a bunch of small fixes + improvements.

Co-authored-by: Weves <chrisweaver101@gmail.com>
2023-05-30 19:59:57 -07:00
Weves
f4ef92e279 Fix OpenAI key validation 2023-05-22 13:42:20 -07:00
Yuhong Sun
8e9e284849
Fix Pull vs Poll naming (#77) 2023-05-22 11:29:50 -07:00
Chris Weaver
0c4dcb13c3
Small fix for indexing (#78) 2023-05-22 11:29:25 -07:00
Weves
806653dcb0 Add timeout option to OpenAI models 2023-05-21 14:31:15 -07:00
Yuhong Sun
62e86efec3
Update models.py 2023-05-21 14:10:23 -07:00
Yuhong Sun
6d7e7d5b71
DAN-19 Confluence Connector Backend for Public Docs (#73)
By public we mean if there is an admin account with an API key that has it setup in Danswer. Means just no support for OAuth for individual users to add docs.
2023-05-21 13:27:37 -07:00
Yuhong Sun
7559ba6e9d
DAN-93 Standardize Connectors (#70) 2023-05-21 13:24:25 -07:00
Weves
0b8c69ceeb Prompt user for OpenAI key 2023-05-20 21:11:07 -07:00
Weves
544ba8f50d initial health check 2023-05-20 12:21:56 -07:00
Yuhong Sun
16dd429826
DAN-91 Fix Web Connector Bugs (#68)
Added pdf support
2023-05-19 17:39:13 -07:00
Chris Weaver
0b46ea76e8
Don't create collection if it already exists + fix OpenAI API Key name (#66)
* Don't create collection if it already exists

* Fix openai api key name
2023-05-17 17:12:00 -07:00
Weves
8685beceb2 Add create collection to app startup 2023-05-17 16:16:09 -07:00
Weves
5f7d2853b8 Fix connectors 2023-05-16 22:45:32 -07:00
Chris Weaver
494514dc68
Quote loading UI + adding back period to end of answer + adding custom logo (#55)
* Logo

* Add spinners + some small housekeeping on the backend
2023-05-16 20:14:06 -07:00
Weves
821df50fa9 Make slack periodic use the DB 2023-05-16 17:56:15 -07:00