234 Commits

Author SHA1 Message Date
jabdoa2
63780113d3
Add support for openid connect (#206)
This allow using Danswer in typical (non-google) enterprise environments.

* Access Tokens can be very large. A token without claims is already 1100 bytes for me (larger than allowed in danswer by default). With roles I got a 12kB token. For that reason I changed the field to TEXT in the database.
* Danswer used to swallow most errors when OIDC would fail. Nodejs forwards a request to the backend and swallows all errors. Even within the backend we catched all ValueErrors and only returned the last exception with the request. Added full stack trace logging to allow debugging issues with userinfo and other endpoints.
* Allow changing name of the login provider on the login button.
* Changed variables and URLs to generic OAUTH_XX (without google in the name) but kept compatibility with the existing google integration
* Tested again Keycloak with OpenID Connect

Next steps:
* Claim to role mappings
* Auto login/SSO (Login button is just an extra click)
2023-07-29 14:04:32 -07:00
Weves
d53ce3bda1 Fix arg to GuruIcon 2023-07-28 14:37:43 -07:00
Yuhong Sun
d03ac44744
Guru Connector (#177)
Co-authored-by: Weves <chrisweaver101@gmail.com>
2023-07-28 14:27:02 -07:00
Weves
555f8bbf08 Allow shared files for drive connector 2023-07-27 17:20:34 -07:00
Chris Weaver
3b546ba1c3
Make Google Drive connectors editable (#237) 2023-07-26 22:20:12 -07:00
Weves
d5f172c292 Handle google drive connectors without folder_path 2023-07-26 12:15:06 -07:00
Weves
6684f1e5d5 Use approved icon colors 2023-07-22 19:22:05 -07:00
Chris Weaver
dd084d40f6
Product board connector (#228)
Also fixes misc mypy issues across the repo
2023-07-22 13:00:51 -07:00
Yuhong Sun
25a028c4a7
Merge pull request #195 from pkabra/notion-connector
Notion connector
2023-07-21 00:04:12 -07:00
Pratik Kabra
610fe6ebc4 Prettier fixes for web 2023-07-20 18:02:41 -05:00
Weves
ab37b8e8ea Fix deletion of web/slack/jira/confluence/... connector when creating a new one 2023-07-18 12:06:49 -07:00
Pratik Kabra
2a42d2df9c Notion connector frontend 2023-07-17 20:06:43 -05:00
Chris Weaver
3b1a8274a9
Allow specification of specific google drive folders to index (#197) 2023-07-17 14:51:16 -07:00
Chris Weaver
676538da61
Better error message on GPT failures (#187)
* Better error message on GPT-call failures

* Add support for disabling Generative AI
2023-07-16 16:25:33 -07:00
Weves
d1003b913b Sync package-lock.json with package.json 2023-07-16 15:19:03 -07:00
Chris Weaver
9252807a51
Specify specific prettier version (#186)
* Add explicit prettier version

* Update CONTRIBUTING.md

* Add .prettierrc.json file to ensure we always use es5 trailing commas
2023-07-16 12:52:28 -07:00
Ikko Eltociear Ashimine
741bf508ac
Fix typo in GoogleDriveCard.tsx
recieved -> received
2023-07-13 00:40:02 +09:00
Chris Weaver
3889e01d86
Control streaming vs non-streaming on frontend with env variable (#162) 2023-07-12 01:12:42 -07:00
Chris Weaver
d135bc7efa
Merge pull request #139 from ssddanbrown/bookstack_connector
BookStack connector
2023-07-08 17:18:59 -07:00
Weves
3b64d62896 Make the Google Drive connector pull rather than pull everything 2023-07-08 13:26:47 -07:00
Weves
e55c23ad6f Make slab token a PW input 2023-07-08 12:40:16 -07:00
Weves
6978573a07 Make confluence connector use polling 2023-07-06 20:24:09 -07:00
Dan Brown
148d9c358f
Fixed incorrect active panel in BookStack connector 2023-07-06 17:24:04 +01:00
Dan Brown
104a248b11
Cleaned up bookstack connector admin panel
Also fixed ESLint issues
2023-07-06 16:35:21 +01:00
Dan Brown
f587161577
Added bookstack to filters, changed inputType 2023-07-06 16:02:53 +01:00
Dan Brown
44f905ef80
Added BookStack connector code
Got to the point of working sync for shelves, books, chapters and pages.
2023-07-06 14:56:28 +01:00
Dan Brown
bfde5fd809
Got basic bookstack connector setup UI/backend working 2023-07-06 10:50:27 +01:00
Weves
7f222f376d Fix Jira connector page description 2023-07-04 14:15:38 -07:00
Weves
eb5eb003e2 Add slab filter 2023-07-03 16:50:59 -07:00
Chris Weaver
10b36f4ce9
Slab connector UI (#130)
Also added in missing dateutil req
2023-07-03 15:57:22 -07:00
Weves
af329d31fb Cancelling searches when submitting a new one, no longer truncating at 7 docs, showing a warning message when no quotes are found 2023-06-30 10:10:54 -07:00
Weves
8f2f63bbec Update semver 2023-06-28 08:43:40 -07:00
Yuhong Sun
03006743ab
DAN-118 Jira connector (#102)
* Small confluence page QoL changes

* Prevent getting into a bad state with orphan connectors for Jira / Confluence

* Jira connector + admin page
---------

Co-authored-by: Weves <chrisweaver101@gmail.com>
2023-06-24 18:48:38 -06:00
Weves
0cd18947ec fix form refresh 2023-06-22 00:39:36 -06:00
Chris Weaver
785d289c68
Fix handling for QA when documents are split into multiple mini-chunks (#110) 2023-06-21 22:46:04 -06:00
Weves
3863ee3ce1 Force users to provide access token before creating connector for Github/Confluence 2023-06-19 12:31:12 -06:00
Weves
1d9a9a60c8 Fix bug with revoking of credentials + adding new credential + adding back connector for google drive 2023-06-19 12:31:12 -06:00
Weves
15543feac1 Fix missing sources when auth is on 2023-06-19 09:31:16 -06:00
Weves
329d0640eb Fix page crash when backend is down 2023-06-13 23:28:28 -07:00
Yuhong Sun
df79214fd6 fixed 2023-06-13 14:00:47 -07:00
Chris Weaver
b4f340b8bd
Adding more details to file connector description (#97)
* Adding more details to file connector description
2023-06-12 00:53:19 -07:00
Chris Weaver
8f5b9c0bcd
Danswer assistant (#96)
Add helper!
2023-06-11 17:54:41 -07:00
Chris Weaver
f20563c9bc
File connector (#93)
* Initial backend changes for file connector

* Add another background job to clean up files

* UI + tweaks for backend
2023-06-09 21:28:50 -07:00
Yuhong Sun
f10ece4411
Danswer Helper QA Flow Backend (#90) 2023-06-09 17:48:17 -07:00
Chris Weaver
e0ebdc2fc1
Keyword search (#88)
* Add keyword search support

* Fix filters display

* Make documents appear immediately
2023-06-05 22:25:15 -07:00
Chris Weaver
e202aa440e
Make filters only display in-use connectors (#87) 2023-06-05 22:13:36 -07:00
Chris Weaver
711e66184e
Add Filters to UI (#86)
* Adding filters

* Fix get_connector_indexing_status endpoint bug
2023-06-05 00:41:48 -07:00
Yuhong Sun
c4e8afe4d2
DAN-81 Improve search round 2 (#82)
Includes:
- Multi vector indexing/search
- Ensemble model reranking
- Keyword Search backend
2023-06-04 20:02:32 -07:00
Chris Weaver
7cc64efc3a
Enable non-admin credentials + add page for google drive (#84)
* Enable non-admin credentials + add page for google drive

* Return one indexing status entry for each connector / credential pair

* Remove some logs

* Small fixes

* Sort index status by source
2023-06-04 11:26:50 -07:00
Yuhong Sun
6891e4f198
Standardize connectors + permissioning + new frontend for admin pages + small fixes / improvements (#75)
Introducing permissioning, standardize onboarding for connectors, re-make the data model for connectors / credentials / index-attempts, making all environment variables optional, a bunch of small fixes + improvements.

Co-authored-by: Weves <chrisweaver101@gmail.com>
2023-05-30 19:59:57 -07:00