2101 Commits

Author SHA1 Message Date
rkuo-danswer
7f1e4a02bf
Feature/kill indexing ()
* checkpoint

* add celery termination of the task

* rename to RedisConnectorPermissionSyncPayload, add RedisLock to more places, add get_active_search_settings

* rename payload

* pretty sure these weren't named correctly

* testing in progress

* cleanup

* remove space

* merge fix

* three dots animation on Pausing

* improve messaging when connector is stopped or killed and animate buttons

---------

Co-authored-by: Richard Kuo <rkuo@rkuo.com>
2024-11-28 05:32:45 +00:00
rkuo-danswer
5be7d27285
use indexing flag in db for manually triggering indexing ()
* use indexing flag in db for manually trigger indexing

* add comment.

* only try to release the lock if we actually succeeded with the lock

* ensure we don't trigger manual indexing on anything but the primary search settings

* comment usage of primary search settings

* run check for indexing immediately after indexing triggers are set

* reorder fix
2024-11-28 01:34:34 +00:00
Weves
fd84b7a768 Remove duplicate API key router 2024-11-27 16:30:59 -08:00
Subash-Mohan
36941ae663 fix: Cannot configure API keys 2024-11-27 16:25:00 -08:00
Richard Kuo (Danswer)
eb8708f770 the word "error" might be throwing off sentry 2024-11-27 14:31:21 -08:00
Chris Weaver
ac448956e9
Add handling for rate limiting () 2024-11-27 14:22:15 -08:00
hagen-danswer
09d3e47c03
Perm sync behavior change ()
* Change external permissions behavior

* fixed behavior

* added error handling

* LLM the goat

* comment

* simplify

* fixed

* done

* limits increased

* added a ton of logging

* uhhhh
2024-11-27 20:04:15 +00:00
hagen-danswer
07dfde2209
add continue in danswer button to slack bot responses ()
* all done except routing

* fixed initial changes

* added backend endpoint for duplicating a chat session from Slack

* got chat duplication routing done

* got login routing working

* improved answer handling

* finished all checks

* finished all!

* made sure it works with google oauth

* dont remove that lol

* fixed weird thing

* bad comments
2024-11-27 18:25:38 +00:00
hagen-danswer
1f2f7d0ac2 Improved logging for confluence doc sync and robust user creation 2024-11-26 08:51:15 -08:00
rkuo-danswer
77cf9b3539
improve messaging and UI around cleanup of leftover index attempts ()
* improve messaging and UI around cleanup of leftover index attempts

* add tag on init
2024-11-25 22:27:14 +00:00
Weves
076ce2ebd0 Saml fix 2024-11-25 09:12:43 -08:00
Richard Kuo (Danswer)
c32b93fcc3 increase indexing worker concurrency to 3 2024-11-24 18:11:58 -08:00
pablodanswer
1c8476072e
Assistant cleanup ()
* minor cleanup

* ensure users don't modify built-in attributes of assistants

* update sidebar

* k

* update update flow + assistant creation
2024-11-25 00:13:34 +00:00
Chris Weaver
7573416ca1
Fix API keys for MIT users () 2024-11-24 16:55:19 -08:00
Yuhong Sun
86d8666481 Add Test Case 2024-11-24 15:42:14 -08:00
Yuhong Sun
8abcde91d4
Fix Test () 2024-11-24 14:31:28 -08:00
Yuhong Sun
3466451d51
Fix Prompt for Non Function Calling LLMs () 2024-11-24 14:16:57 -08:00
Yuhong Sun
413891f143
Token Level Log () 2024-11-23 18:41:50 -08:00
Yuhong Sun
a3439605a5
Remove Dead Code () 2024-11-23 14:31:59 -08:00
pablodanswer
694e79f5e1
minor enforcement of CSV length for internal processing () 2024-11-23 21:05:30 +00:00
Yuhong Sun
62a4aa10db
Refactor Search () 2024-11-23 13:42:54 -08:00
Yuhong Sun
a357cdc4c9
Remove Dead Code () 2024-11-23 13:21:27 -08:00
Yuhong Sun
84615abfdd
Seeding () 2024-11-23 13:12:42 -08:00
pablodanswer
8ae6b1960b
Bugfix/usage report ()
* fix pagination

* update side

* fixed query history

* minor update

* minor update

* typing
2024-11-23 20:11:39 +00:00
James Jordan
d9b87bbbc2
Fixed 400 error when author of ticket is no longer an active user in a Zendesk account. () 2024-11-23 12:15:38 -08:00
hagen-danswer
1e17934de4
Merge pull request from danswer-ai/fix-slack-ui
cleaned up new slack bot creation
2024-11-23 10:53:47 -08:00
rkuo-danswer
3a466a4b08
add minimal retries to confluence probe ()
* add minimal retries to confluence probe

* name variable correctly
2024-11-23 17:11:15 +00:00
hagen-danswer
85cbd9caed
Increased slim doc batch size for confluence connector () 2024-11-23 00:42:15 +00:00
hagen-danswer
3e58f9f8ab fixed ugly stuff 2024-11-22 14:39:55 -08:00
hagen-danswer
c6dadb24dc cleaned up new slack bot creation 2024-11-22 11:53:51 -08:00
hagen-danswer
5dc07d4178
Each section is now cleaned before being chunked ()
* Each section is now cleaned before being chunked

* k

---------

Co-authored-by: Yuhong Sun <yuhongsun96@gmail.com>
2024-11-22 19:06:19 +00:00
Chris Weaver
129c8f8faf
Add start/end date ability for query history as CSV endpoint () 2024-11-22 18:29:13 +00:00
rkuo-danswer
9819aa977a
implement double check pattern for error conditions ()
* Move unfenced check to check_for_indexing. implement a double check pattern for all indexing error checks

* improved commenting

* exclusions
2024-11-22 04:21:02 +00:00
pablodanswer
682319d2e9
Bugfix/curator interface ()
* mystery solved

* update config

* update

* update

* update user role

* remove values
2024-11-22 02:33:09 +00:00
hagen-danswer
fe1400aa36
replace deprecated confluence group api endpoint ()
* replace deprecated confluence group api endpoint

* reworked it

* properly escaped the user query

* less passing around is_cloud

* done
2024-11-22 01:51:29 +00:00
rkuo-danswer
5eddc89b5a
merge indexing and heartbeat callbacks (and associated lock reacquisi… ()
* merge indexing and heartbeat callbacks (and associated lock reacquisition). no db updates

* review fixes
2024-11-21 23:48:58 +00:00
hagen-danswer
9a492ceb6d
admins cant be set as curator on backend ()
* set-curator

* updated error
2024-11-21 23:33:29 +00:00
rkuo-danswer
3c54ae9de9
Bugfix/redis wait ()
* rename to payload

* log redis info replication on primary worker startup

* fix mypy

---------

Co-authored-by: Richard Kuo <rkuo@rkuo.com>
2024-11-21 23:11:00 +00:00
pablodanswer
bd9f15854f
provider fix ()
* clean horizontal scrollbar

* provider fix

* ensure proper migration

* k

* update migration

* Revert "clean horizontal scrollbar"

This reverts commit fa592a1b7a69897110a928a222b19eaef3b7267a.
2024-11-21 22:08:16 +00:00
pablodanswer
deee237c7e
Sheet update ()
* quick pass

* k

* update sheet

* add multiple sheet stuff

* k

* finalized

* update configuration
2024-11-21 18:07:00 +00:00
hagen-danswer
100b4a0d16
Added Slim connector for Jira ()
* Added Slim connector for Jira

* fixed testing

* more cleanup of Jira connector

* cleanup
2024-11-21 17:00:20 +00:00
hagen-danswer
049091eb01
decreased confluence retry times and added more logging ()
* decreased confluence retry times and added more logging

* added check on connector startup

* no retries!

* fr no retries
2024-11-21 00:00:14 +00:00
pablodanswer
194dcb593d
update slack redirect + token missing check ()
* update slack redirect + token missing check

* reset time
2024-11-20 21:42:54 +00:00
pablodanswer
bf291d0c0a
Fix missing json ()
* initial steps

* k

* remove logs

* k

* k
2024-11-20 21:24:43 +00:00
rkuo-danswer
8309f4a802
test overlapping connectors (but using a source that is way too big a… ()
* test overlapping connectors (but using a source that is way too big and slow, fix that next)

* pass thru secrets

* rename

* rename again

* now we are fixing it

---------

Co-authored-by: Richard Kuo <rkuo@rkuo.com>
2024-11-20 21:12:01 +00:00
hagen-danswer
e89dcd7f84
added logging and bugfixing to conf ()
* standardized escaping of CQL strings

* think i found it

* fix

* should be fixed

* added handling for special linking behavior in confluence

* Update onyx_confluence.py

* Update onyx_confluence.py

---------

Co-authored-by: rkuo-danswer <rkuo@danswer.ai>
2024-11-20 18:40:21 +00:00
hagen-danswer
9209fc804b
multiple slackbot support ()
* multiple slackbot support

* app_id + tenant_id key

* removed kv store stuff

* fixed up mypy and migration

* got frontend working for multiple slack bots

* some frontend stuff

* alembic fix

* might be valid

* refactor dun

* alembic stuff

* temp frontend stuff

* alembic stuff

* maybe fixed alembic

* maybe dis fix

* im getting mad

* api names changed

* tested

* almost done

* done

* routing nonsense

* done!

* done!!

* fr done

* doneski

* fix alembic migration

* getting mad again

* PLEASE IM BEGGING YOU
2024-11-20 01:49:43 +00:00
Richard Kuo (Danswer)
e6df32dcc3 improve logging around pruning 2024-11-19 12:41:21 -08:00
hagen-danswer
487ef4acc0
Merge pull request from danswer-ai/add-to-admin-chat-sessions-api
Extend query history API
2024-11-19 07:28:12 -08:00
Weves
ce3124f9e4 Extend query history API 2024-11-18 17:50:21 -08:00