highperfocused/danswer
1
0
Fork 0
mirror of https://github.com/danswer-ai/danswer.git synced 2025-07-04 19:50:57 +02:00
Code Issues Packages Projects Releases Wiki Activity

doc sync celery refactor (#3084)

Browse Source 
* doc_sync is refactored

* maybe this works

* tested to work!

* mypy fixes

* enabled integration tests

* fixed the test

* added external group sync

* testing should work now

* mypy

* confluence doc id fix

* got group sync working

* addressed feedback

* renamed some vars and fixed mypy

* conf fix?

* added wiki handling to confluence connector

* test fixes

* revert google drive connector

* fixed groups

* hotfix
This commit is contained in:
hagen-danswer
2024-11-12 15:57:14 -08:00
committed by GitHub
parent 021d0cf314
commit fdc4811fce
55 changed files with 1645 additions and 618 deletions
Download Patch File Download Diff File Expand all files Collapse all files

4
backend/scripts/dev_run_background_jobs.py
View File

@ -42,7 +42,7 @@ def run_jobs() -> None:
"--loglevel=INFO",
"--hostname=light@%n",
"-Q",
"vespa_metadata_sync,connector_deletion",
"vespa_metadata_sync,connector_deletion,doc_permissions_upsert",
]
cmd_worker_heavy = [
@ -56,7 +56,7 @@ def run_jobs() -> None:
"--loglevel=INFO",
"--hostname=heavy@%n",
"-Q",
"connector_pruning",
"connector_pruning,connector_doc_permissions_sync,connector_external_group_sync",
]
cmd_worker_indexing = [