use native rate limiting in the confluence client (#2837)

* use native rate limiting in the confluence client

* upgrade urllib3 to v2.2.3 to support retries in confluence client

* improve logging so that progress is visible.
This commit is contained in:
rkuo-danswer
2024-10-18 11:15:43 -07:00
committed by GitHub
parent 59364aadd7
commit 5b78299880
5 changed files with 230 additions and 110 deletions

View File

@@ -20,6 +20,9 @@ def build_confluence_client(
username=credentials_json["confluence_username"] if is_cloud else None,
password=credentials_json["confluence_access_token"] if is_cloud else None,
token=credentials_json["confluence_access_token"] if not is_cloud else None,
backoff_and_retry=True,
max_backoff_retries=60,
max_backoff_seconds=60,
)