highperfocused/danswer
1
0
Fork 0
mirror of https://github.com/danswer-ai/danswer.git synced 2025-07-12 14:12:53 +02:00
Code Issues Packages Projects Releases Wiki Activity

figuring out why multiprocessing set_start_method isn't working.

Browse Source
This commit is contained in:
Richard Kuo (Danswer)
2025-01-09 16:29:37 -08:00
parent 439217317f
commit 962240031f
6 changed files with 15 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
backend/onyx/background/celery/tasks/indexing/tasks.py
View File

@ -1,3 +1,4 @@
import multiprocessing
import os
import sys
import time
@ -853,11 +854,14 @@ def connector_indexing_proxy_task(
search_settings_id: int,
tenant_id: str | None,
) -> None:
"""celery tasks are forked, but forking is unstable. This proxies work to a spawned task."""
"""celery tasks are forked, but forking is unstable.
This is a thread that proxies work to a spawned task."""
task_logger.info(
f"Indexing watchdog - starting: attempt={index_attempt_id} "
f"cc_pair={cc_pair_id} "
f"search_settings={search_settings_id}"
f"search_settings={search_settings_id} "
f"multiprocessing={multiprocessing.get_start_method()}"
)
if not self.request.id: