highperfocused/danswer
1
0
Fork 0
mirror of https://github.com/danswer-ai/danswer.git synced 2025-07-28 13:53:28 +02:00
Code Issues Packages Projects Releases Wiki Activity

figuring out why multiprocessing set_start_method isn't working.

Browse Source
This commit is contained in:
Richard Kuo (Danswer)
2025-01-09 16:29:37 -08:00
parent 439217317f
commit 962240031f
6 changed files with 15 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

6
backend/onyx/background/celery/apps/app_base.py
View File

@@ -1,5 +1,4 @@
import logging
import multiprocessing
import time
from typing import Any
@@ -163,7 +162,10 @@ def on_task_postrun(
def on_celeryd_init(sender: Any = None, conf: Any = None, **kwargs: Any) -> None:
"""The first signal sent on celery worker startup"""
multiprocessing.set_start_method("spawn") # fork is unsafe, set to spawn
# rkuo: commenting out as set_start_method seems to work here on macOS
# but not in the cloud and it is unclear why.
# logger.info(f"Multiprocessing start method - setting to spawn.")
# multiprocessing.set_start_method("spawn") # fork is unsafe, set to spawn
def wait_for_redis(sender: Any, **kwargs: Any) -> None: