highperfocused/danswer
1
0
Fork 0
mirror of https://github.com/danswer-ai/danswer.git synced 2025-10-09 20:55:06 +02:00
Code Issues Packages Projects Releases Wiki Activity

Add Llama2 Prompt Option (#1254)

Browse Source
This commit is contained in:
Yuhong Sun
2024-03-24 19:01:38 -07:00
committed by GitHub
parent b28b3cfa37
commit d3674b02e6
1 changed files with 30 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

34
backend/danswer/prompts/chat_prompts.py
View File

@@ -48,17 +48,43 @@ CHAT_USER_CONTEXT_FREE_PROMPT = f"""
# consider doing COT for this and keep it brief, but likely only small gains. # consider doing COT for this and keep it brief, but likely only small gains.
SKIP_SEARCH = "Skip Search" SKIP_SEARCH = "Skip Search"
YES_SEARCH = "Yes Search" YES_SEARCH = "Yes Search"
AGGRESSIVE_SEARCH_TEMPLATE = f""" AGGRESSIVE_SEARCH_TEMPLATE = f"""
You are an expert of a critical system. Given the conversation history and a follow up query, determine if the system should call \ Given the conversation history and a follow up query, determine if the system should call \
an external search tool to better answer the latest user input. an external search tool to better answer the latest user input.
Your default response is {YES_SEARCH}.
Respond "{SKIP_SEARCH}" if either:
- There is sufficient information in chat history to FULLY and ACCURATELY answer the query AND \
additional information or details would provide little or no value.
- The query is some form of request that does not require additional information to handle.
Conversation History:
{GENERAL_SEP_PAT}
{{chat_history}}
{GENERAL_SEP_PAT}
If you are at all unsure, respond with {YES_SEARCH}.
Respond with EXACTLY and ONLY "{YES_SEARCH}" or "{SKIP_SEARCH}"
Follow Up Input:
{{final_query}}
""".strip()
# TODO, templatize this so users don't need to make code changes to use this
AGGRESSIVE_SEARCH_TEMPLATE_LLAMA2 = f"""
You are an expert of a critical system. Given the conversation history and a follow up query, \
determine if the system should call an external search tool to better answer the latest user input.
Your default response is {YES_SEARCH}. Your default response is {YES_SEARCH}.
If you are even slightly unsure, respond with {YES_SEARCH}. If you are even slightly unsure, respond with {YES_SEARCH}.
Respond "{SKIP_SEARCH}" if either: Respond "{SKIP_SEARCH}" if any of these are true:
- There is sufficient information in chat history to FULLY and ACCURATELY answer the query - There is sufficient information in chat history to FULLY and ACCURATELY answer the query.
- The query is some form of request that does not require additional information to handle. - The query is some form of request that does not require additional information to handle.
- You are 100% absolutely sure about the question and there is no ambiguity in the answer or question. - You are absolutely sure about the question and there is no ambiguity in the answer or question.
Conversation History: Conversation History:
{GENERAL_SEP_PAT} {GENERAL_SEP_PAT}
{{chat_history}} {{chat_history}}