highperfocused/danswer
1
0
Fork 0
mirror of https://github.com/danswer-ai/danswer.git synced 2025-09-27 20:38:32 +02:00
Code Issues Packages Projects Releases Wiki Activity

Fix issue with web connector for pages not ending with / (#176)

Browse Source
This commit is contained in:
Chris Weaver
2023-07-13 22:30:10 -07:00
committed by GitHub
parent c6bcd5e1aa
commit 33463b45e8
1 changed files with 0 additions and 2 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
backend/danswer/connectors/web/connector.py
View File

@@ -42,8 +42,6 @@ def get_internal_links(
if not is_valid_url(href):
# Relative path handling
if url[-1] != "/":
url += "/"
href = urljoin(url, href)
if urlparse(href).netloc == urlparse(url).netloc and base_url in href: