highperfocused/danswer
1
0
Fork 0
mirror of https://github.com/danswer-ai/danswer.git synced 2025-03-18 22:01:55 +01:00
Code Issues Packages Projects Releases Wiki Activity
718 Commits 716 Branches 850 Tags
Commit Graph

52 Commits

Author SHA1 Message Date
Yuhong Sun
fcb7f6fcc0
Accept files with character issues (#781) 2023-11-28 22:43:58 -08:00
Yuhong Sun
05c2b7d34e
Update LLM related Libs (#771) 2023-11-26 19:54:16 -08:00
Chris Weaver
b258ec1bed
Adjust checks for removal from existing_jobs dict + add more logging + only one scheduled job for a connector at a time (#739) 2023-11-19 02:03:17 -08:00
Yuhong Sun
31bfd015ae
Request Tracker Connector (#709) 
Contributed by Evan! Thanks for the contribution!

- Minor linting and rebasing done by Yuhong, everything else from Evan

---------

Co-authored-by: Evan Sarmiento <e.sarmiento@soax.com>
Co-authored-by: Evan <esarmien@fas.harvard.edu>
 2023-11-07 16:55:10 -08:00
Yuhong Sun
7433dddac3
Model Server (#695) 
Provides the ability to pull out the NLP models into a separate model server which can then be hosted on a GPU instance if desired.
 2023-11-06 16:36:09 -08:00
dependabot[bot]
2db029672b
Bump pypdf from 3.16.4 to 3.17.0 in /backend/requirements (#667) 
Bumps [pypdf](https://github.com/py-pdf/pypdf) from 3.16.4 to 3.17.0.
- [Release notes](https://github.com/py-pdf/pypdf/releases)
- [Changelog](https://github.com/py-pdf/pypdf/blob/main/CHANGELOG.md)
- [Commits](https://github.com/py-pdf/pypdf/compare/3.16.4...3.17.0)

---
updated-dependencies:
- dependency-name: pypdf
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-11-03 18:54:29 -07:00
Bryan Peterson
44e3dcb19f
support for zendesk help center (#661) 2023-11-01 21:11:56 -07:00
Yuhong Sun
fbf7c642a3
Reworking the LLM layer (#666) 2023-10-31 18:22:42 -07:00
Yuhong Sun
947d4d0a2e
Pin Litellm Version (#665) 2023-10-31 12:09:39 -07:00
dependabot[bot]
d7a90aeb2b
Bump langchain from 0.0.312 to 0.0.325 in /backend/requirements (#658) 
Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.0.312 to 0.0.325.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/compare/v0.0.312...v0.0.325)

---
updated-dependencies:
- dependency-name: langchain
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-10-31 12:05:55 -07:00
Yuhong Sun
e279918f95
Introduce Time Filters (#610) 2023-10-22 15:06:52 -07:00
dependabot[bot]
4ffbdbb8b0
Bump langchain from 0.0.308 to 0.0.312 in /backend/requirements (#551) 
Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.0.308 to 0.0.312.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/compare/v0.0.308...v0.0.312)

---
updated-dependencies:
- dependency-name: langchain
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-10-19 17:11:42 -07:00
Yuhong Sun
2037e11495
Replace PyPDF2 with pypdf (#595) 2023-10-19 16:12:31 -07:00
Weves
ca74884bd7 Pin pytorch version to fix segmentation fault in Docker 2023-10-08 16:11:53 -07:00
dependabot[bot]
21aa233170
Bump langchain from 0.0.273 to 0.0.308 in /backend/requirements (#516) 
Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.0.273 to 0.0.308.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/compare/v0.0.273...v0.0.308)

---
updated-dependencies:
- dependency-name: langchain
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2023-10-07 17:18:51 -07:00
nlp8899
c666f35cd0
create a hubspot connector (#482) 2023-10-02 10:13:23 -07:00
Yuhong Sun
6b305c56b3
Use Sentence Aware Splitter (#452) 2023-09-16 16:28:16 -07:00
Yuhong Sun
e549d2bb4a
Chat with Context Backend (#441) 2023-09-15 12:17:05 -07:00
Weves
c4e0face9b Move connector / credential pair deletion to celery 2023-09-14 16:23:13 -07:00
Yuhong Sun
b5fc2a5775
Regression Test (#434) 2023-09-11 19:06:01 -07:00
Yuhong Sun
c28f4d4527
Remove py library due to denial of service CVE (#391) 2023-09-03 16:36:13 -07:00
Yuhong Sun
4aebb69883
Upgrade packages for security reasons (#384) 2023-09-01 20:35:48 -07:00
Patrick Decat
0a7775860c
feat(dev): use ruff for python linting (#355) 2023-08-31 15:29:59 -07:00
Yuhong Sun
856061c7ea
Fix ReDoS and Directory Traversal (#352) 
Co-authored-by: Weves <chrisweaver101@gmail.com>
 2023-08-29 21:20:15 -07:00
Weves
4469447fde Add LangChain-based LLM 2023-08-26 21:57:15 -07:00
Weves
a2d3a3f116 Fix image build by pinning safetensors version 2023-08-23 22:23:45 -07:00
Chris Weaver
e307275774
Add support for multiple indexing workers (#322) 2023-08-22 18:11:31 -07:00
Michał Flak
286445f9ba
Zulip connector (#247) 
Co-authored-by: Yuhong Sun <yuhongsun96@gmail.com>
 2023-08-14 15:29:34 -07:00
Yuhong Sun
3bfc72484d
Support for Request accessed GenAI Models (#270) 2023-08-06 18:31:47 -07:00
Pratik Kabra
0e667d3384
Huggingface Inference backend internal models (#265) 2023-08-05 11:33:19 -07:00
Yuhong Sun
17e2008027
Add TODOs and minor style changes to web connector (#254) 2023-07-29 12:35:38 -07:00
Yuhong Sun
2a339ec34b
Prevent too many tokens to GPT (#245) 2023-07-28 16:00:26 -07:00
Yuhong Sun
273802eff0
Disable Gpt4all due to mac not supporting it currently (#233) 2023-07-25 22:19:15 -07:00
Sid Ravinutala
d6d3d5291b added docx2txt 2023-07-24 01:42:39 +00:00
Yuhong Sun
d6ca865034
Support GPT4All in memory (#230) 2023-07-23 12:26:14 -07:00
Chris Weaver
b4759403ac
Adjust slack bot (#144) 
* Add handling for cases where an answer is not found

* Make danswer bot slightly more configurable

* Don't respond to messages in thread + add better formatting for slack messages
 2023-07-07 09:56:01 -07:00
Chris Weaver
10b36f4ce9
Slab connector UI (#130) 
Also added in missing dateutil req
 2023-07-03 15:57:22 -07:00
Yuhong Sun
675a5aec9e
DAN-158 Slab Connector (#129) 
No support for comments or topics
 2023-07-03 14:27:23 -07:00
Yuhong Sun
03006743ab
DAN-118 Jira connector (#102) 
* Small confluence page QoL changes

* Prevent getting into a bad state with orphan connectors for Jira / Confluence

* Jira connector + admin page
---------

Co-authored-by: Weves <chrisweaver101@gmail.com>
 2023-06-24 18:48:38 -06:00
Yuhong Sun
6fe54a4eed
DAN-115 Document Polling (#91) 
Includes updated document counting for polling
 2023-06-15 21:07:05 -07:00
Chris Weaver
f20563c9bc
File connector (#93) 
* Initial backend changes for file connector

* Add another background job to clean up files

* UI + tweaks for backend
 2023-06-09 21:28:50 -07:00
Yuhong Sun
7c97cc4626
DAN-55 Intent Model (#89) 
Includes:
- Intent Model
- Heuristic Classifications
- GPT self error classification
- Bugfix on finding end of answer stream
 2023-06-07 15:27:06 -07:00
Yuhong Sun
c4e8afe4d2
DAN-81 Improve search round 2 (#82) 
Includes:
- Multi vector indexing/search
- Ensemble model reranking
- Keyword Search backend
 2023-06-04 20:02:32 -07:00
Yuhong Sun
6d7e7d5b71
DAN-19 Confluence Connector Backend for Public Docs (#73) 
By public we mean if there is an admin account with an API key that has it setup in Danswer. Means just no support for OAuth for individual users to add docs.
 2023-05-21 13:27:37 -07:00
Chris Weaver
da8031c1aa
Fix sync DB engine (#32) 2023-05-11 22:49:44 -07:00
Yuhong Sun
0b610502e0
DAN-54 Github PR Connector (#29) 
also fixed some mypy stuff as well
 2023-05-11 18:47:32 -07:00
Yuhong Sun
e20179048d
DAN-5 OAuth Backend (#17) 
Also added in an exception handler for logging
 2023-05-06 23:47:21 -07:00
Yuhong Sun
63f93594a3
DAN-3 Authentication and User Registration (#12) 
also added mypy.ini
 2023-05-05 17:25:24 -07:00
Chris Weaver
e2a949ebaf
Setup Postgres to docker compose + add web indexing APIs + update background runner to look for web indices to run (#13) 
* Adding Postgres to docker compose

* Model / migrations for indexing logs
 2023-05-05 13:08:32 -07:00
Yuhong Sun
22b7f7e89f
DAN-26 Enable GPT 4 through chat completion endpoint (#10) 
Also touched up front page README which had a typo
 2023-05-02 12:08:44 -07:00