62 Commits

Author SHA1 Message Date
Itay
692fdb4597
Gmail Connector ()
---------

Co-authored-by: Yuhong Sun <yuhongsun96@gmail.com>
2024-01-22 16:25:10 -08:00
Rutik Thakre
1670d923aa
Gitlab Connector () 2024-01-18 15:43:17 -08:00
dependabot[bot]
4ff3bee605
Bump pycryptodome from 3.19.0 to 3.19.1 in /backend/requirements ()
Bumps [pycryptodome](https://github.com/Legrandin/pycryptodome) from 3.19.0 to 3.19.1.
- [Release notes](https://github.com/Legrandin/pycryptodome/releases)
- [Changelog](https://github.com/Legrandin/pycryptodome/blob/master/Changelog.rst)
- [Commits](https://github.com/Legrandin/pycryptodome/compare/v3.19.0...v3.19.1)

---
updated-dependencies:
- dependency-name: pycryptodome
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-01-13 15:42:37 -08:00
Weves
1b6eb0a52f Add API Key table 2024-01-12 17:48:25 -08:00
Yuhong Sun
13c536c033
Final Backend CVEs () 2023-12-30 11:57:49 -08:00
Yuhong Sun
aa67768c79
CVEs continued () 2023-12-29 20:42:16 -08:00
Yuhong Sun
4aebf824d2
Fix broken build SHA issue () 2023-12-26 14:36:40 -08:00
Weves
95bf1c13ad Add http2 dependency 2023-12-24 14:49:31 -08:00
Yuhong Sun
ff014e4f5a
Bump Transformer Version () 2023-12-22 01:47:18 -08:00
mattboret
c6f354fd03
Add the latest document update to the Slack bot answer ()
* Add the latest source update to the Slack bot answer

* fix mypy errors

---------

Co-authored-by: Matthieu Boret <matthieu.boret@fr.clara.net>
2023-12-21 18:16:05 -08:00
Yuhong Sun
fcb7f6fcc0
Accept files with character issues () 2023-11-28 22:43:58 -08:00
Yuhong Sun
05c2b7d34e
Update LLM related Libs () 2023-11-26 19:54:16 -08:00
Chris Weaver
b258ec1bed
Adjust checks for removal from existing_jobs dict + add more logging + only one scheduled job for a connector at a time () 2023-11-19 02:03:17 -08:00
Yuhong Sun
31bfd015ae
Request Tracker Connector ()
Contributed by Evan! Thanks for the contribution!

- Minor linting and rebasing done by Yuhong, everything else from Evan

---------

Co-authored-by: Evan Sarmiento <e.sarmiento@soax.com>
Co-authored-by: Evan <esarmien@fas.harvard.edu>
2023-11-07 16:55:10 -08:00
Yuhong Sun
7433dddac3
Model Server ()
Provides the ability to pull out the NLP models into a separate model server which can then be hosted on a GPU instance if desired.
2023-11-06 16:36:09 -08:00
dependabot[bot]
2db029672b
Bump pypdf from 3.16.4 to 3.17.0 in /backend/requirements ()
Bumps [pypdf](https://github.com/py-pdf/pypdf) from 3.16.4 to 3.17.0.
- [Release notes](https://github.com/py-pdf/pypdf/releases)
- [Changelog](https://github.com/py-pdf/pypdf/blob/main/CHANGELOG.md)
- [Commits](https://github.com/py-pdf/pypdf/compare/3.16.4...3.17.0)

---
updated-dependencies:
- dependency-name: pypdf
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-11-03 18:54:29 -07:00
Bryan Peterson
44e3dcb19f
support for zendesk help center () 2023-11-01 21:11:56 -07:00
Yuhong Sun
fbf7c642a3
Reworking the LLM layer () 2023-10-31 18:22:42 -07:00
Yuhong Sun
947d4d0a2e
Pin Litellm Version () 2023-10-31 12:09:39 -07:00
dependabot[bot]
d7a90aeb2b
Bump langchain from 0.0.312 to 0.0.325 in /backend/requirements ()
Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.0.312 to 0.0.325.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/compare/v0.0.312...v0.0.325)

---
updated-dependencies:
- dependency-name: langchain
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-31 12:05:55 -07:00
Yuhong Sun
e279918f95
Introduce Time Filters () 2023-10-22 15:06:52 -07:00
dependabot[bot]
4ffbdbb8b0
Bump langchain from 0.0.308 to 0.0.312 in /backend/requirements ()
Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.0.308 to 0.0.312.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/compare/v0.0.308...v0.0.312)

---
updated-dependencies:
- dependency-name: langchain
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-19 17:11:42 -07:00
Yuhong Sun
2037e11495
Replace PyPDF2 with pypdf () 2023-10-19 16:12:31 -07:00
Weves
ca74884bd7 Pin pytorch version to fix segmentation fault in Docker 2023-10-08 16:11:53 -07:00
dependabot[bot]
21aa233170
Bump langchain from 0.0.273 to 0.0.308 in /backend/requirements ()
Bumps [langchain](https://github.com/langchain-ai/langchain) from 0.0.273 to 0.0.308.
- [Release notes](https://github.com/langchain-ai/langchain/releases)
- [Commits](https://github.com/langchain-ai/langchain/compare/v0.0.273...v0.0.308)

---
updated-dependencies:
- dependency-name: langchain
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2023-10-07 17:18:51 -07:00
nlp8899
c666f35cd0
create a hubspot connector () 2023-10-02 10:13:23 -07:00
Yuhong Sun
6b305c56b3
Use Sentence Aware Splitter () 2023-09-16 16:28:16 -07:00
Yuhong Sun
e549d2bb4a
Chat with Context Backend () 2023-09-15 12:17:05 -07:00
Weves
c4e0face9b Move connector / credential pair deletion to celery 2023-09-14 16:23:13 -07:00
Yuhong Sun
b5fc2a5775
Regression Test () 2023-09-11 19:06:01 -07:00
Yuhong Sun
c28f4d4527
Remove py library due to denial of service CVE () 2023-09-03 16:36:13 -07:00
Yuhong Sun
4aebb69883
Upgrade packages for security reasons () 2023-09-01 20:35:48 -07:00
Patrick Decat
0a7775860c
feat(dev): use ruff for python linting () 2023-08-31 15:29:59 -07:00
Yuhong Sun
856061c7ea
Fix ReDoS and Directory Traversal ()
Co-authored-by: Weves <chrisweaver101@gmail.com>
2023-08-29 21:20:15 -07:00
Weves
4469447fde Add LangChain-based LLM 2023-08-26 21:57:15 -07:00
Weves
a2d3a3f116 Fix image build by pinning safetensors version 2023-08-23 22:23:45 -07:00
Chris Weaver
e307275774
Add support for multiple indexing workers () 2023-08-22 18:11:31 -07:00
Michał Flak
286445f9ba
Zulip connector ()
Co-authored-by: Yuhong Sun <yuhongsun96@gmail.com>
2023-08-14 15:29:34 -07:00
Yuhong Sun
3bfc72484d
Support for Request accessed GenAI Models () 2023-08-06 18:31:47 -07:00
Pratik Kabra
0e667d3384
Huggingface Inference backend internal models () 2023-08-05 11:33:19 -07:00
Yuhong Sun
17e2008027
Add TODOs and minor style changes to web connector () 2023-07-29 12:35:38 -07:00
Yuhong Sun
2a339ec34b
Prevent too many tokens to GPT () 2023-07-28 16:00:26 -07:00
Yuhong Sun
273802eff0
Disable Gpt4all due to mac not supporting it currently () 2023-07-25 22:19:15 -07:00
Sid Ravinutala
d6d3d5291b added docx2txt 2023-07-24 01:42:39 +00:00
Yuhong Sun
d6ca865034
Support GPT4All in memory () 2023-07-23 12:26:14 -07:00
Chris Weaver
b4759403ac
Adjust slack bot ()
* Add handling for cases where an answer is not found

* Make danswer bot slightly more configurable

* Don't respond to messages in thread + add better formatting for slack messages
2023-07-07 09:56:01 -07:00
Chris Weaver
10b36f4ce9
Slab connector UI ()
Also added in missing dateutil req
2023-07-03 15:57:22 -07:00
Yuhong Sun
675a5aec9e
DAN-158 Slab Connector ()
No support for comments or topics
2023-07-03 14:27:23 -07:00
Yuhong Sun
03006743ab
DAN-118 Jira connector ()
* Small confluence page QoL changes

* Prevent getting into a bad state with orphan connectors for Jira / Confluence

* Jira connector + admin page
---------

Co-authored-by: Weves <chrisweaver101@gmail.com>
2023-06-24 18:48:38 -06:00
Yuhong Sun
6fe54a4eed
DAN-115 Document Polling ()
Includes updated document counting for polling
2023-06-15 21:07:05 -07:00