highperfocused/danswer
1
0
Fork 0
mirror of https://github.com/danswer-ai/danswer.git synced 2025-03-31 16:08:04 +02:00
Code Issues Packages Projects Releases Wiki Activity
2,924 Commits 762 Branches 885 Tags
Commit Graph

143 Commits

Author SHA1 Message Date
Weves
ea75f5cd5d Move google-cloud-aiplatform to default requirements to support vertex AI llama 2025-01-03 15:20:59 -08:00
Chris Weaver
3f92ed9d29
Airtable connector (#3564) 
* Airtable connector

* Improvements

* improve

* Clean up test

* Add secrets

* Fix mypy + add access token

* Mock unstructured call

* Adjust comments

* Fix ID in test
 2024-12-31 03:06:28 +00:00
pablonyx
27acd3387a
Auth specific rate limiting (#3463) 
* k

* v1

* fully functional

* finalize

* nit

* nit

* nit

* clean up with wrapper + comments

* k

* update

* minor clean
 2024-12-29 23:34:23 +00:00
pablonyx
ca9ba925bd
Support o1 (#3510) 
* support o1

* nit
 2024-12-19 00:05:00 +00:00
Yuhong Sun
814f97c2c7
MT Cloud Monitoring (#3465) 2024-12-15 16:05:03 -08:00
Yuhong Sun
6026536110
Model Server Async (#3386) 
* need-verify

* fix some lib calls

* k

* tests

* k

* k

* k

* Address the comments

* fix comment
 2024-12-11 01:33:44 +00:00
Weves
06f4146597 Bump litellm to support Nova models from AWS 2024-12-09 21:19:11 -08:00
Chris Weaver
2783fa08a3
Update openai version in model server (#3306) 2024-12-02 21:39:10 +00:00
Chris Weaver
16863de0aa
Improve model token limit detection (#3292) 
* Properly find context window for ollama llama

* Better ollama support + upgrade litellm

* Ugprade OpenAI as well

* Fix mypy
 2024-11-30 04:42:56 +00:00
pablodanswer
7c841051ed
Cohere (#3111) 
* add cohere default

* finalize

* minor improvement

* update

* update

* update configs

* ensure we properly expose name(space) for slackbot

* update config

* config
 2024-11-14 01:58:54 +00:00
pablodanswer
2d81710ccc minor udpate 2024-11-06 13:49:16 -08:00
pablodanswer
a7002dfa1d
add CSV display (#3028) 
* add CSV display

* add downloading

* restructure

* create portal for modal

* update requirements

* nit
 2024-11-03 10:43:05 -08:00
Yuhong Sun
b34f5862d7
Remove License Issues (#3013) 
* k

* k

* k

* k

* k
 2024-11-01 00:31:19 +00:00
pablodanswer
088551a4ef
remove rt + home-grown sitemap parsing (#2933) 
* remove rt

* nit

* add minor alembic revision

* functional migration

* replace usp

* k

* typing
 2024-10-26 21:58:42 +00:00
hagen-danswer
94edcac36e
upgraded claude model strings (#2876) 
* upgraded model strings

* trolled

* we do a little trolling

* reeeeeee

* alembic upgrade

* added ignore

* bump litellm

* k

* nit

---------

Co-authored-by: pablodanswer <pablo@danswer.ai>
 2024-10-26 00:11:52 +00:00
pablodanswer
1b6b134722
Clearer azure models (#2898) 
* clear up llm

* remove logs
 2024-10-24 17:29:36 +00:00
rkuo-danswer
5b78299880
use native rate limiting in the confluence client (#2837) 
* use native rate limiting in the confluence client

* upgrade urllib3 to v2.2.3 to support retries in confluence client

* improve logging so that progress is visible.
 2024-10-18 18:15:43 +00:00
pablodanswer
61424de531
add sentry (#2786) 
* add sentry

* nit

* nit

* add requirement to ee

* try to ensure sentry is installed in integration tests
 2024-10-17 23:20:37 +00:00
pablodanswer
e48086b1c2
add slack markdown formatting (#2829) 
* add slack markdown formatting

* nit

* k
 2024-10-17 20:27:57 +00:00
pablodanswer
15afe4dc78
bump litellm (#2827) 2024-10-17 18:05:35 +00:00
pablodanswer
a385234c0e
Parsing (#2734) 
* k

* update chunking limits

* nit

* nit

* clean up types

* nit

* validate

* k
 2024-10-16 16:44:19 +00:00
pablodanswer
e022e77b6d
Simpler azure embedding (#2751) 
* functional but janky

* nit

* adapt for azure

* nit

* minor updates

* nits

* nit

* nit

* ensure access to litellm

* k
 2024-10-15 23:23:11 +00:00
Yuhong Sun
ba712d447d
Notion Connector Improvements (#2789) 2024-10-13 23:01:17 -07:00
pablodanswer
20df20ae51
Multi tenant vespa (#2762) 
* add vespa multi tenancy

* k

* formatting

* Billing (#2667)

* k

* data -> control

* nit

* nit: error handling

* auth + app

* nit: color standardization

* nit

* nit: typing

* k

* k

* feat: functional upgrading

* feat: add block for downgrading to seats < active users

* add auth

* remove accomplished todo + prints

* nit

* tiny nit

* nit: centralize security

* add tenant expulsion/gating + invite user -> increment billing seat no.

* add cloud configs

* k

* k

* nit: update

* k

* k

* k

* k

* nit
 2024-10-12 23:53:11 +00:00
rkuo-danswer
7f788e4b1e
bump celery to 5.5.0b4 (#2681) 2024-10-04 05:54:32 +00:00
Chris Weaver
b8232e0681
Update litellm to fix bedrock models (#2649) 2024-10-01 20:09:57 -07:00
Yuhong Sun
e229d27734
Unstructured UI (#2636) 
* checkpoint

* k

* k

* need frontend

* add api key check + ui component

* add proper ports + icons + functions

* k

* k

* k

---------

Co-authored-by: pablodanswer <pablo@danswer.ai>
 2024-10-01 04:50:03 +00:00
pablodanswer
45f67368a2
Add support for o1 (#2538) 
* add o1 support + bump litellm/openai

* ports

* update exception message for testing
 2024-09-22 23:16:28 +00:00
pablodanswer
9f179940f8
Asana connector (community originated) (#2485) 
* initial Asana connector

* hint on how to get Asana workspace ID

* re-format with black

* re-order imports

* update asana connector for clarity

* minor robustification

* minor update to naming

* update for best practice

* update connector

---------

Co-authored-by: Daniel Naber <naber@danielnaber.de>
 2024-09-19 23:54:18 +00:00
Yuhong Sun
f04ecbf87a Un-bump nltk due to llamaindex issue 2024-09-08 16:39:19 -07:00
dependabot[bot]
5e9c6d1499
Bump aiohttp from 3.9.4 to 3.10.2 in /backend/requirements (#2097) 
Bumps [aiohttp](https://github.com/aio-libs/aiohttp) from 3.9.4 to 3.10.2.
- [Release notes](https://github.com/aio-libs/aiohttp/releases)
- [Changelog](https://github.com/aio-libs/aiohttp/blob/master/CHANGES.rst)
- [Commits](https://github.com/aio-libs/aiohttp/compare/v3.9.4...v3.10.2)

---
updated-dependencies:
- dependency-name: aiohttp
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-09-08 10:59:47 -07:00
dependabot[bot]
50211ec401
Bump nltk from 3.8.1 to 3.9 in /backend/requirements (#2174) 
Bumps [nltk](https://github.com/nltk/nltk) from 3.8.1 to 3.9.
- [Changelog](https://github.com/nltk/nltk/blob/develop/ChangeLog)
- [Commits](https://github.com/nltk/nltk/compare/3.8.1...3.9)

---
updated-dependencies:
- dependency-name: nltk
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-09-08 10:50:36 -07:00
dependabot[bot]
1e4b27185d
Bump torch from 2.0.1 to 2.2.0 in /backend/requirements (#1933) 
Bumps [torch](https://github.com/pytorch/pytorch) from 2.0.1 to 2.2.0.
- [Release notes](https://github.com/pytorch/pytorch/releases)
- [Changelog](https://github.com/pytorch/pytorch/blob/main/RELEASE.md)
- [Commits](https://github.com/pytorch/pytorch/compare/v2.0.1...v2.2.0)

---
updated-dependencies:
- dependency-name: torch
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-09-08 10:17:17 -07:00
Yuhong Sun
c8891a5829
Remove LangChain Community (#2362) 2024-09-08 09:41:20 -07:00
Art Matsak
51a13f5fc7
Implement indexing of simple tables in Word files (#1651) 2024-09-08 09:38:46 -07:00
dependabot[bot]
e2e04af7e2
Bump msal from 1.26.0 to 1.28.0 in /backend/requirements (#1626) 
Bumps [msal](https://github.com/AzureAD/microsoft-authentication-library-for-python) from 1.26.0 to 1.28.0.
- [Release notes](https://github.com/AzureAD/microsoft-authentication-library-for-python/releases)
- [Commits](https://github.com/AzureAD/microsoft-authentication-library-for-python/compare/1.26.0...1.28.0)

---
updated-dependencies:
- dependency-name: msal
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2024-09-07 21:05:11 -07:00
rkuo-danswer
2933c3598b
first cut at redis (#2226) 
* first cut at redis

* fix startup dependencies on redis

* kombu cleanup - fail silently

* mypy

* add redis_host environment override

* update REDIS_HOST env var in docker-compose.dev.yml

* update the rest of the docker files

* update contributing guide

* renaming cache to cache_volume

* add redis password to various deployments

* try setting up pr testing for helm

* fix indent

* hopefully this release version actually exists

* fix command line option to --chart-dirs

* fetch-depth 0

* edit values.yaml

* try setting ct working directory

* bypass testing only on change for now

* move files and lint them

* update helm testing

* some issues suggest using --config works

* add vespa repo

* add postgresql repo

* increase timeout

* try amd64 runner

* fix redis password reference

* add comment to helm chart testing workflow

* rename helm testing workflow to disable it

---------

Co-authored-by: Richard Kuo <rkuo@rkuo.com>
 2024-09-06 19:21:29 +00:00
rkuo-danswer
abe01144ca
Update CONTRIBUTING.md (#2298) 2024-09-02 15:30:18 -07:00
josvdw
50c17438d5
Litellm bump (#2195) 
* ran bump-pydantic

* replace root_validator with model_validator

* mostly working. some alternate assistant error. changed root_validator and typing_extensions

* working generation chat. changed type

* replacing .dict with .model_dump

* argument needed to bring model_dump up to parity with dict()

* fix a fewremaining issues -- working with llama and gpt

* updating requirements file

* more requirement updates

* more requirement updates

* fix to make search work

* return type fix:

* half way tpyes change

* fixes for mypy and pydantic:

* endpoint fix

* fix pydantic protected namespaces

* it works!

* removed unecessary None initializations

* better logging

* changed default values to empty lists

* mypy fixes

* fixed array defaulting

---------

Co-authored-by: hagen-danswer <hagen@danswer.ai>
 2024-08-28 00:00:27 +00:00
Yuhong Sun
7dcc42aa95
Intent Model Update (#2069) 2024-08-08 20:45:53 -07:00
hagen-danswer
1be1959d80
Changed default local model to nomic (#1943) 2024-07-31 18:54:02 -07:00
Yuhong Sun
0e8ba111c8
Model Touchups (#1887) 2024-07-21 12:31:00 -07:00
hagen-danswer
eb3e7610fc
Added retries and multithreading for cloud embedding (#1879) 
* added retries and multithreading for cloud embedding

* refactored a bit

* cleaned up code

* got the errors to bubble up to the ui correctly

* added exceptin printing

* added requirements

* touchups

---------

Co-authored-by: Yuhong Sun <yuhongsun96@gmail.com>
 2024-07-20 22:10:18 -07:00
Zoltan Szabo
1b311d092e
Try to find the sitemap for a given site (#1538) 2024-07-14 13:24:10 -07:00
pablodanswer
e7f81d1688
add third party embedding models (#1818) 2024-07-14 10:19:53 -07:00
pablodanswer
09a11b5e1a
Fix citations + unit tests (#1760) 2024-07-10 10:05:20 -07:00
pablodanswer
de6d040349
add boto3 typing to default requirements (#1740) 2024-06-28 13:06:59 -07:00
pablodanswer
f03f97307f
Blob Storage (#1705) 
S3 + OCI + Google Cloud Storage + R2
---------

Co-authored-by: Art Matsak <5328078+artmatsak@users.noreply.github.com>
 2024-06-27 17:12:20 -07:00
Yuhong Sun
92de6acc6f Initial EE features (#3) 2024-06-25 15:07:56 -07:00
Weves
7746375bfd Custom tools 2024-06-17 15:12:50 -07:00