170 Commits

Author SHA1 Message Date
pablodanswer
7419bf6b06 fix typing issues / build issues + backwards-compatibility for indexing 2024-09-27 12:48:21 -07:00
pablodanswer
e5f3f2d73a validated functionality for single-tenant 2024-09-27 10:21:08 -07:00
pablodanswer
dc5a91fd85 update logs 2024-09-26 17:31:37 -07:00
pablodanswer
01e1bd0ee2 remove logs 2024-09-26 13:35:00 -07:00
pablodanswer
5f7be266f0 fix building + types 2024-09-26 13:29:57 -07:00
pablodanswer
daad96d180 valid multi tenant indexing + valid upgrades/updated endpoints 2024-09-26 10:47:29 -07:00
pablodanswer
b853e5f22a robustified alembic upgrade 2024-09-25 14:48:38 -07:00
pablodanswer
dcc4c61fcb update alembic to temporarily include initial seeding 2024-09-25 14:25:59 -07:00
pablodanswer
5775aec498 more solid schema context passing 2024-09-25 14:15:16 -07:00
pablodanswer
a69a0333a5 valid but janky db session handling 2024-09-25 13:09:55 -07:00
pablodanswer
198f80d224 remove dependency fully in alembic migrations 2024-09-25 12:08:33 -07:00
pablodanswer
4855a80f86 proper schema isolation 2024-09-24 20:02:34 -07:00
pablodanswer
6e78f2094b update alembic to be stateless 2024-09-24 19:15:45 -07:00
pablodanswer
c2e953633a update vespa + sidebar 2024-09-24 19:00:31 -07:00
pablodanswer
fe3f6d451d ruff 2024-09-22 11:24:48 -07:00
pablodanswer
a28ac88341 fix build 2024-09-22 11:15:14 -07:00
pablodanswer
d3d63ee8f7 updated alembic migrations 2024-09-21 19:30:59 -07:00
pablodanswer
cb0a1e4fdc functional porting over user 2024-08-29 17:25:43 -07:00
pablodanswer
90da2166c2 add proper stripe checkout button for user 2024-08-29 11:49:10 -07:00
Yuhong Sun
1e67332078
Remove warning on user signup (#2252) 2024-08-27 18:49:05 -07:00
pablodanswer
97ba71e1b3
Db search (#2235)
* k

* update enum imports

* add functional types + model swaps

* remove a log

* remove kv

* fully functional + robustified for kv swap

* validated with hosted + cloud

* ensure not updating current search settings when reindexing

* add instance check

* revert back to updating search settings (will need a slight refactor for endpoint)

* protect advanced config override1

* run pretty

* fix typing

* update typing

* remove unnecessary function

* update model name

* clearer interface names

* validated foreign key constaint

* proper migration

* squash

---------

Co-authored-by: Yuhong Sun <yuhongsun96@gmail.com>
2024-08-27 04:26:51 +00:00
Chris Weaver
c0e1a02e8e
Add it on merge queue (#2112)
* Github action to run integration tests

* Improve

* Fix build

* Add pull

* Fix readiness script

* Add IT runner

* Add IT runner

* Add logs

* update

* Fix

* Fix path

* file path

* test

* fix

* fix

* fix

* test

* network

* fix

* cleanup

* fix

* test

* Fix downgrade

* Add OpenAI API key

* Add VESPA_HOST

* test pulling first

* Add API server host

* Cache tweak

* Fix pull/push settings:

* Stop pushing to latest tag

* test cache change

* test

* test

* test

* remove cache temporarily

* Fix

* Enable EE

* test

* Remove duplicate funcs

* add back build

* Update all

* Fix stop cmd

* Add to merge queue

* Cleanup image tag
2024-08-26 07:20:28 +00:00
pablodanswer
c152123ef4
alembic once again (#2221) 2024-08-23 05:28:13 +00:00
pablodanswer
e89dc67e5d
Update embedding interface (#2205)
* squash

* simplify interface

* some updates to typing

* cloud provider type

* update typing to be even clearer

* push local commit (squash)

* cleaner interfaces

* another quick pass

* squash

* cleaner alembic

* cleaner

* remove trailing whitespace

* add sequence

* quick circle back to double check

* update

* update naming

* update naming
2024-08-23 03:52:02 +00:00
hagen-danswer
c042a19c00
Curator role (#2166)
* Added backend support for curator role

* modal refactor

* finalized first 2 commits

same as before

finally

what was it for

* added credential, cc_pair, and cleanup

mypy is super helpful hahahahahahahahahahahaha

* curator support for personas

* added connector management permission checks

* fixed the connector creation flow

* added document access to curator

* small cleanup added comments and started ui

* groups and assistant editor

* Persona frontend

* Document set frontend

* cleaned up the entire frontend

* alembic fix

* Minor fixes

* credentials section

* some credential updates

* removed logging statements

* fixed try catch

* fixed model name

* made everything happen in one db commit

* Final cleanup

* cleaned up fast code

* mypy/build fixes

* polish

* more token rate limit polish

* fixed weird credential permissions

* Addressed chris feedback

* addressed pablo feedback

* fixed alembic

* removed deduping and caching

* polish!!!!
2024-08-23 01:39:37 +00:00
pablodanswer
197b62aed1
Regenerate (branch of stop) (#2157)
* add regenerate

* functional once again post rebase but quite ugly

* validated + cleaner UI

* more robust implementation for first messages

* squash

* remove parameter

* proper margin

* clarify for future programmers

* remove some logs

* self nit pick - smoother ux

* more self-nits

* stroke line cap

* rebase
2024-08-22 19:06:44 +00:00
Yuhong Sun
9d5db05e4b
Add Migration (#2213) 2024-08-22 10:44:42 -07:00
Yuhong Sun
bb1916d5d0
Warm Up Models Prep (#2196) 2024-08-20 20:53:02 -07:00
pablodanswer
048cb8dd55
update alembic version (for rebase) (#2193) 2024-08-21 02:58:22 +00:00
pablodanswer
53387ab3eb
Simplify index and model name swap logic (#2188) 2024-08-20 17:31:00 -07:00
hagen-danswer
f77b1ebd87
Updated pruning defaults (#2186)
* Updated pruning defaults

* changed minutes to days
2024-08-20 23:29:19 +00:00
Yuhong Sun
42f0fea9f8
Fix Assistant vs Persona (#2185) 2024-08-20 14:43:15 -07:00
Chris Weaver
af647959f6
Performance Improvements (#2162) 2024-08-19 11:07:00 -07:00
Yuhong Sun
119aefba88
Add log files to containers (#2164) 2024-08-18 19:18:28 -07:00
rkuo-danswer
492797c9f3
Feature/indexing errors (#2148)
* backend changes to handle partial completion of index attempts

* typo fix

* Display partial success in UI

* make log timing more readable by limiting printed precision to milliseconds

* forgot alembic

* initial cut at "completed with errors" indexing

* remove and reorganize unused imports

* show view errors while indexing is in progress

* code review fixes
2024-08-18 19:14:32 +00:00
pablodanswer
f8e0e6f015
Extremely robustified Index Attempt migration (#2151)
* account for connector_id edge case

* robustified
2024-08-17 01:12:18 +00:00
Yuhong Sun
4d194bc86a
Cohere No Large Chunks (#2145) 2024-08-15 10:18:54 -07:00
Nathan Schwerdfeger
c7e5b11c63
EE Connector Deletion Bugfix + Refactor (#2042)
---------

Co-authored-by: Weves <chrisweaver101@gmail.com>
2024-08-11 20:33:07 -07:00
Yuhong Sun
ce666f3320
Propagate Embedding Enum (#2108) 2024-08-11 12:17:54 -07:00
pablodanswer
7d5cfd2fa3
Add user specific model defaults (#2043) 2024-08-10 14:37:33 -07:00
Yuhong Sun
a4caf66a35
User Notification Backend (#2104) 2024-08-10 11:39:21 -07:00
Yuhong Sun
7dcc42aa95
Intent Model Update (#2069) 2024-08-08 20:45:53 -07:00
Chris Weaver
bb7e1d6e55
Add integration tests for document set syncing (#1904) 2024-08-06 18:00:19 -07:00
pablodanswer
6d67d472cd
Add answers to search (#2020) 2024-08-04 23:02:55 -07:00
hagen-danswer
e6a92aa936
support confluence single page only indexing (#2008)
* added index recursively checkbox

* mypy fixes

* added migration to not break existing connectors
2024-08-01 20:32:46 +00:00
pablodanswer
459bd46846
Add Prompt library (#1990) 2024-08-01 08:40:35 -07:00
Yuhong Sun
036d5c737e
No Null Embeddings (#1982) 2024-07-30 19:54:49 -07:00
pablodanswer
e4b1f5b963 fix index attempt migration where no credential ID 2024-07-30 08:57:57 -07:00
pablodanswer
38af12ab97
remove unnecessary index drop (#1968) 2024-07-29 09:51:53 -07:00
pablodanswer
3aa0e0124b
Add new admin page (#1947)
* add admin page

* credential + typing fix

* rebase fix

* on add, cleaner buttons

* functional G + Ddrive

* organized auth sections

* update types and remove logs

* ccs -> connectors

* validated formik

* update styling + connector-handling logic

* udpate colors

* separate out hooks + util functions

* update to adhere to rest standards

* remove "todos"

* rebase

* copy + formatting + sidebar

* update statuses + configuration possibilities

* update interfaces to be clearer

* update indexing status page

* formatting

* address backend security + comments

* update font

* fix form routing

* fix hydration error

* add statuses, fix bugs, etc. (squash)

* fix color (squash)

* squash

* add functionality to sidebar

* disblae buttons if deleting

* add color

* minor copy + formatting updates
- on modify credential, close
- update copy for deletion of connectors

* fix build error

* copy

---------

Co-authored-by: Yuhong Sun <yuhongsun96@gmail.com>
2024-07-28 20:57:43 -07:00