* discord: frontend and backend poll connector
* added requirements for discord installation
* fixed the mypy errors
* process messages not part of any thread
* minor change
* updated the connector; this logic works & am able to docs when i print
* minor change
* ability to enter a start date to pull docs from and refactor
* added the load connector and fixed mypy errors
* local commit test
done!
* minor refactor and properly commented everything
* updated the logic to handle permissions and index active/archived threads
* basic discord test template
* cleanup
* going away with the danswer discord client class ; using an async context manager
* moved to proper folder
* minor fixes
* needs improvement
* fixed discord icon
---------
Co-authored-by: hagen-danswer <hagen@danswer.ai>
* Add description for Google Gemini models and custom model icons for LiteLLM (OpenAI) proxied models
* Adds Vertex AI aliases for Claude
---------
Co-authored-by: Emerson Gomes <emerson.gomes@thalesgroup.com>
* Xenforo forum parser support
* clarify ssl cert reqs
* missed a file
* add isLoadState function, fix up xenforo for data driven connector approach
* fixing a new edge case to skip an unexpected parsed element
* change documentsource to xenforo
* make doc id unique and comment what's happening
* remove stray log line
* address code review
---------
Co-authored-by: sime2408 <simun.sunjic@gmail.com>
Co-authored-by: Richard Kuo <rkuo@rkuo.com>
* initial Asana connector
* hint on how to get Asana workspace ID
* re-format with black
* re-order imports
* update asana connector for clarity
* minor robustification
* minor update to naming
* update for best practice
* update connector
---------
Co-authored-by: Daniel Naber <naber@danielnaber.de>
* Added connector for clickup
* Fixed mypy issues
* Fallback to description if markdown is not available
* Added extra information in metadata, and support to index comments
* Fixes for fields parsing
* updated fetcher to errorHandlingFetcher
---------
Co-authored-by: hagen-danswer <hagen@danswer.ai>
* start dropbox connector
* add wip ui
* polish ui
* Fix some ci
* ignore types
* addressed, fixed, and tested all comments
* ran prettier
* ran mypy fixes
---------
Co-authored-by: Bill Yang <bill@Bills-MacBook-Pro.local>
Co-authored-by: hagen-danswer <hagen@danswer.ai>
* start dropbox connector
* add wip ui
* polish ui
* Fix some ci
* ignore types
* addressed, fixed, and tested all comments
* ran prettier
* ran mypy fixes
---------
Co-authored-by: Bill Yang <bill@Bills-MacBook-Pro.local>
Co-authored-by: hagen-danswer <hagen@danswer.ai>
* Add MediaWikiConnector first draft
* Add MediaWikiConnector first draft
* Add MediaWikiConnector first draft
* Add MediaWikiConnector sections for each document
* Add MediaWikiConnector to constants and factory
* Integrate MediaWikiConnector with connectors page
* Unit tests + bug fixes
* Allow adding multiple mediawikiconnectors
* add wikipedia connector
* add wikipedia connector to factory
* improve docstrings of mediawiki connector backend
* improve docstrings of mediawiki connector backend
* move wikipedia and mediawiki icon locations in admin page
* undo accidental commit of modified docker compose yaml
Looks good! I couldn't verify that it end-to-end because Loopio still hasn't granted me API access but the code looks good. Thanks a bunch for the contribution!
Would you be open to also writing the docs page for the setup? It's just adding an md file with some images or gifs:
https://github.com/danswer-ai/danswer-docs
I can provide a template branch if that would make it easier, just let me know 🙏
Contributed by Evan! Thanks for the contribution!
- Minor linting and rebasing done by Yuhong, everything else from Evan
---------
Co-authored-by: Evan Sarmiento <e.sarmiento@soax.com>
Co-authored-by: Evan <esarmien@fas.harvard.edu>
