mirror of
https://github.com/open-webui/open-webui.git
synced 2025-03-28 18:52:14 +01:00
185 lines
10 KiB
Markdown
185 lines
10 KiB
Markdown
# Open WebUI (Formerly Ollama WebUI) 👋
|
||
|
||

|
||

|
||

|
||

|
||

|
||

|
||

|
||

|
||
[](https://discord.gg/5rJgQTnV4s)
|
||
[](https://github.com/sponsors/tjbck)
|
||
|
||
Open WebUI is an extensible, feature-rich, and user-friendly self-hosted WebUI designed to operate entirely offline. It supports various LLM runners, including Ollama and OpenAI-compatible APIs. For more information, be sure to check out our [Open WebUI Documentation](https://docs.openwebui.com/).
|
||
|
||

|
||
|
||
## Key Features of Open WebUI ⭐
|
||
|
||
- 🚀 **Effortless Setup**: Install seamlessly using Docker or Kubernetes (kubectl, kustomize or helm) for a hassle-free experience.
|
||
|
||
- 🤝 **Ollama/OpenAI API Integration**: Effortlessly integrate OpenAI-compatible APIs for versatile conversations alongside Ollama models. Customize the Ollama API URL to link with **LMStudio, GroqCloud, Mistral, OpenRouter, and more**.
|
||
|
||
- 📱 **Responsive Design**: Enjoy a seamless experience across Desktop PC, Laptop, and Mobile devices.
|
||
|
||
- ✒️🔢 **Full Markdown and LaTeX Support**: Elevate your LLM experience with comprehensive Markdown and LaTeX capabilities for enriched interaction.
|
||
|
||
- 🧩 **Model Builder**: Easily create Ollama models via the Web UI. Create and add custom characters/agents, customize chat elements, and import models effortlessly through [Open WebUI Community](https://openwebui.com/) integration.
|
||
|
||
- 🔍 **RAG Embedding Support**: Change the RAG embedding model directly in document settings, enhancing document processing. This feature supports Ollama and OpenAI models.
|
||
|
||
- 🌐 **Web Browsing Capability**: Seamlessly integrate websites into your chat experience using the `#` command followed by the URL. This feature allows you to incorporate web content directly into your conversations, enhancing the richness and depth of your interactions.
|
||
|
||
- 🎨 **Image Generation Integration**: Seamlessly incorporate image generation capabilities using options such as AUTOMATIC1111 API or ComfyUI (local), and OpenAI's DALL-E (external), enriching your chat experience with dynamic visual content.
|
||
|
||
- 🤖 **Multiple Model Support**: Seamlessly switch between different chat models for diverse interactions.
|
||
|
||
- 🔐 **Role-Based Access Control (RBAC)**: Ensure secure access with restricted permissions; only authorized individuals can access your Ollama, and exclusive model creation/pulling rights are reserved for administrators.
|
||
|
||
- 🌐🌍 **Multilingual Support**: Experience Open WebUI in your preferred language with our internationalization (i18n) support. Join us in expanding our supported languages! We're actively seeking contributors!
|
||
|
||
- 🌟 **Continuous Updates**: We are committed to improving Open WebUI with regular updates, fixes, and new features.
|
||
|
||
Want to learn more about Open WebUI's features? Check out our [Open WebUI documentation](https://docs.openwebui.com/) for a comprehensive overview!
|
||
|
||
## 🔗 Also Check Out Open WebUI Community!
|
||
|
||
Don't forget to explore our sibling project, [Open WebUI Community](https://openwebui.com/), where you can discover, download, and explore customized Modelfiles. Open WebUI Community offers a wide range of exciting possibilities for enhancing your chat interactions with Open WebUI! 🚀
|
||
|
||
## How to Install 🚀
|
||
|
||
> [!NOTE]
|
||
> Please note that for certain Docker environments, additional configurations might be needed. If you encounter any connection issues, our detailed guide on [Open WebUI Documentation](https://docs.openwebui.com/) is ready to assist you.
|
||
|
||
### Quick Start with Docker 🐳
|
||
|
||
> [!WARNING]
|
||
> When using Docker to install Open WebUI, make sure to include the `-v open-webui:/app/backend/data` in your Docker command. This step is crucial as it ensures your database is properly mounted and prevents any loss of data.
|
||
|
||
> [!TIP]
|
||
> If you wish to utilize Open WebUI with Ollama included or CUDA acceleration, we recommend utilizing our official images tagged with either `:cuda` or `:ollama`. To enable CUDA, you must install the [Nvidia CUDA container toolkit](https://docs.nvidia.com/dgx/nvidia-container-runtime-upgrade/) on your Linux/WSL system.
|
||
|
||
### Installation with Default Configuration
|
||
|
||
- **If Ollama is on your computer**, use this command:
|
||
|
||
```bash
|
||
docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main
|
||
```
|
||
|
||
- **If Ollama is on a Different Server**, use this command:
|
||
|
||
To connect to Ollama on another server, change the `OLLAMA_BASE_URL` to the server's URL:
|
||
|
||
```bash
|
||
docker run -d -p 3000:8080 -e OLLAMA_BASE_URL=https://example.com -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main
|
||
```
|
||
|
||
- **To run Open WebUI with Nvidia GPU support**, use this command:
|
||
|
||
```bash
|
||
docker run -d -p 3000:8080 --gpus all --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:cuda
|
||
```
|
||
|
||
### Installation for OpenAI API Usage Only
|
||
|
||
- **If you're only using OpenAI API**, use this command:
|
||
|
||
```bash
|
||
docker run -d -p 3000:8080 -e OPENAI_API_KEY=your_secret_key -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main
|
||
```
|
||
|
||
### Installing Open WebUI with Bundled Ollama Support
|
||
|
||
This installation method uses a single container image that bundles Open WebUI with Ollama, allowing for a streamlined setup via a single command. Choose the appropriate command based on your hardware setup:
|
||
|
||
- **With GPU Support**:
|
||
Utilize GPU resources by running the following command:
|
||
|
||
```bash
|
||
docker run -d -p 3000:8080 --gpus=all -v ollama:/root/.ollama -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:ollama
|
||
```
|
||
|
||
- **For CPU Only**:
|
||
If you're not using a GPU, use this command instead:
|
||
|
||
```bash
|
||
docker run -d -p 3000:8080 -v ollama:/root/.ollama -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:ollama
|
||
```
|
||
|
||
Both commands facilitate a built-in, hassle-free installation of both Open WebUI and Ollama, ensuring that you can get everything up and running swiftly.
|
||
|
||
After installation, you can access Open WebUI at [http://localhost:3000](http://localhost:3000). Enjoy! 😄
|
||
|
||
### Other Installation Methods
|
||
|
||
We offer various installation alternatives, including non-Docker native installation methods, Docker Compose, Kustomize, and Helm. Visit our [Open WebUI Documentation](https://docs.openwebui.com/getting-started/) or join our [Discord community](https://discord.gg/5rJgQTnV4s) for comprehensive guidance.
|
||
|
||
### Troubleshooting
|
||
|
||
Encountering connection issues? Our [Open WebUI Documentation](https://docs.openwebui.com/troubleshooting/) has got you covered. For further assistance and to join our vibrant community, visit the [Open WebUI Discord](https://discord.gg/5rJgQTnV4s).
|
||
|
||
#### Open WebUI: Server Connection Error
|
||
|
||
If you're experiencing connection issues, it’s often due to the WebUI docker container not being able to reach the Ollama server at 127.0.0.1:11434 (host.docker.internal:11434) inside the container . Use the `--network=host` flag in your docker command to resolve this. Note that the port changes from 3000 to 8080, resulting in the link: `http://localhost:8080`.
|
||
|
||
**Example Docker Command**:
|
||
|
||
```bash
|
||
docker run -d --network=host -v open-webui:/app/backend/data -e OLLAMA_BASE_URL=http://127.0.0.1:11434 --name open-webui --restart always ghcr.io/open-webui/open-webui:main
|
||
```
|
||
|
||
### Keeping Your Docker Installation Up-to-Date
|
||
|
||
In case you want to update your local Docker installation to the latest version, you can do it with [Watchtower](https://containrrr.dev/watchtower/):
|
||
|
||
```bash
|
||
docker run --rm --volume /var/run/docker.sock:/var/run/docker.sock containrrr/watchtower --run-once open-webui
|
||
```
|
||
|
||
In the last part of the command, replace `open-webui` with your container name if it is different.
|
||
|
||
### Moving from Ollama WebUI to Open WebUI
|
||
|
||
Check our Migration Guide available in our [Open WebUI Documentation](https://docs.openwebui.com/migration/).
|
||
|
||
## What's Next? 🌟
|
||
|
||
Discover upcoming features on our roadmap in the [Open WebUI Documentation](https://docs.openwebui.com/roadmap/).
|
||
|
||
## Supporters ✨
|
||
|
||
A big shoutout to our amazing supporters who's helping to make this project possible! 🙏
|
||
|
||
### Platinum Sponsors 🤍
|
||
|
||
- We're looking for Sponsors!
|
||
|
||
### Acknowledgments
|
||
|
||
Special thanks to [Prof. Lawrence Kim](https://www.lhkim.com/) and [Prof. Nick Vincent](https://www.nickmvincent.com/) for their invaluable support and guidance in shaping this project into a research endeavor. Grateful for your mentorship throughout the journey! 🙌
|
||
|
||
## License 📜
|
||
|
||
This project is licensed under the [MIT License](LICENSE) - see the [LICENSE](LICENSE) file for details. 📄
|
||
|
||
## Support 💬
|
||
|
||
If you have any questions, suggestions, or need assistance, please open an issue or join our
|
||
[Open WebUI Discord community](https://discord.gg/5rJgQTnV4s) to connect with us! 🤝
|
||
|
||
## Star History
|
||
|
||
<a href="https://star-history.com/#open-webui/open-webui&Date">
|
||
<picture>
|
||
<source media="(prefers-color-scheme: dark)" srcset="https://api.star-history.com/svg?repos=open-webui/open-webui&type=Date&theme=dark" />
|
||
<source media="(prefers-color-scheme: light)" srcset="https://api.star-history.com/svg?repos=open-webui/open-webui&type=Date" />
|
||
<img alt="Star History Chart" src="https://api.star-history.com/svg?repos=open-webui/open-webui&type=Date" />
|
||
</picture>
|
||
</a>
|
||
|
||
---
|
||
|
||
Created by [Timothy J. Baek](https://github.com/tjbck) - Let's make Open WebUI even more amazing together! 💪
|