Find a file
Timothy J. Baek 1d225dd804
Some checks failed
Release / release (push) Failing after 2s
Deploy to HuggingFace Spaces / check-secret (push) Successful in 1s
Create and publish Docker images with specific build args / build-main-image (linux/amd64) (push) Failing after 13s
Create and publish Docker images with specific build args / build-main-image (linux/arm64) (push) Failing after 12s
Create and publish Docker images with specific build args / merge-main-images (push) Has been skipped
Create and publish Docker images with specific build args / build-cuda-image (linux/amd64) (push) Failing after 13s
Create and publish Docker images with specific build args / build-cuda-image (linux/arm64) (push) Failing after 15s
Create and publish Docker images with specific build args / merge-cuda-images (push) Has been skipped
Create and publish Docker images with specific build args / build-ollama-image (linux/amd64) (push) Failing after 13s
Create and publish Docker images with specific build args / build-ollama-image (linux/arm64) (push) Failing after 14s
Create and publish Docker images with specific build args / merge-ollama-images (push) Has been skipped
Python CI / Format Backend (3.11) (push) Successful in 12s
Frontend Build / Format & Build Frontend (push) Successful in 2m18s
Frontend Build / Frontend Unit Tests (push) Successful in 55s
Integration Test / Run Cypress Integration Tests (push) Failing after 2s
Integration Test / Run Migration Tests (push) Failing after 4s
Release to PyPI / release (push) Failing after 3s
Deploy to HuggingFace Spaces / deploy (push) Has been skipped
fix: chat pdf, txt export issue
2024-09-26 20:59:25 +02:00
.github fix scripts to point to correct path 2024-09-04 20:27:30 +02:00
backend refac 2024-09-26 03:13:38 +02:00
cypress tests: update share test to actually share 2024-08-11 22:30:25 +01:00
docs Update SECURITY.md 2024-08-19 09:18:40 -05:00
kubernetes Improve kustomization usage 2024-09-08 20:43:00 +02:00
scripts refac 2024-06-18 19:44:32 -07:00
src fix: chat pdf, txt export issue 2024-09-26 20:59:25 +02:00
static Add robots.txt to fix validation error 2024-08-28 10:10:22 +02:00
test/test_files/image_gen feat: add image gen with automatic1111 to integration test 2024-05-20 23:03:05 +01:00
.dockerignore Added HTML and Typescript UI components to support configration of text extraction engine. 2024-07-01 12:10:59 -06:00
.env.example refac: byebye litellm 2024-05-25 14:43:35 -07:00
.eslintignore chat feature added 2023-10-08 15:38:42 -07:00
.eslintrc.cjs feat: add basic cypress test as initial work towards e2e tests 2024-04-27 14:10:10 +01:00
.gitattributes fixed Docker problem some users experienced 2024-02-13 12:46:21 +01:00
.gitignore feat(config): exclude .vscode/settings.json from version control 2024-07-01 18:52:19 +02:00
.npmrc chat feature added 2023-10-08 15:38:42 -07:00
.prettierignore chore: format 2024-05-16 18:21:19 -10:00
.prettierrc chat feature added 2023-10-08 15:38:42 -07:00
bun.lockb first draft 2024-02-22 11:54:55 +01:00
Caddyfile.localhost feat: update .env.example and add Caddyfile 2023-10-22 12:26:55 -06:00
CHANGELOG.md Update CHANGELOG.md 2024-09-26 04:12:19 +02:00
CODE_OF_CONDUCT.md doc: typo 2024-06-01 20:50:01 -07:00
confirm_remove.sh Chose between "docker-compose" and "docker compose" in confirm_remove.sh 2024-04-19 20:19:24 +02:00
cypress.config.ts feat: add basic cypress test as initial work towards e2e tests 2024-04-27 14:10:10 +01:00
demo.gif doc: demo.gif 2024-06-03 15:15:59 -07:00
docker-compose.a1111-test.yaml feat: add image gen with automatic1111 to integration test 2024-05-20 23:03:05 +01:00
docker-compose.amdgpu.yaml Add variables 2024-04-05 23:46:20 -04:00
docker-compose.api.yaml Removed version synatax as its no longer needed per Docker Docs 2024-05-09 14:54:26 -04:00
docker-compose.data.yaml Removed version synatax as its no longer needed per Docker Docs 2024-05-09 14:54:26 -04:00
docker-compose.gpu.yaml Removed version synatax as its no longer needed per Docker Docs 2024-05-09 14:54:26 -04:00
docker-compose.yaml Removed version synatax as its no longer needed per Docker Docs 2024-05-09 14:54:26 -04:00
Dockerfile refac 2024-09-19 22:21:35 +02:00
hatch_build.py refac: rename build hash vars 2024-05-26 08:49:30 +01:00
i18next-parser.config.ts fix: configure i18next to not return empty strings 2024-03-09 03:33:20 +03:30
INSTALLATION.md rename 2024-02-17 00:07:43 -08:00
LICENSE chore: revert license change 2023-11-14 13:32:59 -08:00
Makefile Chose between "docker-compose" and "docker compose" in Makefile 2024-04-19 19:30:25 +02:00
package-lock.json chore: bump 2024-09-26 03:14:06 +02:00
package.json doc: changelog 2024-09-26 04:11:13 +02:00
postcss.config.js chore: npm run fmt 2023-10-21 22:47:30 -06:00
pyproject.toml Merge remote-tracking branch 'origin/main' 2024-09-24 12:17:33 +08:00
README.md Update README.md 2024-09-26 15:57:43 +02:00
run-compose.sh fix: docker gpus option "all" support 2024-04-27 23:50:07 +03:00
run-ollama-docker.sh fix: run-ollama-docker.sh 2024-01-29 15:38:56 -08:00
run.sh Update run.sh 2024-02-19 11:43:53 -08:00
svelte.config.js migration to SvelteKit 2 2024-08-05 11:00:30 -04:00
tailwind.config.js Add padding to compensate for iPhone nav bar 2024-09-08 17:52:10 +02:00
TROUBLESHOOTING.md refac: AIOHTTP_CLIENT_TIMEOUT default value should match 2024-06-15 04:25:21 -06:00
tsconfig.json chat feature added 2023-10-08 15:38:42 -07:00
update_ollama_models.sh fix: update Makefile and rename script for open-webui integration 2024-02-24 07:51:27 +01:00
uv.lock fix: pip install database save issue 2024-09-26 03:02:08 +02:00
vite.config.ts Merge remote-tracking branch 'upstream/dev' into feat/include-git-hash-everywhere 2024-05-26 11:27:02 +01:00

Open WebUI (Formerly Ollama WebUI) 👋

GitHub stars GitHub forks GitHub watchers GitHub repo size GitHub language count GitHub top language GitHub last commit Hits Discord

Open WebUI is an extensible, feature-rich, and user-friendly self-hosted WebUI designed to operate entirely offline. It supports various LLM runners, including Ollama and OpenAI-compatible APIs. For more information, be sure to check out our Open WebUI Documentation.

Open WebUI Demo

Key Features of Open WebUI

  • 🚀 Effortless Setup: Install seamlessly using Docker or Kubernetes (kubectl, kustomize or helm) for a hassle-free experience with support for both :ollama and :cuda tagged images.

  • 🤝 Ollama/OpenAI API Integration: Effortlessly integrate OpenAI-compatible APIs for versatile conversations alongside Ollama models. Customize the OpenAI API URL to link with LMStudio, GroqCloud, Mistral, OpenRouter, and more.

  • 🧩 Pipelines, Open WebUI Plugin Support: Seamlessly integrate custom logic and Python libraries into Open WebUI using Pipelines Plugin Framework. Launch your Pipelines instance, set the OpenAI URL to the Pipelines URL, and explore endless possibilities. Examples include Function Calling, User Rate Limiting to control access, Usage Monitoring with tools like Langfuse, Live Translation with LibreTranslate for multilingual support, Toxic Message Filtering and much more.

  • 📱 Responsive Design: Enjoy a seamless experience across Desktop PC, Laptop, and Mobile devices.

  • 📱 Progressive Web App (PWA) for Mobile: Enjoy a native app-like experience on your mobile device with our PWA, providing offline access on localhost and a seamless user interface.

  • ✒️🔢 Full Markdown and LaTeX Support: Elevate your LLM experience with comprehensive Markdown and LaTeX capabilities for enriched interaction.

  • 🎤📹 Hands-Free Voice/Video Call: Experience seamless communication with integrated hands-free voice and video call features, allowing for a more dynamic and interactive chat environment.

  • 🛠️ Model Builder: Easily create Ollama models via the Web UI. Create and add custom characters/agents, customize chat elements, and import models effortlessly through Open WebUI Community integration.

  • 🐍 Native Python Function Calling Tool: Enhance your LLMs with built-in code editor support in the tools workspace. Bring Your Own Function (BYOF) by simply adding your pure Python functions, enabling seamless integration with LLMs.

  • 📚 Local RAG Integration: Dive into the future of chat interactions with groundbreaking Retrieval Augmented Generation (RAG) support. This feature seamlessly integrates document interactions into your chat experience. You can load documents directly into the chat or add files to your document library, effortlessly accessing them using the # command before a query.

  • 🔍 Web Search for RAG: Perform web searches using providers like SearXNG, Google PSE, Brave Search, serpstack, serper, Serply, DuckDuckGo, TavilySearch and SearchApi and inject the results directly into your chat experience.

  • 🌐 Web Browsing Capability: Seamlessly integrate websites into your chat experience using the # command followed by a URL. This feature allows you to incorporate web content directly into your conversations, enhancing the richness and depth of your interactions.

  • 🎨 Image Generation Integration: Seamlessly incorporate image generation capabilities using options such as AUTOMATIC1111 API or ComfyUI (local), and OpenAI's DALL-E (external), enriching your chat experience with dynamic visual content.

  • ⚙️ Many Models Conversations: Effortlessly engage with various models simultaneously, harnessing their unique strengths for optimal responses. Enhance your experience by leveraging a diverse set of models in parallel.

  • 🔐 Role-Based Access Control (RBAC): Ensure secure access with restricted permissions; only authorized individuals can access your Ollama, and exclusive model creation/pulling rights are reserved for administrators.

  • 🌐🌍 Multilingual Support: Experience Open WebUI in your preferred language with our internationalization (i18n) support. Join us in expanding our supported languages! We're actively seeking contributors!

  • 🌟 Continuous Updates: We are committed to improving Open WebUI with regular updates, fixes, and new features.

Want to learn more about Open WebUI's features? Check out our Open WebUI documentation for a comprehensive overview!

🔗 Also Check Out Open WebUI Community!

Don't forget to explore our sibling project, Open WebUI Community, where you can discover, download, and explore customized Modelfiles. Open WebUI Community offers a wide range of exciting possibilities for enhancing your chat interactions with Open WebUI! 🚀

How to Install 🚀

Installation via Python pip 🐍

Open WebUI can be installed using pip, the Python package installer. Before proceeding, ensure you're using Python 3.11 to avoid compatibility issues.

  1. Install Open WebUI: Open your terminal and run the following command to install Open WebUI:

    pip install open-webui
    
  2. Running Open WebUI: After installation, you can start Open WebUI by executing:

    open-webui serve
    

This will start the Open WebUI server, which you can access at http://localhost:8080

Quick Start with Docker 🐳

Note

Please note that for certain Docker environments, additional configurations might be needed. If you encounter any connection issues, our detailed guide on Open WebUI Documentation is ready to assist you.

Warning

When using Docker to install Open WebUI, make sure to include the -v open-webui:/app/backend/data in your Docker command. This step is crucial as it ensures your database is properly mounted and prevents any loss of data.

Tip

If you wish to utilize Open WebUI with Ollama included or CUDA acceleration, we recommend utilizing our official images tagged with either :cuda or :ollama. To enable CUDA, you must install the Nvidia CUDA container toolkit on your Linux/WSL system.

Installation with Default Configuration

  • If Ollama is on your computer, use this command:

    docker run -d -p 3000:8080 --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main
    
  • If Ollama is on a Different Server, use this command:

    To connect to Ollama on another server, change the OLLAMA_BASE_URL to the server's URL:

    docker run -d -p 3000:8080 -e OLLAMA_BASE_URL=https://example.com -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main
    
  • To run Open WebUI with Nvidia GPU support, use this command:

    docker run -d -p 3000:8080 --gpus all --add-host=host.docker.internal:host-gateway -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:cuda
    

Installation for OpenAI API Usage Only

  • If you're only using OpenAI API, use this command:

    docker run -d -p 3000:8080 -e OPENAI_API_KEY=your_secret_key -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:main
    

Installing Open WebUI with Bundled Ollama Support

This installation method uses a single container image that bundles Open WebUI with Ollama, allowing for a streamlined setup via a single command. Choose the appropriate command based on your hardware setup:

  • With GPU Support: Utilize GPU resources by running the following command:

    docker run -d -p 3000:8080 --gpus=all -v ollama:/root/.ollama -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:ollama
    
  • For CPU Only: If you're not using a GPU, use this command instead:

    docker run -d -p 3000:8080 -v ollama:/root/.ollama -v open-webui:/app/backend/data --name open-webui --restart always ghcr.io/open-webui/open-webui:ollama
    

Both commands facilitate a built-in, hassle-free installation of both Open WebUI and Ollama, ensuring that you can get everything up and running swiftly.

After installation, you can access Open WebUI at http://localhost:3000. Enjoy! 😄

Other Installation Methods

We offer various installation alternatives, including non-Docker native installation methods, Docker Compose, Kustomize, and Helm. Visit our Open WebUI Documentation or join our Discord community for comprehensive guidance.

Troubleshooting

Encountering connection issues? Our Open WebUI Documentation has got you covered. For further assistance and to join our vibrant community, visit the Open WebUI Discord.

Open WebUI: Server Connection Error

If you're experiencing connection issues, its often due to the WebUI docker container not being able to reach the Ollama server at 127.0.0.1:11434 (host.docker.internal:11434) inside the container . Use the --network=host flag in your docker command to resolve this. Note that the port changes from 3000 to 8080, resulting in the link: http://localhost:8080.

Example Docker Command:

docker run -d --network=host -v open-webui:/app/backend/data -e OLLAMA_BASE_URL=http://127.0.0.1:11434 --name open-webui --restart always ghcr.io/open-webui/open-webui:main

Keeping Your Docker Installation Up-to-Date

In case you want to update your local Docker installation to the latest version, you can do it with Watchtower:

docker run --rm --volume /var/run/docker.sock:/var/run/docker.sock containrrr/watchtower --run-once open-webui

In the last part of the command, replace open-webui with your container name if it is different.

Check our Migration Guide available in our Open WebUI Documentation.

Using the Dev Branch 🌙

Warning

The :dev branch contains the latest unstable features and changes. Use it at your own risk as it may have bugs or incomplete features.

If you want to try out the latest bleeding-edge features and are okay with occasional instability, you can use the :dev tag like this:

docker run -d -p 3000:8080 -v open-webui:/app/backend/data --name open-webui --add-host=host.docker.internal:host-gateway --restart always ghcr.io/open-webui/open-webui:dev

What's Next? 🌟

Discover upcoming features on our roadmap in the Open WebUI Documentation.

Supporters

A big shoutout to our amazing supporters who's helping to make this project possible! 🙏

Platinum Sponsors 🤍

  • We're looking for Sponsors!

Acknowledgments

Special thanks to Prof. Lawrence Kim and Prof. Nick Vincent for their invaluable support and guidance in shaping this project into a research endeavor. Grateful for your mentorship throughout the journey! 🙌

License 📜

This project is licensed under the MIT License - see the LICENSE file for details. 📄

Support 💬

If you have any questions, suggestions, or need assistance, please open an issue or join our Open WebUI Discord community to connect with us! 🤝

Star History

Star History Chart

Created by Timothy J. Baek - Let's make Open WebUI even more amazing together! 💪