Open-WebUI:How to Build and Run locally with NodeJs.

CA Amit Singh
Free or Open Source software’s
4 min readApr 19, 2024

--

Learn to Install and Run Open-WebUI for Ollama Models and Other Large Language Models with NodeJS

What is Open-WebUI?

User-friendly WebUI for LLMs

Where is Github Repository?

Where is Website?

Features of Open-WebUI

Intuitive Interface: User-friendly experience.

Responsive Design: Enjoy a seamless experience on both desktop and mobile devices.

Local RAG Integration: Dive into the future of chat interactions with the groundbreaking Retrieval Augmented Generation (RAG) support. This feature seamlessly integrates document interactions into your chat experience. You can load documents directly into the chat or add files to your document library, effortlessly accessing them using command in the prompt. In its alpha phase, occasional issues may arise as we actively refine and enhance this feature to ensure optimal performance and reliability.

Web Browsing Capability: Seamlessly integrate websites into your chat experience using the command followed by the URL. This feature allows you to incorporate web content directly into your conversations, enhancing the richness and depth of your interactions.

LHF Annotation: Empower your messages by rating them with thumbs up and thumbs down, facilitating the creation of datasets for Reinforcement Learning from Human Feedback (RLHF). Utilize your messages to train or fine-tune models, all while ensuring the confidentiality of locally saved data.

Download/Delete Models: Easily download or remove models directly from the web UI.

GGUF File Model Creation: Effortlessly create Ollama models by uploading GGUF files directly from the web UI. Streamlined process with options to upload from your machine or download GGUF files from Hugging Face.

You can read all the features on Open-WebUI website or Github Repository mentioned above.

Here is how to Build and run Open-WebUI with NodeJs.

*******Kindly note that Build instructions remain same for Windows/Ubuntu/MacOS*******

Step 01: Clone Open-WebUI repository with below command

git clone https://github.com/open-webui/open-webui.git

Step 02: Now enter into Open-WebUI directory

cd open-webui

Step 03: Now Copy required .env file with below command in open-webui directory

cp -RPp .env.example .env

Step 04: Build Frontend Using Node by typing below commands

npm i
npm audit fix "only if you find issues"
npm run build

Step 05: Serving Frontend with the Backend

Step 06: Move to backend directory within Open-Webui with below command

cd ./backend

Step 07: Now install dependencies with below command

pip install -r requirements.txt -U

Step 08: Now start Open-Webui with below command

bash start.sh

Step 09: Open-WebUI will be available on localhost:8080

Here is youtube video for visual reference.

--

--

CA Amit Singh
Free or Open Source software’s

Qualified Chartered Accountant & Multi Technology Trainer with 24 yrs of Multi Technology/ Multi Industry Experience. www.linkedin.com/in/ca-amit-singh-07babb