How to Build an AI Chat at Home with Free Tiers: OmniRoute + Open WebUI

You start an AI chat, get into a useful conversation, and hit a usage limit just when you need to keep going. Paying for another subscription is the obvious fix, but the bills add up.

In my video, I showed the chat I built at home using free tiers from several AI providers. Here is the full walkthrough. By the end, you will have a chat interface on your computer that you can also open on your phone when both devices are on the same home network.

What we are installing

There are two parts:

• OmniRoute routes requests. You connect provider API keys and arrange models in a sequence. If the first model is unavailable or hits a limit, a combo can try the next one.
• Open WebUI is the chat interface. It runs in your browser and feels familiar if you have used other AI chats.

The OmniRoute dashboard shown in the video listed 151 providers with free plans. That is the number displayed in its dashboard. It does not mean they all offer a free API, work in your country, or fit this guide. We will use API keys from the providers’ official websites.

Before you start

You need a Windows, macOS, or Linux computer that supports Docker and can run Linux containers. It needs an internet connection, enough room to download the software, and it must stay on while you use the chat. Set aside about 30 to 40 minutes. Downloads may take longer on a slow connection.

New to Docker? Start here

Docker is the application that will run OmniRoute and Open WebUI on your computer. Follow the official installation guide for your system before downloading this article’s installer:

1. Windows: follow the Docker Desktop installation guide for Windows. Download the installer, open it, and follow the prompts. If it asks you to enable WSL 2 or restart, do that. Then launch Docker Desktop from the Start menu and wait for it to finish loading. Check that it is using Linux containers.
2. Mac: follow the Docker Desktop installation guide for Mac. Pick the download for your Mac’s chip, Apple silicon or Intel. Open the .dmg, drag Docker to Applications, launch it, and wait for it to finish loading.
3. Linux: follow the Docker Engine installation guide and choose your distribution. Ubuntu users can go straight to the Ubuntu guide. When installation is complete, follow the post-installation steps for using Docker without sudo, because the installer below runs docker as your user.

How to check: on Windows and Mac, keep Docker Desktop open. On Linux, open a terminal and run docker info. If you get a permission error, resolve it with the guide above before continuing. The installer in the next step also checks whether it can access Docker.

OmniRoute can also run without Docker. I chose Docker here because the same setup works across all three systems. The downloadable scripts below install and start both applications. You will create provider accounts and API keys separately on their official websites.

Try the computer you already own first. Consider a dedicated device only if you find yourself using the chat regularly.

Step 1: download the installer for your system

Each ZIP contains a readable script. Extract the ZIP and run only the script for your operating system. Keep the extracted file somewhere easy to find:

• Download the Windows installer
• Download the Mac installer
• Download the Linux installer

Want to know what the script does? Open it in a text editor before running it. It checks Docker, creates a network for the two applications, pulls their official container images, starts them, and generates random installation secrets. It does not ask for your provider API keys.

The installer names the router container capyborg-omniroute and the chat interface container capyborg-open-webui. These are Docker container names, not your computer’s name. You will use the first one in the connection address in step 5.

Windows

After extracting the ZIP, open the folder containing the script. Click the folder’s address bar, type powershell, and press Enter. In the window that opens, run:

.instalar-chat-ia-windows.cmd

Docker Desktop must be running in Linux containers mode. The terminal will stay open at the end so you can copy the initial password.

Mac

After extracting the ZIP into Downloads, open Terminal and run:

bash "$HOME/Downloads/instalar-chat-ia-mac.sh"

If the script is in another folder, type bash , drag the file into Terminal, and press Enter.

Linux

After extracting the ZIP into Downloads, open a terminal and run:

bash "$HOME/Downloads/instalar-chat-ia-linux.sh"

If the file ended up in a subfolder, type bash , drag the file into the terminal, and press Enter. If Docker reports a permission error, follow its official post-installation instructions and run the script again. The script does not change your computer’s permissions.

Save the initial OmniRoute password shown in the terminal. You will need it in the next step. The installer also prints two addresses: http://localhost:20128 for OmniRoute and http://localhost:3000 for Open WebUI. The first launch may take a few minutes.

Step 2: sign in to OmniRoute

On your computer, open http://localhost:20128. Sign in using the initial password from the installer. If the dashboard offers to change it, do so and save the new password in a password manager.

localhost works only on the same computer. The installer restricts the OmniRoute port to that computer. This is why Open WebUI will use a different address to reach it.

Step 3: create free API keys

An API key is like a password that lets OmniRoute use your account with a provider. Create one in each service. Do not share it in comments, screenshots, or messages.

1. Google AI Studio: visit the API key page, sign in, and copy an existing key or choose Create API key. Check the official pricing table to see which models have a free tier.
2. Groq: visit the API key page, create an account if needed, and choose Create API Key. Check the limits shown in your dashboard.
3. OpenRouter: create a key on its API keys page. For this guide, choose only model IDs ending in :free from its official free models list.

What about Cerebras and Mistral? Cerebras advertises an initial free credit, which is not an ongoing free allowance. Add it only while your account shows free credit. Mistral’s current documentation says API access requires billing activation. That is why Mistral is not part of this guide’s free combo.

Step 4: connect the keys and create a combo

In OmniRoute, open Providers → Add Provider. Select Google, paste your key, and test the connection. Repeat for Groq and OpenRouter. The official providers guide explains this flow.

Next, open Combos → Create New. Name the combo gratis, choose at least two models from different providers, and select the Priority strategy. Save it. OmniRoute will try models in the order you set and can fall back to the next one when a model is unavailable. See the official combo guide.

Check every model before adding it. A provider with a free tier may also offer paid models. In OpenRouter, use only IDs ending in :free.

Step 5: connect Open WebUI to OmniRoute

On your computer, open http://localhost:3000. Create an administrator account with a strong password. Do this before opening the chat on your phone, because the first account created becomes the administrator.

In OmniRoute, open Endpoints and create or copy an API key for the connection. Use that key in Open WebUI. The installer enables API key enforcement, so arbitrary text will not work in this field.

Where does capyborg-omniroute come from? The script in step 1 created a container with that name and placed both applications on the capyborg-ia Docker network. Open WebUI can use that name to reach OmniRoute. You do not need to rename your computer or find its IP for this connection.

In Open WebUI, open your profile and go to Settings → Admin → Connections:

1. Under Manage OpenAI API Connections, add an External connection.
2. For URL, enter http://capyborg-omniroute:20128/v1.
3. For API Key, paste the key copied from OmniRoute.
4. Under Advanced → Model IDs, add only gratis.
5. Save. If an Ollama connection is enabled and you do not use it, disable it.

In this setup, 127.0.0.1 would point back to the Open WebUI container. The Model IDs field keeps the interface focused on your combo. See the Open WebUI documentation.

Start a new chat, select gratis, and ask: “Explain what an API key is in three sentences.” If you get an answer, your chat is working.

Step 6: open it on your phone

Your phone must be on your home Wi-Fi. Your computer can use the same Wi-Fi or a cable connected to the same router. To open the chat on your phone, find the computer’s local IP address, a number like 192.168.1.50. This is not your public internet address.

1. Windows: open the Start menu, type cmd, and press Enter. In the black window, type ipconfig and press Enter. Find the Wireless LAN adapter Wi-Fi or Ethernet adapter section, depending on how your computer connects. Copy its IPv4 Address. Ignore adapters named vEthernet or Docker. You can also find it under Settings → Network & internet → Properties. Microsoft’s help page.
2. Mac: open System Settings → Network → Wi-Fi or Ethernet, select your active connection, then choose Details → TCP/IP. Copy the IPv4 address. Apple’s help page.
3. Linux: open your active network connection’s settings and look for IPv4. Or open a terminal and run ip -4 route get 1.1.1.1. Copy the number after src. For example, src 192.168.1.50 means that 192.168.1.50 is the IP you need.

On your phone, replace YOUR-PC-IP with the number you copied: http://YOUR-PC-IP:3000. With the example above, use http://192.168.1.50:3000. Enter the full address, including http:// and :3000, then sign in with the account you created in step 5.

If it does not load, first test http://localhost:3000 on the computer. Then make sure your phone is not on a guest network or VPN, and check that your computer’s firewall allows port 3000 on your home network.

How to see automatic switching in action

1. With at least two working providers in the combo, send a short question through Open WebUI.
2. Check Logs in OmniRoute to see which provider answered.
3. Under Providers, temporarily disable the connection that answered.
4. Send another short question using the gratis combo and check whether another provider took over.
5. Enable the connection you disabled.

This test shows what happens when one option is unavailable. If every provider in the combo has run out of quota, the chat will stop responding too.

Limits and precautions you should know

Read this before sending real data. The interface runs on your computer, but your prompts travel over the internet to the provider that handles them.

• These are different models. Quality varies, and some free models may perform worse on difficult tasks.
• Privacy depends on the provider. Google says free-tier content may be used to improve its products. On OpenRouter, practices vary by model and final provider. Do not send passwords, personal documents, client data, or confidential material without checking each service’s data policy.
• Automatic switching has limits. Providers can change their quotas, models, and terms. Three API keys do not guarantee that one will always be available.
• Your computer must stay on. If it sleeps or Docker stops, your chat stops working.
• Keep access on your home network. Use a strong Open WebUI password and do not open port 3000 on your router to the internet. The project’s security guidance calls for additional protection before public exposure.
• Use official APIs. OmniRoute also lists connections that use third-party tool logins or sessions. Those may conflict with terms of service and lead to account blocks. This guide uses only keys created in official provider dashboards.
• This installer uses the slim Open WebUI image. It works for the text chat in this guide. Voice and document features may require other services or components. See the image variants.

Frequently asked questions

Is it safe?

You protect the interface with a password, and OmniRoute remains restricted to your computer. Your prompts still go to external AI providers. Check each provider’s data policy before using sensitive information.

Does it work on my phone when the computer is off?

No. In this setup, your computer hosts the chat. Your phone only opens it over your home network.

Can I use it at work?

That depends on your company’s rules and the data you send. Do not put client information or internal documents into external APIs without authorization.

How much electricity does it use?

That depends on your computer’s actual power draw and local electricity price. To estimate it, use watts × hours on ÷ 1,000 × price per kWh. A plug-in power meter can help you measure your computer.

Do I need to add a payment card?

Check each provider’s current free-tier terms. Do not enable billing to follow this guide. Mistral is excluded because its current API documentation requires billing activation.

What if I run the installer again?

It detects the containers it already created and does not erase their settings. If you lost your original OmniRoute password, rerunning the installer will not show it again. See the official password recovery documentation.

Start chatting

Open Open WebUI, choose gratis, and start a conversation. If a response fails, check provider status and limits in OmniRoute first. That is where you can see which part stopped working.

Disclosure: I know OmniRoute’s creator. This is not paid advertising, and I received no benefit for publishing this article.