Omi captures your screen and conversations, transcribes in real-time, generates summaries and action items, and gives you an AI chat that remembers everything you've seen and heard. Works on desktop, phone and wearables. Fully open source.
Trusted by 300,000+ professionals.
git clone https://github.com/BasedHardware/omi.git && cd omi/desktop && ./run.sh --yoloBuilds the macOS app, connects to the cloud backend, and launches. No env files, no credentials, no local backend.
Requirements: macOS 14+, Xcode (includes Swift & code signing), Node.js
Full Installation
For local development with the full backend stack:
- Install prerequisites
xcode-select --install
curl --proto '=https' --tlsv1.2 -sSf https://sh.rustup.rs | sh- Clone and configure
git clone https://github.com/BasedHardware/omi.git
cd omi/desktop
cp Backend-Rust/.env.example Backend-Rust/.env- Build and run
./run.shSee desktop/README.md for environment variables and credential setup.
cd app && bash setup.sh ios # or: bash setup.sh androidThis fork runs entirely on your own machine: no Firebase, no Deepgram, no OpenAI, no data leaving your network.
| Upstream service | Local replacement |
|---|---|
| Firebase Auth | Local JWT (AUTH_PROVIDER=local) |
| Firestore | SQLite (DB_PROVIDER=sqlite) |
| Deepgram STT | faster-whisper (STT_PROVIDER=local) |
| OpenAI LLM | Ollama (LLM_PROVIDER=ollama) |
| Pinecone | Qdrant in Docker (VECTOR_DB_PROVIDER=qdrant) |
Prerequisites: macOS, Docker Desktop, Ollama, Homebrew + conda (Miniforge) — the setup guide installs the last two.
Quick start:
# 1. Clone and configure
git clone https://github.com/gentbot/lomi.git && cd lomi
cp backend/.env.local.example backend/.env
# Edit backend/.env — change LOCAL_JWT_SECRET and ENCRYPTION_SECRET to unique values
# Generate: python3 -c "import secrets; print(secrets.token_hex(32))"
# 2. Pull a model
ollama pull qwen3:0.6b
# 3. Start everything
cd backend && bash start_local.shThe API starts on http://localhost:8088. Browse to /docs for the Swagger UI.
First time on a new machine — follow the full guide: docs-local/SETUP_FROM_SCRATCH.md. Covers installing all prerequisites from scratch (~30–60 min).
Day-to-day operations, connecting clients, troubleshooting: README-LOCAL.md
How it works
┌─────────────────────────────────────────────────────────┐
│ Your Devices │
│ │
│ ┌──────────┐ ┌──────────────┐ ┌───────────────────┐ │
│ │ Omi │ │ macOS App │ │ Mobile App │ │
│ │ Wearable │ │ (Swift/Rust) │ │ (Flutter) │ │
│ └────┬─────┘ └──────┬───────┘ └────────┬──────────┘ │
│ │ BLE │ HTTPS/WS │ │
└───────┼────────────────┼───────────────────┼─────────────┘
│ │ │
▼ ▼ ▼
┌─────────────────────────────────────────────────────────┐
│ Omi Backend (Python) │
│ │
│ ┌─────────┐ ┌──────────┐ ┌─────────┐ ┌──────────┐ │
│ │ Listen │ │ Pusher │ │ VAD │ │ Diarizer │ │
│ │ (REST) │ │ (WS) │ │ (GPU) │ │ (GPU) │ │
│ └─────────┘ └──────────┘ └─────────┘ └──────────┘ │
│ │
│ ┌─────────┐ ┌──────────┐ ┌─────────┐ ┌──────────┐ │
│ │ Deepgram│ │ Firestore│ │ Redis │ │ LLMs │ │
│ │ (STT) │ │ (DB) │ │ (Cache) │ │ (AI) │ │
│ └─────────┘ └──────────┘ └─────────┘ └──────────┘ │
└─────────────────────────────────────────────────────────┘
| Component | Path | Stack |
|---|---|---|
| macOS app | desktop/ |
Swift, SwiftUI, Rust backend |
| Mobile app | app/ |
Flutter (iOS & Android) |
| Backend API | backend/ |
Python, FastAPI, Firebase |
| Firmware | omi/ |
nRF, Zephyr, C |
| Omi Glass | omiGlass/ |
ESP32-S3, C |
| SDKs | sdks/ |
React Native, Swift, Python |
| AI Personas | web/personas-open-source/ |
Next.js |
- Full Setup Guide — install everything from scratch on a new machine
- Operations Runbook — clients, pin bridge, day-to-day ops
- What Works Locally — feature parity vs cloud
- Upstream Sync Guide — keeping the fork current with BasedHardware/omi
- Environment Variables — every config option documented
- App Development Guide
- Example Apps — GitHub, Slack, OmiMentor
- Audio Streaming Apps
- Custom Chat Tools
- Submit to App Store
- API Reference — REST endpoints for memories, conversations, action items
- Python SDK
- Swift SDK
- React Native SDK
- MCP Server — Model Context Protocol integration
-
Buy Omi Glass Dev Kit — ESP32-S3, camera + audio
MIT — see LICENSE