Llumen

🚀 The antidote to bloated AI interfaces.

A lightweight, performant chat application for the rest of us.

If you have ever tried to self-host an LLM interface on a modest device, you know the struggle:

1. The Bloat: Python-based containers that eat Gigabytes of RAM just to idle.
2. The Lag: Waiting 30+ seconds for a server to boot and another minute to load chat history.
3. The Config Hell: Spending hours wrestling with pipelines just to get a simple feature like "Title Generation" to work reliably.

We refused to accept that "powerful" means "heavy." We built llumen to fill the gap between commercial products (easy to setup, but no privacy) and power-user tools (private, but heavy & complex).

Don't let the size fool you. Llumen is lightweight in resources, but heavy on capability.

• 🔌 OpenAI Compatible: Works with OpenRouter, local models, or OpenAI-compatible server.
• 🚀 Blazing Fast: Sub-second cold starts. No more waiting.
• 🧠 Smart & Deep: Built-in "Deep Research" capabilities, web-search integration.
• 🎨 Rich Media: Handles PDF uploads, image generation, and renders complex LaTeX/Code.
• 🤝 Run Anywhere: Windows, Linux, Docker, and fully optimized for Arm64 (yes, it fly on a Raspberry Pi).

Prove the speed yourself. If you have Docker, you are 30 seconds away from chatting.

Our multi-stage build produces a tiny, efficient container.

docker run -it --rm \
  -e API_KEY="<YOUR_OPENROUTER_API_KEY>" \
  -p 80:80 \
  -v "$(pwd)/data:/data" \
  ghcr.io/pinkfuwa/llumen:latest

That's it. No pipelines to configure. No dependencies to install.

See ./docs/sample for docker-compose examples.

Prefer a binary? We support that too. Check the Releases for Windows and Linux binaries.

It works out of the box, but if you want to tweak it:

• API_KEY (required) — Your OpenRouter/Provider key.
• OPENAI_API_BASE — Custom endpoint (Default: https://openrouter.ai/api).
• DATABASE_URL — SQLite path (Default: sqlite://data/db.sqlite?mode=rwc).
• BIND_ADDR — Network interface (Default: 0.0.0.0:80).

• User Guide: ./docs/user/README.md - Full features and usage.
• For Developers:
  • Build from source: ./docs/chore/README.md
  • Architecture docs: ./docs/dev/README.md