llm.rb

A family of open-source AI runtimes, tools, and applications, all built on Ruby and the 0BSD license.

Tools

robert

Artificial Intelligence packaged as a native, 2MB FreeBSD binary. Built on mruby-llm. Ask questions about manual pages, search documentation, and read files with tool confirmation.

FreeBSD Binary CLI
GitHub Docs

relay

A self-hostable, hackable LLM web environment built on llm.rb. Extend with your own tools and skills. Supports MCP servers, streaming, multi-turn conversations, and inline audio playback.

Roda Sequel HTMX MCP
GitHub Docs

Runtimes

llm.rb

Ruby's most capable AI runtime. One runtime for providers, agents, tools, skills, MCP, A2A, streaming, and persistence. Supports OpenAI, Anthropic, Google Gemini, DeepSeek, xAI, Ollama, and more.

CRuby MCP A2A Rails
GitHub Docs API

mruby-llm

mruby's most capable AI runtime. A port of llm.rb to mruby that can be embedded into small standalone applications. Supports the same providers, tools, MCP, and A2A protocol.

mruby Embedded MCP A2A
GitHub Docs

wasm-llm

A browser- and edge-oriented LLM runtime compiled to WebAssembly. Uses the same llm.rb runtime underneath, exposed through a JavaScript API with tools, MCP HTTP, and streaming support.

WASM Browser Edge JavaScript
GitHub Docs

rails-llm

Rails integration for llm.rb. Generators, an engine with a stream-capable chat interface, and full access to the llm.rb runtime from your Rails application.

Rails Engine Generator Chat
GitHub Docs

About

The llm.rb family shares a common foundation: zero external dependencies by default, a single runtime for providers and tools, and the permissive 0BSD license.

llm.rb is the core Ruby AI runtime. rails-llm integrates it into Rails with generators and a chat engine. mruby-llm brings the same architecture to embedded mruby environments. wasm-llm compiles it to WebAssembly for browsers and edge runtimes. robert is a complete FreeBSD AI assistant built on mruby-llm. And relay is a full-featured web application that you can self-host and extend.

Together, these projects provide a complete ecosystem for building AI-powered applications in Ruby — from embedded systems and CLI tools to full-stack Rails applications and browser-based runtimes, all backed by the same proven runtime that supports every major LLM provider.

License

All projects are distributed under the BSD Zero Clause License. No restrictions on use, modification, or redistribution.