Local-first agent runtime

A state-of-the-art agent you can run at home.

Aithy is a local-first agent for experimenting with the latest research, local and hosted inference, DSPy, RLM, sandboxed tools, durable memory, and agent mesh networks.

Download build Start from code

Ax Agent checkpointed context sandboxed tools local inference LAN Mesh

Aithy chat workspace with tool evidence and a browser interface — A local workspace for long-running chat, files, tools, evidence, and artifacts.

Aithy is pronounced ay-thee.

Local agent

Run private agent work close to your data.

Use Aithy as a personal agent today, with sessions, files, tools, artifacts, and visible runtime evidence in one browser workspace.

Private runtime

Keep the power visible.

State, memories, skills, settings, usage, permissions, sandbox status, and service health are product surfaces instead of hidden logs.

Local inference

Small local models, big hosted models.

Use managed llama.cpp models for local chat, embeddings, and reranking, then switch to a stronger provider when a task needs it.

Home Mesh

Your laptop can borrow the big machine.

Pair trusted Aithy instances on your LAN so one machine can use validated inference or search services from another.

Memory

Long conversations stay useful.

Durable sessions, searchable memories, transcript recall, and task episodes give the agent evidence without stuffing every turn into context.

Sandbox

Tools stay behind clear boundaries.

Agent commands run through sandbox and permission gates, with host files exposed through explicit attachments or mounts.

Model router

Model choice is runtime configuration.

Use local Qwen GGUF models, a normal cloud provider, an OpenAI-compatible endpoint, eligible Grok subscription sign-in, or a family machine discovered through Mesh.

llama.cpp Qwen GGUF OpenAI-compatible Grok OAuth Family Mesh

Aithy inference settings with local and family model choices — Choose local, hosted, subscription, custom, or Mesh-shared model sources.

Agent architecture

From prompt to proof, every layer stays inspectable.

Chat + filesUser intent, uploads, artifacts, and prior sessions

Skills + memorySearchable workflows, facts, episodes, and transcript evidence

Aithy runtime Ax Agent loop, context distillation, queues, permissions, and tool traces

SandboxGoverned commands, staged attachments, mounts, and published artifacts

InferenceLocal models, cloud providers, Grok sign-in, and Mesh family services

Aithy local inference settings — Local inference keeps chat, embeddings, reranking, and retrieval close.

Aithy runtime console showing services and jobs — The runtime console makes services, queues, jobs, and logs visible.

Home lab Mesh

Share local compute without copying secrets around.

Mesh discovery is LAN-only and advertises identity and connection metadata, not API keys, prompts, sessions, memories, model lists, provider URLs, or service catalogs.

Catalogs and requests move only after explicit pairing and mutual family trust, so a laptop can borrow selected services from a stronger nearby machine.

Aithy Mesh pairing and trusted services page — Pair trusted local Aithy instances and share selected services over your LAN.

Grok subscription

Use OAuth instead of pasted credentials.

Eligible Grok subscription sign-in can power chat and web.search without pasting an API key into Aithy, subject to xAI eligibility and limits.

Aithy Grok subscription OAuth sign-in — Connected provider settings stay visible in the local product surface.

Quick start

Download a build or run from source.

Download a build

Grab the latest archive from GitHub Releases, unpack it, run Aithy, then open the local browser control surface.

gh release download --repo dosco/aithy --pattern 'aithy-*-darwin-arm64.tar.gz'
tar -xzf aithy-*-darwin-arm64.tar.gz
cd aithy-*-darwin-arm64
./aithy

github.com/dosco/aithy/releases/latest

Start from code

Use the source path if you want to hack on the runtime or inspect the whole stack while it runs. You need Bun 1.3.14 or newer.

git clone https://github.com/dosco/aithy.git
cd aithy
bun install
bun run start

Local state defaults to ~/.config/aithy/default/.