Stars
MIDI effects plugin for chords and arpeggios with support for ratcheting
A local inference engine for Apple silicon, built around the model.
Blazing fast Apple Silicon inference engine optimized for Qwen & Nemotron. OpenAI + Anthropic API compatible. Built by folks from nace.ai
lithos-metal: high-performance LLM inference kernels and serving for Apple silicon.
LLM Inference Engine for Metal, CUDA and Vulkan.
lemire / llama.cpp
Forked from jadidbourbaki/llama.cppLLM inference in C/C++
An Engine-Agnostic Deep Learning Framework in Java
Java Inference Tornado toolkit: High performance LLM inference & serving for the JVM on GPUs
A 2.78-trillion-parameter Kimi K3 running inference on a single CPU in 8.24 GB of RAM. Portable C99: no BLAS, no framework, no GPU.
A multi-instrument music transcription model developed by Kyutai and Mirelo.
⌥ Coding agent with the IDE wired in. Built by Stencil Labs.
The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on App…
A port of Snappy, LZO, LZ4, and Zstandard to Java
Distributed self-replicating programs in Python
Docker-compatible REST API on top of Apple container
Shoaku - AI Tools for Better Human Understanding
Bidirectional, stateful control of Logic Pro from AI assistants. 8 dispatcher tools + 7 resources across 5 native macOS channels.
LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar
DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
🍺 Alcoholless: lightweight security sandbox for Homebrew, AI agents, etc. on macOS
AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI