Stars
DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
Validated recipe for serving Qwen3.6-27B on a single RTX 5090 — full OpenAI API, vision, tool calling, MTP spec-decode
Fast, lossless LLM inference via dual-view diffusion decoding.
SNDR Core Engine (Genesis) — vLLM runtime patch-overlay for Qwen3.6 + Gemma4 on consumer NVIDIA (Ampere sm_86, 2× A5000/3090). Qwen3.6-35B-A3B FP8 ~240 tok/s, 27B-int4 hybrid GDN+Mamba, Gemma4 26B/…
Rust for native business logic, Flutter for flexible and beautiful GUI
Qwen3.5-122B-A10B on DGX Spark: 28.3 → 51 tok/s (+80%)
Fullstack app framework for web, desktop, and mobile.
Qwen3.6-35B-A3B-heretic NVFP4 + DFlash speculative decoding on DGX Spark (GB10/sm_121a). Source-built vLLM image + 7 patches + comprehensive deployment guide.
🔥🔥 Kokoro in Rust. https://huggingface.co/hexgrad/Kokoro-82M Insanely fast, realtime TTS with high quality you ever have.
Caveman Compression is a semantic compression method for LLM contexts. It removes predictable grammar while preserving the unpredictable, factual content that defines meaning.
On-device property graph database. Schema-as-code. One CLI → One Folder. No Server. Think: DuckDB for graphs.
Protocol-Driven Development (PDD) is an AI-assisted software engineering approach for building reliable systems.
Lean 4 formalization of Knuth's 'Claude's Cycles' paper
A free, open source, and extensible speech-to-text application that works completely offline.
💻 testing framework and cli for driving tests for terminal apps - native ai agent support
Browser automation CLI for AI agents
Hundreds of models & providers. One command to find what runs on your hardware.
A fast and minimal command-line interface for generating terminal and PNG QR codes.
Extracted system prompts from Anthropic - Claude Fable 5, Opus 5, Claude Design, Claude Code. OpenAI - ChatGPT GPT-5.6-Sol, Codex. Google - Gemini 3.5 Flash, 3.1 Pro, Antigravity. xAI - Grok, Curso…
AI agent skill that researches any topic across Reddit, X, YouTube, HN, Polymarket, and the web - then synthesizes a grounded summary
Podman: A tool for managing OCI containers and pods.
A tool for creating and running Linux containers using lightweight virtual machines on a Mac. It is written in Swift, and optimized for Apple silicon.
A high-level API to control headless Chrome or Chromium over the DevTools Protocol. It is the Rust equivalent of Puppeteer, a Node library maintained by the Chrome DevTools team.