Lists (1)
Stars
CUDA Templates and Python DSLs for High-Performance Linear Algebra
FlashInfer: Kernel Library for LLM Serving
Fastest and only macOS Dictation app with on-device STT and custom trained AI enhancement model. A local Wispr Flow alternative. ⭐ helps a ton :) Windows & iOS waitlist open. Linux soon.
A free, open source, and extensible speech-to-text application that works completely offline.
Voice-to-text dictation app with local (Nvidia Parakeet/Whisper) and cloud models (BYOK). Privacy-first and available cross-platform.
Robust Speech Recognition via Large-Scale Weak Supervision
A high-throughput and memory-efficient inference and serving engine for LLMs
Give your AI agent eyes to see the entire internet. Read & search Twitter, Reddit, YouTube, GitHub, Bilibili, XiaoHongShu — one CLI, zero API fees.
AI Agent Framework, the Pydantic way
Run GLM-5.2 (744B MoE) on a 25GB-RAM consumer machine — pure C, zero deps, experts streamed from disk. Tiny engine, immense model. 🐦
DroidDesk turns your Android phone into a real Linux desktop using Termux, Termux X11, TUR, and Proot. Run VS Code, Firefox, LibreOffice, Blender, and more with X11 or VNC support for monitor setup.
AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI
Lightweight coding agent that runs in your terminal
The agent that grows with you
🙌 OpenHands: AI-Driven Development
AirLLM 70B inference with single 4GB GPU
DeepSeek 4 Flash and PRO local inference engine for Metal, CUDA and ROCm
SkillOpt is a text-space optimizer that trains reusable natural-language skills for frozen LLM agents through trajectory-driven edits, validation-gated updates, and deployable best_skill.md artifacts.
Benchmark tool for measuring speculative decoding speedups. Sweep draft/target model combinations and generate interactive charts.
Open Source Wealth Management Software. Angular + NestJS + Prisma + Nx + TypeScript 🤍
An ebook reader application supporting PDF, DjVu, EPUB, FB2 and many more formats, running on Cervantes, Kindle, Kobo, PocketBook and Android devices
Instant, easy, and predictable development environments
Connect Your Agents And Harnesses With Any Provider 🦚