Elasticsearch gui - desktop app, browser extension, docker, self hosted

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Open-source local AI SDK - run AI on-device with no cloud, no API keys. Supports GGUF, RAG, image, music, and video generation, speech-to-text, P2P inference, and more. Cross-platform: Linux, macOS…

Open-source implementation of AlphaEvolve

Winner 🏆 (Agent-only) MLSys 2026 - FlashInfer AI Kernel Generation Contest for the DeepSeek Sparse Attention (DSA) track with an average speedup of 34.93x

Produce your own Dynamic 3.0 Quants and achieve optimum accuracy & SOTA quantization performance! Input a target size and the toolchain will create a GGUF recipe tuned to your hardware within secon…

Local-first session search, analytics, insights, and token use statistics for coding agents, supporting Claude Code, Codex, and more than 20 other agents.

Kernel Design Agents (KDA) is a agent-centric workflow to write high-performance CUDA Kernels.

A framework for building realtime voice AI agents 🤖🎙️📹

Dion optimizer algorithm

Tang Primer 25K + FT601

Windows Llama App Companion

Animate skeletons with natural language; NVIDIA's Kimodo ported to C++/GGML

Generate PowerPoint (pptx) from Markdown without AI

⚡️A native, local-first alternative to Logitech Options+, written in Rust 🦀 — remap buttons, DPI, and SmartShift over HID++. No account, no telemetry.

A PULP SoC for education, easy to understand and extend with a full flow for a physical design.

The official Python SDK for Model Context Protocol servers and clients

Gives criticality score for an open source project

Uniform metadata schema for buildings

FlashMLA: Efficient Multi-head Latent Attention Kernels

J-tau: A Japanese tau-bench for Benchmarking Tool-Agent-User Interaction in Real-World Domains

An all-in-one, pure C++ inference engine for audio models, powered by ggml. Supports TTS, STT, VAD, voice conversion, music generation, and more, with highly optimized performance. No Python depend…

End-to-end realtime stack for connecting humans and AI

GGUF implementation in C as a library and a tools CLI program

a community oriented 1:1, vLLM-alike (Continuous batching, paged KV) engine in C++ with additional features (GGUF, RadixAttention, Cache-aware scheduling, ...)

NeMo-Speech.cpp is a lightweight C++ inference runtime for Speech models