Community recipes for serving LLMs on RTX 3090/4090/5090 CUDA gpus. Multi-engine (vLLM, llama.cpp, ik_llama) and model-agnostic. Currently shipping Qwen3.6-27B Qwen3.6 35B Gemma 4 26B Gemma 4 31B c…

Late Interaction Models Training & Retrieval

🛜 ESPectre 👻 - Motion detection system based on Wi-Fi spectre analysis (CSI), with Home Assistant integration.

Some local Nemotron Nano Omni code

Repository for the Human Disease Ontology.

A tool for creating and running Linux containers using lightweight virtual machines on a Mac. It is written in Swift, and optimized for Apple silicon.

An Open Source implementation of Notebook LM with more flexibility and features

Taste-Skill - gives your AI good taste. stops the AI from generating boring, generic slop

Local-first healthcare AI: clinical NER & HIPAA PII de-identification that runs 100% on-device. 1,000+ medical models, 12 languages, Apple MLX + Python, no cloud, no patient data leaving your netwo…

We write your reusable computer vision tools. 💜

Semantic version control => entity-level diffs, blame, and impact analysis on top of git. 26 languages via tree-sitter. Built for coding agents.

pyshimmer provides a Python API to work with the wearable sensor devices produced by Shimmer.

Tokenization and analysis pipeline for full-text search

LisanBench is a lightweight benchmark for LLMs that stresses forward planning, vocabulary depth, constraint adherence, attention, and long-context "stamina" all at once.

Lower-latency OpenMP-style minimalistic scoped thread-pool designed for 'Fork-Join' parallelism in Rust and C++, avoiding memory allocations, mutexes, CAS-primitives, and false-sharing on the hot p…

Artificial Neural Engine Machine Learning Library

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

Show status of GitHub Repos right in your menu bar and terminal: CI, Issues, Pull Requests, Latest Release.

Fast LLM speculative inference server for consumer hardware.

Markdown parser, done right. 100% CommonMark support, extensions, syntax plugins & high speed. Now in Python!

SQLite extension + bindings for Postgres NOTIFY/LISTEN semantics with durable queues, streams, pub/sub, and scheduler

SQLite VFS with sub-100ms cold JOIN queries from S3 + page-level compression and encryption

Speech Separation

Beautiful map components. 100% Free, Zero config, one command setup.

AI agent toolkit: unified LLM API, agent loop, TUI, coding agent CLI

Unified realtime agent trace database & search MCP

🤗 ml-intern: an open-source ML engineer that reads papers, trains models, and ships ML models