A high-throughput and memory-efficient inference and serving engine for LLMs

Learning TileLang with 10 puzzles!

FlashInfer: Kernel Library for LLM Serving

Pure Rust Inference Engine

TokenSpeed is a speed-of-light LLM inference engine.

high-performance linear attention kernel library built on TileLang

A kernel library written in tilelang

Lucebox: LLM inference server built for speed for specific consumer hardware.

FlashKDA: high-performance Kimi Delta Attention kernels

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Open-source, low-cost 10.5 GHz PLFM phased array RADAR system

The Native Terminal Emulator with a builtin AI Harness

Information collection for the Happy Horse AI video generator model. Official demo and updates at happyhorses.io.

Intelligence for Kubernetes. World's most promising Kubernetes Visualization Tool for Developer and Platform Engineering teams.

A Flash Player emulator written in Rust

A dedicated effort to make an optimized, bleeding edge vLLM image using Docker to support DGX comprehensively

LLM inference server with continuous batching & SSD caching for Apple Silicon — managed from the macOS menu bar

Bub it. Build it. A hook-first runtime for agents that live alongside people.

Python interface to PROJ (cartographic projections and coordinate transformations library)

Visual Skills Pack for Obsidian: generate Canvas, Excalidraw, and Mermaid diagrams from text with Claude Code

Make Any Website & Tool Your CLI. A universal CLI Hub and AI-native runtime. Transform any website, Electron app, or local binary into a standardized command-line interface. Built for AI Agents to …

Turn any project into a tmux-powered terminal IDE with a simple ide.yml

⭐️ A cross-platform CLI All-in-One assistant tool for Claude Code, Codex & Gemini CLI.

SGLang Omni: High-Performance Multi-Stage Pipeline Framework for Omni Models

Distributed Compiler based on Triton for Parallel Systems

Terminal UI for NVIDIA Nsight Systems profiles — timeline viewer, kernel navigator, NVTX hierarchy

A KeePass/Password Safe Client for iOS and OS X