Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

⌥ Coding agent with the IDE wired in

SGLang is a high-performance serving framework for large language models and multimodal models.

Defend sound research against LLM reviewer bias through meaning-preserving rewrites.

Ongoing research training transformer models at scale

NVIDIA Inference Xfer Library (NIXL)

A PyTorch native platform for training generative AI models

🚀 Efficient implementations for emerging model architectures

FlashInfer: Kernel Library for LLM Serving

high-performance inference and serving library for interactive autoregressive video and world models

Training library for Megatron-based models with bidirectional Hugging Face conversion capability

LMCache: Supercharge Your LLM with the Fastest KV Cache Layer

The micro-VM for AI agents — light enough to embed on your laptop, elastic enough to power an agentic cloud.

Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.

Dr.Jit — A Just-In-Time-Compiler for Differentiable Rendering

A Datacenter Scale Distributed Inference Serving Framework

The absolute trainer to light up AI agents.

🚀 Pytorch Distributed native training library for LLMs/VLMs with OOTB Hugging Face support

A framework for efficient model inference with omni-modality models

File-driven AI trading agent engine for crypto and securities markets

Next Generation Agentic Proxy for AI Agents and MCP servers

A powerful Claude Code skill that provides safe disk space analysis, junk file cleaning, and real-time monitoring across Windows, Linux, and macOS.

cuda-oxide is an experimental Rust-to-CUDA compiler that lets you write (SIMT) GPU kernels in safe(ish), idiomatic Rust. It compiles standard Rust code directly to PTX — no DSLs, no foreign languag…

Apache Maka (Incubating) is a local-first AI agent workspace. Model messages, tool calls, tool results, permission decisions, and termination events are recorded as an append-only log.

✨ Self hosted, always-on AI agent platform run in containers. Create multiple bots with long memory, and connect them to Telegram, Discord, Feishu(Lark), Matrix, etc (like OpenClaw).

A Virtual Machine Monitor for modern Cloud workloads. Features include CPU, memory and device hotplug, support for running Windows and Linux guests, device offload with vhost-user and a minimal com…

OpenLake is a high performance storage engine for efficient LLM inference and GPU Training