A scalable asynchronous reinforcement learning implementation with in-flight weight updates.

GenAI inference performance benchmarking tool

TorchStore is a distributed KV Cache for Tensors.

PyTorch-native post-training at scale

Post-training with Tinker

GitHub Copilot CLI brings the power of Copilot coding agent directly to your terminal.

nv-one-logger enables tracking of GPU application progress over time and can help to identify overhead from workload and cluster inefficiencies to provide efficiency metrics.

Nano vLLM

Agent Builder and Runtime by Docker Engineering

Intelligent Mixture-of-Models Router for Efficient LLM Inference

Environments for LLM Reinforcement Learning

Pipeline parallelism for the minimalist

Tools to use with the controller-runtime libraries

OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)

An open-source AI agent that brings the power of Gemini directly into your terminal.

👻 Ghostty is a fast, feature-rich, and cross-platform terminal emulator that uses platform-native UI and GPU acceleration.

Claude Code is an agentic coding tool that lives in your terminal, understands your codebase, and helps you code faster by executing routine tasks, explaining complex code, and handling git workflo…

PyTorch Single Controller

Installs ucacher (Earthly Universal Caching) in a GHA job

by ex-googlers, for ex-googlers - a lookup table of similar tech & services

A Datacenter Scale Distributed Inference Serving Framework

AppWrapper controller for Kueue

InGate - an Ingress & Gateway API Controller

NVIDIA GPU Operator creates, configures, and manages GPUs in Kubernetes

Lightweight coding agent that runs in your terminal

CUDA Python: Performance meets Productivity

JavaScript animation engine

KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale

CLI extension for the GitHub Models service