Stars
Data processing for and with foundation models! 🍎 🍋 🌽 ➡️ ➡️🍸 🍹 🍷
Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.
Boskos is a resource management service that provides reservation and lifecycle management of a variety of different kinds of resources.
Definition, proposals, and conformance tests for AI Conformance
Sonobuoy is a diagnostic tool that makes it easier to understand the state of a Kubernetes cluster by running a set of Kubernetes conformance tests and other plugins in an accessible and non-destru…
Hydrophone is a lightweight Kubernetes conformance tests runner
Vendor-agnostic orchestration for training, inference and agentic workloads across NVIDIA, AMD, TPU, and Tenstorrent on clouds, Kubernetes, and bare metal.
FlexTensor is a tensor offloading and management library for PyTorch that enables running large models on limited GPU memory by intelligently offloading tensors between GPU and CPU memory.
NVIDIA AITune is an inference toolkit designed for tuning and deploying Deep Learning models with a focus on NVIDIA GPUs.
💥 Blazing fast terminal file manager written in Rust, based on async I/O.
A smarter cd command. Supports all major shells.
Skills for Real Engineers. Straight from my .agents directory.
Run Slurm on Kubernetes. A Slinky project.
Tooling for optimized, validated, and reproducible GPU-accelerated AI runtime in Kubernetes
[ECCV 2022] This is the official implementation of BEVFormer, a camera-only framework for autonomous driving perception, e.g., 3D object detection and semantic map segmentation.
TokenSpeed is a speed-of-light LLM inference engine.
Model Express is a Rust-based component meant to be placed next to existing model inference systems to speed up their startup times and improve overall performance.
Agent Skill for generating 2D sprite sheets and map, transparent PNG frames, and animated GIFs from prompts.
Use Garry Tan's exact Claude Code setup: 23 opinionated tools that serve as CEO, Designer, Eng Manager, Release Manager, Doc Engineer, and QA
Network monitoring & diagnosis suite for Kubernetes
Kubernetes controllers for fast model actuation using vLLM sleep/wake and launcher-based model swapping
Next Generation Agentic Proxy for AI Agents and MCP servers
Spec-driven development (SDD) for AI coding assistants.