Declarative Kubernetes renderer for llm-d and vLLM deployments

AI Grid Network

Stateful API logic for agentic applications using vLLM

SAM Sovereign Agent Mesh

Open Source echo sounder / depth sounder / SONAR for bathymetry and research. Arduino based and compatible.

Flight Control aims to provide simple, scalable, and secure management of edge devices and applications. Users declare the operating system version, host configuration, and set of applications they…

A unified library for building, evaluating, and storing speculative decoding algorithms for LLM inference in vLLM

Achieve state of the art inference performance with modern accelerators on Kubernetes

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

Low-overhead Kubernetes informer for sidecar controllers that don't need the full object

llm-d benchmark scripts and tooling

Concurrent ART (adaptive radix tree)

llm-d Router: The intelligent entry point for inference requests

The simplest, fastest repository for training/finetuning medium-sized GPTs.

A high-throughput and memory-efficient inference and serving engine for LLMs

A programmable Mixture-of-Models router for heterogeneous LLM inference

A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.

Gateway API Inference Extension

Pull-through caching proxy with resumable downloads for OCI images

Collective communications library with various primitives for multi-machine training.

A collection of RPMs

Red Hat Device Edge image construction

a script to run docker-compose.yml using podman

QMK TrackBall with 3 Switches (TB3S)

GitHub Action self-hosted runner images for OpenShift.

Low-level unprivileged sandboxing tool used by Flatpak and similar projects