Inference scheduler for llm-d

The simplest, fastest repository for training/finetuning medium-sized GPTs.

A high-throughput and memory-efficient inference and serving engine for LLMs

System Level Intelligent Router for Mixture-of-Models at Cloud, Data Center and Edge

A lightweight, configurable, and real-time simulator designed to mimic the behavior of vLLM without the need for GPUs or running actual heavy models.

Gateway API Inference Extension

Pull-through caching proxy with resumable downloads for OCI images

Collective communications library with various primitives for multi-machine training.

A collection of RPMs

Red Hat Device Edge image construction

a script to run docker-compose.yml using podman

QMK TrackBall with 3 Switches (TB3S)

GitHub Action self-hosted runner images for OpenShift.

Low-level unprivileged sandboxing tool used by Flatpak and similar projects

Podman: A tool for managing OCI containers and pods.

demos asible collection

Generic Control plane for creating Kubernetes like APIs

Random 3D models

FABoulous bootc build system

GPUd automates monitoring, diagnostics, and issue identification for GPUs

eBPF based always-on CPU/GPU profiler auto-discovering targets in Kubernetes and systemd, zero code changes or restarts needed!

Go client bindings for rpm-ostree

Free, simple, and intuitive online database diagram editor and SQL generator.

Analyzes resource usage and performance characteristics of running containers.

Sign git commits with a YubiKey