Repeatable LLM inference benchmarks for OpenShift.

UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

Offline optimization of your disaggregated Dynamo graph

Tools and technologies that are hosted on an OpenShift cluster

A limited and opensource version of the popular app WIFI WPS WPA TESTER

claude skills for llm-d by Red Hat with love

Demo - Distributed Inference on OpenShift (aka llm-d)

Starter templates for Obsidian

OB_Templates is a Obsidian reference for note templates focused on new users of the application using only core plugins.

An extendible framework for executing benchmarks and computational experiments at scale

GenAI inference performance benchmarking tool

A powerful little TUI framework 🏗

High-performance safetensors model loader

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem).

Variant optimization autoscaler for distributed inference workloads

A high-throughput and memory-efficient inference and serving engine for LLMs

A benchmarking and performance analysis framework

Helper scripts for working with "Principles of Planetary Climate," including graphing and reference values

Python utilities for the book "Principles of Planetary Climate", by Raymond T. Pierrehumbert

An open-source model for extreme atmospheres on rocky exoplanets.

Generate Kubernetes architecture diagrams from Kubernetes manifest files, kustomization files, Helm charts, helmfiles, and actual cluster state

Carbon Efficient Karpenter: Optimizing Kubernetes Cluster Autoscaling for Carbon Efficiency

21 Lessons, Get Started Building with Generative AI

An orchestration platform for the development, production, and observation of data assets.

KubeStellar - a flexible solution for multi-cluster configuration management for edge, multi-cloud, and hybrid cloud

🖥 Effortlessly manage your Linux machine using MQTT.

Local development against a remote Kubernetes or OpenShift cluster

Enable dynamic and seamless Kubernetes multi-cluster topologies