Tensors and Dynamic neural networks in Python with strong GPU acceleration

vgpu.rs is the fractional GPU & vgpu-hypervisor implementation written in Rust

Tensor Fusion is a state-of-the-art GPU virtualization and pooling solution designed to optimize GPU cluster utilization to its fullest potential.

Device Metrics Exporter exports metrics from AMD devices (GPUs) to collectors like Prometheus.

SGLang is a fast serving framework for large language models and vision language models.

A retargetable MLIR-based machine learning compiler and runtime toolkit.

The HIP Environment and ROCm Kit - A lightweight open source build system for HIP and ROCm

Development repository for the Triton language and compiler

The goal of the OSSCI Fleet is to provide a central mechanism to enable test automation, batch job scheduling, and developer access to a federated set of limited GPU resources

The "leetcode"-like platform for GPU hackers

NanoGPT (124M) in 3.4 minutes

IREE's PyTorch Frontend, based on Torch Dynamo.

Ongoing research training transformer models at scale

A high-throughput and memory-efficient inference and serving engine for LLMs

Efficient Triton Kernels for LLM Training

Documentation for vLLM Dev Channel releases

Reference implementations of MLPerf™ inference benchmarks