super repo for rocm libraries

This is the AMD-maintained fork of the LLVM git repository. This repository accepts pull requests and issues related to AMD fork-specific topics (amd/*). For all other issues/PRs, please submit ups…

CUDA on non-NVIDIA GPUs

Open-source CUDA compiler targeting multiple GPU architectures. Compiles .cu to AMD and Tenstorrent GPU's

vortex backend

Ray is an AI compute engine. Ray consists of a core distributed runtime and a set of AI Libraries for accelerating ML workloads.

Development repository for the Triton language and compiler

Efficient Triton Kernels for LLM Training

Ultralytics YOLO11 🚀

A unified library of state-of-the-art model optimization techniques like quantization, pruning, distillation, speculative decoding, etc. It compresses deep learning models for downstream deployment…

AISystem 主要是指AI系统，包括AI芯片、AI编译器、AI推理和训练框架等AI全栈底层技术

LLM inference in C/C++

Mirage: Automatically Generating Fast GPU Kernels without Programming in Triton/CUDA

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Data manipulation and transformation for audio signal processing, powered by PyTorch

Datasets, Transforms and Models specific to Computer Vision

NVIDIA curated collection of educational resources related to general purpose GPU programming.

Connect home devices into a powerful cluster to accelerate LLM inference. More devices means faster inference.

SGLang is a fast serving framework for large language models and vision language models.

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations

Wan: Open and Advanced Large-Scale Video Generative Models

Stable Diffusion and Flux in pure C/C++

Get up and running with Llama 2, Mistral, and other large language models locally.

On-device AI across mobile, embedded and edge for PyTorch

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

🚀LLaMA-MoE v2: Exploring Sparsity of LLaMA from Perspective of Mixture-of-Experts with Post-Training

🤖 The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transf…