LLM inference in C/C++

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Dear ImGui: Bloat-free Graphical User interface for C++ with minimal dependencies

Port of OpenAI's Whisper model in C/C++

OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation

Windows Subsystem for Linux

A modern replacement for Redis and Memcached

MLX: An array framework for Apple silicon

Tensor library for machine learning

FlashMLA: Efficient Multi-head Latent Attention Kernels

Monero: the secure, private, untraceable cryptocurrency

A high-performance distributed file system designed to address the challenges of AI training and inference workloads.

CUDA Templates and Python DSLs for High-Performance Linear Algebra

A tool for recompiling Xbox 360 games to native executables.

Open Source H.264 Codec

🎛 🔊 A Python library for audio.

Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++

One stop solution for all Vulkan samples

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

Fast inference engine for Transformer models

Simplify your onnx model

Kernels & AI inference engine for mobile devices.

A machine learning compiler for GPUs, CPUs, and ML accelerators

A lightweight library for portable low-level GPU computation using WebGPU.

A retargetable MLIR-based machine learning compiler and runtime toolkit.

Learning FPGA, yosys, nextpnr, and RISC-V

10x faster matrix and vector operations

audible feedback on just how much your browsing feeds into google

Small C++ program to display images in a (modern) terminal using RGB ANSI codes and unicode block graphics characters

Large-scale LLM inference engine