LLM inference in C/C++

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Dear ImGui: Bloat-free Graphical User interface for C++ with minimal dependencies

Port of OpenAI's Whisper model in C/C++

OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation

Windows Subsystem for Linux

A modern replacement for Redis and Memcached

MLX: An array framework for Apple silicon

Tensor library for machine learning

FlashMLA: Efficient Multi-head Latent Attention Kernels

Monero: the secure, private, untraceable cryptocurrency

A high-performance distributed file system designed to address the challenges of AI training and inference workloads.

CUDA Templates and Python DSLs for High-Performance Linear Algebra

A tool for recompiling Xbox 360 games to native executables.

🎛 🔊 A Python library for audio.

Open Source H.264 Codec

Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

One stop solution for all Vulkan samples

Fast inference engine for Transformer models

Simplify your onnx model

A machine learning compiler for GPUs, CPUs, and ML accelerators

A lightweight library for portable low-level GPU computation using WebGPU.

A retargetable MLIR-based machine learning compiler and runtime toolkit.

Learning FPGA, yosys, nextpnr, and RISC-V

10x faster matrix and vector operations

audible feedback on just how much your browsing feeds into google

Large-scale LLM inference engine

Small C++ program to display images in a (modern) terminal using RGB ANSI codes and unicode block graphics characters

FB (Facebook) + GEMM (General Matrix-Matrix Multiplication) - https://code.fb.com/ml-applications/fbgemm/