LLM inference in C/C++

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Port of OpenAI's Whisper model in C/C++

OpenPose: Real-time multi-person keypoint detection library for body, face, hands, and foot estimation

Carbon Language's main repository: documents, design, implementation, and related tools. (NOTE: Carbon Language is experimental; see README)

A modern replacement for Redis and Memcached

Productive, portable, and performant GPU programming in Python.

MLX: An array framework for Apple silicon

ncnn is a high-performance neural network inference framework optimized for the mobile platform

A C++ header-only HTTP/HTTPS server and client library

Frame profiler

A fast multi-producer, multi-consumer lock-free concurrent queue for C++11

Tiny data-over-sound library

lightweight, standalone C++ inference engine for Google's Gemma models.

header only, dependency-free deep learning framework in C++14

🎛 🔊 A Python library for audio.

Diffusion model(SD,Flux,Wan,Qwen Image,Z-Image,...) inference in pure C/C++

Performance-portable, length-agnostic SIMD with runtime dispatch

The AI-native database built for LLM applications, providing incredibly fast hybrid search of dense vector, sparse vector, tensor (multi-vector), and full-text.

Simplify your onnx model

A composable and fully extensible C++ execution engine library for data management systems.

Learning embeddings for classification, retrieval and ranking.

A lightweight library for portable low-level GPU computation using WebGPU.

Fast Open-Source Search & Clustering engine × for Vectors & Arbitrary Objects × in C++, C, Python, JavaScript, Rust, Java, Objective-C, Swift, C#, GoLang, and Wolfram 🔍

Embedded property graph database built for speed. Vector search and full-text search built in. Implements Cypher.

The Compute Library is a set of computer vision and machine learning functions optimised for both Arm CPUs and GPUs using SIMD technologies.

A tensorflow implementation of EAST text detector

10x faster matrix and vector operations

🍅🍅🍅YOLOv5-Lite: Evolved from yolov5 and the size of model is only 900+kb (int8) and 1.7M (fp16). Reach 15 FPS on the Raspberry Pi 4B~

A Simple ESP32 Bluetooth A2DP Library (to implement a Music Receiver or Sender) that supports Arduino, PlatformIO and Espressif IDF