An Open Source Machine Learning Framework for Everyone

LLM inference in C/C++

Open Source Computer Vision Library

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Port of OpenAI's Whisper model in C/C++

ClickHouse® is a real-time analytics database management system

A library that provides an embeddable, persistent key-value store for fast storage.

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

MLX: An array framework for Apple silicon

Parsing gigabytes of JSON per second : used by Facebook/Meta Velox, the Node.js runtime, ClickHouse, WatermelonDB, Apache Doris, Milvus, StarRocks

A framework for building Mobile cross-platform UI

Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit

A framework for building native Windows apps with React.

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

Tensor library for machine learning

A Multithreaded Fork of Redis

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and supports state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. Tensor…

FlashMLA: Efficient Multi-head Latent Attention Kernels

Log file navigator

cuDF - GPU DataFrame Library

lightweight, standalone C++ inference engine for Google's Gemma models.

HarfBuzz text shaping engine

Nodejs bindings to OpenCV 3 and OpenCV 4

YDB is an open source Distributed SQL Database that combines high availability and scalability with strong consistency and ACID transactions

Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.

A lightweight library for portable low-level GPU computation using WebGPU.

A machine learning compiler for GPUs, CPUs, and ML accelerators

Fast Open-Source Search & Clustering engine × for Vectors & Arbitrary Objects × in C++, C, Python, JavaScript, Rust, Java, Objective-C, Swift, C#, GoLang, and Wolfram 🔍

10x faster matrix and vector operations

C++ Implementation of PyTorch Tutorials for Everyone