An Open Source Machine Learning Framework for Everyone

LLM inference in C/C++

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.

Truly independent web browser

Port of OpenAI's Whisper model in C/C++

ClickHouse® is a real-time analytics database management system

A library for efficient similarity search and clustering of dense vectors.

MLX: An array framework for Apple silicon

Distribute and run LLMs with a single file.

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

NoSQL data store using the Seastar framework, compatible with Apache Cassandra and Amazon DynamoDB

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

Empower the Web community and invite more to build across platforms.

Tensor library for machine learning

Approximate Nearest Neighbors in C++/Python optimized for memory usage and loading/saving to disk

Open3D: A Modern Library for 3D Data Processing

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!

Easy to use open source fast database for search | Good alternative to Elasticsearch | Drop-in replacement for E in the ELK stack

Real-Time SLAM for Monocular, Stereo and RGB-D Cameras, with Loop Detection and Relocalization Capabilities

A lightweight, lightning-fast, in-process vector database

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

Cartographer is a system that provides real-time simultaneous localization and mapping (SLAM) in 2D and 3D across multiple platforms and sensor configurations.

Implementation of popular deep learning networks with TensorRT network definition API

lightweight, standalone C++ inference engine for Google's Gemma models.

Facebook AI Research's Automatic Speech Recognition Toolkit

Transformer related optimization, including BERT, GPT

Making it easier to work with shaders

Header-only C++/python library for fast approximate nearest neighbors