An Open Source Machine Learning Framework for Everyone

LLM inference in C/C++

Port of OpenAI's Whisper model in C/C++

ClickHouse® is a real-time analytics database management system

A library for efficient similarity search and clustering of dense vectors.

Scalable, Portable and Distributed Gradient Boosting (GBDT, GBRT or GBM) Library, for Python, R, Java, Scala, C++ and more. Runs on single machine, Hadoop, Spark, Dask, Flink and DataFlow

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

ncnn is a high-performance neural network inference framework optimized for the mobile platform

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

C++ Parallel Computing and Asynchronous Networking Framework

An open source library for face detection in images. The face detection speed can reach 1000FPS.

超轻量级中文ocr，支持竖排文字识别, 支持ncnn、mnn、tnn推理 ( dbnet(1.8M) + crnn(2.5M) + anglenet(378KB)) 总模型仅4.7M

FlashMLA: Efficient Multi-head Latent Attention Kernels

Repository for OpenCV's extra modules

A high-performance distributed file system designed to address the challenges of AI training and inference workloads.

OneFlow is a deep learning framework designed to be user-friendly, scalable and efficient.

Open source real-time translation app for Android that runs locally

cuDF - GPU DataFrame Library

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Sampling CPU and HEAP profiler for Java featuring AsyncGetCallTrace + perf_events

High-speed Large Language Model Serving for Local Deployment

Implementation of popular deep learning networks with TensorRT network definition API

Facebook AI Research's Automatic Speech Recognition Toolkit

An open source quadruped robot pet framework for developing Boston Dynamics-style four-legged robots that are perfect for STEM, coding & robotics education, IoT robotics applications, AI-enhanced r…

Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

Kernels & AI inference engine for phones

Wangle is a framework providing a set of common client/server abstractions for building services in a consistent, modular, and composable way.

KenLM: Faster and Smaller Language Model Queries

10x faster matrix and vector operations

An efficient video loader for deep learning with smart shuffling that's super easy to digest