An Open Source Machine Learning Framework for Everyone

A library for efficient similarity search and clustering of dense vectors.

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

Lightweight, Portable, Flexible Distributed/Mobile Deep Learning with Dynamic, Mutation-aware Dataflow Dep Scheduler; for Python, R, Julia, Scala, Go, Javascript and more

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning …

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

Transformer related optimization, including BERT, GPT

fastllm是后端无依赖的高性能大模型推理库。同时支持张量并行推理稠密模型和混合模式推理MOE模型，任意10G以上显卡即可推理满血DeepSeek。双路9004/9005服务器+单显卡部署DeepSeek满血满精度原版模型，单并发20tps；INT4量化模型单并发30tps，多并发可达60+。

该仓库主要记录 NLP 算法工程师相关的顶会论文研读笔记

LightSeq: A High Performance Library for Sequence Processing and Generation

ONNX-TensorRT: TensorRT backend for ONNX

A scalable inference server for models optimized with OpenVINO™