An Open Source Machine Learning Framework for Everyone

Productive, portable, and performant GPU programming in Python.

MLX: An array framework for Apple silicon

MNN: A blazing-fast, lightweight inference engine battle-tested by Alibaba, powering high-performance on-device LLMs and Edge AI.

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

A flexible, high-performance serving system for machine learning models