A high-throughput and memory-efficient inference and serving engine for LLMs

verl: Volcano Engine Reinforcement Learning for LLMs

SGLang is a high-performance serving framework for large language models and multimodal models.

Optimized primitives for collective multi-GPU communication

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Grid-based workflow management system for lattice field theory simulations

A framework for efficient model inference with omni-modality models

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit floating point (FP8) precision on Hopper and Ada GPUs, to provide better performance with lower memory utilizatio…

TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficie…

The fundamental package for scientific computing with Python.

Efficiently computes derivatives of numpy code.

Data parallel C++ mathematical object library

A conda-smithy repository for pyerrors.

Python package for relating finite-volume data to amplitudes

Solve automatic numerical differentiation problems in one or more variables.

Documentation for Hadrons

matplotlib: plotting with Python

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

⚡ Dynamically generated stats for your github readmes