Concurrency permutation testing tool for Rust.

Rust interface to io_uring

Unsafely fast hashing algorithm 📈

A tracing library 10~100x faster than others.

A PyTorch native platform for training generative AI models

Open Fabric Interfaces

Long context evaluation for large language models

A framework for serving and evaluating LLM routers - save LLM costs without compromising quality

Python library for accurately querying username and email usage on online platforms

OpenAI-Compatible RESTful APIs for Amazon Bedrock

Tutorial for building LLM router

LLM101n: Let's build a Storyteller

The source of LMSYS website and blogs

CoreNet: A library for training deep neural networks

Implementation of the LongRoPE: Extending LLM Context Window Beyond 2 Million Tokens Paper

AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

Arena-Hard-Auto: An automatic LLM benchmark.

Python bindings for FFmpeg - with complex filtering support

WhisperX: Automatic Speech Recognition with Word-level Timestamps (& Diarization)

Grok open release

One-for-All Multimodal Evaluation Toolkit Across Text, Image, Video, and Audio Tasks

Making large AI models cheaper, faster and more accessible

A unified evaluation framework for large language models

This project aim to reproduce Sora (Open AI T2V model), we wish the open source community contribute to this project.

An extremely fast Python package and project manager, written in Rust.

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

SGLang is a high-performance serving framework for large language models and multimodal models.

Python 3.8+ toolbox for submitting jobs to Slurm