Ongoing research training transformer models at scale

Megatron's multi-modal data loader

A high-throughput and memory-efficient inference and serving engine for LLMs

ONNX Optimizer

A header-only C++ library for numerical optimization --

A Next-Generation Training Engine Built for Ultra-Large MoE Models

The new web framework that breathes fresh air into Python web development. Built with FastAPI, Starlette, Pydantic, and HTMX.

brpc is an Industrial-grade RPC framework using C++ Language, which is often used in high performance system such as Search, Storage, Machine learning, Advertisement, Recommendation etc. "brpc" mea…

HAProxy Load Balancer's development branch (mirror of git.haproxy.org)

A blazingly fast multi-language serialization framework powered by JIT and zero-copy.

Redis for LLMs

A composable and fully extensible C++ execution engine library for data management systems.

OpenVINO Tokenizers extension

P3610 Generic Scope Guard for C++29

TLS/SSL and crypto library

Suite for benchmarking malloc implementations.

PyTorch video decoding

A microbenchmark support library

Application Kernel for Containers

Zeek is a powerful network analysis framework that is much different from the typical IDS you may know.

JSON for Modern C++

Apache Kvrocks is a distributed key value NoSQL database that uses RocksDB as storage engine and is compatible with Redis protocol.

A modern replacement for Redis and Memcached

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

Userspace eBPF instrumentation and control framework for deploying control and monitoring functions in a secure manner

FastClick - A faster version of the Click Modular Router featuring batching, advanced multi-processing and improved Netmap and DPDK support (ANCS'15). Check the metron branch for Metron specificiti…

MiniOB is a compact database that assists developers in understanding the fundamental workings of a database.