Highlights
- Pro
Stars
Protocol Buffers - Google's data interchange format
A library for efficient similarity search and clustering of dense vectors.
A library that provides an embeddable, persistent key-value store for fast storage.
Cloud-native high-performance edge/middle/service proxy
FlashMLA: Efficient Multi-head Latent Attention Kernels
A high-performance distributed file system designed to address the challenges of AI training and inference workloads.
Header-only C++/python library for fast approximate nearest neighbors
A distributed approximate nearest neighborhood search (ANN) library which provides a high quality vector index build, search and distributed online serving toolkits for large scale vector search sc…
Mooncake is the serving platform for Kimi, a leading LLM service provided by Moonshot AI.
Non-Metric Space Library (NMSLIB): An efficient similarity search library and a toolkit for evaluation of k-NN methods for generic non-metric spaces.
Mirage Persistent Kernel: Compiling LLMs into a MegaKernel
Platform for building access networks and modular network services
Graph-structured Indices for Scalable, Fast, Fresh and Filtered Approximate Nearest Neighbor Search
Pluggable in-process caching engine to build and scale high performance services
Collective communications library with various primitives for multi-machine training.
Nearest Neighbor Search with Neighborhood Graph and Tree for High-dimensional Data
UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)
The Click modular router: fast modular packet processing and analysis
C++ implementation of the AWS Lambda runtime
PLEASE NOTE: Mesos is now hosted in Apache git! Get it using git clone https://git-wip-us.apache.org/repos/asf/mesos.git
Large scale graph learning on a single machine.