Infinigence

Popular repositories Loading

1. Infini-Megrez Infini-Megrez Public

   337 20

2. FlashOverlap FlashOverlap Public

   A lightweight design for computation-communication overlap.

   Python 249 18

3. Infini-Megrez-Omni Infini-Megrez-Omni Public

   Python 243 9

4. Semi-PD Semi-PD Public

   A prefill & decode disaggregated LLM serving framework with shared GPU memory and fine-grained compute isolation.

   Python 136 16

5. FUSCO FUSCO Public

   High-performance distributed data shuffling (all-to-all) library for MoE training and inference

   Python 127 11

6. pdd pdd Public

   95