UCCL is an efficient communication library for GPUs, covering collectives, P2P (e.g., KV cache transfer, RL weight transfer), and EP (e.g., GPU-driven)

Sparse Allreduce

Modified Dissemination/Bruck algorithm for commutative reduction operations in MPI