Pinned Loading

1. vllm-project/vllm vllm-project/vllm Public

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python 59.7k 10.6k

2. pytorch/pytorch pytorch/pytorch Public

   Tensors and Dynamic neural networks in Python with strong GPU acceleration

   Python 93.8k 25.5k

3. LazyAGI/LazyLLM LazyAGI/LazyLLM Public

   Easiest and laziest way for building multi-agent LLMs applications.

   Python 2.9k 254

4. deepspeedai/DeepSpeed deepspeedai/DeepSpeed Public

   DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

   Python 40.3k 4.6k

5. deepseek-ai/DeepGEMM deepseek-ai/DeepGEMM Public

   DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling

   Cuda 5.8k 710

6. yewentao256.github.io yewentao256.github.io Public

   wentao.site / Hugo Template / A template repository for Hugo based blog

   47 3