Popular repositories Loading

1. chat chat Public

   Python

2. cmake_example cmake_example Public template

   Forked from pybind/cuda_example

   Example pybind11 module built with a CMake-based build system

   Python

3. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

4. transformers transformers Public

   Forked from huggingface/transformers

   🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

   Python

5. vllm-project.github.io vllm-project.github.io Public

   Forked from vllm-project/vllm-project.github.io

   JavaScript

6. py-inference-scheduler py-inference-scheduler Public

   Forked from llm-d-incubation/py-inference-scheduler

   Python based inference-scheduler for Reinforcement Learning

   Python