Pinned Loading

1. EricLBuehler/candle-vllm EricLBuehler/candle-vllm Public

   Efficent platform for inference and serving local LLMs including an OpenAI compatible API server.

   Rust 553 65

2. vllm.rs vllm.rs Public

   Minimalist vLLM implementation in Rust

   Rust 83 13

3. EnflameTechnology/vllm-gcu EnflameTechnology/vllm-gcu Public

   Python 29 7

4. EnflameTechnology/candle-vllm-gcu EnflameTechnology/candle-vllm-gcu Public

   Python 5 3

5. attention.rs attention.rs Public

   LLM Attentions for Rust

   Cuda 11 6

6. rustchatui rustchatui Public

   A small Rust library + binary that serves pre-built OpenAI-API compatible Chat UI

   Rust 5 2