Popular repositories Loading

1. nsys2perfetto-datafusion nsys2perfetto-datafusion Public

   Forked from Ma1oneZhang/nsys2perfetto-datafusion

   Convert Nsight Systems Parquet exports to Perfetto JSON with Rust and Apache DataFusion

   Rust 1

2. vllm vllm Public

   Forked from vllm-project/vllm

   A high-throughput and memory-efficient inference and serving engine for LLMs

   Python

3. sglang sglang Public

   Forked from sgl-project/sglang

   SGLang is a fast serving framework for large language models and vision language models.

   Python

4. flashinfer flashinfer Public

   Forked from flashinfer-ai/flashinfer

   FlashInfer: Kernel Library for LLM Serving

   Cuda

5. opencompass opencompass Public

   Forked from open-compass/opencompass

   OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

   Python

6. evalscope evalscope Public

   Forked from modelscope/evalscope

   A streamlined and customizable framework for efficient large model evaluation and performance benchmarking

   Python