Skip to content

@sgl-project sgl-project

Change the repository type filter

All

    Repositories list

    19 repositories

    • sgl-project.github.io

      Public
      This is the documentation repository for SGLang. It is auto-generated from https://github.com/sgl-project/sglang/tree/main/docs.
      HTML
      •24•95•9•1•Updated Dec 19, 2025Dec 19, 2025

    • sglang

      Public
      SGLang is a fast serving framework for large language models and vision language models.
      cudainferencepytorchtransformeropenaimoellamavlmkimiblackwell
      Python
      •
      Apache License 2.0
      •3.8k•22k•662•1.1k•Updated Dec 19, 2025Dec 19, 2025

    • sglang-jax

      Public
      JAX backend for SGL
      Python
      •
      Apache License 2.0
      •47•200•70•18•Updated Dec 19, 2025Dec 19, 2025

    • sgl-kernel-xpu

      Public
      SGLang kernel library for Intel XPU
      Python
      •
      MIT License
      •13•15•0•14•Updated Dec 19, 2025Dec 19, 2025

    • sgl-kernel-npu

      Public
      SGLang kernel library for NPU
      C++
      •
      MIT License
      •61•86•13•21•Updated Dec 19, 2025Dec 19, 2025

    • ome

      Public
      OME is a Kubernetes operator for enterprise-grade management and serving of Large Language Models (LLMs)
      k8sllamaoracle-cloudmodel-servingmodel-as-a-servicemulti-node-kubernetesllmllm-inferencedeepseeksglang
      Go
      •
      MIT License
      •50•340•32•20•Updated Dec 19, 2025Dec 19, 2025

    • whl

      Public
      Kernel Library Wheel for SGLang
      cudacutlasssglangflashinfer
      HTML
      •
      MIT License
      •4•16•1•1•Updated Dec 19, 2025Dec 19, 2025

    • mini-sglang

      Public
      Python
      •95•1.3k•4•4•Updated Dec 18, 2025Dec 18, 2025

    • sgl-cookbook

      Public
      Cookbook of SGLang - Recipe
      JavaScript
      •
      Apache License 2.0
      •6•37•2•5•Updated Dec 18, 2025Dec 18, 2025

    • SpecForge

      Public
      Train speculative decoding models effortlessly and port them smoothly to SGLang serving.
      trainingeaglepytorchllmfsdpsglangeagle3
      Python
      •
      MIT License
      •119•557•49•16•Updated Dec 18, 2025Dec 18, 2025

    • DeepGEMM

      Public
      DeepGEMM: clean and efficient FP8 GEMM kernels with fine-grained scaling
      Cuda
      •
      MIT License
      •778•21•0•1•Updated Dec 17, 2025Dec 17, 2025

    • sgl-test-files

      Public
      The test files for SGLang.
      MIT License
      •3•1•0•2•Updated Dec 17, 2025Dec 17, 2025

    • FlashMLA

      Public
      FlashMLA: Efficient Multi-head Latent Attention Kernels
      C++
      •
      MIT License
      •918•0•0•0•Updated Dec 16, 2025Dec 16, 2025

    • sgl-flash-attn

      Public
      Fast and memory-efficient exact attention
      Python
      •
      BSD 3-Clause "New" or "Revised" License
      •2.2k•14•0•0•Updated Dec 15, 2025Dec 15, 2025

    • sgl-learning-materials

      Public
      Materials for learning SGLang
      MIT License
      •50•690•0•0•Updated Dec 15, 2025Dec 15, 2025

    • rbg

      Public
      A workload for deploying LLM inference services on Kubernetes
      k8sllmsglangpd-disagg
      Go
      •
      Apache License 2.0
      •36•140•13•9•Updated Dec 12, 2025Dec 12, 2025

    • genai-bench

      Public
      Genai-bench is a powerful benchmark tool designed for comprehensive token-level performance evaluation of large language model (LLM) serving systems.
      Python
      •
      MIT License
      •42•249•4•9•Updated Dec 10, 2025Dec 10, 2025

    • fast-hadamard-transform

      Public
      Fast Hadamard transform in CUDA, with a PyTorch interface
      C
      •
      BSD 3-Clause "New" or "Revised" License
      •49•1•0•0•Updated Oct 15, 2025Oct 15, 2025

    • sgl-whl

      Public
      SGLang wheels for multiple platforms
      MIT License
      •1•11•1•0•Updated Oct 13, 2025Oct 13, 2025