Skip to content

@xLLM-AI xLLM-AI

All

    Repositories list

    16 repositories

    • xllm

      Public
      A high-performance inference engine for LLM, VLM, DiT and REC models, optimized for diverse AI accelerators. It is hosted in OpenAtom Foundation.
      inferenceglminference-engine
      inferenceglminference-enginelarge-language-modelsllm-inferenceqwendeepseek
      C++
      •
      Apache License 2.0
      •308•1.6k•84•133•Updated Oct 11, 2026Oct 11, 2026

    • torch-npu-ops

      Public
      C++
      •6•0•0•3•Updated Oct 10, 2026Oct 10, 2026

    • xllm-ops

      Public
      C++
      •
      Other
      •28•5•1•7•Updated Oct 9, 2026Oct 9, 2026

    • xllm-atb-layers

      Public
      C++
      •
      Other
      •12•0•0•3•Updated Sep 17, 2026Sep 17, 2026

    • Mooncake

      Public
      C++
      •
      Apache License 2.0
      •4•0•0•1•Updated Sep 17, 2026Sep 17, 2026

    • xllm-service

      Public
      A flexible serving framework that delivers efficient and fault-tolerant LLM inference for clustered deployments.
      C++
      •
      Other
      •40•100•3•4•Updated Sep 9, 2026Sep 9, 2026

    • xllm-workflow

      Public
      This is the ai coding workflow repository for xLLM.
      Python
      •9•15•0•0•Updated Sep 3, 2026Sep 3, 2026

    • xllm-website

      Public
      This is the website repository for xLLM.
      Astro
      •
      MIT License
      •2•0•0•0•Updated Aug 3, 2026Aug 3, 2026

    • ParaKV

      Public
      C++
      •
      Other
      •3•4•0•1•Updated Jul 14, 2026Jul 14, 2026

    • spdlog

      Public
      C++
      •
      Other
      •0•0•0•0•Updated Jul 6, 2026Jul 6, 2026

    • smhasher

      Public
      C++
      •0•0•0•0•Updated Jul 6, 2026Jul 6, 2026

    • sentencepiece

      Public
      C++
      •0•0•0•0•Updated Jul 6, 2026Jul 6, 2026

    • etcd_cpp_apiv3

      Public
      C++
      •
      BSD 3-Clause "New" or "Revised" License
      •0•0•0•0•Updated Jul 6, 2026Jul 6, 2026

    • xxHash

      Public
      C
      •
      Other
      •0•0•0•5•Updated Jul 6, 2026Jul 6, 2026

    • minja

      Public
      C++
      •0•0•0•0•Updated Jul 6, 2026Jul 6, 2026

    • cpprestsdk

      Public
      C++
      •
      Other
      •0•0•0•0•Updated Jul 6, 2026Jul 6, 2026
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.