Skip to content
@Infini-AI-Lab

Infini-AI-Lab

Next Generation AI algorithms and systems

Popular repositories Loading

  1. Sequoia Sequoia Public

    scalable and robust tree-based speculative decoding algorithm

    Python 368 37

  2. TriForce TriForce Public

    [COLM 2024] TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding

    Python 276 17

  3. MagicPIG MagicPIG Public

    [ICLR2025 Spotlight] MagicPIG: LSH Sampling for Efficient LLM Generation

    Python 249 17

  4. MagicDec MagicDec Public

    [ICLR2025] Breaking Throughput-Latency Trade-off for Long Sequences with Speculative Decoding

    Python 142 9

  5. UMbreLLa UMbreLLa Public

    LLM Inference on consumer devices

    Python 129 15

  6. Multiverse Multiverse Public

    Python 112 10

Repositories

Showing 10 of 33 repositories
  • STEM Public
    Infini-AI-Lab/STEM’s past year of commit activity
    Python 53 BSD-3-Clause 1 2 0 Updated Feb 12, 2026
  • jackpot Public

    A rejection-sampling based distribution alignment method for extreme actor-policy mismatch RL Training

    Infini-AI-Lab/jackpot’s past year of commit activity
    Python 9 Apache-2.0 0 0 5 Updated Feb 11, 2026
  • jpt_website Public

    Host the website of project Jackpot

    Infini-AI-Lab/jpt_website’s past year of commit activity
    HTML 0 0 0 0 Updated Feb 9, 2026
  • vortex_torch Public

    Vortex: A Flexible and Efficient Sparse Attention Framework

    Infini-AI-Lab/vortex_torch’s past year of commit activity
    Python 46 Apache-2.0 3 0 0 Updated Jan 21, 2026
  • jackpot_unofficial Public
    Infini-AI-Lab/jackpot_unofficial’s past year of commit activity
    0 0 0 0 Updated Dec 7, 2025
  • vortex-technical-blog Public
    Infini-AI-Lab/vortex-technical-blog’s past year of commit activity
    HTML 0 0 0 0 Updated Dec 1, 2025
  • ai-environment-architect Public
    Infini-AI-Lab/ai-environment-architect’s past year of commit activity
    HTML 0 0 0 0 Updated Nov 26, 2025
  • FCV Public
    Infini-AI-Lab/FCV’s past year of commit activity
    Python 11 0 0 0 Updated Nov 4, 2025
  • M2PO Public
    Infini-AI-Lab/M2PO’s past year of commit activity
    Python 29 Apache-2.0 2 3 0 Updated Oct 8, 2025
  • Multiverse Public
    Infini-AI-Lab/Multiverse’s past year of commit activity
    Python 112 Apache-2.0 10 5 0 Updated Sep 13, 2025
View all repositories

Most used topics

Loading…