Skip to content

@SqueezeBits SqueezeBits Inc.

Change the repository type filter

All

    Repositories list

    33 repositories

    • vllm-rbln

      Public
      vLLM plugin for RBLN NPU
      Python
      •
      Apache License 2.0
      •11•0•0•0•Updated May 20, 2026May 20, 2026

    • hermes-agent

      Public
      The agent that grows with you
      Python
      •
      MIT License
      •26k•0•0•1•Updated May 18, 2026May 18, 2026

    • modular

      Public
      The Modular Platform (includes MAX & Mojo)
      Mojo
      •
      Other
      •2.8k•0•0•18•Updated May 7, 2026May 7, 2026

    • llm-compressor-K-EXAONE

      Public
      Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
      Python
      •
      Apache License 2.0
      •520•0•0•0•Updated May 3, 2026May 3, 2026

    • vla-evaluation-harness

      Public
      One framework to evaluate any VLA model on any robot simulation benchmark.
      Python
      •
      Apache License 2.0
      •27•0•0•1•Updated Apr 20, 2026Apr 20, 2026

    • JacobiForcing-K-LLM

      Public
      Jacobi Forcing: Fast and Accurate Diffusion-style Decoding
      Python
      •
      Apache License 2.0
      •11•0•0•0•Updated Apr 15, 2026Apr 15, 2026

    • optimum-rbln

      Public
      ⚡ A seamless integration of HuggingFace Transformers & Diffusers with RBLN SDK for efficient inference on RBLN NPUs.
      Python
      •
      Apache License 2.0
      •5•0•0•0•Updated Apr 13, 2026Apr 13, 2026

    • diffusers_benchmark

      Public
      Python
      •0•0•0•0•Updated Apr 7, 2026Apr 7, 2026

    • yetter-client

      Public
      Yetter Python Client
      Python
      •0•0•0•0•Updated Mar 27, 2026Mar 27, 2026

    • vllm

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •17k•0•0•0•Updated Feb 10, 2026Feb 10, 2026

    • guidellm-rbln-vllm

      Public
      Python
      •0•0•0•0•Updated Jan 22, 2026Jan 22, 2026

    • Gaudi-Hands-on-Workshop

      Public
      Jupyter Notebook
      •1•6•0•0•Updated Jan 18, 2026Jan 18, 2026

    • GraLoRA

      Public
      Jupyter Notebook
      •2•34•0•0•Updated Nov 18, 2025Nov 18, 2025

    • owlite

      Public
      OwLite is a low-code AI model compression toolkit for AI models.
      Python
      •
      GNU Affero General Public License v3.0
      •4•54•0•0•Updated Nov 14, 2025Nov 14, 2025

    • owlite-examples

      Public
      OwLite Examples repository offers illustrative example codes to help users seamlessly compress PyTorch deep learning models and transform them into TensorRT eng…
      Python
      •1•9•1•1•Updated Nov 14, 2025Nov 14, 2025

    • llm-compressor

      Public
      Transformers-compatible library for applying various compression algorithms to LLMs for optimized deployment with vLLM
      Python
      •
      Apache License 2.0
      •520•0•0•0•Updated Nov 12, 2025Nov 12, 2025

    • transformers

      Public
      🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference an…
      Python
      •
      Apache License 2.0
      •33k•0•0•0•Updated Nov 4, 2025Nov 4, 2025

    • vllm-fork

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •17k•0•0•0•Updated Nov 4, 2025Nov 4, 2025

    • ml-engineering

      Public
      Machine Learning Engineering Open Book
      Python
      •
      Creative Commons Attribution Share Alike 4.0 International
      •1.1k•1•0•0•Updated Sep 1, 2025Sep 1, 2025

    • sglang-guided-decoding

      Public
      SGLang is a fast serving framework for large language models and vision language models.
      Python
      •
      Apache License 2.0
      •6k•0•0•0•Updated Aug 28, 2025Aug 28, 2025

    • Torch-TRTLLM

      Public
      Ditto is an open-source framework that enables direct conversion of HuggingFace PreTrainedModels into TensorRT-LLM engines.
      Python
      •
      Apache License 2.0
      •3•57•0•0•Updated Jul 16, 2025Jul 16, 2025

    • vllm-guided-decoding

      Public
      A high-throughput and memory-efficient inference and serving engine for LLMs
      Python
      •
      Apache License 2.0
      •17k•0•0•0•Updated Jul 14, 2025Jul 14, 2025

    • LMCache

      Public
      Redis for LLMs
      Python
      •
      Apache License 2.0
      •1.2k•0•0•0•Updated Jul 10, 2025Jul 10, 2025

    • swifty-llm

      Public
      0•0•0•0•Updated Jul 9, 2025Jul 9, 2025

    • TensorRT-LLM

      Public
      TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optim…
      C++
      •
      Apache License 2.0
      •2.4k•0•0•1•Updated Jun 26, 2025Jun 26, 2025

    • fal-js

      Public
      The JavaScript client and utilities to fal-serverless with built-in TypeScript definitions
      TypeScript
      •
      MIT License
      •43•0•0•0•Updated May 30, 2025May 30, 2025

    • gradio

      Public
      Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!
      Python
      •
      Apache License 2.0
      •3.5k•0•0•0•Updated Jan 13, 2025Jan 13, 2025

    • vllm-hpu-extension

      Public
      Python
      •
      Apache License 2.0
      •48•0•0•0•Updated Nov 22, 2024Nov 22, 2024

    • neural-compressor

      Public
      Intel Neural Compressor
      Python
      •
      Apache License 2.0
      •0•0•0•0•Updated Oct 22, 2024Oct 22, 2024

    • nvidia-dind

      Public
      Isolated DinD (Docker in Docker) container for developing and deploying Docker containers using NVIDIA GPUs and the NVIDIA container toolkit. Useful for deployi…
      Dockerfile
      •
      Mozilla Public License 2.0
      •19•0•0•0•Updated Aug 27, 2024Aug 27, 2024
    ProTip! When viewing an organization's repositories, you can use the props. filter to filter by custom property.