Skip to content
@moonmath-ai

MoonMath.ai

Private AI inference, engineered for performance.
MoonMath.ai

We are a small team of mathematicians and engineers building faster LLM inference through low-level algorithms, systems engineering, custom kernels, and hardware-aware optimization — with a focus on coding models and agentic workloads.

Zro: Fast inference for coding agents

Zro is MoonMath's private inference platform built for coding agents. It gives developers fast access to leading open-weight coding models through a single endpoint, optimized for long-context, multi-turn agentic workloads.

  • Built for coding agents: Connect Claude Code, Codex, OpenCode, Cline, and more in minutes.
  • Accelerated inference: Our serving stack is engineered for high-throughput, low-latency LLM inference.
  • Private by default: Zero request retention and no training on customer data.
  • Open models, one endpoint: Run capable open-weight coding models without managing GPUs, inference engines, or serving infrastructure yourself.
  • Performance from the stack down: MoonMath combines algorithmic optimization, custom kernels, compression, and hardware-aware deployment to push more performance from modern accelerators.

→ Start coding with Zro

MoonLite: LLM acceleration research & tooling

MoonLite is MoonMath's collection of low-level techniques and tools for making large models faster and more efficient:

  • LiteLinear: decomposed modules designed to replace standard FFN layers with more efficient alternatives.
  • BackLite: FlashAttention 3-based backward-pass acceleration using sparse gradient approximation.
  • LiteAttention: sparse attention techniques for accelerating large generative models.
  • LiteRunner: experiment infrastructure for benchmarking and developing model acceleration techniques, with local and Weights & Biases tracking.

Links

Pinned Loading

  1. LiteAttention LiteAttention Public

    Transforming Video Diffusion with Temporal Sparse Attention

    Python 56 5

  2. LiteLinear LiteLinear Public

    LiteLinear is a drop-in inference acceleration: compress nn.Linear layers via calibration-aware low-rank decomposition + quantization

    8 1

  3. LiteRunner LiteRunner Public

    MLOps-style tracking without touching the code.

    Python 3

  4. HyperQuant HyperQuant Public

    Python 14 2

  5. amd-kernels amd-kernels Public

    Hand-tuned kernels for AMD Instinct

    C++ 5 2

  6. zro zro Public

    Zro CLI - Easily use your existing agent harnesses and setup with Zro

    TypeScript 4

Repositories

Showing 10 of 45 repositories
  • zro Public

    Zro CLI - Easily use your existing agent harnesses and setup with Zro

    moonmath-ai/zro's past year of commit activity
    TypeScript 4 MIT 0 0 3 Updated Oct 12, 2026
  • sglang Public Forked from sgl-project/sglang

    SGLang is a high-performance serving framework for large language models and multimodal models.

    moonmath-ai/sglang's past year of commit activity
    Python 2 Apache-2.0 9,539 0 3 Updated Oct 12, 2026
  • sglang-jax Public Forked from sgl-project/sglang-jax

    JAX backend for SGL

    moonmath-ai/sglang-jax's past year of commit activity
    Python 0 Apache-2.0 155 0 0 Updated Oct 8, 2026
  • jax Public Forked from jax-ml/jax

    Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

    moonmath-ai/jax's past year of commit activity
    Python 0 Apache-2.0 3,999 0 0 Updated Oct 4, 2026
  • aiter Public Forked from ROCm/aiter

    AI Tensor Engine for ROCm

    moonmath-ai/aiter's past year of commit activity
    Python 0 MIT 628 0 0 Updated Oct 2, 2026
  • LiteRunner Public

    MLOps-style tracking without touching the code.

    moonmath-ai/LiteRunner's past year of commit activity
    Python 3 MIT 0 0 4 Updated Oct 1, 2026
  • vllm Public Forked from vllm-project/vllm

    A high-throughput and memory-efficient inference and serving engine for LLMs

    moonmath-ai/vllm's past year of commit activity
    Python 0 Apache-2.0 23,541 0 0 Updated Sep 17, 2026
  • models.dev Public Forked from anomalyco/models.dev

    An open-source database of AI models.

    moonmath-ai/models.dev's past year of commit activity
    TypeScript 0 MIT 1,818 0 1 Updated Sep 17, 2026
  • amd-kernels Public

    Hand-tuned kernels for AMD Instinct

    moonmath-ai/amd-kernels's past year of commit activity
    C++ 5 MIT 2 1 0 Updated Sep 16, 2026
  • antseed-verification Public

    This repository is used only for Antseed provider verification

    moonmath-ai/antseed-verification's past year of commit activity
    0 0 0 0 Updated Sep 6, 2026

People

This organization has no public members. You must be a member to see who’s a part of this organization.

Most used topics

Loading…