Skip to content
View andyxning's full-sized avatar
🎯
Focusing
🎯
Focusing
  • Beijing, China

Organizations

@nsqio @kubernetes @vllm-project

Block or report andyxning

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse

Starred repositories

Showing results

Post-training with Tinker

Python 4,259 562 Updated Nov 14, 2026

Agent Substrate: the core system

Go 6,812 759 Updated Nov 14, 2026

DeepInfer: High-performance, large-scale inference framework for DeepSeek models

Python 26,076 3,205 Updated Nov 3, 2026

Open-source framework for the research and development of foundation models.

Python 4,109 349 Updated Nov 16, 2026

A curated list of awesome approaches to AI model routing

254 36 Updated Mar 24, 2025

Deep learning for dummies. All the practical details and useful utilities that go into working with real models.

Python 857 49 Updated Oct 27, 2026

Recipes and resources for training, building generative AI with Fireworks

Python 243 71 Updated Nov 15, 2026

Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.

Python 1,789 197 Updated Nov 15, 2026

DeepSpec: a full-stack codebase for training and evaluating speculative decoding algorithms

Python 7,312 701 Updated Jul 9, 2026

DeepEP: an efficient expert-parallel communication library

Cuda 10,447 1,563 Updated Oct 21, 2026

mKernel: fast multi-node, multi-GPU fused kernels

Cuda 311 29 Updated Nov 12, 2026

Tile primitives for speedy kernels

Cuda 3,802 348 Updated Sep 12, 2026

A curated list of best cuda programming books

1,000 33 Updated May 19, 2026

Machine Learning Engineering Open Book

Python 19,718 1,303 Updated Nov 12, 2026

Module, Model, and Tensor Serialization/Deserialization

Python 328 55 Updated Nov 13, 2026

Benchmark suite for LLMs from Fireworks.ai

Python 120 44 Updated Nov 13, 2026

High Performance LLM Inference Operator Library

C++ 1,190 151 Updated Nov 10, 2026

📚A curated list of Awesome LLM/VLM Inference Papers with Codes: Flash-Attention, Paged-Attention, WINT8/4, Parallelism, etc.🎉

Python 5,558 447 Updated Oct 20, 2026

SkyRL: A Modular Full-stack RL Library for LLMs

Python 2,531 491 Updated Nov 14, 2026

LLMPerf is a library for validating and benchmarking LLMs

Python 1,128 201 Updated Dec 9, 2024

Manages Unified Access to Generative AI Services built on Envoy Gateway

Go 2,406 467 Updated Nov 14, 2026
C++ 553 46 Updated Aug 27, 2026

Inference server benchmarking tool

Rust 176 35 Updated Sep 23, 2026

Fluid, elastic data abstraction and acceleration for BigData/AI applications in cloud. (Project under CNCF)

Go 2,000 1,255 Updated Nov 12, 2026

Using CRDs to manage GPU resources in Kubernetes.

Go 215 30 Updated Nov 21, 2022

Heterogeneous GPU Sharing on Kubernetes

Go 5,014 894 Updated Nov 15, 2026

AI on GKE is a collection of examples, best-practices, and prebuilt solutions to help build, deploy, and scale AI Platforms on Google Kubernetes Engine

Jupyter Notebook 327 241 Updated Jun 23, 2025
Next