Stars
Demonstrate all the questions on LeetCode in the form of animation.（用动画的形式呈现解LeetCode题目的思路）
A high-throughput and memory-efficient inference and serving engine for LLMs
LeetCode Solutions: A Record of My Problem Solving Journey.( leetcode题解，记录自己的leetcode解题之路。)
The open source developer platform to build AI agents and models with confidence. Enhance your AI applications with end-to-end tracking, observability, and evaluations, all in one integrated platform.
Universal LLM Deployment Engine with ML Compilation
SGLang is a fast serving framework for large language models and vision language models.
PyTorch tutorials and fun projects including neural talk, neural style, poem writing, anime generation (《深度学习框架PyTorch：入门与实战》)
Modin: Scale your Pandas workflows by changing a single line of code
Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 17+ clouds, or on-prem).
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
[ICLR 2024] Efficient Streaming Language Models with Attention Sinks
Code repo for realtime multi-person pose estimation in CVPR'17 (Oral)
🏋️ Python / Modern C++ Solutions of All 3735 LeetCode Problems (Weekly Update)
🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSy…
A toolkit to run Ray applications on Kubernetes
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
Achieve state of the art inference performance with modern accelerators on Kubernetes
RayLLM - LLMs on Ray (Archived). Read README for more info.
KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale
Tell stories of your work with Notion
Serverless LLM Serving for Everyone.
TensorFlow 中文教程 (Chinese Tutorials)
scBSP is a specialized package designed for processing biological data, specifically in the analysis of gene expression and cell coordinates. It efficiently computes p-values for a given set of gen…
A dynamic verification tool using json configuration file instead of if statements