Stars
Achieve state of the art inference performance with modern accelerators on Kubernetes
KAI Scheduler is an open source Kubernetes Native scheduler for AI workloads at large scale
Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 17+ clouds, or on-prem).
Serverless LLM Serving for Everyone.
SGLang is a fast serving framework for large language models and vision language models.
Universal LLM Deployment Engine with ML Compilation
scBSP is a specialized package designed for processing biological data, specifically in the analysis of gene expression and cell coordinates. It efficiently computes p-values for a given set of gen…
A toolkit to run Ray applications on Kubernetes
MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.
A high-throughput and memory-efficient inference and serving engine for LLMs
[ICLR 2024] Efficient Streaming Language Models with Attention Sinks
RayLLM - LLMs on Ray (Archived). Read README for more info.
An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Models for All.
Tell stories of your work with Notion
A dynamic verification tool using json configuration file instead of if statements
Modin: Scale your Pandas workflows by changing a single line of code
The open source developer platform to build AI/LLM applications and models with confidence. Enhance your AI applications with end-to-end tracking, observability, and evaluations, all in one integra…
PyTorch tutorials and fun projects including neural talk, neural style, poem writing, anime generation (《深度学习框架PyTorch：入门与实战》)
🚀 Awesome System for Machine Learning ⚡️ AI System Papers and Industry Practice. ⚡️ System for Machine Learning, LLM (Large Language Model), GenAI (Generative AI). 🍻 OSDI, NSDI, SIGCOMM, SoCC, MLSy…
TensorFlow 中文教程 (Chinese Tutorials)
LeetCode Solutions: A Record of My Problem Solving Journey.( leetcode题解，记录自己的leetcode解题之路。)
Code repo for realtime multi-person pose estimation in CVPR'17 (Oral)
🏋️ Python / Modern C++ Solutions of All 3735 LeetCode Problems (Weekly Update)
Demonstrate all the questions on LeetCode in the form of animation.（用动画的形式呈现解LeetCode题目的思路）