LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

Model-less Inference Serving

iGniter, an interference-aware GPU resource provisioning framework for achieving predictable performance of DNN inference in the cloud.

Create matplotlib plots with broken axes

[MLSys 2021] IOS: Inter-Operator Scheduler for CNN Acceleration

阿里DIEN与DIN Tensorflow2.0 复现

solutions to puzzles in Vim Adventures

🎓 Path to a free self-taught education in Computer Science!

📚 List of awesome university courses for learning Computer Science!

Easy-to-use,Modular and Extendible package of deep-learning based CTR models .

A cd command that learns - easily navigate directories from the command line

Oh my tmux! My self-contained, pretty & versatile tmux configuration made with 💛🩷💙🖤❤️🤍

Zsh 开发指南

Open source FPGA-based NIC and platform for in-network compute

Automatic virtualization of (general) accelerators.

A collection of pre-trained, state-of-the-art models in the ONNX format

A booklet on machine learning systems design with exercises. NOT the repo for the book "Designing Machine Learning Systems", which is `dmls-book`

Learn regex the easy way

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Visualizer for neural network, deep learning and machine learning models

📄 🇨🇳 📃 论文阅读笔记（分布式系统、虚拟化、机器学习）Papers Notebook (Distributed System, Virtualization, Machine Learning)

A high performance and generic framework for distributed DNN training

A list of ICs and IPs for AI, Machine Learning and Deep Learning.

To make it easy to benchmark AI accelerators

use vim as IDE

🌺 Minimalist Vim Plugin Manager

Tools for monitoring NVIDIA GPUs on Linux