Official community-driven Azure Machine Learning examples, tested with GitHub Actions.

Make bilingual epub books Using AI translate

Binary Optimization and Layout Tool - A linux command-line utility used for optimizing performance of binaries

Samples for CUDA Developers which demonstrates features in CUDA Toolkit

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

An open platform for training, serving, and evaluating large languages. Release repo for Vicuna and FastChat-T5.

Flexible I/O Tester

Running large language models on a single GPU for throughput-oriented scenarios.

翻墙、免费翻墙、免费科学上网、免费节点、免费梯子、免费ss/ssr/v2ray/trojan节点、蓝灯、谷歌商店、翻墙梯子

Interview questions

Lab Materials for MIT 6.S191: Introduction to Deep Learning

LightLLM is a Python-based LLM (Large Language Model) inference and serving framework, notable for its lightweight design, easy scalability, and high-speed performance.

Personal website including a blog - hosted on GitHub

Neural Networks with Tensorflow

Operating Systems: Principles and Practice (2nd Edition) Anderson and Dahlin

Key/Value Datastore for Persistent Memory

Tensors and Dynamic neural networks in Python with strong GPU acceleration

Demonstration of flow control over RDMA fabric

Remote Persistent Memory Access

S-LoRA: Serving Thousands of Concurrent LoRA Adapters

SGLang is a fast serving framework for large language models and vision language models.

Learn how to design large-scale systems. Prep for the system design interview.

TensorRT LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and support state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorR…