Archive of Temporal Knowledge Reasoning in Social Network and Knowledge Graph

A high-throughput and memory-efficient inference and serving engine for LLMs

Fast and memory-efficient exact attention

Best practice for training LLaMA models in Megatron-LM

Transformer related optimization, including BERT, GPT

Colossal-AI: A Unified Deep Learning System for Big Model Era

深度学习模型在各大公司实战落地细节解读：主要是通过阅读各种实战文章，梳理模型落地的工程细节，涉及到搜索/推荐/自然语言处理。

Towards Generalized and Efficient Blackbox Optimization System/Package (KDD 2021 & JMLR 2024)

Tutorial code on how to build your own Deep Learning System in 2k Lines