Ongoing research training transformer models at scale

A high-throughput and memory-efficient inference and serving engine for LLMs

Ongoing research training transformer models at scale

Zero Bubble Pipeline Parallelism

Best practice for training LLaMA models in Megatron-LM

AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and versatility of software and hardware.

Python extension for Visual Studio Code

zk-SNARK library

Ongoing research training transformer language models at scale, including: BERT & GPT-2

symbolic musical datasets

Free Niek's Operating System (FreeNOS)

x86 JIT compiler in 86 lines

C in four functions

C 资源大全中文版，包括了：构建系统、编译器、数据库、加密、初中高的教程/指南、书籍、库等。