Single File, Single GPU, From Scratch, Efficient, Full Parameter Tuning library for "RL for LLMs"

A Distributed Attention Towards Linear Scalability for Ultra-Long Context, Heterogeneous Data Training

MAGI-1: Autoregressive Video Generation at Scale

Drawing Bayesian networks, graphical models, tensors, technical frameworks, and illustrations in LaTeX.

Meta Lingua: a lean, efficient, and easy-to-hack codebase to research LLMs.

VIT inference in triton because, why not?

Since the emergence of chatGPT in 2022, the acceleration of Large Language Model has become increasingly important. Here is a list of papers on accelerating LLMs, currently focusing mainly on infer…

Machine Learning Engineering Open Book

UNet diffusion model in pure CUDA

Ring attention implementation with flash attention

A subset of PyTorch's neural network modules, written in Python using OpenAI's Triton.

LLM training in simple, raw C/CUDA

LL3M: Large Language and Multi-Modal Model in Jax

Elucidating the Design Space of Diffusion-Based Generative Models (EDM)

Karras et al. (2022) diffusion models for PyTorch

A curated list of recent diffusion models for video generation, editing, and various other applications.

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

Building blocks for foundation models.

Robust Speech Recognition via Large-Scale Weak Supervision

Easy generative modeling in PyTorch

Simple, safe way to store and distribute tensors

Annotated version of the Mamba paper

Simple, minimal implementation of the Mamba SSM in one file of PyTorch.

A 2D Gaussian Splatting paper for no obvious reasons. Enjoy!

OneDiff: An out-of-the-box acceleration library for diffusion models.

Repository of Jupyter notebook tutorials for teaching the Deep Learning Course at the University of Amsterdam (MSc AI), Fall 2023

[CVPR2024 Highlight]GLEE: General Object Foundation Model for Images and Videos at Scale

[ECCV 2024] Tokenize Anything via Prompting

Examples for MS-AMP package.