A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

[NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". A…

An annotated implementation of the Transformer paper.

Align Anything: Training All-modality Model with Feedback

Medusa: Simple Framework for Accelerating LLM Generation with Multiple Decoding Heads

Puzzles for learning Triton

PyTorch implementation for Score-Based Generative Modeling through Stochastic Differential Equations (ICLR 2021, Oral)

Official code for Score-Based Generative Modeling through Stochastic Differential Equations (ICLR 2021, Oral)

Training LLMs with QLoRA + FSDP

Efficient Deep Learning Systems course materials (HSE, YSDA)

A throughput-oriented high-performance serving framework for LLMs

Simple implementation of OpenAI CLIP model in PyTorch.

Collection of scripts and notebooks for OpenAI's latest GPT OSS models

code for MS thesis "White-Box Adversarial Attacks on classification in NLP"