Implementing a Neural Network from Scratch

A tiny scalar-valued autograd engine and a neural net library on top of it with PyTorch-like API

The simplest, fastest repository for training/finetuning medium-sized GPTs.

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Trax — Deep Learning with Clear Code and Speed