Ongoing research training transformer language models at scale, including: BERT & GPT-2

『밑바닥부터 시작하는 딥러닝 1(리마스터판)』(한빛미디어, 2025)

Ongoing research training transformer models at scale

Inference code for Mistral and Mixtral hacked up into original Llama implementation

Inference Llama 2 in one file of pure Rust 🦀

Doing simple retrieval from LLM models at various context lengths to measure accuracy

Python and NodeJS packages that monitors OpenAI API calls and send OpenAI usage metrics and logs to Grafana Cloud

A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Python tools for NVIDIA Profiler