Instruct-tune LLaMA on consumer hardware

CodeTF: One-stop Transformer Library for State-of-the-art Code LLM

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

Structured Outputs

🔥 The Web Data API for AI - Turn entire websites into LLM-ready markdown or structured data

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.

A guidance language for controlling large language models.

A Bulletproof Way to Generate Structured JSON from Language Models

LLM(😽)

Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, 20+ clouds, or on-prem).

Training Sparse Autoencoders on Language Models

Ungreedy subword tokenizer and vocabulary trainer for Python, Go & Javascript

A JavaScript library like PyTorch, with GPU acceleration.

train with kittens!

A data visualization and analytics component, especially well-suited for large and/or streaming datasets.