Graphic notes on Gilbert Strang's "Linear Algebra for Everyone"

Home for "How To Scale Your Model", a short blog-style textbook about scaling LLMs on TPUs

Large Context Attention

Generative Representational Instruction Tuning

Efficient Triton Kernels for LLM Training

Retrieval and Retrieval-augmented LLMs

One stop shop for running AI/ML on AWS.

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

Go ahead and axolotl questions

The local UI to run and train text and diffusion models, including Kimi K3, Gemma 4, Qwen3.6, DeepSeek-V4, FLUX and more.

Ongoing research training transformer models at scale

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

The simplest, fastest repository for training/finetuning medium-sized GPTs.

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

Kernl lets you run PyTorch transformer models several times faster on GPU with a single line of code, and is designed to be easily hackable.

Curated coding interview preparation materials for busy software engineers

A computer science textbook

The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.

A fast, distributed, high performance gradient boosting (GBT, GBDT, GBRT, GBM or MART) framework based on decision tree algorithms, used for ranking, classification and many other machine learning …

A library for efficient similarity search and clustering of dense vectors.

Code repository for supporting the paper "Atlas Few-shot Learning with Retrieval Augmented Language Models",(https//arxiv.org/abs/2208.03299)

SPLADE: sparse neural search (SIGIR21, SIGIR22)

Large-scale Self-supervised Pre-training Across Tasks, Languages, and Modalities

PyTorch + HuggingFace code for RetoMaton: "Neuro-Symbolic Language Modeling with Automaton-augmented Retrieval" (ICML 2022), including an implementation of kNN-LM and kNN-MT

LibAUC: A Deep Learning Library for X-Risk Optimization

Python package to accelerate the sparse matrix multiplication and top-n similarity selection

A Library for Field-aware Factorization Machines

Sequence-to-sequence framework with a focus on Neural Machine Translation based on PyTorch

Code of GAMLP for Open Graph Benchmark