Can LLMs Write Correct and Efficient GPU Communication Code?

AI agents running research on single-GPU nanochat training automatically

Give your agents the power of the Hugging Face ecosystem

Claude Opus 4.6 wrote a dependency-free C compiler in Rust, with backends targeting x86 (64- and 32-bit), ARM, and RISC-V, capable of compiling a booting Linux kernel.

Our first fully AI generated deep learning system

Quantized LLM training in pure CUDA/C++.

Tritonbench is a collection of PyTorch custom operators with example inputs to measure their performance.

The best ChatGPT that $100 can buy.

Puzzles for learning Triton, play it with minimal environment configuration!

A Quirky Assortment of CuTe Kernels

NanoGPT (124M) in 90 seconds

Distributed Compiler based on Triton for Parallel Systems

(Crafter + NetHack) in JAX. ICML 2024 Spotlight.

[NeurIPS 2023] Tree of Thoughts: Deliberate Problem Solving with Large Language Models

Simulation platform for general-purpose robotics & embodied AI learning.

[NeurIPS 2024 Best Paper Award][GPT beats diffusion🔥] [scaling laws in visual generation📈] Official impl. of "Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Prediction". A…

prime is a framework for efficient, globally distributed training of AI models over the internet.

DIAMOND (DIffusion As a Model Of eNvironment Dreams) is a reinforcement learning agent trained in a diffusion world model. NeurIPS 2024 Spotlight.

verl/HybridFlow: A Flexible and Efficient RL Post-Training Framework

A customisable 3D platform for agent-based AI research

800,000 step-level correctness labels on LLM solutions to MATH problems

SGLang is a high-performance serving framework for large language models and multimodal models.

OpenSpiel is a collection of environments and algorithms for research in general reinforcement learning and search/planning in games.

Distributed Training Over-The-Internet