Official Implementation for the paper "d1: Scaling Reasoning in Diffusion Large Language Models via Reinforcement Learning"

Official PyTorch implementation for "Large Language Diffusion Models"

Dream 7B, a large diffusion language model

Stable Diffusion web UI

The official implementation of Self-Play Preference Optimization (SPPO)

"LightRAG: Simple and Fast Retrieval-Augmented Generation"

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

[ACL2023] We introduce LLM-Blender, an innovative ensembling framework to attain consistently superior performance by leveraging the diverse strengths of multiple open-source LLMs. LLM-Blender cut …

Open-LLM-Leaderboard: Open-Style Question Evaluation. Paper at https://arxiv.org/abs/2406.07545

Easy-to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, ChatGLM2)

MetaMath: Bootstrap Your Own Mathematical Questions for Large Language Models

The code of NeurIPS 2021 paper "Scalable Rule-Based Representation Learning for Interpretable Classification" and TPAMI paper "Learning Interpretable Rules for Scalable Data Representation and Clas…

A high-throughput and memory-efficient inference and serving engine for LLMs

Implementation of the LLaMA language model based on nanoGPT. Supports flash attention, Int8 and GPTQ 4bit quantization, LoRA and LLaMA-Adapter fine-tuning, pre-training. Apache 2.0-licensed.

Example models using DeepSpeed