An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Language Model for All.

Finetune Llama 3.2, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

A framework for few-shot evaluation of language models.

This repo contains the source code for RULER: What’s the Real Context Size of Your Long-Context Language Models?

Code and documents of LongLoRA and LongAlpaca (ICLR 2024 Oral)

An automatic evaluator for instruction-following language models. Human-validated, high-quality, cheap, and fast.

Repository for Label Words are Anchors: An Information Flow Perspective for Understanding In-Context Learning

d3.js

Tell stories of your work with Notion

A high-throughput and memory-efficient inference and serving engine for LLMs

torch-optimizer -- collection of optimizers for Pytorch

Collaborative Tuning of Large Language Models in an Efficient Way

LOMO: LOw-Memory Optimization

MeZO: Fine-Tuning Language Models with Just Forward Passes. https://arxiv.org/abs/2305.17333

🏅 Collection of Kaggle Solutions and Ideas 🏅

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

ChatGLM-6B 指令学习|指令数据|Instruct

🐙 Guides, papers, lecture, notebooks and resources for prompt engineering

Code and documentation to train Stanford's Alpaca models, and generate the data.

The release repo for "Vicuna: An Open Chatbot Impressing GPT-4"