A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)

DLRover: An Automatic Distributed Deep Learning System

Machine Learning Engineering Open Book

Minimalistic large language model 3D-parallelism training

Tools to download and cleanup Common Crawl data

maximal update parametrization (µP)

Retrieval and Retrieval-augmented LLMs

Microsoft Automatic Mixed Precision Library

The implementation of "Mitigating Hallucinations and Off-target Machine Translation with Source-Contrastive and Language-Contrastive Decoding"

The RedPajama-Data repository contains code for preparing large datasets for training large language models.

A high-throughput and memory-efficient inference and serving engine for LLMs

Official inference library for Mistral models

The simplest, fastest repository for training/finetuning medium-sized GPTs.

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.

A library for efficient similarity search and clustering of dense vectors.

A curated list of awesome papers related to pre-trained models for information retrieval (a.k.a., pretraining for IR).

Code repository for supporting the paper "Atlas Few-shot Learning with Retrieval Augmented Language Models",(https//arxiv.org/abs/2208.03299)

Making large AI models cheaper, faster and more accessible

An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.

Official repository for LongChat and LongEval

Hackable and optimized Transformers building blocks, supporting a composable construction.

OpenLLaMA, a permissively licensed open source reproduction of Meta AI’s LLaMA 7B trained on the RedPajama dataset

This repository contains code to quantitatively evaluate instruction-tuned models such as Alpaca and Flan-T5 on held-out tasks.

PyMultiDictionary is a dictionary module that gets meanings, translations, synonyms, and antonyms of words in 20 different languages

Dromedary: towards helpful, ethical and reliable LLMs.

Exact structure out of any language model completion.

Formalizing Coq Modules in the MetaCoq Project

An offline command-line interface to zdic.net dictionary (漢典)

Home of StarCoder: fine-tuning & inference!