Tora: Torchtune-LoRA for RL

Ongoing research training transformer models at scale

A high-throughput and memory-efficient inference and serving engine for LLMs

train with kittens!

Zero Bubble Pipeline Parallelism

Large language models (LLMs) made easy, EasyLM is a one stop solution for pre-training, finetuning, evaluating and serving LLMs in JAX/Flax.

Qwen2 VL Fine Tuning using Llama Factory

LLM training in simple, raw C/CUDA

The simplest, fastest repository for training/finetuning medium-sized GPTs.

Inference code for LLaMA models

👀 Track & visualize user interactions with your streamlit app

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

Generative Agents: Interactive Simulacra of Human Behavior

Code repository for "Introducing Airavata: Hindi Instruction-tuned LLM"

Parameter Efficient Transfer Learning with Diff Pruning

Source-to-Source Debuggable Derivatives in Pure Python

Solve puzzles. Learn CUDA.

Train to 94% on CIFAR-10 in 4.4 seconds on a single A100

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Draw a ui and make it real

An Apache 2.0 fork of HuggingFace's Large Language Model Text Generation Inference

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

A repo for distributed training of language models with Reinforcement Learning via Human Feedback (RLHF)

RWKV is a RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, …

The deep learning toolkit for Speech-to-Text. Training and deploying STT models has never been so easy.

TensorFlow/Keras port of Stable Diffusion

Industry-strength Natural Language Processing workflows with Keras

This repository contains description and examples for the DAQC VQE challenge for the Womanium Hackathon 2022.

Data augmentation for NLP, accepted at EMNLP 2021 Findings

Public repo for the GANFT video