Lists (2)
Stars
A curriculum for learning about gpu performance engineering, from scratch to what the frontier AI labs do
Cohere Toolkit is a collection of prebuilt components enabling users to quickly build and deploy RAG applications.
Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.
Solve puzzles. Improve your pytorch.
Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
[ICML 2024] Break the Sequential Dependency of LLM Inference Using Lookahead Decoding
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
S-LoRA: Serving Thousands of Concurrent LoRA Adapters
A guidance language for controlling large language models.
This repository contains demos I made with the Transformers library by HuggingFace.
Implementations of basic RL algorithms with minimal lines of codes! (pytorch based)
Robust recipes to align language models with human and AI preferences
The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
Toolkit for fine-tuning, ablating and unit-testing open-source LLMs.
A fast inference library for running LLMs locally on modern consumer-class GPUs
Running large language models on a single GPU for throughput-oriented scenarios.
Customizable implementation of the self-instruct paper.
A high-throughput and memory-efficient inference and serving engine for LLMs
Build LLM apps in Typescript/Javascript. 🧑💻 🧑💻 🧑💻 🚀 🚀 🚀
A playbook for systematically maximizing the performance of deep learning models.
LlamaIndex is the leading document agent and OCR platform
Cramming the training of a (BERT-type) language model into limited compute.
The simplest, fastest repository for training/finetuning medium-sized GPTs.
Developer friendly Natural Language Processing ✨
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RN…