AdaRFT: Efficient Reinforcement Finetuning via Adaptive Curriculum Learning

Real-time Attribution Classification to Detect Hallucinations

Library for fast text representation and classification.

GPTQLoRA: Efficient Finetuning of Quantized LLMs with GPTQ

Pyink, pronounced pī-ˈiŋk, is a Python formatter, forked from Black with a few different formatting behaviors.

Quantized inference code for LLaMA models

A crude RLHF layer on top of nanoGPT with Gumbel-Softmax trick

Ongoing research training transformer language models at scale, including: BERT & GPT-2

The Levenshtein Python C extension module contains functions for fast computation of Levenshtein distance and string similarity

🌸 fastText + Bloom embeddings for compact, full-coverage vectors with spaCy

fast python port of arc90's readability tool, updated to match latest readability.js!

This repository contains two independent news datasets used in the 2017 study: "This Just In: Fake News Packs a Lot in Title, Uses Simpler, Repetitive Content in Text Body, More Similar to Satire t…

Build a Jekyll blog in minutes, without touching the command line.

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

🔥 A collection of PyTorch notebooks for learning and practicing deep learning

⏩ Generating speech in a single forward pass without any attention!

Pytorch Implementation of ALBERT(A Lite BERT for Self-supervised Learning of Language Representations)

hULMonA (حلمنا)​: tHe first Universal Language MOdel iN Arabic

NYU ML² work on sentence encoding with tree structure and dynamic graphs

XLNet: fine tuning on RTX 2080 GPU - 8 GB

Training Transformer-XL on 128 GPUs

python implementation of the parquet columnar file format.

Pre-trained ELMo Representations for Many Languages

Assessing syntactic abilities of BERT

A curated list of resources dedicated to text summarization

Models and examples built with TensorFlow