LightSeq: A High Performance Library for Sequence Processing and Generation

Open Source Pre-training Model Framework in PyTorch & Pre-trained Model Zoo

Rust native ready-to-use NLP pipelines and transformer-based models (BERT, DistilBERT, GPT2,...)

Self-contained Machine Learning and Natural Language Processing library in Go

Tencent Pre-training framework in PyTorch & Pre-trained Model Zoo

TextGen: Implementation of Text Generation models, include LLaMA, BLOOM, GPT2, BART, T5, SongNet and so on. 文本生成模型，实现了包括LLaMA，ChatGLM，BLOOM，GPT2，Seq2Seq，BART，T5，UDA等模型的训练和预测，开箱即用。

Multilingual/multidomain question generation datasets, models, and python library for question generation.

Cybertron: the home planet of the Transformers in Go

MinT: Minimal Transformer Library and Tutorials

Build and train state-of-the-art natural language processing models using BERT

code for AAAI2022 paper "Open Vocabulary Electroencephalography-To-Text Decoding and Zero-shot Sentiment Classification"

Code associated with the "Data Augmentation using Pre-trained Transformer Models" paper

Calculate perplexity on a text with pre-trained language models. Support MLM (eg. DeBERTa), recurrent LM (eg. GPT3), and encoder-decoder LM (eg. Flan-T5).

Pytorch implementation of baseline models of KQA Pro, a large-scale dataset of complex question answering over knowledge base.

BARTpho: Pre-trained Sequence-to-Sequence Models for Vietnamese (INTERSPEECH 2022)

Abstractive and Extractive Text summarization using Transformers.

NAACL 2021 - Progressive Generation of Long Text

Codes for our paper "JointGT: Graph-Text Joint Representation Learning for Text Generation from Knowledge Graphs" (ACL 2021 Findings)

Official implementation of the paper "IteraTeR: Understanding Iterative Revision from Human-Written Text" (ACL 2022)

Code for EMNLP 2021 paper "Topic-Aware Contrastive Learning for Abstractive Dialogue Summarization"