H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K…

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

implement llama in fastertransformer

JARVIS, a system to connect LLMs with ML community. Paper: https://arxiv.org/pdf/2303.17580.pdf

An experimental open-source attempt to make GPT-4 fully autonomous.

train llama-30B on a single A100 80G node using 🤗 transformers and 🚀 Deepspeed Pipeline Parallelism

An implementation of model parallel autoregressive transformers on GPUs, based on the DeepSpeed library.

An Extensible Toolkit for Finetuning and Inference of Large Foundation Models. Large Model for All.

Making large AI models cheaper, faster and more accessible

Instruct-tune LLaMA on consumer hardware

Let ChatGPT teach your own chatbot in hours with a single GPU!

GTP engine and self-play learning in Go

An elegant Go board and SGF editor for a more civilized age.

Open standard for machine learning interoperability

Code for the paper "Language Models are Unsupervised Multitask Learners"

A Large-scale Chinese Short-Text Conversation Dataset and Chinese pre-training dialog models

A PyTorch implementation of the Transformer model in "Attention is All You Need".

Library of deep learning models and datasets designed to make deep learning more accessible and accelerate ML research.

CLUENER2020 中文细粒度命名实体识别 Fine Grained Named Entity Recognition

Tutorials on getting started with PyTorch and TorchText for sentiment analysis.

TensorFlow code and pre-trained models for BERT

Chinese version of GPT2 training code, using BERT tokenizer.

神策杯2018高校算法大师赛（中文关键词提取）第二名代码方案

中文语言理解基准测评 Chinese Language Understanding Evaluation Benchmark: datasets, baselines, pre-trained models, corpus and leaderboard

Chinese NER using Lattice LSTM. Code for ACL 2018 paper.

追一科技首届中文NL2SQL挑战赛决赛第3名方案+代码

Pre-Training with Whole Word Masking for Chinese BERT（中文BERT-wwm系列模型）