For the rlhf learning environment of Koreans

code for NH AI/Big Data Strategy Report(23.04)

KoAlpaca: 한국어 명령어를 이해하는 오픈소스 언어모델 (KoAlpaca: An open-source language model to understand Korean instructions)

Inference code for Llama models

DSBA code study

Reading list of Instruction-tuning. A trend starts from Natrural-Instruction (ACL 2022), FLAN (ICLR 2022) and T0 (ICLR 2022).

Accelerator test

A Unified Semi-Supervised Learning Codebase (NeurIPS'22)

📝 python package to calculate readability statistics of a text object - paragraphs, sentences, articles.

Must-read papers on prompt-based tuning for pre-trained language models.

BERT-based NLP template (+ WandB, Hydra)

Model explainability that works seamlessly with 🤗 transformers. Explain your transformers model in just 2 lines of code.

[ACL 2021] LM-BFF: Better Few-shot Fine-tuning of Language Models https://arxiv.org/abs/2012.15723

A Unified Library for Parameter-Efficient and Modular Transfer Learning

List of Korean pre-trained language models.

A python library for self-supervised learning on images.

Code associated with the Don't Stop Pretraining ACL 2020 paper

KB국민은행에서 제공하는 경제/금융 도메인에 특화된 한국어 ALBERT 모델

NL-Augmenter 🦎 → 🐍 A Collaborative Repository of Natural Language Transformations

A PyTorch-based library for semi-supervised learning (NeurIPS'21)

Phrase-Based & Neural Unsupervised Machine Translation

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Transformer Implementation using PyTorch for Neural Machine Translation (Korean to English)