Simple migration engine for Peewee

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

Universal markup converter

A debugging and profiling tool that can trace and visualize python code execution

Simple migration engine for Peewee

Keeping language models honest by directly eliciting knowledge encoded in their activations.

A framework for few-shot evaluation of language models.

Sacred is a tool to help you configure, organize, log and reproduce experiments developed at IDSIA.

Small language model built in Minecraft.

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.

Starlark Language

Python 3.9 to JavaScript compiler - Lean, fast, open!

Simple, elegant, Pythonic functional programming.

a small library for combinatorial iters of dicts, useful for config/hyperparameter sweep management

CLIP (Contrastive Language-Image Pretraining), Predict the most relevant text snippet given an image

A simple and efficient tool to parallelize Pandas operations on all available CPUs

downloads and parses subtitle dataset from opensubtitles.org

PyTorch package for the discrete VAE used for DALL·E.

Transforms PDF, Documents and Images into Enriched Structured Data

URL downloader supporting checkpointing and continuous checksumming.

Evaluation of measurement tampering detection techniques on the datasets from Benchmarks for Detecting Measurement Tampering

German part-of-speech dictionary

A dataset of alignment research and code to reproduce it

Download, parse, and filter data from Court Listener, part of the FreeLaw projects. Data-ready for The-Pile.

Downloads 2020 English Wikipedia articles as plaintext

Athens is no longer maintainted. Athens was an open-source, collaborative knowledge graph, backed by YC W21

Model parallel transformers in JAX and Haiku

Massively-Parallel Natural Extension of Reference Frame