Efficient Deep Learning Systems course materials (HSE, YSDA)

🤖 A PyTorch library of curated Transformer models and their composable components

Tools to download and cleanup Common Crawl data

Machine Learning Engineering Open Book

Hackable and optimized Transformers building blocks, supporting a composable construction.

Tensors and Dynamic neural networks in Python with strong GPU acceleration

The simplest, fastest repository for training/finetuning medium-sized GPTs.

StableLM: Stability AI Language Models

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.