PyTorch implementation of the paper "MILAN: Masked Image Pretraining on Language Assisted Representation" https://arxiv.org/pdf/2208.06049.pdf.

Code release for ConvNeXt model

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

Colossal-AI: A Unified Deep Learning System for Big Model Era

METER: A Multimodal End-to-end TransformER Framework

Model parallel transformers in JAX and Haiku

Scalable PaLM implementation of PyTorch

PyTorch implementation of MAE https//arxiv.org/abs/2111.06377

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.

Ongoing research training transformer language models at scale, including: BERT & GPT-2

UniLM AI - Large-scale Self-supervised Pre-training across Tasks, Languages, and Modalities

A modular framework for Visual Question Answering research by the FAIR A-STAR team

PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057

Code for ALBEF: a new vision-language pre-training method

PyTorch code for Vision Transformers training with the Self-Supervised learning method DINO

VISSL is FAIR's library of extensible, modular and scalable components for SOTA Self-Supervised Learning with images.

SimCLRv2 - Big Self-Supervised Models are Strong Semi-Supervised Learners

PyTorch implementation of SwAV https//arxiv.org/abs/2006.09882

Official DeiT repository

Deformable DETR: Deformable Transformers for End-to-End Object Detection.

Repository for NeurIPS 2020 Spotlight "AdaBelief Optimizer: Adapting stepsizes by the belief in observed gradients"

Rethinking Image Inpainting via a Mutual Encoder Decoder with Feature Equalizations. ECCV 2020 Oral

PyTorch image models, scripts, pretrained weights -- (SE)ResNet/ResNeXT, DPN, EfficientNet, MixNet, MobileNet-V3/V2, MNASNet, Single-Path NAS, FBNet, and more

[CVPR 2020] 3D Photography using Context-aware Layered Depth Inpainting