Framework based on a vector dabase to store, manage and curate large image datasets

An English lexical database from the Big 🍎, let's go Mets baby love da Mets

FAIR Sequence Modeling Toolkit 2

A library for data streaming and augmentation

Code for SaGe subword tokenizer (EACL 2023)

This repository contains an extension of fairseq for pixel / visual representations of text for machine translation.

A toolkit to create, launch and monitor SLURM jobs over existing python scripts.

Foundation Architecture for (M)LLMs

remote pbcopy over ssh

A tool for holistic analysis of language generations systems

MAFAND-MT

Open information and community for machine translation

A PyTorch repo for data loading and utilities to be shared by the PyTorch domain libraries.

Code and data for the IWSLT 2022 shared task on Formality Control for SLT

Cross language information retrieval pipeline

Hackable and optimized Transformers building blocks, supporting a composable construction.

Learned string similarity for entity names using optimal transport.

A python package to run contextualized topic modeling. CTMs combine contextualized embeddings (e.g., BERT) with topic models to get coherent topics. Published at EACL and ACL 2021 (Bianchi et al.).

State-of-the-Art Text Embeddings

docTR (Document Text Recognition) - a seamless, high-performing & accessible library for OCR-related tasks powered by Deep Learning.

This repository contains the code and implementation details of the CascadeTabNet paper "CascadeTabNet: An approach for end to end table detection and structure recognition from image-based documents"

Open-source AI orchestration framework for building context-engineered, production-ready LLM applications. Design modular pipelines and agent workflows with explicit control over retrieval, routing…

Models, data loaders and abstractions for language processing, powered by PyTorch

A data augmentations library for audio, image, text, and video.

OPUS-CAT is a collection of software which make it possible to OPUS-MT neural machine translation models in professional translation. OPUS-CAT includes a local offline MT engine and a collection of…

skweak: A software toolkit for weak supervision applied to NLP tasks

Document Layout Analysis

document image degradation

A Unified Toolkit for Deep Learning Based Document Image Analysis

A PyTorch-based Speech Toolkit