List of academic resources on Multimodal ML for Music

[CVPR 2021] Multi-Modal-CelebA-HQ: A Large-Scale Text-Driven Face Generation and Understanding Dataset

muon is a multimodal omics Python framework

Data Analysis program and framework for materials science data analytics, based on the managing framework SIMPL framework.

Unified storage framework for the entire machine learning lifecycle

Interface for easier topic modelling.

A curated list of awesome Multimodal studies.

Code on selecting an action based on multimodal inputs. Here in this case inputs are voice and text.

Frontiers in Intelligent Colonoscopy [ColonSurvey | ColonINST | ColonGPT]

Corpus of resources for multimodal machine learning with physiological signals (mmps).

An EXA-Scale repository of Multi-Modality AI resources from papers and models, to foundational libraries!

[IEEE TGRS 2022] Unsupervised Multimodal Change Detection Based on Structural Relationship Graph Representation Learning

Study of Transformer based models for Multimodal Remote Sensing Image Classification

A fully differentiable set autoencoder

Collects a multimodal dataset of Wikipedia articles and their images

Manage logical datasets!

Prompt Engineering and Dev-Ops toolkit for applications powered by Language Models

Tumor2Graph: a novel Overall-Tumor-Profile-derived virtual graph deep learning for predicting tumor typing and subtyping.

The backend algorithms and framework associated with DREAM3DNX, a data analysis program for materials science data analytics

A multimodal architecture to build multimodal knowledge graphs with flexible multimodal feature extraction and dynamic multimodal concept generation