Hateful Memes dataset contains real hate speech. The Real Hateful Memes dataset consists of more than 10,000 newly created examples by Facebook AI.
-
Updated
May 17, 2021 - Jupyter Notebook
#
multimodal-deep-learning
Here are 504 public repositories matching this topic...
Deepfake Detection Solution using Multimodal Approach.
-
Updated
Jun 22, 2025 - Python
Create a large, well-managed and clean data-set for the task of music composition for video soundtracks.
video deep-learning music-composition soundtrack dataset-generation multimodal-deep-learning multimodal-datasets
-
Updated
Jul 6, 2023 - Jupyter Notebook
Analyzing Hateful Memes/ (Resources:- Hateful Memes Challenge)
-
Updated
Feb 18, 2024 - Jupyter Notebook
Experiments around using Multi-Modal Casual Attention with Multi-Grouped Query Attention
artificial-intelligence attention attention-mechanism multimodality attention-is-all-you-need multimodal multimodal-deep-learning gpt4
-
Updated
Mar 11, 2024 - Python
Facebook Marketplace is a platform for buying and selling products on Facebook. This project involves training a multimodal deep neural network model that predicts the category of a product based on its image and text description.
-
Updated
Jul 27, 2022 - Jupyter Notebook
A Fully Deployable React-Native mobile app that seeks to classify incoming messages in messaging apps into important or disturbing categories. using a Multi-Modal Machine Learning Architecture to achieve Text classification, Image classification and YouTube Video Link classification.
-
Updated
May 10, 2022 - Jupyter Notebook
Multimodal Agentic GenAI Workflow – Seamlessly blends retrieval and generation for intelligent storytelling
story-generation multimodal-learning multimodal multimodal-deep-learning multimodal-data vision-language vision-language-transformer generative-ai vision-language-model multimodal-large-language-models vision-language-learning generative-ai-model agentic-workflow agentic-rag agentic-ai internvl2
-
Updated
Jan 29, 2025 - Python
A list of research papers on knowledge-enhanced multimodal learning
knowledge-graph multi-task-learning visual-reasoning visual-dialog visual-question-answering vision-and-language multimodal-deep-learning visual-storytelling multimodal-retrieval visual-grounding visual-commonsense-reasoning vision-and-language-navigation story-visualization image-text-matching vision-language-transformer image-text-retrieval vision-and-language-pre-training conditional-image-generation knowledge-enhanced-multimodal-learning knowledge-enhanced-vision-language
-
Updated
Dec 8, 2022
Multi-speaker diarization from video using SyncNet’s cross-modal embedding space to match multiple face tracks to corresponding audio tracks.
-
Updated
Aug 14, 2025 - Python
[IROS 2023] GVCCI: Lifelong Learning of Visual Grounding for Language-Guided Robotic Manipulation
robotic-arm lifelong-learning vision-and-language multimodal-deep-learning robot-manipulation iros2023
-
Updated
Apr 23, 2024 - Python
Multimodal deep learning model for fake news classification.
classification social-network-analysis cnn-for-visual-recognition multimodal-deep-learning embedding-vectors misinformation-spreads
-
Updated
Jan 1, 2025
App to cheer you up with some awesome quotes when depressed using deep learning
flask sentiment-analysis tensorflow pytorch node-js emotion-recognition capsnet multimodal-deep-learning
-
Updated
Feb 25, 2019 - Python
SIREN Scalable, Isotropic Recursive Column Multimodal Neural Architecture with Device State Recognition Use-Case
machine-learning time-series neural-network images regression classification feature-engineering anomaly-detection multimodal-learning rul remaining-useful-life multimodal multimodal-deep-learning isotropic-architecture
-
Updated
Sep 9, 2024 - Jupyter Notebook
Example of a multimodal (end-to-end) deep learning model with transformers architecture
-
Updated
Feb 5, 2023
Image Recommendation for Wikipedia Articles
image wikipedia text wikipedia-api data-collection recommender-systems wikipedia-scraper multimodal-learning multimodal-deep-learning multimodal-datasets
-
Updated
May 22, 2021 - Jupyter Notebook
MSc project investigating multi-modal fusion approaches to combining textual and visual features for multi-page classification of documents within the OGA National Data Repository (NDR).
text-classification image-classification document-classification convolutional-neural-networks lstm-neural-network multimodal-deep-learning
-
Updated
Mar 17, 2024 - Jupyter Notebook
A PyTorch implementation of a Transformer Network for Machine Translation that incorporates image features to enhance the performance of the translation
-
Updated
Oct 26, 2021 - Python
Build a reliable and interpretable model that classifies extreme weather from images – enhancing early detection, situational awareness, and decision-making.
image deep-neural-networks deep-learning cnn pytorch embeddings rnn image-classification cosine-similarity feature-engineering clip tsne canny-edge-detection prompts encoder-decoder resnet-50 multimodal multimodal-deep-learning diffusion-models
-
Updated
Jun 17, 2025 - Jupyter Notebook
Improve this page
Add a description, image, and links to the multimodal-deep-learning topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the multimodal-deep-learning topic, visit your repo's landing page and select "manage topics."