Analyzing Hateful Memes/ (Resources:- Hateful Memes Challenge)
-
Updated
Feb 18, 2024 - Jupyter Notebook
#
multimodal-deep-learning
Here are 504 public repositories matching this topic...
Multi-speaker diarization from video using SyncNet’s cross-modal embedding space to match multiple face tracks to corresponding audio tracks.
-
Updated
Aug 14, 2025 - Python
Deeplearning utils for multimodal research
-
Updated
Jul 28, 2023 - Python
Clasificación de imágenes y asignación de textos mediante redes neuronales convolucionales y transformers multimodales
machine-learning tensorflow transformer neural-networks deeplearning convolutional-neural-network multimodal-deep-learning multimodal-transformer vertex-ai
-
Updated
Jul 10, 2024 - Jupyter Notebook
Code and Models for Binding Text, Images, Graphs, and Audio for Music Representation Learning
-
Updated
Jun 24, 2024 - Python
Example of a multimodal (end-to-end) deep learning model with transformers architecture
-
Updated
Feb 5, 2023
Fine-tuning BLIP for pathological visual question answering.
-
Updated
Jun 30, 2024 - Jupyter Notebook
Build a reliable and interpretable model that classifies extreme weather from images – enhancing early detection, situational awareness, and decision-making.
image deep-neural-networks deep-learning cnn pytorch embeddings rnn image-classification cosine-similarity feature-engineering clip tsne canny-edge-detection prompts encoder-decoder resnet-50 multimodal multimodal-deep-learning diffusion-models
-
Updated
Jun 17, 2025 - Jupyter Notebook
A Survey on Patent Analysis: From NLP to Multimodal AI (ACL 2025)
ai survey vlm patent-data multimodal-learning multimodal-deep-learning patent-analysis llm ai4patent
-
Updated
Aug 25, 2025
This repository implements temporal reasoning capabilities for vision-language models in simulated embodied environments, addressing the critical limitation of frame-by-frame processing in current multimodal AI systems.
computer-vision robotics artificial-intelligence multimodal multimodal-deep-learning embodied-artificial-intelligence temporal-reasoning embodied-agent embodied-ai habitat-sim llava
-
Updated
Sep 21, 2025 - Python
A repository of Video Language papers, code and datasets.
-
Updated
Jan 28, 2024
My implementation of research papers
-
Updated
Sep 12, 2024 - Jupyter Notebook
Learning a common representation space from speech and text for cross-modal retrieval given textual queries and speech files.
natural-language-processing deep-learning speech transformer speech-recognition spoken-language-understanding multimodal-deep-learning self-supervised-learning
-
Updated
Apr 27, 2023 - Python
Facial landmark detection and emotion classification using PyTorch, MediaPipe, and ResNet18 with attention mechanisms on the FER2013
-
Updated
Jul 26, 2025 - Jupyter Notebook
A unified multimodal generative AI system designed to learn and adapt across multiple modalities (text, audio, vision, robotics) with minimal data and long-term autonomy through reinforcement learning.
machine-learning ai ml agi unified generative multimodality multimodal multimodal-deep-learning multimodal-ai unified-multimodal-models ml-generative
-
Updated
Jul 30, 2025 - Python
Multimodal deep learning model for fake news classification.
classification social-network-analysis cnn-for-visual-recognition multimodal-deep-learning embedding-vectors misinformation-spreads
-
Updated
Jan 1, 2025
The purpose of this project is to build an NLP model to make reading medical abtracts easier.
-
Updated
Aug 20, 2023 - Jupyter Notebook
Build AI Superpowers with One SDK: Agents, Models, Context, Orchestration. Anywhere. Framework for Python & JavaScript/TypeScript
deep-neural-networks sdk ai deep-learning deep-reinforcement-learning deeplearning ai-agents sdk-python fine-tuning deeplearning-ai finetuning multimodal-deep-learning large-language-models llm fine-tuning-llm agentic-framework agentic-workflow agentic-ai-development multimindsdk sdk-ai
-
Updated
Jul 22, 2025
This repository is cloned from https://github.com/HLR/LatentAlignmentProcedural. This is a potential baseline explored for the textual_cloze task on the RecipeQA Dataset - https://hucvl.github.io/recipeqa/
multimodal-deep-learning multimodal-machine-learning recipeqa multimodal-prodedural-comprehension cmu-11777 cmu-11777-s24 cmu-11777-s24-mars
-
Updated
Jul 9, 2025 - Jupyter Notebook
MCD-UNet: A Multi-modal Conditional Diffusion UNet for 3D Medical Image Segmentation
-
Updated
Jun 13, 2025 - Python
Improve this page
Add a description, image, and links to the multimodal-deep-learning topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the multimodal-deep-learning topic, visit your repo's landing page and select "manage topics."