Analyzing Hateful Memes/ (Resources:- Hateful Memes Challenge)
-
Updated
Feb 18, 2024 - Jupyter Notebook
#
multimodal-deep-learning
Here are 526 public repositories matching this topic...
Deeplearning utils for multimodal research
-
Updated
Jul 28, 2023 - Python
Clasificación de imágenes y asignación de textos mediante redes neuronales convolucionales y transformers multimodales
machine-learning tensorflow transformer neural-networks deeplearning convolutional-neural-network multimodal-deep-learning multimodal-transformer vertex-ai
-
Updated
Jul 10, 2024 - Jupyter Notebook
Code and Models for Binding Text, Images, Graphs, and Audio for Music Representation Learning
-
Updated
Jun 24, 2024 - Python
Example of a multimodal (end-to-end) deep learning model with transformers architecture
-
Updated
Feb 5, 2023
A repository of Video Language papers, code and datasets.
-
Updated
Jan 28, 2024
My implementation of research papers
-
Updated
Sep 12, 2024 - Jupyter Notebook
Learning a common representation space from speech and text for cross-modal retrieval given textual queries and speech files.
natural-language-processing deep-learning speech transformer speech-recognition spoken-language-understanding multimodal-deep-learning self-supervised-learning
-
Updated
Apr 27, 2023 - Python
A unified multimodal generative AI system designed to learn and adapt across multiple modalities (text, audio, vision, robotics) with minimal data and long-term autonomy through reinforcement learning.
machine-learning ai ml agi unified generative multimodality multimodal multimodal-deep-learning multimodal-ai unified-multimodal-models ml-generative
-
Updated
Jul 30, 2025 - Python
Facial landmark detection and emotion classification using PyTorch, MediaPipe, and ResNet18 with attention mechanisms on the FER2013
-
Updated
Jul 26, 2025 - Jupyter Notebook
Build AI Superpowers with One SDK: Agents, Models, Context, Orchestration. Anywhere. Framework for Python & JavaScript/TypeScript
deep-neural-networks sdk ai deep-learning deep-reinforcement-learning deeplearning ai-agents sdk-python fine-tuning deeplearning-ai finetuning multimodal-deep-learning large-language-models llm fine-tuning-llm agentic-framework agentic-workflow agentic-ai-development multimindsdk sdk-ai
-
Updated
Jul 22, 2025
The purpose of this project is to build an NLP model to make reading medical abtracts easier.
-
Updated
Aug 20, 2023 - Jupyter Notebook
A generalized research workbench for fusing visual (CNN) and textual (RNN/LSTM) features. It provides a clean, modular Keras framework, optimized for efficient training on Google Colab by leveraging local I/O and persistent asset saving to Google Drive.
colab image-classification text-processing cnn-keras cnn-model multimodal-learning multimodal multimodal-deep-learning colab-notebook multimodal-classification efficientnet multimodal-ai
-
Updated
Oct 29, 2025 - Jupyter Notebook
This repository implements temporal reasoning capabilities for vision-language models in simulated embodied environments, addressing the critical limitation of frame-by-frame processing in current multimodal AI systems.
computer-vision robotics artificial-intelligence multimodal multimodal-deep-learning embodied-artificial-intelligence temporal-reasoning embodied-agent embodied-ai habitat-sim llava
-
Updated
Sep 24, 2025 - Python
Fine-tuning BLIP for pathological visual question answering.
-
Updated
Jun 30, 2024 - Jupyter Notebook
Build a reliable and interpretable model that classifies extreme weather from images – enhancing early detection, situational awareness, and decision-making.
image deep-neural-networks deep-learning cnn pytorch embeddings rnn image-classification cosine-similarity feature-engineering clip tsne canny-edge-detection prompts encoder-decoder resnet-50 multimodal multimodal-deep-learning diffusion-models
-
Updated
Jun 17, 2025 - Jupyter Notebook
A novel multimodal approach for emotion recognition deploying early fusion based on graph-captured embeddings
-
Updated
Jan 3, 2024 - Jupyter Notebook
This repository accompanies the Thesis "Automated Segmentation and Analysis of High-Speed Video Phase-Detection Data for Boiling Heat Transfer Characterization Using U-Net Convolutional Neural Networks and Uncertainty Quantification" published by MIT Libraries.
machine-learning cnn computer uncertainty-quantification multimodal-deep-learning unet-image-segmentation
-
Updated
May 25, 2024 - MATLAB
This repository focuses on the cutting-edge features of Llama 3.2, including multimodal capabilities, advanced tokenization, and tool calling for building next-gen AI applications. It highlights Llama's enhanced image reasoning, multilingual support, and the Llama Stack API for seamless customization and orchestration.
nlp machine-learning llama tokenization multimodal-deep-learning prompting tool-calling llama-stack advaned-prompting image-reasoning
-
Updated
Dec 18, 2024 - Jupyter Notebook
Improve this page
Add a description, image, and links to the multimodal-deep-learning topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the multimodal-deep-learning topic, visit your repo's landing page and select "manage topics."