[WACV 2023] Temporal Feature Enhancement Dilated Convolution Network for Weakly-supervised Temporal Action Localization

PHATE (Potential of Heat-diffusion for Affinity-based Transition Embedding) is a tool for visualizing high dimensional data.

✨✨Latest Advances on Multimodal Large Language Models

🔥🔥🔥Latest Papers, Codes and Datasets on Vid-LLMs.

TextGrad: Automatic ''Differentiation'' via Text -- using large language models to backpropagate textual gradients.

Implementing a ChatGPT-like LLM in PyTorch from scratch, step by step

Pretrained Pytorch face detection (MTCNN) and facial recognition (InceptionResnet) models

Reading list for research topics in multimodal machine learning

Code for paper "Speech Emotion Recognition with ASR Transcripts: A Comprehensive Study on Word Error Rate and Fusion Techniques"

[ECCV 2022] Dual-Evidential Learning for Weakly-supervised Temporal Action Localization

Official repository for our CVPR 2024 Workshop paper "Multi-Task Multi-Modal Self-Supervised Learning for Facial Expression Recognition".

ABAW6 (CVPR-W) We achieved second place in the valence arousal challenge of ABAW6

Official code of "Emotion-Anchored Contrastive Learning Framework for Emotion Recognition in Conversation" (Findings of NAACL 2024)

A curated publication list on open vocabulary semantic segmentation and related area (e.g. zero-shot semantic segmentation) resources..

[WACV 2024] LibreFace: An Open-Source Toolkit for Deep Facial Expression Analysis

Accepted by ICCV2023, Revisiting Foreground and Background Separation in Weakly-supervised Temporal Action Localization: A Clustering-based Approach

Official Implementation of "Moving Object Segmentation: All You Need Is SAM (and Flow)" Junyu Xie, Charig Yang, Weidi Xie, Andrew Zisserman

EMNLP'22 | MedCLIP: Contrastive Learning from Unpaired Medical Images and Texts

[NeurIPS 2023] The Rise of AI Language Pathologists: Exploring Two-level Prompt Learning for Few-shot Weakly-supervised Whole Slide Image Classification

Official code for "CorrMatch: Label Propagation via Correlation Matching for Semi-Supervised Semantic Segmentation"

Macaw-LLM: Multi-Modal Language Modeling with Image, Video, Audio, and Text Integration

PyTorch code and models for the DINOv2 self-supervised learning method.

Low rank adaptation for Vision Transformer

[EMNLP 2022] This repository contains the official implementation of the paper "MM-Align: Learning Optimal Transport-based Alignment Dynamics for Fast and Accurate Inference on Missing Modality Seq…

MELD: A Multimodal Multi-Party Dataset for Emotion Recognition in Conversation

List of papers about Proteins Design using Deep Learning

This repository is for the first comprehensive survey on Meta AI's Segment Anything Model (SAM).