[NeurIPS 2024] Official PyTorch implementation of the paper "Classifier-guided Gradient Modulation for Enhanced Multimodal Learning"

[AAAI 2025] Official pytorch implementation of the paper Wander

[AAAI 2025] Official PyTorch implementation of the paper "Bridging the Gap for Test-Time Multimodal Sentiment Analysis"

[ICLR 2025] Official pytorch implementation of the paper SuMi, new challenge multimodal wild TTA

Observe-R1: Unlocking Reasoning Abilities of MLLMs with Dynamic Progressive Reinforcement Learning

🚀 LLM-I: Transform LLMs into natural interleaved multimodal creators! ✨ Tool-use framework supporting image search, generation, code execution & editing

[ACL 2024 Main] Official PyTorch implementation of the paper "Multimodal Prompt Learning with Missing Modalities for Sentiment Analysis and Emotion Recognition"

大规模中文自然语言处理语料 Large Scale Chinese Corpus for NLP

A collaboration friendly studio for NeRFs

[CVPRW 2022] MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessment

[CVPR2023] Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspective

ChatGLM-6B: An Open Bilingual Dialogue Language Model | 开源双语对话语言模型

LLaMA: Open and Efficient Foundation Language Models

Curated list of apps and tools that not only use the new ChatGPT API, but also allow users to configure their own API keys, enabling free and on-demand usage of their own quota.

Official implementation of PCS in essay "Prompt Vision Transformer for Domain Generalization"

Code for paper "Fingerspelling detection in American Sign Language"

Pytorch implementation for M^3L. CVPR 2021

IJCAI2020: Learning to Discretely Compose Reasoning Module Networks for Video Captioning

[ICLR 2022] Official pytorch implementation of "Uncertainty Modeling for Out-of-Distribution Generalization" in International Conference on Learning Representations (ICLR) 2022.

The code repository for NAACL 2021 paper "Multimodal End-to-End Sparse Model for Emotion Recognition".

Implementation of our paper "Self-training Sampling with Monolingual Data Uncertainty for Neural Machine Translation" to appear in ACL-2021.

🤟 Visual Alignment Constraint for Continuous Sign Language Recognition. ( ICCV 2021)

This repo contains the official code of our work SAM-SLR which won the CVPR 2021 Challenge on Large Scale Signer Independent Isolated Sign Language Recognition.

WACV 2020 "Word-level Deep Sign Language Recognition from Video: A New Large-scale Dataset and Methods Comparison"

A PyTorch-based library for semi-supervised learning (NeurIPS'21)

Missing Modality Imagination Network for Emotion Recognition with Uncertain Missing Modalities