🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

The official repo of Qwen-VL (通义千问-VL) chat & pretrained large vision language model proposed by Alibaba Cloud.

[CVPR 2024] LION: Empowering Multimodal Large Language Model with Dual-Level Visual Knowledge

An open-source framework for training large multimodal models.

Implementation of 🦩 Flamingo, state-of-the-art few-shot visual question answering attention net out of Deepmind, in Pytorch

Code for [CVPR 2024] VideoSwap: Customized Video Subject Swapping with Interactive Semantic Point Correspondence

Official code for ICML 2022: Mitigating Neural Network Overconfidence with Logit Normalization

【PyTorch】Easy-to-use,Modular and Extendible package of deep-learning based CTR models.

Factorization Machine models in PyTorch

A PyTorch implementation of EmpiricalMVM

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.

A set of examples around pytorch in Vision, Text, Reinforcement Learning, etc.

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

NeurIPS 2023, Mix-of-Show: Decentralized Low-Rank Adaptation for Multi-Concept Customization of Diffusion Models

Chinese and English multimodal conversational language model | 多模态中英双语对话语言模型

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

Research code for CVPR 2022 paper "SwinBERT: End-to-End Transformers with Sparse Attention for Video Captioning"

This is an official implementation of GRIT-VLP

Official implementation of "Everything at Once - Multi-modal Fusion Transformer for Video Retrieval." CVPR 2022

👨 Code for "Large Pose 3D Face Reconstruction from a Single Image via Direct Volumetric CNN Regression"

Pretrained language model and its related optimization techniques developed by Huawei Noah's Ark Lab.

Open source implementation of "Spreading Vectors for Similarity Search"

The 1st Place Solution of the Facebook AI Image Similarity Challenge (ISC21) : Descriptor Track.

PyTorch implementation of SimCLR: A Simple Framework for Contrastive Learning of Visual Representations

PyTorch implementation of MoCo v3 https//arxiv.org/abs/2104.02057

CNN Image Retrieval in PyTorch: Training and evaluating CNNs for Image Retrieval in PyTorch

End-to-end learning of deep visual representations for image retrieval

PyTorch implementation of DELG paper.

Official PyTorch Implementation of Correlation Verification for Image Retrieval, CVPR 2022 (Oral Presentation)

XBM: Cross-Batch Memory for Embedding Learning