Eagle: Frontier Vision-Language Models with Data-Centric Strategies

🔥🔥🔥 A curated list of papers on LLMs-based multimodal generation (image, video, 3D and audio).

[Fully open] [Encoder-free MLLM] Vision as LoRA

OpenThinkIMG is an end-to-end open-source framework that empowers LVLMs to think with images.

up-to-date curated list of state-of-the-art Large vision language models hallucinations research work, papers & resources

[NeurIPS 2024] This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"

📜 Paper list on decoding methods for LLMs and LVLMs

[ICCV'25] The official code of paper "Combining Similarity and Importance for Video Token Reduction on Large Visual Language Models"

[ICCV 2025] HQ-CLIP: Leveraging Large Vision-Language Models to Create High-Quality Image-Text Datasets

CLIP-MoE: Mixture of Experts for CLIP

Latest Advances on (RL based) Multimodal Reasoning and Generation in Multimodal Large Language Models

[AAAI 2025] HiRED strategically drops visual tokens in the image encoding stage to improve inference efficiency for High-Resolution Vision-Language Models (e.g., LLaVA-Next) under a fixed token budget.

The official repository of "SmartAgent: Chain-of-User-Thought for Embodied Personalized Agent in Cyber World".

LEMMA: An effective and explainable way to detect multimodal misinformation with LVLM and external knowledge augmentation, incorporating the intuition and reasoning capbility inside LVLM.

Code for ICLR 2025 Paper: Visual Description Grounding Reduces Hallucinations and Boosts Reasoning in LVLMs

Large Visual Language Model(LVLM), Large Language Model(LLM), Multimodal Large Language Model(MLLM), Alignment, Agent, AI System, Survey

A benchmark dataset and simple code examples for measuring the perception and reasoning of multi-sensor Vision Language models.

[CVPR'25] Antidote: A Unified Framework for Mitigating LVLM Hallucinations in Counterfactual Presupposition and Object Perception

📖Curated list about reasoning abilitiy of MLLM, including OpenAI o1, OpenAI o3-mini, and Slow-Thinking.

[NeurIPS 2025] Intervene-All-Paths: Unified Mitigation of LVLM Hallucinations across Alignment Formats