Q-Bench+: A Benchmark for Multi-modal Foundation Models on Low-level Vision from Single Images to Pairs

• Zicheng Zhang*, Haoning Wu*, Erli Zhang, Guangtao Zhai, Weisi Lin
• [Paper] [Repo]

Large Multimodal Models Evaluation: A Survey

• AIBench Team
• [Paper] [Repo]

Redundancy Principles for MLLMs Benchmarks

• Zicheng Zhang, Xiangyu Zhao, Xinyu Fang, Chunyi Li, Xiaohong Liu, Xiongkuo Min2, Haodong Duan1#, Kai Chen1#, Guangtao Zhai
• [Paper] [Repo]

Q-Bench-Video: Benchmarking the Video Quality Understanding of LMMs

• Zicheng Zhang, Ziheng Jia, Haoning Wu, Chunyi Li, Zijian Chen, Yingjie Zhou, Wei Sun, Xiaohong Liu, Xiongkuo Min, Weisi Lin, Guangtao Zhai
• [Paper] [Repo]

Q-SiT: Teaching LMMs for Image Quality Scoring and Interpreting

• Zicheng Zhang, Haoning Wu, Ziheng Jia, Weisi Lin, Guangtao Zhai
• [Paper] [Repo]

Q-Eval-100K: Evaluating Visual Quality and Alignment Level for Text-to-Vision Content

• Zicheng Zhang, Tengchuan Kou, Shushi Wang, Chunyi Li, Wei Sun, Wei Wang, Xiaoyu Li, Zongyu Wang, Xuezhi Cao, Xiongkuo Min, Xiaohong Liu, Guangtao Zhai
• [Paper] [Repo]

LMM-PCQA: Assisting Point Cloud Quality Assessment with LMM

• Zicheng Zhang, Haoning Wu, Yingjie Zhou, Chunyi Li, Wei Sun, Chaofeng Chen, Xiongkuo Min, Xiaohong Liu, Weisi Lin, Guangtao Zhai
• [Paper] [Repo]

A-Bench: Are LMMs Masters at Evaluating AI-generated Images?

• Zicheng Zhang, Haoning Wu, Chunyi Li, Yingjie Zhou, Wei Sun, Xiongkuo Min, Zijian Chen, Xiaohong Liu, Weisi Lin, Guangtao Zhai
• [Paper] [Repo]

Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-Level Vision

• Haoning Wu*, Zicheng Zhang*, Erli Zhang*, Chaofeng Chen, Liang Liao, Annan Wang, Chunyi Li, Wenxiu Sun, Qiong Yan, Guangtao Zhai, Weisi Lin
• [Paper] [Repo]

Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Models

• Haoning Wu*, Zicheng Zhang*, Erli Zhang*, Chaofeng Chen1, Liang Liao, Annan Wang, Kaixin Xu, Chunyi Li, Jingwen Hou, Guangtao Zhai, Geng Xue, Wenxiu Sun, Qiong Yan, Weisi Lin
• [Paper] [Repo]

Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levels

• Haoning Wu*, Zicheng Zhang*, Weixia Zhang, Chaofeng Chen, Liang Liao, Chunyi Li, Yixuan Gao, Annan Wang, Erli Zhang, Wenxiu Sun, Qiong Yan, Xiongkuo Min, Guangtao Zhai, Weisi Lin
• [Paper] [Repo]

MM-PCQA: Multi-Modal Learning for No-reference Point Cloud Quality Assessment

• Zicheng Zhang, Wei Sun, Xiongkuo Min, Quan Zhou, Jun He, Qiyuan Wang, Guangtao Zhai
• [Paper] [Repo]

No-reference quality assessment for 3d colored point cloud and mesh models

• Zicheng Zhang, Wei Sun, Xiongkuo Min, Tao Wang, Wei Lu, Guangtao Zhai
• [Paper] [Repo]

Evaluating Point Cloud from Moving Camera Videos: A No-Reference Metric

• Zicheng Zhang, Wei Sun, Yucheng Zhu, Xiongkuo Min, Wei Wu, Ying Chen, Guangtao Zhai
• [Paper] [Repo]

Subjective and Objective Quality Assessment for in-the-Wild Computer Graphics Images

• Zicheng Zhang, Wei Sun, Yingjie Zhou, Jun Jia, Zhichao Zhang, Jing Liu, Xiongkuo Min, Guangtao Zhai
• [Paper] [Repo]

GMS-3DQA: Projection-based Grid Mini-patch Sampling for 3D Model Quality Assessment

• Zicheng Zhang, Wei Sun, Houning Wu, Yingjie Zhou, Chunyi Li, Xiongkuo Min, Guangtao Zhai, Weisi Lin
• [Paper] [Repo]

MD-VQA: Multi-Dimensional Quality Assessment for UGC Live Videos

• Zicheng Zhang, Wei Wu, Wei Sun, Dangyang Tu, Wei Lu, Xiongkuo Min, Ying Chen, Guangtao Zhai
• [Paper] [Repo]

Quality-of-Experience Evaluation for Digital Twins in 6G Network Environments

• Zicheng Zhang, Yingjie Zhou, Long Teng, Wei Sun, Chunyi Li, Xiongkuo Min, Xiao-Ping Zhang, Guangtao Zhai
• [Paper]

Towards Open-ended Visual Quality Comparison

• Haoning Wu*, Hanwei Zhu*, Zicheng Zhang*, Erli Zhang, Chaofeng Chen, Liang Liao, Chunyi Li, Annan Wang, Wenxiu Sun, Qiong Yan, Xiaohong Liu, Guangtao Zhai, Shiqi Wang, Weisi Lin
• [Paper] [Repo]