Official code for IJCAI 2024 paper: M2Beats: When Motion Meets Beats in Short-form Videos

Linux conda python 3.9

https://pytorch.org/get-started/locally/

参考安装命令：

conda install pytorch==1.13.1 torchvision==0.14.1 torchaudio==0.13.1 pytorch-cuda=11.7 -c pytorch -c nvidia

pip install -U openmim mim install "mmcv==2.1.0" mim install mmdet mim install mmpose

moviepy

mir_eval

checkpoint链接：

视频链接：

路径: M2Beats/checkpoint/

修改demo.py中12-13行的movie_path和music_path为自己的视频和音乐

python demo.py

python make_dataset.py

python train.py

python test.py

🎁 Projects	📚 Publication	🌈 Content	⭐ Stars
Attacker Against IAA Model【美学模型的攻击和安全评估框架】	TIP 2025	Code, Dataset
Personalized Aesthetics Assessment【个性化美学评估新范式】	CVPR 2025	Code, Dataset
Pixel-level image exposure assessment【首个像素级曝光评估】	NIPS 2024	Code, Dataset
Long-tail solution for image aesthetics assessment【美学评估数据不平衡解决方案】	ICML 2024	Code
CLIP-based image aesthetics assessment【基于CLIP多因素色彩美学评估】	Information Fusion 2024	Code, Dataset
Compare-based image aesthetics assessment【基于对比学习的多因素美学评估】	ACMMM 2024	Code
Image color aesthetics assessment【首个色彩美学评估】	ICCV 2023	Code, Dataset
Image aesthetics assessment【通用美学评估】	ACMMM 2023	Code
Theme-oriented image aesthetics assessment【首个多主题美学评估】	IJCAI 2022	Code, Dataset
Select prompt based on image aesthetics assessment【基于美学评估的提示词筛选】	IJCAI 2024	Code
Motion rhythm synchronization with beats【动作与韵律对齐】	IJCAI 2024	Code, Dataset
Champion Solution for AIGC Image Quality Assessment【NTIRE AIGC图像质量评估赛道冠军】	CVPRW NTIRE 2024	Code