output.mp4
Please follow the instructions in INSTALL.md to set up the environment.
Please run the following script to download the required data:
bash fetch_data.shThis requires access to SMPL, SMPL-X, AGORA, and CameraHMR. Please enter the credentials when prompted.
To run the code, please copy images to the images/ directory. Then, execute the following command:
python run_optimizer.pyThis will save the results in the outputs/ directory.
- Demo code release
- Evaluation code
This code is built on top of many great open-source projects. We would like to thank the authors of the following repositories:
- OmniEraser for the image inpainting code.
- MoGe for affine-invariant depth estimation.
- CameraHMR for the initial human mesh estimation.
- WiLoR/WiLoR-mini for initial hand pose estimation.
- DECO and PROX for contact estimation and static contacts.
- DepthPro for metric depth estimation.
- HSfM and ViTPose for the ViTPose inference code and models.
- LangSAM, GroundingDINO, and Segment-Anything for the segmentation code and models.
- SMPLFitter/NLF for the SMPL-to-SMPL-X converter.
and many others.
If you find our work useful, please cite:
@inproceedings{ym2025physic,
author = {Yalandur Muralidhar, Pradyumna and Xue, Yuxuan and Xie, Xianghui and Kostyrko, Margaret and Pons-Moll, Gerard},
title = {PhySIC: Physically Plausible 3D Human-Scene Interaction and Contact from a Single Image},
journal = {SIGGRAPH Asia 2025 Conference Papers},
year = {2025},
}