Raindrop Clarity: A Dual-Focused Dataset for Day and Night Raindrop Removal
European Conference on Computer Vision (ECCV'2024) (CVPR-NTIRE'2025)

[Poster] [Slides] [Video]

🔥 The first challenge on Day and Night Raindrop Removal for Dual-Focused Images
[Competitions] [ChallengePage]

Existing raindrop removal datasets have two shortcomings. First, they consist of images captured by cameras with a focus on the background, leading to the presence of blurry raindrops. To our knowledge, none of these datasets include images where the focus is specifically on raindrops, which results in a blurry background. Second, these datasets predominantly consist of daytime images, thereby lacking nighttime raindrop scenarios. Consequently, algorithms trained on these datasets may struggle to perform effectively in raindrop-focused or nighttime scenarios. The absence of datasets specifically designed for raindrop-focused and nighttime raindrops constrains research in this area. In this paper, we introduce a large-scale, real-world raindrop removal dataset called Raindrop Clarity. Raindrop Clarity comprises 15,186 high-quality pairs/triplets (raindrops, blur, and background) of images with raindrops and the corresponding clear background images. There are 5,442 daytime raindrop images and 9,744 nighttime raindrop images. Specifically, the 5,442 daytime images include 3,606 raindrop- and 1,836 background-focused images. While the 9,744 nighttime images contain 4,838 raindrop- and 4,906 background-focused images. Our dataset will enable the community to explore background-focused and raindrop-focused images, including challenges unique to daytime and nighttime conditions.

1. the checkpoint RainDrop_DiT_ddpm.pth.tar is patch_size=4, image_size:64, transformer2d.py, follow patch_size=4

2. the checkpoint RainDrop_DiT2_ddpm.pth.tar is patch_size=2, image_size:64, transformer2d.py, follow patch_size=2

python calculate_psnr_ssim_sid.py

please change base_path, time_of_day, model_name accordingly.

The analysis code is available at analyse/cal_rf_bf.py

python cal_rf_bf.py

bash run_eval_diffusion_day.sh

bash run_eval_diffusion_night.sh

Inside the script, please change model_name accordingly.

CUDA_VISIBLE_DEVICES=1 python eval_diffusion_day_dit.py --sid "$sid"

CUDA_VISIBLE_DEVICES=1 python eval_diffusion_day_rdiffusion.py --sid "$sid"

CUDA_VISIBLE_DEVICES=2 python eval_diffusion_day_restomer.py --sid "$sid"

CUDA_VISIBLE_DEVICES=1 python eval_diffusion_day_uformer.py --sid "$sid"

CUDA_VISIBLE_DEVICES=2 python eval_diffusion_day_onego.py --sid "$sid"

CUDA_VISIBLE_DEVICES=1 python eval_diffusion_day_idt.py --sid "$sid"

CUDA_VISIBLE_DEVICES=2 python eval_diffusion_day_icra.py --sid "$sid"

CUDA_VISIBLE_DEVICES=1 python eval_diffusion_day_atgan.py --sid "$sid"

CUDA_VISIBLE_DEVICES=1,2 python train.py --config daytime_64.yml --test_set Raindrop_DiT

please change daytime_64.yml,daytime_128.yml,daytime_256.yml according to model_name and image_size.

The code is implemented based on WeatherDiffusion, we would like to thank them.

The code and models in this repository are licensed under the MIT License for academic and other non-commercial uses.
For commercial use of the code and models, separate commercial licensing is available. Please contact:

• Yeying Jin ([email protected])
• Jonathan Tan ([email protected])

If this work is useful for your research, please cite our paper.

@inproceedings{li2025ntire,
  title={NTIRE 2025 challenge on day and night raindrop removal for dual-focused images: Methods and results},
  author={Li, Xin and Jin, Yeying and Jin, Xin and Wu, Zongwei and Li, Bingchen and Wang, Yufei and Yang, Wenhan and Li, Yu and Chen, Zhibo and Wen, Bihan and others},
  booktitle={Proceedings of the Computer Vision and Pattern Recognition Conference},
  pages={1172--1183},
  year={2025}
}
@inproceedings{jin2024raindrop,
  title={Raindrop Clarity: A Dual-Focused Dataset for Day and Night Raindrop Removal},
  author={Jin, Yeying and Li, Xin and Wang, Jiadong and Zhang, Yan and Zhang, Malu},
  booktitle={European Conference on Computer Vision},
  pages={1--17},
  year={2024},
  organization={Springer}
}