Thanks to visit codestin.com
Credit goes to github.com

Skip to content

tandaily/Awesome-Relighting

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 

Repository files navigation

Awesome-Relighting

Collection of relighting works. Questions and discussions are most welcome! Upcoming works will be updated on a regular basis.

Hope you can help with the following:

  • Help with adding any missing papers and their links.
  • Assist in adding code links for the papers and the number of stars on GitHub.
  • Help with including information on publicly available datasets.
  • Provide links of current relighting software or websites.
  • Assist in adding or correcting any other relevant information.
  • Star this repository.

Publications

Survey

[CGF2021] Deep Neural Models for Illumination Estimation and Relighting: A Survey paper

Papers

Image

[2019.05] [SIGGRAPH2019] Single Image Portrait Relighting paper

[2019.06] [CVPR2020] Learning Physics-guided Face Relighting under Directional Light paper

[2019.08] [ICCV2019] Deep Single-Image Portrait Relighting paper code Star

[2020] [SIGGRAPH Asia 2020] Single image portrait relighting via explicit multiple reflectance channel modeling paper

[2020.08] [ECCV2020] Learning to Factorize and Relight a City paper

[2020.08] [ECCV2020] Self-supervised Outdoor Scene Relighting paper code GitHub Repo stars

[2021] [SIGGRAPH 2021] Total Relighting: Learning to Relight Portraits for Background Replacement paper

[2021.04] [CVPR2021] Towards High Fidelity Face Relighting with Realistic Shadows paper project code GitHub Repo stars

[2021.10] [CGF2021] Relighting Humans in the Wild: Monocular Full-Body Human Relighting with Domain Adaptation paper code GitHub Repo stars

[2022.03] [CVPR2022] Face Relighting with Geometrically Consistent Shadows paper project code GitHub Repo stars

[2022.04] [CVPR2024] SIMBAR: Single Image-Based Scene Relighting For Effective Data Augmentation For Automated Driving Vision Tasks paper

[2022.04] [CGF2024] OutCast: Outdoor Single-image Relighting with Cast Shadows paper

[2022.05] [CVPR2024] StyLitGAN: Image-Based Relighting via Latent Control paper code GitHub Repo stars

[2022.05] [TIP2022] PNRNet: Physically-Inspired Neural Rendering for Any-to-Any Relighting paper code GitHub Repo stars

[2022.07] Local Relighting of Real Scenes paper code GitHub Repo stars

[2022.07] [TIP2022] Designing an Illumination-Aware Network for Deep Image Relighting paper code GitHub Repo stars

[2022.07] [ECCV2022] Geometry-aware Single-image Full-body Human Relighting paper project

[2022.09] [SIGGRAPH Asia 2022] Lumos: Learning to Relight Portrait Images via a Virtual Light Stage and Synthetic-to-Real Adaptation paper

[2023.03] [CVPR2023] LightPainter: Interactive Portrait Relighting with Freehand Scribble paper project

[2023.03] [CVPR2023] Weakly-supervised Single-view Image Relighting paper code GitHub Repo stars

[2023.04] [ICCV2023] DiFaReli: Diffusion Face Relighting paper code GitHub Repo stars

[2023.11] Lasagna: Layered Score Distillation for Disentangled Object Relighting paper code GitHub Repo stars

[2023.12] [CVPR2024] Relightful Harmonization: Lighting-aware Portrait Background Replacement paper

[2023.12] [CVPR2024] Intrinsic Image Diffusion for Single-view Material Estimation paper project code GitHub Repo stars

[2024.01] [CVPR2025] IRIS: Inverse Rendering of Indoor Scenes from Low Dynamic Range Images paper project

[2024.02] [CVPR2024] SwitchLight: Co-design of Physics-driven Architecture and Pre-training Framework for Human Portrait Relighting paper

[2024.02] [SIGGRAPH2024] DiLightNet: Fine-grained Lighting Control for Diffusion-based Image Generation paper code GitHub Repo stars

[2024.03] [CVPR2024] LightIt: Illumination Modeling and Control for Diffusion Models paper

[2024.03] [CVPR2024] Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Image paper project

[2024.05] [SIGGRAPH2024] RGB↔X: Image decomposition and synthesis using material- and lighting-aware diffusion models paper project code GitHub Repo stars

[2024.05] [ICLR2025] Scaling In-the-Wild Training for Diffusion-based Illumination Harmonization and Editing by Imposing Consistent Light Transport paper code GitHub Repo stars

[2024.05] [NeurIPS2024] Latent Intrinsics Emerge from Training to Relight paper code GitHub Repo stars

[2024.06] [NeurIPS2024] Neural Gaffer: Relighting Any Object via Diffusion paper code GitHub Repo stars

[2024.07] [ACM MM2024] CFDiffusion: Controllable Foreground Relighting in Image Compositing via Diffusion Model paper

[2024.07] [SIGGRAPH2024] Lite2Relight: 3D-aware Single Image Portrait Relighting paper

[2024.08] [ECCV2024] COMPOSE: Comprehensive Portrait Shadow Editing paper

[2024.09] [CGF2024] A Diffusion Approach to Radiance Field Relighting using Multi-Illumination Synthesis paper code GitHub Repo stars

[2024.09] [SIGGRAPH Asia 2024] Portrait Video Editing Empowered by Multimodal Generative Priors paper code GitHub Repo stars

[2024.09] [TMM2025] Relighting from a Single Image: Datasets and Deep Intrinsic-based Architecture paper code GitHub Repo stars

[2024.10] [SIGGRAPH Asia 2024] DifFRelight: Diffusion-Based Facial Performance Relighting paper

[2024.10] [TOG2024] Generative Portrait Shadow Removal paper

[2024.10] Noise Crystallization and Liquid Noise: Zero-shot Video Generation using Image Diffusion Models paper code GitHub Repo stars

[2024.11] [CVPR2025] ScribbleLight: Single Image Indoor Relighting with Scribbles paper

[2024.11] SpotLight: Shadow-Guided Object Relighting via Diffusion paper

[2024.11] All-frequency Full-body Human Image Relighting paper

[2024.11] [CVPR2025] Diffusion Self-Distillation for Zero-Shot Customized Image Generation paper project demo code GitHub Repo stars

[2024.12] [CVPR2025] LumiNet: Latent Intrinsics Meets Diffusion Models for Indoor Scene Relighting paper code GitHub Repo stars

[2024.12] [AAAI2025] Text2Relight: Creative Portrait Relighting with Text Guidance paper

[2024.12] LuminaBrush: Illumination Drawing Tools for Text-to-Image Diffusion Models code GitHub Repo stars

[2024.12] GenLit:Reformulating Single-Image Relighting as Video Generation paper

[2024.12] [CVPR2025] Uni-Renderer: Unifying Rendering and Inverse Rendering Via Dual Stream Diffusion paper project code GitHub Repo stars

[2024.12] [CVPR2025] Neural LightRig: Unlocking Accurate Object Normal and Material Estimation with Multi-Light Diffusion paper project code GitHub Repo stars

[2025.01] [CVPR2025] SynthLight: Portrait Relighting with Diffusion Model by Learning to Re-render Synthetic Faces paper

[2025.01] DiFaReli++: Diffusion Face Relighting with Consistent Cast Shadows paper code GitHub Repo stars

[2025.01] IC-Portrait: In-Context Matching for View-Consistent Personalized Portrait Generation paper

[2025.01] Joint Learning of Depth and Appearance for Portrait Image Animation paper

[2025.01] Materialist: Physically Based Editing Using Single-Image Inverse Rendering paper code GitHub Repo stars

[2025.03] [ICCV2025] LBM:Latent Bridge Matching for Fast Image-to-Image Translation paper demo project code GitHub Repo stars

[2025.03] [CVPR2025] GroomLight: Hybrid Inverse Rendering for Relightable Human Hair Appearance Modeling paper project

[2025.04] [CVPR2025] Comprehensive Relighting: Generalizable and Consistent Monocular Human Relighting and Harmonization paper project

[2025.04] ChildlikeSHAPES: Semantic Hierarchical Region Parsing for Animating Figure Drawings paper

[2025.04] Digital Kitchen Remodeling: Editing and Relighting Intricate Indoor Scenes from a Single Panorama paper

[2025.05] [SIGGRAPH2025] IntrinsicEdit: Precise generative image manipulation in intrinsic space paper project

[2025.05] [SIGGRAPH2025] LightLab: Controlling Light Sources in Images with Diffusion Models paper project

[2025.05] SAIL: Self-supervised Albedo Estimation from Real Images with a Latent Diffusion Model paper

[2025.06] [NeurIPS2025] DreamLight: Towards Harmonious and Consistent Image Relighting paper code GitHub Repo stars

[2025.07] [SIGGRAPH2025] Physically Controllable Relighting of Photographs paper project

[2025.08] Hybrelighter: Combining Deep Anisotropic Diffusion and Scene Reconstruction for On-device Real-time Relighting in Mixed Reality paper

[2025.08] TransLight: Image-Guided Customized Lighting Control with Generative Decoupling paper

[2025.09] PractiLight: Practical Light Control Using Foundational Diffusion Models paper

Video

[2021.04] [ICCV2021] Neural Video Portrait Relighting in Real-time via Consistency Modeling paper project code GitHub Repo stars

[2023.11] [ECCV2024] Personalized Video Relighting With an At-Home Light Stage paper project

[2024.04] [CVPR workshop: EDGE2024] EdgeRelight360: Text-Conditioned 360-Degree HDR Image Generation for Real-Time On-Device Video Portrait Relighting paper

[2024.10] LumiSculpt: A Consistency Lighting Control Network for Video Generation paper

[2025.01] RelightVid: Temporal-Consistent Diffusion Model for Video Relighting paper project code GitHub Repo stars

[2025.01] [CVPR2025] DiffusionRenderer: Neural Inverse and Forward Rendering with Video Diffusion Models paper

[2025.02] VidCRAFT3: Camera, Object, and Lighting Control for Image-to-Video Generation paper

[2025.02] [ICCV2025] Light-A-Video: Training-free Video Relighting via Progressive Light Fusion paper code GitHub Repo stars

[2025.02] [CVPR2025] High-Fidelity Relightable Monocular Portrait Animation with Lighting-Controllable Video Diffusion Model paper code GitHub Repo stars

[2025.03] [CVPR2025] Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Dataset paper project

[2025.03] Follow Your Motion: A Generic Temporal Consistency Portrait Editing Framework with Trajectory Guidance paper project

[2025.06] IllumiCraft: Unified Geometry and Illumination Diffusion for Controllable Video Generation paper project code GitHub Repo stars

[2025.06] [NeurIPS2025] UniRelight: Learning Joint Decomposition and Synthesis for Video Relighting paper project

[2025.06] TC-Light: Temporally Consistent Relighting for Dynamic Long Videos paper project code GitHub Repo stars

[2025.08] Lumen: Consistent Video Relighting and Harmonious Background Replacement with Video Generative Models paper

[2025.11] [NeurIPS2025] UniLumos: Fast and Unified Image and Video Relighting with Physics-Plausible Feedback paper code GitHub Repo stars

3D (Face/Avatar/Human)

[2023.06] [EGSR23] Learning Projective Shadow Textures for Neural Rendering of Human Cast Shadows from Silhouettes paper dataset

[2023.05] [TOG2023] NeRFFaceLighting: Implicit and Disentangled Face Lighting Representation Leveraging Generative Prior in Neural Radiance Fields paper project code GitHub Repo stars

[2023.08] [CVPR2024] Relightable and Animatable Neural Avatar from Sparse-View Video paper project code GitHub Repo stars

[2023.12] [AAAI2024] Relightable and Animatable Neural Avatars from Videos paper project code GitHub Repo stars

[2023.12] [ECCV2024] Relightable Neural Actor with Intrinsic Decomposition and Pose Control paper project code GitHub Repo stars

[2023.12] [CVPR2024] Relightable Gaussian Codec Avatars paper project code GitHub Repo stars

[2024.03] [CVPR2024] Holo-Relighting: Controllable Volumetric Portrait Relighting from a Single Image paper

[2024.05] [CVPR2024] Real-time 3D-aware Portrait Video Relighting paper code GitHub Repo stars

[2024.06] [NeurIPS2024] IllumiNeRF: 3D Relighting Without Inverse Rendering paper project code GitHub Repo stars

[2024.07] [EGSR2024] Learning Self-Shadowing for Clothed Human Bodies paper code

[2024.07] [SIGGRAPH2024] Lite2Relight: 3D-aware Single Image Portrait Relighting paper

[2024.09] Instant Facial Gaussians Translator for Relightable and Interactable Facial Rendering paper project

[2024.10] [SIGGRAPH Asia 2024] DifFRelight: Diffusion-Based Facial Performance Relighting paper

[2024.10] [SIGGRAPH Asia 2024] URAvatar: Universal Relightable Gaussian Codec Avatars paper project

[2025.01] [SIGGRAPH2025] Relightable Full-Body Gaussian Codec Avatars paper project

[2025.02] BEAM: Bridging Physically-based Rendering and Gaussian Modeling for Relightable Volumetric Video paper

[2025.03] [CVPR2025] HRAvatar: High-Quality and Relightable Gaussian Head Avatar paper project code GitHub Repo stars

[2025.03] [ICME2025] Fast and Physically-based Neural Explicit Surface for Relightable Human Avatars paper

[2025.04] LightHeadEd: Relightable & Editable Head Avatars from a Smartphone paper

[2025.04] Beyond Reconstruction: A Physics-Based Neural Deferred Shader for Photo-realistic Rendering paper

[2025.04] DNF-Avatar: Distilling Neural Fields for Real-time Animatable Avatar Relighting paper project code GitHub Repo stars

[2025.05] Total-Editing: Head Avatar with Editable Appearance, Motion, and Lighting paper

[2025.05] Generalizable and Relightable Gaussian Splatting for Human Novel View Synthesis paper project

[2025.06] [NeurIPS2025] BecomingLit: Relightable Gaussian Avatars with Hybrid Neural Shading paper project

[2025.07] [SIGGRAPH2025] GSHeadRelight: Fast Relightability for 3D Gaussian Head Synthesis paper

[ICCV2025] HumanOLAT: A Large-Scale Dataset for Full-Body Human Relighting and Novel-View Synthesis

[2025.12] [ACM MM2025] Relightable and Dynamic Gaussian Avatar Reconstruction from Monocular Video paper

3D (Others)

[2022.04] [CVPR2022] (InvRender) Modeling Indirect Illumination for Inverse Rendering paper code project GitHub Repo stars

[2022.06] [NeurIPS2022] (nvdiffrecmc) Shape, Light, and Material Decomposition from Images using Monte Carlo Rendering and Denoising paper code project GitHub Repo stars

[2023.04] [ICCV2023] Neural-PBIR Reconstruction of Shape, Material, and Illumination paper project

[2023.04] [CVPR2023] TensoIR: Tensorial Inverse Rendering paper project code GitHub Repo stars

[2023.11] [CVPR2024] GS-IR: 3D Gaussian Splatting for Inverse Rendering paper project code GitHub Repo stars

[2023.11] [ECCV2024] Relightable 3D Gaussian: Real-time Point Cloud Relighting with BRDF Decomposition and Ray Tracing paper project code GitHub Repo stars

[2023.11] [ECCV2024] The Sky's the Limit: Re-lightable Outdoor Scenes via a Sky-pixel Constrained Illumination Prior and Outside-In Visibility paper

[2023.12] [TOG2024] RNA: Relightable Neural Assets paper

[2024.02] [ECCV2024] FlashTex: Fast Relightable Mesh Texturing with LightControlNet paper project code GitHub Repo stars

[2024.05] [NeurIPS2025] MetaGS: A Meta-Learned Gaussian-Phong Model for Out-of-Distribution 3D Scene Relighting paper

[2024.06] [NeurIPS2024] Neural Gaffer: Relighting Any Object via Diffusion paper code GitHub Repo stars

[2024.06] [NeurIPS2024] IllumiNeRF: 3D Relighting Without Inverse Rendering paper project code GitHub Repo stars

[2024.09] [CGF2024] A Diffusion Approach to Radiance Field Relighting using Multi-Illumination Synthesis paper code GitHub Repo stars

[2024.09] [CVPR2025] RNG: Relightable Neural Gaussians paper project code GitHub Repo stars

[2024.10] [ICLR2025] GI-GS: Global Illumination Decomposition on Gaussian Splatting for Inverse Rendering paper code GitHub Repo stars

[2024.10] [ICLR2025] RelitLRM: Generative Relightable Radiance for Large Reconstruction Models paper project

[2024.10] [SIGGRAPH Asia 2024] GS^3: Efficient Relighting with Triple Gaussian Splatting paper project code GitHub Repo stars

[2024.11] [CVPR2025] ARM: Appearance Reconstruction Model for Relightable 3D Generation paper project

[2024.11] [CVPR2025] UrbanCAD: Towards Highly Controllable and Photorealistic 3D Vehicles for Urban Scene Simulation paper project

[2024.11] [CVPR2025] NeISF++: Neural Incident Stokes Field for Polarized Inverse Rendering of Conductors and Dielectrics paper project code GitHub Repo stars

[2024.11] [CVPR2025] Differentiable Inverse Rendering with Interpretable Basis BRDFs paper project code GitHub Repo stars

[2024.12] MCMat: Multiview-Consistent and Physically Accurate PBR Material Generation paper project code GitHub Repo stars

[2024.12] IDArb: Intrinsic Decomposition for Arbitrary Number of Input Views and Illuminations paper project code GitHub Repo stars

[2024.12] [CVPR2025] ReCap: Better Gaussian Relighting with Cross-Environment Captures paper project code GitHub Repo stars

[2024.12] [CVPR2025] Generative Multiview Relighting for 3D Reconstruction under Extreme Illumination Variation paper project

[2024.12] [CVPR2025] Birth and Death of a Rose paper project

[2024.12] [ICLR2025] Reflective Gaussian Splatting paper project code GitHub Repo stars

[2024.12] [CVPR2025] IRGS: Inter-Reflective Gaussian Splatting with 2D Gaussian Ray Tracing paper project code GitHub Repo stars

[2024.12] GraphicsDreamer: Image to 3D Generation with Physical Consistency paper

[2025.03] TranSplat: Lighting-Consistent Cross-Scene Object Transfer with 3D Gaussian Splatting paper

[2025.04] RGS-DR: Reflective Gaussian Surfels with Deferred Rendering for Shiny Objects paper

[2025.04] SVG-IR: Spatially-Varying Gaussian Splatting for Inverse Rendering paper

[2025.04] [CVPR2025] LIRM: Large Inverse Rendering Model for Progressive Reconstruction of Shape, Materials and View-dependent Radiance Fields paper project

[2025.05] Generalizable and Relightable Gaussian Splatting for Human Novel View Synthesis paper project

[2025.05] [SIGGRAPH2025] RenderFormer: Transformer-based Neural Rendering of Triangle Meshes with Global Illumination paper project code GitHub Repo stars

[2025.06] [CVPR2025] GS-2DGS: Geometrically Supervised 2DGS for Reflective Object Reconstruction paper code GitHub Repo stars

[2025.06] 2D Triangle Splatting for Direct Differentiable Mesh Training paper

[2025.06] [CVPR2025] Neural Inverse Rendering from Propagating Light paper project

[2025.06] Light of Normals: Unified Feature Representation for Universal Photometric Stereo paper project code GitHub Repo stars

[2025.06] [ICCV2025] HiNeuS: High-fidelity Neural Surface Mitigating Low-texture and Reflective Ambiguity paper

[2025.07] [SIGGRAPH2025] Practical Inverse Rendering of Textured and Translucent Appearance paper project

[2025.07] MatDecompSDF: High-Fidelity 3D Shape and PBR Material Decomposition from Multi-View Images paper

[2025.07] RTR-GS: 3D Gaussian Splatting for Inverse Rendering with Radiance Transfer and Reflection paper

[ICCV2025] LightSwitch: Multi-view Relighting with Material-guided Diffusion

[ICCV2025] SU-RGS: Relightable 3D Gaussian Splatting from Sparse Views under Unconstrained Illuminations

[ICCV2025] GaRe: Relightable 3D Gaussian Splatting for Outdoor Scenes from Unconstrained Photo Collections

[ICCV2025] Gaussian Splatting with Discretized SDF for Relightable Assets

[2025.10] [NeurIPS2025] ROGR: Relightable 3D Objects using Generative Relighting paper project

Security

[2021.08] [TIFS2024] Adversarial Relighting Against Face Recognition paper

[2025.06] Light as Deception: GPT-driven Natural Relighting Against Vision-Language Pre-training Models paper

Reinforcement Learning

[CVIU2024] BiPR-RL: Portrait relighting via bi-directional consistent deep reinforcement learning paper

[TMM2022] PR-RL: Portrait Relighting Via Deep Reinforcement Learning paper

Autonomous Driving

[2022.04] [CVPR2024] SIMBAR: Single Image-Based Scene Relighting For Effective Data Augmentation For Automated Driving Vision Tasks paper

[2025.06] MADrive: Memory-Augmented Driving Scene Modeling paper project

Datasets

[3DV2024] Objects With Lighting: A Real-World Dataset for Evaluating Reconstruction and Rendering for Object Relighting paper

VIDIT Dataset

Multi-Illumination Dataset

DPR Dataset

Workshop

[ECCV2020] AIM 2020 Any to one relighting Illumination Settings estimation Any to any relighting

[CVPR2021] NTIRE 2021 Depth Guided Image Relighting One-to-One relighting Any-to-Any relighting

[CVPR2025] NTIRE 2025 Video Quality Enhancement for Video Conferencing

[ICCV2025] UniLight Workshop link

Software Products

Flux Kontext Relight https://huggingface.co/spaces/kontext-community/kontext-relight
SwitchLight: https://www.switchlight.beeble.ai/
Switchlight 2.0: https://app.beeble.ai/home report
IC-Light: https://github.com/lllyasviel/IC-Light https://huggingface.co/spaces/lllyasviel/IC-Light https://huggingface.co/spaces/lllyasviel/iclight-v2-vary
LBM: https://huggingface.co/spaces/jasperai/LBM_relighting
Adobe ProjectPerfectBlend: https://x.com/Pinsky/status/1846351993478037857
Magnific Relight: https://x.com/javilopen/status/1805274155065176489
Clipdrop: https://clipdrop.co/relight
FreeLighting: https://huggingface.co/spaces/wulongmetac/FreeLighting code

Related Work

Intrinsic Decomposition & Inverse Rendering

Please refer to Awesome-InverseRendering GitHub Repo stars

HDR Panorama Generation

[SIGGRAPH Asia 2022] Text2Light: Zero-Shot Text-Driven HDR Panorama Generation paper project code GitHub Repo stars

[SIGGRAPH2025] LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generation paper project code GitHub Repo stars

PBR Generation

[2024.09] [CVPR2025] 3DTopia-XL: High-Quality 3D PBR Asset Generation via Primitive Diffusion paper project code GitHub Repo stars

[2025.04] IntrinsiX: High-Quality PBR Generation using Image Priors paper project

Lighting Estimation

Please refer to Awesome-Illumination-Estimation GitHub Repo stars

[AAAI2021] EMLight: Lighting Estimation via Spherical Distribution Approximation paper & [TIP2022] GMLight: Lighting Estimation via Geometric Distribution Approximation paper code GitHub Repo stars

[ECCV2022] StyleLight: HDR Panorama Generation for Lighting Estimation and Editing paper project code GitHub Repo stars

[TOG2023] Spatiotemporally Consistent HDR Indoor Lighting Estimation paper

[CVPR2024] DiffusionLight: Light Probes for Free by Painting a Chrome Ball paper project code GitHub Repo stars

[CVPR2024] Towards a Perceptual Evaluation Framework for Lighting Estimation paper project

[SIGGRAPH2025] Spatiotemporally Consistent Indoor Lighting Estimation with Diffusion Priors

[TVCG2025] IllumiDiff: Indoor Illumination Estimation from a Single Image with Diffusion Model paper code GitHub Repo stars

DiffusionLight-Turbo: Accelerated Light Probes for Free via Single-Pass Chrome Ball Inpainting paper code project GitHub Repo stars

About

No description, website, or topics provided.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 3

  •  
  •  
  •