pith. sign in

arxiv: 2402.18848 · v1 · pith:DCIFQN5Hnew · submitted 2024-02-29 · 💻 cs.CV

SwitchLight: Co-design of Physics-driven Architecture and Pre-training Framework for Human Portrait Relighting

classification 💻 cs.CV
keywords architecturepre-trainingrelightingframeworkhumanportraitaccurateapproach
0
0 comments X
read the original abstract

We introduce a co-designed approach for human portrait relighting that combines a physics-guided architecture with a pre-training framework. Drawing on the Cook-Torrance reflectance model, we have meticulously configured the architecture design to precisely simulate light-surface interactions. Furthermore, to overcome the limitation of scarce high-quality lightstage data, we have developed a self-supervised pre-training strategy. This novel combination of accurate physical modeling and expanded training dataset establishes a new benchmark in relighting realism.

This paper has not been read by Pith yet.

discussion (0)

Sign in with ORCID, Apple, or X to comment. Anyone can read and Pith papers without signing in.