Practical acquisition of shape and plausible appearance of reflective and translucent objects
File(s)EGSR2023-TranslucentObjectsScanning.pdf (33.4 MB)
Accepted version
Author(s)
Lin, Arvin
Lin, Yiming
Ghosh, Abhijeet
Type
Journal Article
Abstract
We present a practical method for acquisition of shape and plausible appearance of reflective and translucent objects for
realistic rendering and relighting applications. Such objects are extremely challenging to scan with existing capture setups,
and have previously required complex lightstage hardware emitting continuous illumination. We instead employ a practical
capture setup consisting of a set of desktop LCD screens to illuminate such objects with piece-wise continuous illumination
for acquisition. We employ phase-shifted sinusoidal illumination for novel estimation of high quality photometric normals and
transmission vector along with diffuse-specular separated reflectance/transmission maps for realistic relighting. We further
employ neural in-painting to fill gaps in our measurements caused by gaps in screen illumination, and a novel NeuS-based
neural rendering that combines these shape and reflectance maps acquired from multiple viewpoints for high-quality 3D
surface geometry reconstruction along with plausible realistic rendering of complex light transport in such objects.
realistic rendering and relighting applications. Such objects are extremely challenging to scan with existing capture setups,
and have previously required complex lightstage hardware emitting continuous illumination. We instead employ a practical
capture setup consisting of a set of desktop LCD screens to illuminate such objects with piece-wise continuous illumination
for acquisition. We employ phase-shifted sinusoidal illumination for novel estimation of high quality photometric normals and
transmission vector along with diffuse-specular separated reflectance/transmission maps for realistic relighting. We further
employ neural in-painting to fill gaps in our measurements caused by gaps in screen illumination, and a novel NeuS-based
neural rendering that combines these shape and reflectance maps acquired from multiple viewpoints for high-quality 3D
surface geometry reconstruction along with plausible realistic rendering of complex light transport in such objects.
Date Issued
2023-07-01
Date Acceptance
2023-06-12
Citation
Computer Graphics Forum: the international journal of the Eurographics Association, 2023, 42 (4)
ISSN
0167-7055
Publisher
Wiley
Journal / Book Title
Computer Graphics Forum: the international journal of the Eurographics Association
Volume
42
Issue
4
Copyright Statement
© 2023 Eurographics - The European Association for Computer Graphics and John Wiley & Sons Ltd. This is the peer reviewed version of the following article, which has been published in final form at https://onlinelibrary.wiley.com/doi/full/10.1111/cgf.14889
Publication Status
Published
Article Number
ARTN e14889
Date Publish Online
2023-07-26