Optimal OLAT alignment for image based relighting with color-multiplexed OLAT sequence
File(s)PlexOlat-CVMP2024.pdf (7.3 MB)
Accepted version
Author(s)
Lin, Arvin
Ghosh, Abhijeet
Type
Conference Paper
Abstract
We present two color-multiplexed illumination sequences for optimally-aligned one-light-at-a-time (OLAT) captures. We leverage color-multiplexing strategies to embed tracking frames within the OLAT photographs to correct for subject motion. Our method allows better motion estimation via optical flow than traditional methods, which interleaves tracking frames between OLATs. Comparison between rendered results and user study on comfortability both demonstrate that color-multiplexed sequences give better-aligned OLATs and are more comfortable for the subject during data capture. Our proposed sequences can replace traditional OLAT sequences for better data acquisition, which would benefit both light-stage rendering results and any state-of-the-art relighting methods that are trained on OLAT-generated data.
Date Issued
2024-11-18
Date Acceptance
2024-09-27
Citation
CVMP '24: Proceedings of 21st ACM SIGGRAPH Conference on Visual Media Production, 2024, pp.1-7
ISBN
9798400712814
Publisher
ACM
Start Page
1
End Page
7
Journal / Book Title
CVMP '24: Proceedings of 21st ACM SIGGRAPH Conference on Visual Media Production
Copyright Statement
© 2024 ACM. This is the author’s accepted manuscript made available under a CC-BY licence in accordance with Imperial’s Research Publications Open Access policy (www.imperial.ac.uk/oa-policy)
License URL
Identifier
https://dl.acm.org/doi/10.1145/3697294.3697297
Source
ACM SIGGRAPH Conference on Visual Media Production (CVMP'24) 2024
Publication Status
Published
Start Date
2024-11-18
Finish Date
2024-11-19
Coverage Spatial
London, UK