Practical measurement and neural encoding of hyperspectral skin reflectance
File(s)3DV-small.pdf (3.07 MB)
Accepted version
Author(s)
Li, Xiaohui
Guarnera, Giuseppe Claudio
Lin, Arvin
Ghosh, Abhijeet
Type
Conference Paper
Abstract
We propose a practical method to measure spectral skin
reflectance as well as a spectral BSSRDF model spanning
a wide spectral range from 300nm to 1000nm. We employ a
practical capture setup consisting of desktop monitors to il-
luminate human faces in the visible domain to estimate five
parameters of spectral chromophore concentrations includ-
ing melanin, hemoglobin, and β carotene concentration,
melanin blend-type fraction, and epidermal hemoglobin
fraction. The estimated parameters make use of a novel
three-stage lookup table search for faster parameter fitting,
and drive our skin model for accurate reconstruction of
facial skin reflectance response in both the visible domain
as well as in the UVA and near-infrared range. We also
propose a novel neural network architecture that given our
measurements, predicts the five chromophore parameters
of our model at the encoder stage and full hyperspectral
reflectance response as the output of the decoder stage.
reflectance as well as a spectral BSSRDF model spanning
a wide spectral range from 300nm to 1000nm. We employ a
practical capture setup consisting of desktop monitors to il-
luminate human faces in the visible domain to estimate five
parameters of spectral chromophore concentrations includ-
ing melanin, hemoglobin, and β carotene concentration,
melanin blend-type fraction, and epidermal hemoglobin
fraction. The estimated parameters make use of a novel
three-stage lookup table search for faster parameter fitting,
and drive our skin model for accurate reconstruction of
facial skin reflectance response in both the visible domain
as well as in the UVA and near-infrared range. We also
propose a novel neural network architecture that given our
measurements, predicts the five chromophore parameters
of our model at the encoder stage and full hyperspectral
reflectance response as the output of the decoder stage.
Date Issued
2024-06-12
Date Acceptance
2024-01-24
Citation
2024 International Conference on 3D Vision (3DV), 2024
ISBN
979-8-3503-6245-9
ISSN
2475-7888
Publisher
IEEE
Journal / Book Title
2024 International Conference on 3D Vision (3DV)
Copyright Statement
Copyright © 2024 IEEE. This is the author’s accepted manuscript made available under a CC-BY licence in accordance with Imperial’s Research Publications Open Access policy (www.imperial.ac.uk/oa-policy)
License URL
Identifier
https://ieeexplore.ieee.org/abstract/document/10550579
Source
International Conference on 3D Vision 2024
Publication Status
Published
Start Date
2024-03-21
Finish Date
2024-03-21
Coverage Spatial
Davos, Switzerland
Date Publish Online
2024-06-12