IRUS Total

Unified neural encoding of BTFs

File Description SizeFormat 
unifiedBTF-lowres.pdfAccepted version3.11 MBAdobe PDFView/Open
Title: Unified neural encoding of BTFs
Authors: Rainer, G
Ghosh, A
Jakob, W
Weyrich, T
Item Type: Journal Article
Abstract: Realistic rendering using discrete reflectance measurements is challenging, because arbitrary directions on the light and viewhemispheres are queried at render time, incurring large memory requirements and the need for interpolation. This explains thedesire for compact and continuously parametrized models akin to analytic BRDFs; however, fitting BRDF parameters to complexdata such as BTF texels can prove challenging, as models tend to describe restricted function spaces that cannot encompassreal-world behavior. Recent advances in this area have increasingly relied on neural representations that are trained to reproduceacquired reflectance data. The associated training process is extremely costly and must typically be repeated for each material.Inspired by autoencoders, we propose a unified network architecture that is trained on a variety of materials, and which projectsreflectance measurements to a shared latent parameter space. Similarly to SVBRDF fitting, real-world materials are representedby parameter maps, and the decoder network is analog to the analytic BRDF expression (also parametrized on light and viewdirections for practical rendering application). With this approach, encoding and decoding materials becomes a simple matter ofevaluating the network. We train and validate on BTF datasets of the University of Bonn, but there are no prerequisites on eitherthe number of angular reflectance samples, or the sample positions. Additionally, we show that the latent space is well-behavedand can be sampled from, for applications such as mipmapping and texture synthesis.
Issue Date: May-2020
Date of Acceptance: 6-Mar-2020
URI: http://hdl.handle.net/10044/1/79317
DOI: 10.1111/cgf.13921
ISSN: 0167-7055
Publisher: Wiley
Start Page: 167
End Page: 178
Journal / Book Title: Computer Graphics Forum: the international journal of the Eurographics Association
Volume: 39
Issue: 2
Sponsor/Funder: Engineering & Physical Science Research Council (EPSRC)
Funder's Grant Number: EP/N006259/1
Keywords: Science & Technology
Computer Science, Software Engineering
Computer Science
<bold>CCS Concepts</bold>
center dot <bold>Computer Graphics</bold> -> Rendering
center dot <bold>Material Appearance</bold> -> BTFs & Neural Models
0801 Artificial Intelligence and Image Processing
Software Engineering
Publication Status: Published
Online Publication Date: 2020-07-13
Appears in Collections:Computing
Faculty of Engineering

Unless otherwise indicated, items in Spiral are protected by copyright and are licensed under a Creative Commons Attribution NonCommercial NoDerivatives License.

Creative Commons