MVDiff: Scalable and flexible multi-view diffusion for 3D object reconstruction from single-view
Author(s)
Bourigault, Emmanuelle
Bourigault, Pauline
Type
Conference Paper
Abstract
Generating consistent multiple views for 3D reconstruction tasks is still a challenge to existing image-to-3D diffusion models. Generally incorporating 3D representations into diffusion model decrease the model's speed as well as generalizability and quality. This paper proposes a general framework to generate consistent multi-view images from single image or leveraging scene representation transformer and view-conditioned diffusion model. In the model we introduce epipolar geometry constraints and multi-view attention to enforce 3D consistency. From as few as one image input our model is able to generate 3D meshes surpassing baselines methods in evaluation metrics including PSNR SSIM and LPIPS.
Date Issued
2024-06-01
Date Acceptance
2024-06-01
Citation
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2024, pp.7579-7586
Publisher
Computer Vision Foundation
Start Page
7579
End Page
7586
Journal / Book Title
Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition
Copyright Statement
© 2024 The Author(s).
Identifier
https://openaccess.thecvf.com/content/CVPR2024W/GCV/html/Bourigault_MVDiff_Scalable_and_Flexible_Multi-view_Diffusion_for_3D_Object_Reconstruction_CVPRW_2024_paper.html
Source
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops
Publication Status
Published
Start Date
2024-06-17
Finish Date
2024-06-21
Coverage Spatial
Seattle WA, USA
Date Publish Online
2024-06-01