Multiview photometric stereo

Abstract

This paper addresses the problem of obtaining complete, detailed reconstructions of textureless shiny objects. We present an algorithm which uses silhouettes of the object, as well as images obtained under changing illumination conditions. In contrast with previous photometric stereo techniques, ours is not limited to a single viewpoint but produces accurate reconstructions in full 3D. A number of images of the object are obtained from multiple viewpoints, under varying lighting conditions. Starting from the silhouettes, the algorithm recovers camera motion and constructs the object's visual hull. This is then used to recover the illumination and initialize a multiview photometric stereo scheme to obtain a closed surface reconstruction. There are two main contributions in this paper: First, we describe a robust technique to estimate light directions and intensities and, second, we introduce a novel formulation of photometric stereo which combines multiple viewpoints and, hence, allows closed surface reconstructions. The algorithm has been implemented as a practical model acquisition system. Here, a quantitative evaluation of the algorithm on synthetic data is presented together with complete reconstructions of challenging real objects. Finally, we show experimentally how, even in the case of highly textured objects, this technique can greatly improve on correspondence-based multiview stereo results.

Publication DOI: https://doi.org/10.1109/TPAMI.2007.70820
Divisions: College of Engineering & Physical Sciences > School of Informatics and Digital Engineering > Computer Science
Additional Information: © 2008 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Uncontrolled Keywords: closed surface reconstruction,multiview photometric stereo,object silhouettes,textureless shiny object reconstructions,visual hull,Control and Systems Engineering,Electrical and Electronic Engineering,Artificial Intelligence,Computer Vision and Pattern Recognition
Full Text Link: http://ieeexplo ... rnumber=4384496
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Article
Published Date: 2008-03
Authors: Hernández, Carlos
Vogiatzis, George (ORCID Profile 0000-0002-3226-0603)
Cipolla, Roberto

Download

Export / Share Citation


Statistics

Additional statistics for this record