Video normals from colored lights

Brostow, Gabe, Hernández, Carlos, Vogiatzis, George, Stenger, Björn and Cipolla, Roberto (2011). Video normals from colored lights. IEEE Transactions on Pattern Analysis and Machine Intelligence, 33 (10), pp. 2104-2114.

Abstract

We present an algorithm and the associated single-view capture methodology to acquire the detailed 3D shape, bends, and wrinkles of deforming surfaces. Moving 3D data has been difficult to obtain by methods that rely on known surface features, structured light, or silhouettes. Multispectral photometric stereo is an attractive alternative because it can recover a dense normal field from an untextured surface. We show how to capture such data, which in turn allows us to demonstrate the strengths and limitations of our simple frame-to-frame registration over time. Experiments were performed on monocular video sequences of untextured cloth and faces with and without white makeup. Subjects were filmed under spatially separated red, green, and blue lights. Our first finding is that the color photometric stereo setup is able to produce smoothly varying per-frame reconstructions with high detail. Second, when these 3D reconstructions are augmented with 2D tracking results, one can register both the surfaces and relax the homogenous-color restriction of the single-hue subject. Quantitative and qualitative experiments explore both the practicality and limitations of this simple multispectral capture system.

Publication DOI: https://doi.org/10.1109/TPAMI.2011.37
Divisions: Engineering & Applied Sciences > Computer Science
Additional Information: © 2011 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Uncontrolled Keywords: photometric stereo,multispectral,single view,video normals,Artificial Intelligence,Computer Vision and Pattern Recognition,Software,Computational Theory and Mathematics,Applied Mathematics
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
http://ieeexplo ... rnumber=5719620 (Publisher URL)
Published Date: 2011-10
Authors: Brostow, Gabe
Hernández, Carlos
Vogiatzis, George ( 0000-0002-3226-0603)
Stenger, Björn
Cipolla, Roberto

Download

[img]

Version: Accepted Version

| Preview

Export / Share Citation


Statistics

Additional statistics for this record