Video normals from colored lights


We present an algorithm and the associated single-view capture methodology to acquire the detailed 3D shape, bends, and wrinkles of deforming surfaces. Moving 3D data has been difficult to obtain by methods that rely on known surface features, structured light, or silhouettes. Multispectral photometric stereo is an attractive alternative because it can recover a dense normal field from an untextured surface. We show how to capture such data, which in turn allows us to demonstrate the strengths and limitations of our simple frame-to-frame registration over time. Experiments were performed on monocular video sequences of untextured cloth and faces with and without white makeup. Subjects were filmed under spatially separated red, green, and blue lights. Our first finding is that the color photometric stereo setup is able to produce smoothly varying per-frame reconstructions with high detail. Second, when these 3D reconstructions are augmented with 2D tracking results, one can register both the surfaces and relax the homogenous-color restriction of the single-hue subject. Quantitative and qualitative experiments explore both the practicality and limitations of this simple multispectral capture system.

Publication DOI:
Divisions: ?? 50811700Jl ??
Additional Information: © 2011 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
Uncontrolled Keywords: photometric stereo,multispectral,single view,video normals,Artificial Intelligence,Computer Vision and Pattern Recognition,Software,Computational Theory and Mathematics,Applied Mathematics
Publication ISSN: 1939-3539
Last Modified: 04 Jan 2024 08:09
Date Deposited: 20 Dec 2012 10:51
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
http://ieeexplo ... rnumber=5719620 (Publisher URL)
PURE Output Type: Article
Published Date: 2011-10
Authors: Brostow, Gabe
Hernández, Carlos
Vogiatzis, George (ORCID Profile 0000-0002-3226-0603)
Stenger, Björn
Cipolla, Roberto



Version: Accepted Version

| Preview

Export / Share Citation


Additional statistics for this record