Video-based, real-time multi-view stereo

Vogiatzis, George and Hernández, Carlos (2011). Video-based, real-time multi-view stereo. Image and Vision Computing, 29 (7), pp. 434-441.

Abstract

We investigate the problem of obtaining a dense reconstruction in real-time, from a live video stream. In recent years, multi-view stereo (MVS) has received considerable attention and a number of methods have been proposed. However, most methods operate under the assumption of a relatively sparse set of still images as input and unlimited computation time. Video based MVS has received less attention despite the fact that video sequences offer significant benefits in terms of usability of MVS systems. In this paper we propose a novel video based MVS algorithm that is suitable for real-time, interactive 3d modeling with a hand-held camera. The key idea is a per-pixel, probabilistic depth estimation scheme that updates posterior depth distributions with every new frame. The current implementation is capable of updating 15 million distributions/s. We evaluate the proposed method against the state-of-the-art real-time MVS method and show improvement in terms of accuracy.

Publication DOI: https://doi.org/10.1016/j.imavis.2011.01.006
Divisions: Engineering & Applied Sciences > Computer science research group
Engineering & Applied Sciences > Computer science
Additional Information: © 2011, Elsevier. Licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/
Uncontrolled Keywords: 3d reconstruction,multi-view stereo,real-time,shape-from-X,Electrical and Electronic Engineering
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
Published Date: 2011-06
Authors: Vogiatzis, George
Hernández, Carlos

Export / Share Citation


Statistics

Additional statistics for this record