Video-based, real-time multi-view stereo

Abstract

We investigate the problem of obtaining a dense reconstruction in real-time, from a live video stream. In recent years, multi-view stereo (MVS) has received considerable attention and a number of methods have been proposed. However, most methods operate under the assumption of a relatively sparse set of still images as input and unlimited computation time. Video based MVS has received less attention despite the fact that video sequences offer significant benefits in terms of usability of MVS systems. In this paper we propose a novel video based MVS algorithm that is suitable for real-time, interactive 3d modeling with a hand-held camera. The key idea is a per-pixel, probabilistic depth estimation scheme that updates posterior depth distributions with every new frame. The current implementation is capable of updating 15 million distributions/s. We evaluate the proposed method against the state-of-the-art real-time MVS method and show improvement in terms of accuracy.

Publication DOI: https://doi.org/10.1016/j.imavis.2011.01.006
Divisions: ?? 50811700Jl ??
Additional Information: © 2011, Elsevier. Licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/
Uncontrolled Keywords: 3d reconstruction,multi-view stereo,real-time,shape-from-X,Electrical and Electronic Engineering
Publication ISSN: 1872-8138
Last Modified: 28 Mar 2024 08:11
Date Deposited: 22 Jul 2013 12:27
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Article
Published Date: 2011-06
Authors: Vogiatzis, George (ORCID Profile 0000-0002-3226-0603)
Hernández, Carlos

Export / Share Citation


Statistics

Additional statistics for this record