Image-based photo hulls for fast and photo-realistic new view synthesis

Slabaugh, G.G., Schafer, R.W. & Hans, M. C. (2003). Image-based photo hulls for fast and photo-realistic new view synthesis. Real-Time Imaging, 9(5), pp. 347-360. doi: 10.1016/j.rti.2003.08.004

[img]
Preview
PDF - Accepted Version
Download (817kB) | Preview

Abstract

We present an efficient image-based rendering algorithm that generates views of a scene's photo hull. The photo hull is the largest 3D shape that is photo-consistent with photographs taken of the scene from multiple viewpoints. Our algorithm, image-based photo hulls (IBPH), like the image-based visual hulls (IBVH) algorithm from Matusik et al. on which it is based, takes advantage of epipolar geometry to efficiently reconstruct the geometry and visibility of a scene. Our IBPH algorithm differs from IBVH in that it utilizes the color information of the images to identify scene geometry. These additional color constraints result in more accurately reconstructed geometry, which often projects to better synthesized virtual views of the scene. We demonstrate our algorithm running in a realtime 3D telepresence application using video data acquired from multiple viewpoints.

Item Type: Article
Additional Information: NOTICE: this is the author’s version of a work that was accepted for publication in Real-Time Imaging. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Real-Time Imaging, Volume 9, Issue 5, October 2003, Pages 347–360, http://dx.doi.org/10.1016/j.rti.2003.08.004
Uncontrolled Keywords: Photo hull, image-based rendering, 3D photography, new view synthesis, voxel coloring, space carving, color consistency, view-dependent scene reconstruction
Divisions: School of Informatics > Department of Computing
URI: http://openaccess.city.ac.uk/id/eprint/4394

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics