City Research Online

Image-based photo hulls for fast and photo-realistic new view synthesis

Slabaugh, G. G., Schafer, R. W. & Hans, M. C. (2003). Image-based photo hulls for fast and photo-realistic new view synthesis. Real-Time Imaging, 9(5), pp. 347-360. doi: 10.1016/j.rti.2003.08.004

Abstract

We present an efficient image-based rendering algorithm that generates views of a scene's photo hull. The photo hull is the largest 3D shape that is photo-consistent with photographs taken of the scene from multiple viewpoints. Our algorithm, image-based photo hulls (IBPH), like the image-based visual hulls (IBVH) algorithm from Matusik et al. on which it is based, takes advantage of epipolar geometry to efficiently reconstruct the geometry and visibility of a scene. Our IBPH algorithm differs from IBVH in that it utilizes the color information of the images to identify scene geometry. These additional color constraints result in more accurately reconstructed geometry, which often projects to better synthesized virtual views of the scene. We demonstrate our algorithm running in a realtime 3D telepresence application using video data acquired from multiple viewpoints.

Publication Type: Article
Additional Information: NOTICE: this is the author’s version of a work that was accepted for publication in Real-Time Imaging. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in Real-Time Imaging, Volume 9, Issue 5, October 2003, Pages 347–360, http://dx.doi.org/10.1016/j.rti.2003.08.004
Publisher Keywords: Photo hull, image-based rendering, 3D photography, new view synthesis, voxel coloring, space carving, color consistency, view-dependent scene reconstruction
Departments: School of Science & Technology > Computer Science
SWORD Depositor:
[thumbnail of ibph_journal.pdf]
Preview
PDF - Accepted Version
Download (817kB) | Preview

Export

Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email

Downloads

Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login