A perceptually validated model for surface depth hallucination
journal contributionposted on 2013-10-02, 14:08 authored by Mashhuda Glencross, Gregory J. Ward, Francho Melendez, Caroline Jay, Jun Liu, Roger Hubbold
Capturing detailed surface geometry currently requires specialized equipment such as laser range scanners, which despite their high accuracy, leave gaps in the surfaces that must be reconciled with photographic capture for relighting applications. Using only a standard digital camera and a single view, we present a method for recovering models of predominantly diffuse textured surfaces that can be plausibly relit and viewed from any angle under any illumination. Our multiscale shape-from-shading technique uses diffuse-lit/flash-lit image pairs to produce an albedo map and textured height field. Using two lighting conditions enables us to subtract one from the other to estimate albedo. In the absence of a flash-lit image of a surface for which we already have a similar exemplar pair, we approximate both albedo and diffuse shading images using histogram matching. Our depth estimation is based on local visibility. Unlike other depth-from-shading approaches, all operations are performed on the diffuse shading image in image space, and we impose no constant albedo restrictions. An experimental validation shows our method works for a broad range of textured surfaces, and viewers are frequently unable to identify our results as synthetic in a randomized presentation. Furthermore, in side-by-side comparisons, subjects found a rendering of our depth map equally plausible to one generated from a laser range scan. We see this method as a significant advance in acquiring surface detail for texturing using a standard digital camera, with applications in architecture, archaeological reconstruction, games and special effects. © 2008 ACM.
- Computer Science
CitationGLENCROSS, M. ... et al., 2008. A perceptually validated model for surface depth hallucination. Proceedings of ACM SIGGRAPH 2008 TOG, 27 (3), August 2008, Article No. 59.
- AM (Accepted Manuscript)
NotesThis article was first published as a conference paper: IN: SIGGRAPH'08: International Conference on Computer Graphics and Interactive Techniques. ACM SIGGRAPH 2008 papers. Article No. 59[© ACM]. It was subsequently published in the ACM Transactions on Graphics, Vol. 27, No. 3, Article 59, August 2008 and the definitive version is available at: http://dx.doi.org/10.1145/1360612.1360658.