Tai-Pang Wu
Abstract
We present an interactive system for reconstructing surface normals from a single image. Our approach has two complementary contributions. First, we introduce a novel shape-from-shading algorithm (SfS) that produces faithful normal reconstruction for local image region (high-frequency component), but it fails to faithfully recover the overall global structure (low-frequency component). Our second contribution consists of an approach that corrects low-frequency error using a simple markup procedure. This approach, aptly called rotation palette, allows the user to specify large scale corrections of surface normals by drawing simple stroke correspondences between the normal map and a sphere image which represents rotation directions. Combining these two approaches, we can produce high-quality surfaces quickly from single images.
Supplemental Material
- Agrawal, A., Raskar, R., and Chellappa, R. 2006. What is the range of surface reconstructions from a gradient field? In ECCV06. http://www.umiacs.umd.edu/-aagrawal/eccv06/RangeofSurfaceReconstructions.html. Google Scholar
- Belhumeur, P. N., Kriegman, D. J., and Yuille, A. L. 1999. The bas-relief ambiguity. Int. J. Comput. Vision 35, 1, 33--44. Google ScholarCross Ref
- Criminisi, A., Reid, I., and Zisserman, A. 2000. Single view metrology. IJCV 40, 2 (November), 123--148. Google ScholarCross Ref
- Fang, H., and Hart, J. C. 2004. Textureshop: texture synthesis as a photograph editing tool. In SIGGRAPH '04, 354--359. Google Scholar
- Frankot, R., and Chellappa, R. 1988. A method for enforcing integrability in shape from shading algorithms. PAMI 10, 4 (July), 439--451. Google ScholarDigital Library
- Gingold, Y., and Zorin, D. 2008. Shading-based surface editing. ACM Transactions on Graphics (TOG) 27, 3. Google ScholarDigital Library
- Gray, A. 1997. Osculating circles to plane curves. In Modern Differential Geometry of Curves and Surfaces with Mathematica, 2nd ed., Boca Raton, FL: CRC Press, 111--115.Google Scholar
- Hoiem, D., Efros, A. A., and Hebert, M. 2005. Automatic photo pop-up. ACM Trans. Graph. 24, 3, 577--584. Google ScholarDigital Library
- Horn, B., and Brooks, M. 1989. Shape from Shading. The MIT Press. Google Scholar
- Horry, Y., Anjyo, K.-I., and Arai, K. 1997. Tour into the picture: using a spidery mesh interface to make animation from a single image. In SIGGRAPH '97, 225--232. Google Scholar
- Karpenko, O. A., and Hughes, J. F. 2006. Smoothsketch: 3d free-form shapes from complex sketches. ACM Trans. Graph. 25, 3. Google ScholarDigital Library
- Khan, E. A., Reinhard, E., Fleming, R. W., and Bülthoff, H. H. 2006. Image-based material editing. In SIGGRAPH '06, 654--663. Google Scholar
- Koenderink, J. 1998. Pictorial relief. Royal 356, 1740, 1071--1086.Google Scholar
- Kovesi, P. 2005. Shapelets correlated with surface normals produce surfaces. In ICCV05, 994--1001. Google Scholar
- Potetz, B. 2007. Efficient belief propagation for vision using linear constraint nodes. In CVPR 2007: Proceedings of the 2007 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE Computer Society, Minneapolis, MN, USA.Google Scholar
- Prados, E., and Faugeras, O. 2005. Shape from shading: A well-posed problem? In CVPR05, II: 870--877. Google Scholar
- Prasad, M., Zisserman, A., and Fitzgibbon, A. 2006. Single view reconstruction of curved surfaces. In CVPR06, II: 1345--1354. Google Scholar
- Sorkine, O., Lipman, Y., Cohen-Or, D., Alexa, M., Rössl, C., and Seidel, H.-P. 2004. Laplacian surface editing. In Proceedings of the Eurographics/ACM SIGGRAPH Symposium on Geometry Processing, Eurographics Association, 179--188. Google Scholar
- Wu, T.-P., Tang, C.-K., Brown, M. S., and Shum, H.-Y. 2007. Shapepalettes: interactive normal transfer via sketching. In SIGGRAPH '07, 44. Google Scholar
- Yu, Y., Zhou, K., Xu, D., Shi, X., Bao, H., Guo, B., and Shum, H.-Y. 2004. Mesh editing with poisson-based gradient field manipulation. ACM Trans. Graph. 23, 3, 644--651. Google ScholarDigital Library
- Zeng, G., Matsushita, Y., Quan, L., and Shum, H. 2005. Interactive shape from shading. In CVPR05, I: 343--350. Google Scholar
- Zhang, R., Tsai, P.-S., Cryer, J. E., and Shah, M. 1999. Shape from shading: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 21, 8, 690--706. http://server.cs.ucf.edu/~vision/faculty/shah.html. Google ScholarDigital Library
- Zhang, L., Dugas-Phocion, G., Samson, J., and Seitz, S. 2001. Single view modeling of free-form scenes. In CVPR01, I:990--997.Google Scholar
Index Terms
- Interactive normal reconstruction from a single image
Recommendations
Interactive normal reconstruction from a single image
SIGGRAPH Asia '08: ACM SIGGRAPH Asia 2008 papersWe present an interactive system for reconstructing surface normals from a single image. Our approach has two complementary contributions. First, we introduce a novel shape-from-shading algorithm (SfS) that produces faithful normal reconstruction for ...
Wavelet-based Light Reconstruction from a Single Image
CRV '07: Proceedings of the Fourth Canadian Conference on Computer and Robot VisionIn this paper we propose a wavelet-based light representation. This representation is used for recovering illumination and reflectance of a scene with known geometry from a single calibrated image. Previous approaches of light estimation reconstruct ...
Image-based rendering of diffuse, specular and glossy surfaces from a single image
SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniquesIn this paper, we present a new method to recover an approximation of the bidirectional reflectance distribution function (BRDF) of the surfaces present in a real scene. This is done from a single photograph and a 3D geometric model of the scene. The ...
Comments