Jia-Bin Huang
Sing Bing Kang
Skip Abstract Section
Skip Supplemental Material SectionAbstract
We propose a method for automatically guiding patch-based image completion using mid-level structural cues. Our method first estimates planar projection parameters, softly segments the known region into planes, and discovers translational regularity within these planes. This information is then converted into soft constraints for the low-level completion algorithm by defining prior probabilities for patch offsets and transformations. Our method handles multiple planes, and in the absence of any detected planes falls back to a baseline fronto-parallel image completion algorithm. We validate our technique through extensive comparisons with state-of-the-art algorithms on a variety of scenes.
Supplemental Material
- Aiger, D., Cohen-Or, D., and Mitra, N. J. 2012. Repetition maximization based texture rectification. Computer Graphics Forum (EUROGRAPHICS) 31, 2pt2, 439--448. Google Scholar
Digital Library
- Ballester, C., Bertalmio, M., Caselles, V., Sapiro, G., and Verdera, J. 2001. Filling-in by joint interpolation of vector fields and gray levels. IEEE TIP 10, 8, 1200--1211. Google ScholarDigital Library
- Barinova, O., Konushin, V., Yakubenko, A., Lee, K., Lim, H., and Konushin, A. 2008. Fast automatic single-view 3-d reconstruction of urban scenes. In ECCV. Google ScholarDigital Library
- Barnes, C., Shechtman, E., Finkelstein, A., and Goldman, D. 2009. PatchMatch: a randomized correspondence algorithm for structural image editing. ACM Trans. on Graphics (Proc. of Siggraph) 28, 3, 24. Google ScholarDigital Library
- Bertalmio, M., Sapiro, G., Caselles, V., and Ballester, C. 2000. Image inpainting. ACM Trans. on Graphics (Proc. of Siggraph) 19, 3, 417--424. Google ScholarDigital Library
- Bertalmio, M., Vese, L., Sapiro, G., and Osher, S. 2003. Simultaneous structure and texture image inpainting. IEEE TIP 12, 8, 882--889. Google ScholarDigital Library
- Chum, O., and Matas, J. 2010. Planar affine rectification from change of scale. In ACCV. Google ScholarDigital Library
- Comaniciu, D., and Meer, P. 2002. Mean Shift: A robust approach toward feature space analysis. IEEE TPAMI 24, 5, 603--619. Google ScholarDigital Library
- Criminisi, A., Pérez, P., and Toyama, K. 2004. Region filling and object removal by exemplar-based image inpainting. IEEE TIP 13, 9, 1200--1212. Google ScholarDigital Library
- Darabi, S., Shechtman, E., Barnes, C., Goldman, D. B., and Sen, P. 2012. Image Melding: Combining Inconsistent Images using Patch-based Synthesis. ACM Trans. on Graphics (Proc. of Siggraph) 31, 4. Google ScholarDigital Library
- Efros, A. A., and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. ACM Trans. on Graphics (Proc. of Siggraph) 20, 3, 341--346. Google ScholarDigital Library
- Efros, A. A., and Leung, T. K. 1999. Texture synthesis by non-parametric sampling. In ICCV. Google ScholarDigital Library
- Hartley, R. I., and Zisserman, A. 2004. Multiple View Geometry in Computer Vision, second ed. Cambridge University Press. Google ScholarDigital Library
- Hays, J., and Efros, A. A. 2007. Scene completion using millions of photographs. ACM Trans. on Graphics (Proc. of Siggraph) 26, 3, 4. Google ScholarDigital Library
- He, K., and Sun, J. 2012. Statistics of patch offsets for image completion. In ECCV. Google ScholarDigital Library
- Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. H. 2001. Image analogies. ACM Trans. on Graphics (Proc. of Siggraph) 20, 3, 327--340. Google ScholarDigital Library
- Huang, H., K. Yin, Gong, M., Lischinski, D., Cohen-Or, D., Ascher, U., and Chen, B. 2013. Mind the gap: Tele-registration for structure-driven image completion. ACM Trans. on Graphics (Proc. of Siggraph Asia) 32, 174:1--174:10. Google ScholarDigital Library
- Huang, J.-B., Kopf, J., Ahuja, N., and Kang, S. B. 2013. Transformation guided image completion. In ICCP.Google Scholar
- Jia, J., and Tang, C. 2003. Image repairing: Robust image synthesis by adaptive nd tensor voting. In CVPR. Google ScholarDigital Library
- Komodakis, N., and Tziritas, G. 2007. Image completion using efficient belief propagation via priority scheduling and dynamic pruning. IEEE TIP 16, 11, 2649--2661. Google ScholarDigital Library
- Kopf, J., Kienzle, W., Drucker, S., and Kang, S. B. 2012. Quality prediction for image completion. ACM Trans. on Graphics (Proc. of Siggraph Asia) 31, 6. Google ScholarDigital Library
- Kwatra, V., Essa, I., Bobick, A., and Kwatra, N. 2005. Texture optimization for example-based synthesis. ACM Trans. on Graphics (Proc. of Siggraph) 24, 3, 795--802. Google ScholarDigital Library
- Liu, Y., Lin, W.-C., and Hays, J. 2004. Near-regular texture analysis and manipulation. ACM Trans. on Graphics (Proc. of Siggraph) 23, 3, 368--376. Google ScholarDigital Library
- Liu, Y., Hel-Or, H., and Kaplan, C. 2010. Computational symmetry in computer vision and computer graphics. Now Publishers.Google Scholar
- Lowe, D. G. 2004. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60, 2, 91--110. Google ScholarDigital Library
- Mansfield, A., Prasad, M., Rother, C., Sharp, T., Kohli, P., and Van Gool, L. 2011. Transforming image completion. In BMVC.Google Scholar
- Pavić, D., Schönefeld, V., and Kobbelt, L. 2006. Interactive image completion with perspective correction. The Visual Computer 22, 9, 671--681. Google ScholarDigital Library
- Pritch, Y., Kav-Venaki, E., and Peleg, S. 2009. Shift-map image editing. In ICCV.Google Scholar
- Sun, J., Yuan, L., Jia, J., and Shum, H. 2005. Image completion with structure propagation. ACM Trans. on Graphics (Proc. of Siggraph) 24, 3, 861--868. Google ScholarDigital Library
- Wexler, Y., Shechtman, E., and Irani, M. 2007. Space-time completion of video. IEEE TPAMI 29, 3, 463--476. Google ScholarDigital Library
- Whyte, O., Sivic, J., and Zisserman, A. 2009. Get out of my picture! internet-based inpainting. In BMVC.Google Scholar
- Zhang, Z., Ganesh, A., Liang, X., and Ma, Y. 2012. TILT: transform invariant low-rank textures. International Journal of Computer Vision 99, 1, 1--24. Google ScholarDigital Library
- Zhang, Y., Xiao, J., Hays, J., and Tan, P. 2013. FrameBreak: Dramatic image extrapolation by guided shift-maps. In CVPR. Google ScholarDigital Library
Index Terms
- Image completion using planar structure guidance
Recommendations
Scene completion using millions of photographs
What can you do with a million images? In this paper we present a new image completion algorithm powered by a huge database of photographs gathered from the Web. The algorithm patches up holes in images by finding similar image regions in the database ...
Image completion with variable scope patch sampling
ICAIR-CACRE '16: Proceedings of the International Conference on Artificial Intelligence and Robotics and the International Conference on Automation, Control and Robotics EngineeringThis paper presents a simple but effective way of patch sampling for image completion which changes the assignment scope in different pixels when sampling patches during completion. In each pixel of missing regions, the scope expands from narrow to wide ...
Sample-based image completion using structure synthesis
Image completion technique is widely used in image processing applications such as textural recovery, object removal, image edit, etc. When filling in the missing areas of an image, it is often a challenge to keep local consistency of image structures ...
Comments