Qi Shan
Abstract
We propose a simple but effective upsampling method for automatically enhancing the image/video resolution, while preserving the essential structural information. The main advantage of our method lies in a feedback-control framework which faithfully recovers the high-resolution image information from the input data, without imposing additional local structure constraints learned from other examples. This makes our method independent of the quality and number of the selected examples, which are issues typical of learning-based algorithms, while producing high-quality results without observable unsightly artifacts. Another advantage is that our method naturally extends to video upsampling, where the temporal coherence is maintained automatically. Finally, our method runs very fast. We demonstrate the effectiveness of our algorithm by experimenting with different image/video data.
Supplemental Material
- Avidan, S., and Shamir, A. 2007. Seam carving for content-aware image resizing. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 10. Google Scholar
- Baker, S., and Kanade, T. 2000. Limits on super-resolution and how to break them. In CVPR, IEEE Computer Society, 2372--2379.Google Scholar
- Bando, Y., and Nishita, T. 2007. Towards digital refocusing from a single photograph. In Pacific Graphics. Google Scholar
- Bhat, P., Zitnick, C. L., Snavely, N., Agarwala, A., Agrawala, M., Curless, B., Cohen, M., and Kang, S. B. 2007. Using photographs to enhance videos of a static scene. In Eurographics Symposium on Rendering, Eurographics, 327--338. Google Scholar
- Bishop, C. M., Blake, A., and Marthi, B. 2003. Super-resolutioin enhancement of video. In In 9th Conf. on Artificial Intelligence and Statistics.Google Scholar
- Chan, T. F., Osher, S., and Shen, J. 2001. The digital tv filter and nonlinear denoising. IEEE Trans. on Image Processing 10, 2, 231--241. Google ScholarDigital Library
- Fattal, R. 2007. Image upsampling via imposed edges statistics. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 95. Google Scholar
- Fergus, R., Singh, B., Hertzmann, A., Roweis, S. T., and Freeman, W. T. 2006. Removing camera shake from a single photograph. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2006) 25, 787--794. Google Scholar
- Freeman, W. T., Jones, T. R., and Pasztor, E. C. 2002. Example-based super-resolution. IEEE Computer Graphics and Applications 22, 56--65. Google ScholarDigital Library
- Frigo, M., and Johnson, S. G., 2006. FFTW Home Page. WWW page. http://www.fftw.org/.Google Scholar
- Hertzmann, A., Jacobs, C. E., Oliver, N., Curless, B., and Salesin, D. 2001. Image analogies. In SIGGRAPH, 327--340. Google Scholar
- Huang, J. G., and Mumford, D. 1999. Statistics of natural images and models. In CVPR, 1541--1547.Google Scholar
- Irani, M., and Peleg, S. 1993. Motion analysis for image enhancement: resolution, occlusion, and transparency. Journal of Visual Communication and Image Representation 4, 324--335.Google ScholarCross Ref
- Keys, R. G. 1981. Cubic convolution interpolation for digital image processing. IEEE Trans. Acoustics, Speech, and Signal Processing 29, 1153--1160.Google ScholarCross Ref
- Kong, D., Han, M., Xu, W., Tao, H., and Gong, Y. H. 2006. Video super-resolution with scene-specific priors. In BMVC.Google Scholar
- Kopf, J., Cohen, M. F., Lischinski, D., and Uyttendaele, M. 2007. Joint bilateral upsampling. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2007) 26, 96. Google Scholar
- Mon, D., 2006. Video enhancer. WWW page. http://www.thedeemon.com/VideoEnhancer/.Google Scholar
- Osher, S., Sole, A., and Vese, L. 2003. Image decomposition and restoration using total variation minimization and the H
-1. Multiscale Modeling and Simulation 1, 3, 349--370.Google ScholarCross Ref
- Patti, A., Sezan, M., and Tekalp, A. 1997. Super resolution video reconstruction with arbitrary sampling lattices and nonzero aperture time. IEEE Trans. on Image Processing 6, 1064--1076. Google ScholarDigital Library
- QELabs, 2005. Qe super resolution. WWW page. http://www.qelabs.com/index.Google Scholar
- Schultz, R. R., and Stevenson, R. L. 1996. Extraction of high-resolution frames from video sequences. IEEE Transactions on Image Processing 5, 996--1011. Google ScholarDigital Library
- Shan, Q., Jia, J. Y., and Agarwala, A. 2008. High-quality motion deblurring from a single image. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2008). Google Scholar
- Sun, J., Sun, J., Xu, Z. B., and Shum, H. Y. 2008. Image super-rosolution using gradient profile prior. In CVPR.Google Scholar
- Tappen, M. F., Russell, B. C., and Freeman, W. T. 2003. Exploiting the sparse derivative prior for super-resolution and image demosaicing. In Intl. Workshop on Statistical and Computational Theories of Vision.Google Scholar
- Tappen, M. F., Russell, B. C., and Freeman, W. T. 2004. Efficient graphical models for processing images. In CVPR, IEEE Computer Society, 673--680. Google Scholar
- Tipping, M. E., and Bishop, C. M. 2002. Bayesian image super resolution. In NIPS, MIT Press, 1279--1286.Google Scholar
- Yuan, L., Sun, J., Quan, L., and Shum, H. Y. 2008. Progressive inter-scale and intra-scale non-blind image deconvolution. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2008). Google Scholar
- Zhao, W. Y., and Sawhney, H. S. 2002. Is super-resolution with optical flow feasible. In ECCV, Springer, 599--613. Google Scholar
Index Terms
- Fast image/video upsampling
Recommendations
Image upsampling via imposed edge statistics
In this paper we propose a new method for upsampling images which is capable of generating sharp edges with reduced input-resolution grid-related artifacts. The method is based on a statistical edge dependency relating certain edge features of two ...
Image upsampling via imposed edge statistics
SIGGRAPH '07: ACM SIGGRAPH 2007 papersIn this paper we propose a new method for upsampling images which is capable of generating sharp edges with reduced input-resolution grid-related artifacts. The method is based on a statistical edge dependency relating certain edge features of two ...
Fast image/video upsampling
SIGGRAPH Asia '08: ACM SIGGRAPH Asia 2008 papersWe propose a simple but effective upsampling method for automatically enhancing the image/video resolution, while preserving the essential structural information. The main advantage of our method lies in a feedback-control framework which faithfully ...
Comments