Abstract
This paper describes a new framework for video dehazing, the process of restoring the visibility of the videos taken under foggy scenes. The framework builds upon techniques in single image dehazing, optical flow estimation and Markov random field. It aims at improving the temporal and spatial coherence of the dehazed video. In this framework, we first extract the transmission map frame-by-frame using guided filter, then estimate the forward and backward optical flow between two neighboring frames to find the matched pixels. The flow fields are used to help us building an MRF model on the transmission map to improve the spatial and temporal coherence of the transmission. The proposed algorithm is verified in both real and synthetic videos. The results demonstrate that our algorithm can preserve the spatial and temporal coherence well. With more coherent transmission map, we get better refocusing effect. We also apply our framework on improving the video coherence on the application of video denoising.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
http://media.xiph.org/video/derf/ (2006). Xiph.org test media
Ancuti, C.O., Ancuti, C., Hermans, C., Bekaert, P.: Layer-based single image dehazing by per-pixel haze detection. In: ACM SIGGRAPH ASIA 2010 Sketches, SA ’10, pp. 45:1–45:2 (2010)
Baker, S., Roth, S., Scharstein, D., Black, M.J., Lewis, J., Szeliski, R.: A Database and Evaluation Methodology for Optical Flow (2007)
Bolz, J., Farmer, I., Grinspun, E., Schröoder P.: Sparse matrix solvers on the GPU. ACM Trans. Graph. 22, 917–214 (2003)
Black, M.J., Anandan, P.: The robust estimation of multiple motions: parametric and piecewise-smooth flow fields. Comput. Vis. Image Underst. 63(1), 75–104 (1996)
Chen, J., Tang, C.K.: Spatio-temporal markov random field for video denoising. In: IEEE Conference on Computer Vision and Pattern Recognition (2007)
Chuang, Y.Y., Agarwala, A., Curless, B., Salesin, D.H., Szeliski, R.: Video matting of complex scenes. In: SIGGRAPH (2002)
Dong, X.M., Hu, X.Y., Peng, S.L., Wang, D.C.: Single color image dehazing using sparse priors. In: 2010 17th IEEE International Conference on Image Processing (ICIP), pp. 3593–3596 (2010)
Fattal, R.: Single image dehazing. ACM Trans. Graph. 27(3), 1–9 (2008)
Haussecker, H.W., Fleet, D.J.: Computing optical flow with physical models of brightness variation. IEEE Trans. Pattern Anal. Mach. Intell. 23, 661–673 (2001)
He, K., Sun, J., Tang, X.: Single image haze removal using dark channel prior. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 1956–1963 (2009)
He, K., Sun, J., Tang, X.: Guided image filtering. In: European Conference on Computer Vision (2010)
Kopf, J., Neubert, B., Chen, B., Cohen, M., Cohen-Or, D., Deussen, O., Uyttendaele, M., Lischinski, D.: Deep photo: model-based photograph enhancement and viewing. ACM Trans. Graph. 27(5) (2008)
Koschmeider, H.: Theorie der horizontalen sichtweite. Beitr. Phys. D. Freien Atm., 171–181 (1924)
Lin, S.Y., Shi, J.Y.: A Markov random field model-based approach to natural image matting. J. Comput. Sci. Technol. 22 (2007)
Lv, X., Chen, W., Shen, I.F.: Real-time dehazing for image and video. In: Pacific Conference on Computer Graphics and Applications, pp. 62–69 (2010)
Narasimhan, S.G., Nayar, S.K.: Chromatic framework for vision in bad weather. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 598–605 (2000)
Preetham, A.J., Shirley, P., Smits, B.: A practical analytic model for daylight. In: ACM SIGGRAPH (1999)
Schechner, Y.Y., Narasimhan, S.G., Nayar, S.K.: Instant dehazing of images using polarization. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Kauai, HI, United States, vol. 1, pp. I325–I332 (2001)
Shwartz, S., Namer, E., Schechner, Y.Y.: Blind haze separation. In: Proceedings—Conference on Computer Vision and Pattern Recognition, CVPR 2006, vol. 2, pp. 1984–1991 (2006)
Sun, D., Roth, S., Black, M.J.: Secrets of optical flow estimation and their principles. In: IEEE Conference on Computer Vision and Pattern Recognition (2010)
Tan, R.T.: Visibility in bad weather from a single image. In: IEEE Conference on Computer Vision and Pattern Recognition (2008)
Tarel, J.P., Hautière, N.: Fast visibility restoration from a single color or gray level image. In: Proceedings of IEEE International Conference on Computer Vision, Kyoto, Japan, 2009, pp. 2201–2208 (2009)
Villegas, P., Marichal, X.: Perceptually-weighted evaluation criteria for segmentation masks in video sequences. IEEE Trans. Image Process. 13(8), 1092–1103 (2004)
Xu, L., Jia, J., Matsushita, Y.: Motion detail preserving optical flow estimation. In: IEEE Conference on Computer Vision and Pattern Recognition (2010)
Zhang, G., Jia, J., Wong, T.T., Bao, H.: Recovering consistent video depth maps via bundle optimization. In: IEEE Conference on Computer Vision and Pattern Recognition (2008)
Zhang, J., Li, L., Yang, G., Zhang, Y., Sun, J.: Local albedo-insensitive single image dehazing. Vis. Comput. 26, 761–768 (2010)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Zhang, J., Li, L., Zhang, Y. et al. Video dehazing with spatial and temporal coherence. Vis Comput 27, 749–757 (2011). https://doi.org/10.1007/s00371-011-0569-8
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00371-011-0569-8