ABSTRACT
Contrast enhancement and noise removal are coupled problems for low-light image enhancement. The existing Retinex based methods do not take the coupling relation into consideration, resulting in under or over-smoothing of the enhanced images. To address this issue, this paper presents a novel progressive Retinex framework, in which illumination and noise of low-light image are perceived in a mutually reinforced manner, leading to noise reduction low-light enhancement results. Specifically, two fully pointwise convolutional neural networks are devised to model the statistical regularities of ambient light and image noise respectively, and to leverage them as constraints to facilitate the mutual learning process. The proposed method not only suppresses the interference caused by the ambiguity between tiny textures and image noises, but also greatly improves the computational efficiency. Moreover, to solve the problem of insufficient training data, we propose an image synthesis strategy based on camera imaging model, which generates color images corrupted by illumination-dependent noises. Experimental results on both synthetic and real low-light images demonstrate the superiority of our proposed approaches against the State-Of-The-Art (SOTA) low-light enhancement methods.
- Yagiz Aksoy, Changil Kim, Petr Kellnhofer, Sylvain Paris, Mohamed Elgharib, Marc Pollefeys, and Wojciech Matusik. 2018. A Dataset of Flash and Ambient Illumination Pairs from the Crowd. In Proceedings of the European Conference on Computer Vision (ECCV). 634--649.Google ScholarCross Ref
- Neil DB Bruce. 2014. Expoblend: Information preserving exposure blending based on normalized log-domain entropy. Computers & Graphics , Vol. 39 (2014), 12--23.Google ScholarDigital Library
- Bolun Cai, Xianming Xu, Kailing Guo, Kui Jia, Bin Hu, and Dacheng Tao. 2017. A Joint Intrinsic-Extrinsic Prior Model for Retinex. In Proceedings of the IEEE International Conference on Computer Vision. 4000--4009.Google ScholarCross Ref
- Jianrui Cai, Shuhang Gu, and Lei Zhang. 2018. Learning a deep single image contrast enhancer from multi-exposure images. IEEE Transactions on Image Processing , Vol. 27, 4 (2018), 2049--2062.Google ScholarCross Ref
- Kostadin Dabov, Alessandro Foi, Vladimir Katkovnik, and Karen Egiazarian. 2007. Image denoising by sparse 3-D transform-domain collaborative filtering. IEEE Transactions on image processing , Vol. 16, 8 (2007), 2080--2095.Google ScholarCross Ref
- Michael Elad. 2005. Retinex by two bilateral filters. In International Conference on Scale-Space Theories in Computer Vision. Springer, 217--229.Google ScholarDigital Library
- David A Forsyth. 1988. A novel approach to colour constancy. In 1988 Second International Conference on Computer Vision. IEEE, 9--18.Google ScholarCross Ref
- Xueyang Fu, Delu Zeng, Yue Huang, Xiao-Ping Zhang, and Xinghao Ding. 2016. A weighted variational model for simultaneous reflectance and illumination estimation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2782--2790.Google ScholarCross Ref
- Brian Funt and Lilong Shi. 2010. The rehabilitation of maxrgb. In Color and imaging conference , Vol. 2010. Society for Imaging Science and Technology, 256--259.Google Scholar
- Michael D Grossberg and Shree K Nayar. 2004. Modeling the space of camera response functions. IEEE transactions on pattern analysis and machine intelligence , Vol. 26, 10 (2004), 1272--1282.Google ScholarDigital Library
- Xiaojie Guo, Yu Li, and Haibin Ling. 2017. LIME: Low-light image enhancement via illumination map estimation. IEEE Transactions on Image Processing , Vol. 26, 2 (2017), 982--993.Google ScholarDigital Library
- Nicolas Hautière, Jean-Philippe Tarel, Didier Aubert, and Eric Dumont. 2011. Blind contrast enhancement assessment by gradient ratioing at visible edges. Image Analysis & Stereology , Vol. 27, 2 (2011), 87--95.Google ScholarCross Ref
- Kaiming He, Jian Sun, and Xiaoou Tang. 2013. Guided image filtering. IEEE transactions on pattern analysis & machine intelligence 6 (2013), 1397--1409.Google ScholarDigital Library
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2015. Delving deep into rectifiers: Surpassing human-level performance on imagenet classification. In Proceedings of the IEEE international conference on computer vision. 1026--1034.Google ScholarDigital Library
- Glenn E Healey and Raghava Kondepudy. 1994. Radiometric CCD camera calibration and noise estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence , Vol. 16, 3 (1994), 267--276.Google ScholarDigital Library
- Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell. 2014. Caffe: Convolutional architecture for fast feature embedding. In Proceedings of the 22nd ACM international conference on Multimedia. ACM, 675--678.Google ScholarDigital Library
- Daniel J Jobson, Zia-ur Rahman, and Glenn A Woodell. 1997. A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Transactions on Image processing , Vol. 6, 7 (1997), 965--976.Google ScholarDigital Library
- Hamid Reza Vaezi Joze, Mark S Drew, Graham D Finlayson, and Perla Aurora Troncoso Rey. 2012. The role of bright pixels in illumination estimation. In Color and Imaging Conference , Vol. 2012. Society for Imaging Science and Technology, 41--46.Google Scholar
- Fei Kou, Zhengguo Li, Changyun Wen, and Weihai Chen. 2017. Multi-scale exposure fusion via gradient domain guided image filtering. In 2017 IEEE International Conference on Multimedia and Expo (ICME). IEEE, 1105--1110.Google ScholarCross Ref
- Lin Li, Ronggang Wang, Wenmin Wang, and Wen Gao. 2015. A low-light image enhancement method for both denoising and contrast enlarging. In 2015 IEEE International Conference on Image Processing (ICIP). IEEE, 3730--3734.Google ScholarDigital Library
- Mading Li, Jiaying Liu, Wenhan Yang, Xiaoyan Sun, and Zongming Guo. 2018. Structure-Revealing Low-Light Image Enhancement Via Robust Retinex Model. IEEE Transactions on Image Processing , Vol. 27, 6 (2018), 2828--2841.Google ScholarCross Ref
- Ce Liu, Richard Szeliski, Sing Bing Kang, C Lawrence Zitnick, and William T Freeman. 2008. Automatic estimation and removal of noise from a single image. IEEE transactions on pattern analysis and machine intelligence , Vol. 30, 2 (2008), 299--314.Google Scholar
- Kin Gwn Lore, Adedotun Akintayo, and Soumik Sarkar. 2017. LLNet: A deep autoencoder approach to natural low-light image enhancement. Pattern Recognition , Vol. 61 (2017), 650--662.Google ScholarDigital Library
- Jean Michel Morel, Ana Belén Petro, and Catalina Sbert. 2010. A PDE formalization of Retinex theory. IEEE Transactions on Image Processing , Vol. 19, 11 (2010), 2825--2837.Google ScholarDigital Library
- Seonhee Park, Soohwan Yu, Minseo Kim, Kwanwoo Park, and Joonki Paik. 2018. Dual Autoencoder Network for Retinex-based Low-Light Image Enhancement. IEEE Access (2018).Google ScholarCross Ref
- Zia-ur Rahman, Daniel J Jobson, and Glenn A Woodell. 2004. Retinex processing for automatic image enhancement. Journal of Electronic imaging , Vol. 13, 1 (2004), 100--111.Google ScholarCross Ref
- Shanmuganathan Raman and Subhasis Chaudhuri. 2009. Bilateral Filter Based Compositing for Variable Exposure Photography.. In Eurographics (short papers). 1--4.Google Scholar
- Rajeev Ramanath, Wesley E Snyder, Griff L Bilbro, and William A Sander. 2002. Demosaicking methods for Bayer color arrays. Journal of Electronic imaging , Vol. 11, 3 (2002), 306--316.Google ScholarCross Ref
- Jianbing Shen, Ying Zhao, Shuicheng Yan, Xuelong Li, et almbox. 2014. Exposure fusion using boosting Laplacian pyramid. IEEE Trans. Cybernetics , Vol. 44, 9 (2014), 1579--1590.Google ScholarCross Ref
- Liang Shen, Zihan Yue, Fan Feng, Quan Chen, Shihao Liu, and Jie Ma. 2017. Msr-net: Low-light image enhancement using deep convolutional network. arXiv preprint arXiv:1711.02488 (2017).Google Scholar
- Rui Shen, Irene Cheng, Jianbo Shi, and Anup Basu. 2011. Generalized random walks for fusion of multi-exposure images. IEEE Transactions on Image Processing , Vol. 20, 12 (2011), 3634--3646.Google ScholarDigital Library
- Yanghai Tsin, Visvanathan Ramesh, and Takeo Kanade. 2001. Statistical calibration of CCD imaging process. In Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001, Vol. 1. IEEE, 480--487.Google ScholarCross Ref
- Shuhang Wang and Gang Luo. 2018. Naturalness Preserved Image Enhancement Using a Priori Multi-Layer Lightness Statistics. IEEE transactions on image processing: a publication of the IEEE Signal Processing Society , Vol. 27, 2 (2018), 938--948.Google ScholarDigital Library
- Zhou Wang, Alan C Bovik, Hamid R Sheikh, Eero P Simoncelli, et almbox. 2004. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing , Vol. 13, 4 (2004), 600--612.Google Scholar
- Chen Wei, Wenjing Wang, Wenhan Yang, and Jiaying Liu. 2018. Deep retinex decomposition for low-light enhancement. arXiv preprint arXiv:1808.04560 (2018).Google Scholar
- Jing Zhang, Yang Cao, Shuai Fang, Yu Kang, and Chang Wen Chen. 2017. Fast Haze Removal for Nighttime Image Using Maximum Reflectance Prior. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) .Google Scholar
- Jing Zhang, Yang Cao, Yang Wang, Chenglin Wen, and Chang Wen Chen. 2018a. Fully Point-wise Convolutional Neural Network for Modeling Statistical Regularities in Natural Images. In 2018 ACM Multimedia Conference on Multimedia Conference. ACM, 984--992.Google Scholar
- Jing Zhang and Dacheng Tao. 2019. FAMED-Net: A Fast and Accurate Multi-scale End-to-end Dehazing Network. IEEE Transactions on Image Processing (2019), 1--13. https://doi.org/10.1109/TIP.2019.2922837Google Scholar
- Lin Zhang, Lei Zhang, Xuanqin Mou, and David Zhang. 2011. FSIM: A feature similarity index for image quality assessment. IEEE transactions on Image Processing , Vol. 20, 8 (2011), 2378--2386.Google ScholarDigital Library
- Qing Zhang, Ganzhao Yuan, Chunxia Xiao, Lei Zhu, and Wei-Shi Zheng. 2018b. High-Quality Exposure Correction of Underexposed Photos. In 2018 ACM Multimedia Conference on Multimedia Conference. ACM, 582--590.Google Scholar
- Wei Zhang and Wai-Kuen Cham. 2012. Gradient-directed multiexposure composition. IEEE Transactions on Image Processing , Vol. 21, 4 (2012), 2318--2323.Google ScholarDigital Library
- Xiangdong Zhang, Peiyi Shen, Lingli Luo, Liang Zhang, and Juan Song. 2012. Enhancement and noise reduction of very low light level images. In Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012). Ieee, 2034--2037.Google Scholar
Index Terms
- Progressive Retinex: Mutually Reinforced Illumination-Noise Perception Network for Low-Light Image Enhancement
Recommendations
An Image Enhancement Approach Using Retinex and YIQ
ITCS '09: Proceedings of the 2009 International Conference on Information Technology and Computer Science - Volume 01On a basis of Retinex and YIQ color space, a new approach of color image enhancement is presented in this paper. The original image in the RGB color space is converted to the YIQ color space, and the multi-scale Retinex (MSR) algorithm is introduced to ...
Underwater image enhancement by color correction and color constancy via Retinex for detail preserving
AbstractIn underwater, light attenuation causes non-uniform illumination that degrades underwater image. To enhance the degraded image, we propose an underwater image enhancement method that includes color correction, color constancy, multi-...
Graphical abstractDisplay Omitted
Highlights- The formulation of color correction compensates the red and blue channels by masking.
Low Illumination Color Image Enhancement Based on Improved Retinex Theory
EITCE '20: Proceedings of the 2020 4th International Conference on Electronic Information Technology and Computer EngineeringIn view of the defects of the classical Retinex image enhancement algorithm, such as poor texture detail retention, halo and over enhancement, and abrupt tone, this paper proposes a low illumination color image enhancement algorithm based on Gabor ...
Comments