Abstract
This paper proposes a novel crack detection method using the three-stages detection model. Deep learning technology has been a focus of attention in the field of crack detection; however, it needs big data to train the corresponding network model. More training samples and the combination of multiple deep learning algorithms help to improve the detection performance. Therefore, this paper employed a generative adversarial network (GAN) model to generate abundant virtual crack images with similar features to real images, these virtual images are used to train the CNN classifier and DeepLab_v3+ respectively, and then the real images are used to evaluate the performance of the three-stages detection method. The results show that the proposed three-stages detection method has excellent detection effect on the crack detection is better than that of the control experiment (the NI_MIoU, NI_Accuracy, NI_F-score and NI_MCC are increased by 22.1%–55.6%, 5.2%–9.8%, 37.4%–40.0% and 6.2%–11.1% respectively)). These results demonstrate that the three-stages detection model has made a beneficial contribution to the crack detection.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Abdel-Qader I, Abudayyeh O, Kelly ME (2003) Analysis of edge-detection techniques for crack identification in bridges. Journal of Computing in Civil Engineering 17(4):255–263, DOI: https://doi.org/10.1061/(ASCE)0887-3801(2003)17:4(255)
Bang S, Park S, Kim H, Kim H (2019) Encoder-decoder network for pixel-level road crack detection in black-box images. Computer-Aided Civil and Infrastructure Engineering 34:713–727, DOI: https://doi.org/10.1111/mice.12440
Chen FC, Jahanshahi RMR (2017) NB-CNN: Deep learning-based crack detection using convolutional neural network and naïve bayes data fusion. IEEE Transactions on Industrial Electronics 65(9): 4392–4400, DOI: https://doi.org/10.1109/TIE.2017.2764844
Chen L, Papandreou G, Schroff F, Adam H (2017) Rethinking atrous convolution for semantic image segmentation. arXiv: 17605587
Choi K, Lim JS, Kim SW (2018) Real-time image reconstruction for low-dose CT using deep convolutional generative adversarial networks (GANs). Physics of Medical Imaging 1057332(2018), DOI: https://doi.org/10.1117/12.2293420
Dorafshan S, Maguire M, Hoffer NV, Coopmans C (2018) Fatigue crack detection using unmanned aerial systems in under-bridge inspection. Idaho Transportation Department 2:1–120
Douarre C, Crispim-Junior CF, Gelibert A, Tougne L, Rousseau D (2019) Novel data augmentation strategies to boost supervised segmentation of plant disease. Computers and Electronics in Agriculture 165:104967, DOI: https://doi.org/10.1016/j.compag.2019.104967
Dung CV, Anh LD (2019) Autonomous concrete crack detection using deep fully convolutional neural network. Automation in Construction 99:52–58, DOI: https://doi.org/10.1016/j.autcon.2018.11.028
Ebrahimkhanlou A, Farhidzadeh A, Salamone S (2016) Multifractal analysis of crack patterns in reinforced concrete shear walls. Structural Health Monitoring 15(1):81–92, DOI: https://doi.org/10.1177/1475921715624502
Francisco R-L, Fernando L-G, Juan CG-G, Jose MP, Olivares J (2020) Benefits of ensemble models in road pavement cracking classification. Computer-Aided Civil and Infrastructure Engineering 35(194–1208, DOI: https://doi.org/10.1111/mice.12543
Giakoumis I, Nikolaidis N, Pitas I (2006) Digital image processing techniques for the detection and removal of cracks in digitized paintings. IEEE Transactions on Image Processing 15(1):178–188, DOI: https://doi.org/10.1109/TIP.2005.860311
Goodfellow I, Pouget Abadie J, Mirza M, Xu B, Warde Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial networks. Advances in Neural Information Processing Systems 3:2672–2680, DOI: https://doi.org/10.1145/3422622
Gu C, Jin L, Lei K (2017) Generating realistic Chinese handwriting characters via deep convolutional generative adversarial networks. Springer, Singapore
Jahanshahi MR, Kelly JS, Masri SF, Sukhatme GS (2009) A survey and evaluation of promising approaches for automatic image-based defect detection of bridge structures. Structure & Infrastructure Engineering 5(6):455–486, DOI: https://doi.org/10.1080/15732470801945930
Ji A, Xue X, Wang Y, Luo X, Xue W (2020) An integrated approach to automatic pixel-level crack detection and quantification of asphalt pavement. Automation in Construction 114:103176, DOI: https://doi.org/10.1016/j.autcon.2020.103176
Kumar SS, Abraham DM, Jahanshahi MR, Iseley T, Starr J (2018) Automated defect classification in sewer closed circuit television inspections using deep convolutional neural networks. Automation in Construction 91:273–283, DOI: https://doi.org/10.1016/j.autcon.2018.03.028
Lecun Y, Bengio Y, Hinton G (2015) Deep learning. Nature 521:436–444, DOI: https://doi.org/10.1038/nature14539
Li B, Wang KCP, Zhang A, Yang E, Wang G (2020) Automatic classification of pavement crack using deep convolutional neural network. International Journal of Pavement Engineering 21(4): 457–463, DOI: https://doi.org/10.1080/10298436.2018.1485917
Li S, Zhao X, Zhou G (2019) Automatic pixel-level multiple damage detection of concrete structure using fully convolutional network. Computer-Aided Civil and Infrastructure Engineering 34(7):616–634, DOI: https://doi.org/10.1111/mice.12433
Liu Z, Cao Y, Wang Y, Wang W (2019a) Computer vision-based concrete crack detection using U-net fully convolutional networks. Automation in Construction 104:129–139, DOI: https://doi.org/10.1016/j.autcon.2019.04.005
Liu Y, Cho S, Spencer BF, Fan J (2014) Automated assessment of cracks on concrete surfaces using adaptive digital image processing. Smart Structures & Systems 14(4):719–741, DOI: https://doi.org/10.12989/sss.2014.14.4.719
Liu X, Zou Y, Xie C, Kuang H, Ma X (2019b) Bidirectional face aging synthesis based on improved deep convolutional generative adversarial networks. Information 10(2):69, DOI: https://doi.org/10.3390/info10020069
Maeda H, Kashiyama T, Sekimoto Y, Seto T, Omata H (2021) Generative adversarial network for road damage detection. Computer-Aided Civil and Infrastructure Engineering 36(1):47–60, DOI: https://doi.org/10.1111/mice.12561
Russakovsky O, Deng J, Su H, Krause J, Satheesh S, Ma S, Huang Z, Karpathy A, Khosla A, Bernstein M (2015) ImageNet large scale visual recognition challenge. International Journal of Computer Vision 115(3):211–252, DOI: https://doi.org/10.1007/s11263-015-0816-y
Situ Z, Teng S, Liu H, Luo J, Zhou Q (2021) Automated sewer defects detection using style-based generative adversarial networks and fine-tuned well-known CNN classifier. IEEE Access 9:59498–59507, DOI: https://doi.org/10.1109/ACCESS.2021.3073915
Teng S, Chen G, Gong P, Liu G, Cui F (2019) Structural damage detection using convolutional neural networks combining strain energy and dynamic response. Meccanica 55(4):945–959, DOI: https://doi.org/10.1007/s11012-019-01052-w
Teng S, Liu Z, Chen G, Cheng L (2021) Concrete crack detection based on well-known feature extractor model and the YOLO_v2 Network. Applied Sciences-Basel 11(2):813, DOI: https://doi.org/10.3390/app11020813
Tong Z, Gao J, Han Z, Wang Z (2018) Recognition of asphalt pavement crack length using deep convolutional neural networks. Road Materials & Pavement Design 19:1334–1349, DOI: https://doi.org/10.1080/14680629.2017.1308265
Wang Y, Zhang JY, Liu JX, Zhang Y, Chen ZP, Li CG, He K, Yan RB (2019) Research on crack detection algorithm of the concrete bridge based on image processing. Procedia Computer Science 154:610–616, DOI: https://doi.org/10.1016/j.procs.2019.06.096
Yang X, Li H, Yu Y, Luo X, Huang T (2018) Automatic pixel-level crack detection and measurement using fully convolutional network. Computer-Aided Civil and Infrastructure Engineering 33(12):1090–1109, DOI: https://doi.org/10.1111/mice.12412
Yang G, Wang KCP, Li J Q, Fei Y, Liu Y, Mahboub KC, Zhang AA (2021) Automatic pavement type recognition for image-based pavement condition survey using convolutional neural network. Journal of Computing in Civil Engineering 35(1):04020060, DOI: https://doi.org/10.1061/(ASCE)CP.1943-5487.0000944
Yuan R, Wang B, Mao Z, Watada J (2021) Multi-objective wind power scenario forecasting based on PG-GAN. Energy 226(3):120379, DOI: https://doi.org/10.1016/j.energy.2021.120379
Zhang K, He Z, Zheng L, Zhao L, Wu L (2021) A generative adversarial network for travel times imputation using trajectory data. Computer-Aided Civil and Infrastructure Engineering 36(2):197–212, DOI: https://doi.org/10.1111/mice.12595
Zhang Y, Miyamori Y, Mikami S, Saito T (2019) Vibration-based structural state identification by a 1-dimensional convolutional neural network. Computer-Aided Civil & Infrastructure Engineering 34(9):1–18, DOI: https://doi.org/10.1111/mice.12447
Zhang K, Zhang Y, Cheng HD (2020) Self-supervised structure learning for crack detection based on cycle-consistent generative adversarial networks. Journal of Computing in Civil Engineering 34(3): 04020004, DOI: https://doi.org/10.1061/(ASCE)CP.1943-5487.0000883
Zhao J, Li Y, Zhang F, Zhu S, Liu Y, Lu H, Ye Z (2018) Semi-supervised learning-based live fish identification in aquaculture using modified deep convolutional generative adversarial networks. Transactions of the ASABE 61(2):699–710
Ziou D, Tabbone S (1998) Edge detection techniques — An overview. International Journal of Pattern Recognition & Image Analysis 8(4):537–559
Acknowledgments
Not Applicable
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Chen, G., Teng, S., Lin, M. et al. Crack Detection Based on Generative Adversarial Networks and Deep Learning. KSCE J Civ Eng 26, 1803–1816 (2022). https://doi.org/10.1007/s12205-022-0518-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12205-022-0518-2