Abstract
In the modern manufacturing industry, the welding quality is one of the key factors which affect the structural strength and the comprehensive quality of the products. It is an important part to establish the standard of welding quality detection and evaluation in the process of production management. At present, the detection technologies of welding quality are mainly performed based on the 2D image features. However, due to the influence of environmental factors and illumination conditions, the welding quality detection results based on grey images are not robust. In this paper, a novel welding detection system is established based on the 3D reconstruct technology for the arc welding robot. The shape from shading (SFS) algorithm is used to reconstruct the 3D shapes of the welding seam and the curvature information is extracted as the feature vector of the welds. Furthermore, the SVM classification method is adopted to perform the evaluation task of welding quality. The experimental results show that the system can quickly and efficiently fulfill the detection task of welding quality, especially with good robustness for environmental influence cases. Meanwhile, the method proposed in this paper can well solve the weakness issues of conventional welding quality detection technologies.
Similar content being viewed by others
References
Chen SB, Lv N (2014) Research evolution on intelligentized technologies for arc welding process. J Manuf Process 16(1):109–122
Mery D, Filbert D (2002) Automated flaw detection in aluminum castings based on the tracking of potential defects in a radioscopic image sequence. IEEE Trans Robot Autom 18(6):890–901
Gang T, Wang DH (2001) Defect extraction of x-ray images based on adaptive morphology filtering. Jixie Gongcheng Xuebao(Chinese Journal of Mechanical Engineering)(China) 37(5):85–89
Zhang XG, Lin JJ (2003) Weld defects distinguishing method based on fuzzy neural networks. J China Univ Min Technol 32(1):92–95
Feng Y, Yong S, Di L, Yizong L, Rehfeltd D (2001) On-line detection of burn-through in GMAW based on statistical decision. Mach Manuf Eng 12:015
Wang KH, Shen YJ, Qian F, You QR (2006) MAG Welding molten pool image character and useful information analysis. Trans China Weld Inst 27(11):53
Wang KH, Jia Y, Qian F, Shen YJ (2007) Molten pool image gathering and processing of aluminum alloy twin-wire MIG welding. Trans China Weld Inst 28(1):53
Wang KH, You QR, Shen YJ (2006) Preliminary discussion about image character of gas pore in MAG welding based on vision sensing. Trans China Weld Inst 27(12):13
Correal R, Pajares G, Ruz JJ (2014) Automatic expert system for 3D terrain reconstruction based on stereo vision and histogram matching. Expert Syst Appl 41(4):2043–2051
Wang X (2014) Three-dimensional vision-based sensing of GTAW: a review. Int J Adv Manuf Technol, 72
Zhang C, Li H, Jin Z, Gao H (2017) Seam sensing of multi-layer and multi-pass welding based on grid structured laser. Int J Adv Manuf Technol 91(1-4):1103–1110
Zhang Z, Nejat G, Guo H, Huang P (2011) A novel 3D sensory system for robot-assisted mapping of cluttered urban search and rescue environments. Intel Serv Robotics 4(2):119–134
Zhang R, Tsai PS, Cryer JE, Shah M (1999) Shape-from-shading: a survey. IEEE Trans Pattern Anal Mach Intell 21(8):690–706
Xu Y, Fang G, Chen SB, Zou JJ, Ye Z (2014) Real-time image processing for vision-based weld seam tracking in robotic GMAW. Int J Adv Manuf Technol 73(9-12):1413–1425
Chu HH, Wang ZY (2016) A vision-based system for post-welding quality measurement and defect detection. Int J Adv Manuf Technol 86(9-12):3007–3014
Huang W, Kovacevic R (2012) Development of a real-time laser-based machine vision system to monitor and control welding processes. Int J Adv Manuf Technol 63(1-4):235–248
Zhong J, Yang C, Xu Y, Chen H, Chen S (2015) Research on reconstruction of weld pool surface based on shape from shading during robot aluminum alloy pulse GTAW. In Robotic Weld, Intelligence and Automation, 525–538
Ciaccio EJ, Tennyson CA, Bhagat G, Lewis SK, Green PH (2013) Use of shape-from-shading to estimate three-dimensional architecture in the small intestinal lumen of celiac and control patients. Comput Meth Programs Biomed 111(3):676–684
Hui Z, Dejian Z, Huang CY (2009) SMT Solder joint 3D reconstruction technology based on shape from shading. Comput Sci 36(07):289–290
Lin YS, Jiang JY, Lee SJ (2014) A similarity measure for text classification and clustering[J]. IEEE Trans Knowl Data Eng 26(7):1575–1590
Valipour M, Banihabib ME, Behbahani SMR (2013) Comparison of the ARMA, ARIMA, and the autoregressive artificial neural network models in forecasting the monthly inflow of Dez dam reservoir. J Hydrol 476:433–441
Pradhan B (2013) A comparative study on the predictive ability of the decision tree, support vector machine and neuro-fuzzy models in landslide susceptibility mapping using GIS. Comput Geol 51:350–365
Fan J, Jing F, Fang Z, Tan M (2017) Automatic recognition system of welding seam type based on SVM method, Int J Adv Manuf Technol, 1–11
Acknowledgements
This work was supported by the National Natural Science Foundation of China under Grant 6140-3372, and by National Science and Technology Support Program of China under Grant 2015BAF01B01.
The authors would like to thank the anonymous referees for their valuable suggestions and comments.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yang, L., Li, E., Long, T. et al. A welding quality detection method for arc welding robot based on 3D reconstruction with SFS algorithm. Int J Adv Manuf Technol 94, 1209–1220 (2018). https://doi.org/10.1007/s00170-017-0991-9
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00170-017-0991-9