Skip to main content
Log in

A welding quality detection method for arc welding robot based on 3D reconstruction with SFS algorithm

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

In the modern manufacturing industry, the welding quality is one of the key factors which affect the structural strength and the comprehensive quality of the products. It is an important part to establish the standard of welding quality detection and evaluation in the process of production management. At present, the detection technologies of welding quality are mainly performed based on the 2D image features. However, due to the influence of environmental factors and illumination conditions, the welding quality detection results based on grey images are not robust. In this paper, a novel welding detection system is established based on the 3D reconstruct technology for the arc welding robot. The shape from shading (SFS) algorithm is used to reconstruct the 3D shapes of the welding seam and the curvature information is extracted as the feature vector of the welds. Furthermore, the SVM classification method is adopted to perform the evaluation task of welding quality. The experimental results show that the system can quickly and efficiently fulfill the detection task of welding quality, especially with good robustness for environmental influence cases. Meanwhile, the method proposed in this paper can well solve the weakness issues of conventional welding quality detection technologies.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Chen SB, Lv N (2014) Research evolution on intelligentized technologies for arc welding process. J Manuf Process 16(1):109–122

    Article  Google Scholar 

  2. Mery D, Filbert D (2002) Automated flaw detection in aluminum castings based on the tracking of potential defects in a radioscopic image sequence. IEEE Trans Robot Autom 18(6):890–901

    Article  Google Scholar 

  3. Gang T, Wang DH (2001) Defect extraction of x-ray images based on adaptive morphology filtering. Jixie Gongcheng Xuebao(Chinese Journal of Mechanical Engineering)(China) 37(5):85–89

    Article  Google Scholar 

  4. Zhang XG, Lin JJ (2003) Weld defects distinguishing method based on fuzzy neural networks. J China Univ Min Technol 32(1):92–95

    Google Scholar 

  5. Feng Y, Yong S, Di L, Yizong L, Rehfeltd D (2001) On-line detection of burn-through in GMAW based on statistical decision. Mach Manuf Eng 12:015

    Google Scholar 

  6. Wang KH, Shen YJ, Qian F, You QR (2006) MAG Welding molten pool image character and useful information analysis. Trans China Weld Inst 27(11):53

    Article  Google Scholar 

  7. Wang KH, Jia Y, Qian F, Shen YJ (2007) Molten pool image gathering and processing of aluminum alloy twin-wire MIG welding. Trans China Weld Inst 28(1):53

    Article  Google Scholar 

  8. Wang KH, You QR, Shen YJ (2006) Preliminary discussion about image character of gas pore in MAG welding based on vision sensing. Trans China Weld Inst 27(12):13

    Google Scholar 

  9. Correal R, Pajares G, Ruz JJ (2014) Automatic expert system for 3D terrain reconstruction based on stereo vision and histogram matching. Expert Syst Appl 41(4):2043–2051

    Article  Google Scholar 

  10. Wang X (2014) Three-dimensional vision-based sensing of GTAW: a review. Int J Adv Manuf Technol, 72

  11. Zhang C, Li H, Jin Z, Gao H (2017) Seam sensing of multi-layer and multi-pass welding based on grid structured laser. Int J Adv Manuf Technol 91(1-4):1103–1110

    Article  Google Scholar 

  12. Zhang Z, Nejat G, Guo H, Huang P (2011) A novel 3D sensory system for robot-assisted mapping of cluttered urban search and rescue environments. Intel Serv Robotics 4(2):119–134

    Article  Google Scholar 

  13. Zhang R, Tsai PS, Cryer JE, Shah M (1999) Shape-from-shading: a survey. IEEE Trans Pattern Anal Mach Intell 21(8):690–706

    Article  MATH  Google Scholar 

  14. Xu Y, Fang G, Chen SB, Zou JJ, Ye Z (2014) Real-time image processing for vision-based weld seam tracking in robotic GMAW. Int J Adv Manuf Technol 73(9-12):1413–1425

    Article  Google Scholar 

  15. Chu HH, Wang ZY (2016) A vision-based system for post-welding quality measurement and defect detection. Int J Adv Manuf Technol 86(9-12):3007–3014

    Article  Google Scholar 

  16. Huang W, Kovacevic R (2012) Development of a real-time laser-based machine vision system to monitor and control welding processes. Int J Adv Manuf Technol 63(1-4):235–248

    Article  Google Scholar 

  17. Zhong J, Yang C, Xu Y, Chen H, Chen S (2015) Research on reconstruction of weld pool surface based on shape from shading during robot aluminum alloy pulse GTAW. In Robotic Weld, Intelligence and Automation, 525–538

  18. Ciaccio EJ, Tennyson CA, Bhagat G, Lewis SK, Green PH (2013) Use of shape-from-shading to estimate three-dimensional architecture in the small intestinal lumen of celiac and control patients. Comput Meth Programs Biomed 111(3):676–684

    Article  Google Scholar 

  19. Hui Z, Dejian Z, Huang CY (2009) SMT Solder joint 3D reconstruction technology based on shape from shading. Comput Sci 36(07):289–290

    Google Scholar 

  20. Lin YS, Jiang JY, Lee SJ (2014) A similarity measure for text classification and clustering[J]. IEEE Trans Knowl Data Eng 26(7):1575–1590

    Article  Google Scholar 

  21. Valipour M, Banihabib ME, Behbahani SMR (2013) Comparison of the ARMA, ARIMA, and the autoregressive artificial neural network models in forecasting the monthly inflow of Dez dam reservoir. J Hydrol 476:433–441

    Article  Google Scholar 

  22. Pradhan B (2013) A comparative study on the predictive ability of the decision tree, support vector machine and neuro-fuzzy models in landslide susceptibility mapping using GIS. Comput Geol 51:350–365

    Article  Google Scholar 

  23. Fan J, Jing F, Fang Z, Tan M (2017) Automatic recognition system of welding seam type based on SVM method, Int J Adv Manuf Technol, 1–11

Download references

Acknowledgements

This work was supported by the National Natural Science Foundation of China under Grant 6140-3372, and by National Science and Technology Support Program of China under Grant 2015BAF01B01.

The authors would like to thank the anonymous referees for their valuable suggestions and comments.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to En Li.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yang, L., Li, E., Long, T. et al. A welding quality detection method for arc welding robot based on 3D reconstruction with SFS algorithm. Int J Adv Manuf Technol 94, 1209–1220 (2018). https://doi.org/10.1007/s00170-017-0991-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-017-0991-9

Keywords

Navigation