Skip to main content
SpringerLink
Log in

Detection of powder bed defects in selective laser sintering using convolutional neural network

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

The presence of defects in a powder bed fusion (PBF) process can lead to the formation of flaws in consolidated parts. Powder bed defects (PBDs) have different sizes and shapes and occur in different locations in the built area. Those variations pose great challenges to their detection. In this study, a deep convolution neural network was applied to detect three typical types of PBDs in a selective laser sintering (SLS) process, namely warpage, part shifting, and short feed, which were intentionally generated by varying the process conditions. Images of the powder bed were captured using a digital camera, which were split into three single-channel images corresponding to the color channels in the color image. A deep residual neural network was then used to extract multiscale features, and a region proposal network was adopted to detect the object-level defect bounding box. In the final stage, a fully convolutional neural network was proposed to generate instance-level defect regions in the bounding box. Our results demonstrated that this method had higher accuracy and efficiency and was able to cope with geometrical distortion and image blurring, in comparison to the defect detection methods reported previously. Also, the detection system was cost-effective and could be easily installed outside the chamber of a PBF system. This study lays the groundwork for the development of a variety of automated technologies for additive manufacturing, such as real-time powder layer quality inspection and 3D quality certificate generation for finish parts.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  1. Hull CW (1986) Apparatus for production of three-dimensional objects by stereolithography. Google Patents

  2. Sames WJ, List F, Pannala S, Dehoff RR, Babu SS (2016) The metallurgy and processing science of metal additive manufacturing. Int Mater Rev 61(5):315–360. https://doi.org/10.1080/09506608.2015.1116649

    Article  Google Scholar 

  3. Diermann SH, Mingyuan L, Yitian Z, Luigi-Jules V, Matthew D, Han H Synthesis, microstructure, and mechanical behaviour of a unique porous PHBV scaffold manufactured using selective laser sintering. J Mech Behav Biomed Mater 84:151–160. https://doi.org/10.1016/j.jmbbm.2018.05.007

  4. Fan Z, Lu M, Han H (2018) Selective laser melting of alumina: a single track study. Ceram Int 44(8). https://doi.org/10.1016/j.ceramint.2018.02.166

  5. Bhavar V, Kattire P, Patil V, Khot S, Gujar K, Singh R (2017) A review on powder bed fusion technology of metal additive manufacturing, Additive Manufacturing Handbook. CRC Press, pp 251–253. https://doi.org/10.1201/9781315119106-15

  6. Caiazzo F, Alfieri V, Corrado G, Argenio P (2017) Laser powder-bed fusion of Inconel 718 to manufacture turbine blades. Int J Adv Manuf Technol. https://doi.org/10.1007/s00170-017-0839-3

  7. Hu D, Kovacevic R (2003) Sensing, modeling and control for laser-based additive manufacturing. Int J Mach Tools Manuf 43(1):51–60. https://doi.org/10.1016/s0890-6955(02)00163-3

    Article  Google Scholar 

  8. Lewandowski JJ, Seifi M (2016) Metal additive manufacturing: a review of mechanical properties. Annu Rev Mater Res 46:151–186. https://doi.org/10.1146/annurev-matsci-070115-032024

    Article  Google Scholar 

  9. Klingbeil NW, Beuth JL, Chin R, Amon C (2002) Residual stress-induced warping in direct metal solid freeform fabrication. Int J Mech Sci 44(1):57–77. https://doi.org/10.1016/S0020-7403(01)00084-4

    Article  MATH  Google Scholar 

  10. Malekipour E, El-Mounayri H (2018) Defects, process parameters and signatures for online monitoring and control in powder-based additive manufacturing, Mechanics of Additive and Advanced Manufacturing, Volume 9, Springer, pp 83–90. https://doi.org/10.1007/978-3-319-62834-9_12

  11. Grasso M, Colosimo BM (2017) Process defects and in situ monitoring methods in metal powder bed fusion: a review. Meas Sci Technol 28(4):044005. https://doi.org/10.1088/1361-6501/aa5c4f

    Article  Google Scholar 

  12. Malekipour E, El-Mounayri H (2018) Common defects and contributing parameters in powder bed fusion AM process and their classification for online monitoring and control: a review. Int J Adv Manuf Technol 95(1–4):527–550. https://doi.org/10.1007/s00170-017-1172-6

    Article  Google Scholar 

  13. Whip B, Sheridan L, Gockel J (2019) The effect of primary processing parameters on surface roughness in laser powder bed additive manufacturing. Int J Adv Manuf Technol 103(7):4411–4422. https://doi.org/10.1007/s00170-019-03716-z

    Article  Google Scholar 

  14. Arısoy YM, Criales LE, Özel T, Lane B, Donmez A (2017) Influence of scan strategy and process parameters on microstructure and its optimization in additively manufactured nickel alloy 625 via laser powder bed fusion. Int J Adv Manuf Technol 90(5–8):1–25. https://doi.org/10.1007/s00170-016-9429-z

    Article  Google Scholar 

  15. Chacón J, Caminero M, Núñez P, García-Plaza E, García-Moreno I, Reverte JJCS (2019) Additive manufacturing of continuous fibre reinforced thermoplastic composites using fused deposition modelling: effect of process parameters on mechanical properties. Technology 181:107688. https://doi.org/10.1016/j.compscitech.2019.107688

    Article  Google Scholar 

  16. Levkulich N, Semiatin S, Gockel J, Middendorf J, DeWald A, Klingbeil NJAM (2019) The effect of process parameters on residual stress evolution and distortion in the laser powder bed fusion of Ti-6Al-4V. 28:475–484. https://doi.org/10.1016/j.addma.2019.05.015

  17. Manjunath A, Anandakrishnan V, Ramachandra S, Parthiban KJMTP (2020) Experimental investigations on the effect of pre-positioned wire electron beam additive manufacturing process parameters on the layer geometry of titanium 6Al4V. 21:766–772. https://doi.org/10.1016/j.matpr.2019.06.755

  18. Wegner A, Witt G (2011) Process monitoring in laser sintering using thermal imaging. SFF Symposium, Austin, pp 8–10

    Google Scholar 

  19. Gong H, Rafi K, Gu H, Starr T, Stucker B (2014) Analysis of defect generation in Ti–6Al–4V parts made using powder bed fusion additive manufacturing processes. Addit Manuf 1:87–98. https://doi.org/10.1016/j.addma.2014.08.002

    Article  Google Scholar 

  20. Gok AJM (2015) A new approach to minimization of the surface roughness and cutting force via fuzzy TOPSIS, multi-objective grey design and RSA. 70:100–109. https://doi.org/10.1016/j.measurement.2015.03.037

  21. Gong H, Rafi K, Gu H, Ram GJ, Starr T, Stucker B (2015) Influence of defects on mechanical properties of Ti–6Al–4 V components produced by selective laser melting and electron beam melting. Mater Des 86:545–554. https://doi.org/10.1016/j.matdes.2015.07.147

    Article  Google Scholar 

  22. Yavari SA, Ahmadi S, Wauthle R, Pouran B, Schrooten J, Weinans H, Zadpoor A (2015) Relationship between unit cell type and porosity and the fatigue behavior of selective laser melted meta-biomaterials. J Mech Behav Biomed Mater 43:91–100. https://doi.org/10.1016/j.jmbbm.2014.12.015

    Article  Google Scholar 

  23. Liu QC, Elambasseril J, Sun SJ, Leary M, Brandt M, Sharp PK (2014) The effect of manufacturing defects on the fatigue behaviour of Ti-6Al-4V specimens fabricated using selective laser melting. Adv Mater Res Trans Tech Publ:1519–1524. https://doi.org/10.4028/www.scientific.net/AMR.891-892.1519

  24. Wycisk E, Solbach A, Siddique S, Herzog D, Walther F, Emmelmann C (2014) Effects of defects in laser additive manufactured Ti-6Al-4V on fatigue properties. Phys Procedia 56:371–378. https://doi.org/10.1016/j.phpro.2014.08.120

    Article  Google Scholar 

  25. Seifi M, Salem AA, Satko DP, Ackelid U, Semiatin SL, Lewandowski JJ (2017) Effects of HIP on microstructural heterogeneity, defect distribution and mechanical properties of additively manufactured EBM Ti-48Al-2Cr-2Nb. J Alloys Compd 729:1118–1135. https://doi.org/10.1016/j.jallcom.2017.09.163

    Article  Google Scholar 

  26. Tillmann W, Schaak C, Nellesen J, Schaper M, Aydinöz M, Hoyer K-P (2017) Hot isostatic pressing of IN718 components manufactured by selective laser melting. Addit Manuf 13:93–102. https://doi.org/10.1016/j.addma.2016.11.006

    Article  Google Scholar 

  27. Price S, Cooper K, Chou K (2012) Evaluations of temperature measurements by near-infrared thermography in powder-based electron-beam additive manufacturing, Proceedings of the Solid Freeform Fabrication Symposium. University of Texas, Austin, pp 761–773

    Google Scholar 

  28. Rodriguez E (2013) Development of a thermal imaging feedback control system in electron beam melting, The University of Texas at El Paso

  29. Yadroitsev I, Krakhmalev P, Yadroitsava I (2014) Selective laser melting of Ti6Al4V alloy for biomedical applications: temperature monitoring and microstructural evolution. J Alloys Compd 583:404–409. https://doi.org/10.1016/j.jallcom.2013.08.183

    Article  Google Scholar 

  30. Abdelrahman M, Starr TL Quality certification and control of polymer laser sintering: layerwise temperature monitoring using thermal imaging. Int J Adv Manuf Technol 84(5–8):831–842. https://doi.org/10.1007/s00170-015-7524-1

  31. Mireles J, Terrazas C, Gaytan SM, Roberson DA, Wicker RB Closed-loop automatic feedback control in electron beam melting. Int J Adv Manuf Technol 78(5–8):1193–1199. https://doi.org/10.1007/s00170-014-6708-4

  32. Abdelrahman M, Reutzel EW, Nassar AR, Starr TL (2017) Flaw detection in powder bed fusion using optical imaging. Addit Manuf 15:1–11. https://doi.org/10.1016/j.addma.2017.02.001

    Article  Google Scholar 

  33. Craeghs T, Clijsters S, Yasa E, Kruth J-P (2011) Online quality control of selective laser melting. Proceedings of the Solid Freeform Fabrication Symposium, Austin, pp 212–226

    Google Scholar 

  34. Foster B, Reutzel E, Nassar A, Hall B, Brown S, Dickman C (2015) Optical, layerwise monitoring of powder bed fusion. Solid Freeform Fabrication Symposium, Austin, pp 10–12

    Google Scholar 

  35. Kleszczynski S, Zur Jacobsmühlen J, Sehrt J, Witt G (2012) Error detection in laser beam melting systems by high resolution imaging, Proceedings of the Solid Freeform Fabrication Symposium

  36. Aminzadeh M, Kurfess T (2015) Layerwise automated visual inspection in laser powder-bed additive manufacturing, ASME 2015 international manufacturing science and engineering conference, American Society of Mechanical Engineers Digital Collection, https://doi.org/10.1115/MSEC2015-9393

  37. Grasso M, Laguzza V, Semeraro Q, Colosimo BM (2017) In-process monitoring of selective laser melting: spatial detection of defects via image data analysis. J Manuf Sci Eng 139(5):051001. https://doi.org/10.1115/1.4034715

    Article  Google Scholar 

  38. Seita M (2019) A high-resolution and large field-of-view scanner for in-line characterization of powder bed defects during additive manufacturing. Mater Des 164:107562. https://doi.org/10.1016/j.matdes.2018.107562

    Article  Google Scholar 

  39. Gobert C, Reutzel EW, Petrich J, Nassar AR, Phoha S (2018) Application of supervised machine learning for defect detection during metallic powder bed fusion additive manufacturing using high resolution imaging. Addit Manuf 21:517–528. https://doi.org/10.1016/j.addma.2018.04.005

    Article  Google Scholar 

  40. Budnik M, Gutierrez-Gomez E-L, Safadi B, Quénot G (2015) Learned features versus engineered features for semantic video indexing, 2015 13th International Workshop on Content-Based Multimedia Indexing (CBMI), IEEE, pp 1–6. https://doi.org/10.1109/CBMI.2015.7153637

  41. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition, Proceedings of the IEEE conference on computer vision and pattern recognition, pp 770–778. https://doi.org/10.1109/CVPR.2016.90

  42. Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: towards real-time object detection with region proposal networks, Advances in neural information processing systems, pp 91–99. https://doi.org/10.1109/TPAMI.2016.2577031

  43. Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation, Proceedings of the IEEE conference on computer vision and pattern recognition, pp 580–587. https://doi.org/10.1109/cvpr.2014.81

  44. Long J, Shelhamer E, Darrell T (2015) Fully convolutional networks for semantic segmentation, Proceedings of the IEEE conference on computer vision and pattern recognition, pp 3431–3440. https://doi.org/10.1109/TPAMI.2016.2572683

  45. Li G, Yu Y (2016) Deep contrast learning for salient object detection, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 478–487. https://doi.org/10.1109/CVPR.2016.58

  46. Li G, Yu Y (2016) Visual saliency detection based on multiscale deep CNN features. IEEE Trans Image Process 25(11):5012–5024. https://doi.org/10.1109/TIP.2016.2602079

    Article  MathSciNet  MATH  Google Scholar 

  47. Liu N, Han J (2016) Dhsnet: deep hierarchical saliency network for salient object detection, Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp 678–686. https://doi.org/10.1109/CVPR.2016.80

  48. Wang L, Wang L, Lu H, Zhang P, Ruan X (2016) Saliency detection with recurrent fully convolutional networks. Springer, European conference on computer vision, pp 825–841. https://doi.org/10.1007/978-3-319-46493-0_50

    Book  Google Scholar 

  49. Giusti A, Cireşan DC, Masci J, Gambardella LM, Schmidhuber J (2013) Fast image scanning with deep max-pooling convolutional neural networks, 2013 IEEE International Conference on Image Processing, IEEE, pp 4034–4038. https://doi.org/10.1109/icip.2013.6738831

  50. Wong SC, Gatt A, Stamatescu V, McDonnell MD (2016) Understanding data augmentation for classification: when to warp?, 2016 international conference on digital image computing: techniques and applications (DICTA), IEEE, pp 1–6. https://doi.org/10.1109/DICTA.2016.7797091

  51. Huang J, Rathod V, Sun C, Zhu M, Korattikara A, Fathi A, Fischer I, Wojna Z, Song Y, Guadarrama S (2017) Speed/accuracy trade-offs for modern convolutional object detectors, Proceedings of the IEEE conference on computer vision and pattern recognition, pp 7310–7311. https://doi.org/10.1109/CVPR.2017.351

  52. He K, Gkioxari G, Dollár P, Girshick R (2017) Mask r-cnn, Proceedings of the IEEE international conference on computer vision, pp 2961–2969. https://doi.org/10.1109/TPAMI.2018.2844175

  53. Garcia-Garcia A, Orts-Escolano S, Oprea S, Villena-Martinez V, Garcia-Rodriguez J (2017) A review on deep learning techniques applied to semantic segmentation, arXiv preprint arXiv:1704.06857

  54. Pech-Pacheco JL, Cristóbal G, Chamorro-Martinez J, Fernández-Valdivia J (2000) Diatom autofocusing in brightfield microscopy: a comparative study, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000, IEEE, pp 314–317. https://doi.org/10.1109/ICPR.2000.903548

Download references

Acknowledgments

L. Xiao would like to thank the CSC-UQ Scholarship (No. 201806160119), provided by the Chinese Scholarship Council (CSC) and the University of Queensland (UQ).

Funding

This work was supported by the UQ-NSRSU (NS-1803) grant.

Author information

Authors and Affiliations

  1. School of Mechanical and Mining Engineering, The University of Queensland, Brisbane, QLD, 4072, Australia

    Ling Xiao, Mingyuan Lu & Han Huang

  2. School of Mechanical Science and Engineering, Huazhong University of Science and Technology, Luoyu Road 1037, Wuhan, 430074, Hubei, People’s Republic of China

    Ling Xiao

Authors
  1. Ling Xiao
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mingyuan Lu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Han Huang
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mingyuan Lu.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Xiao, L., Lu, M. & Huang, H. Detection of powder bed defects in selective laser sintering using convolutional neural network. Int J Adv Manuf Technol 107, 2485–2496 (2020). https://doi.org/10.1007/s00170-020-05205-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-020-05205-0

Keywords

Search

Navigation