Abstract
We present an end-to-end deep learning segmentation method by combining a 3D UNet architecture with a graph neural network (GNN) model. In this approach, the convolutional layers at the deepest level of the UNet are replaced by a GNN-based module with a series of graph convolutions. The dense feature maps at this level are transformed into a graph input to the GNN module. The incorporation of graph convolutions in the UNet provides nodes in the graph with information that is based on node connectivity, in addition to the local features learnt through the downsampled paths. This information can help improve segmentation decisions. By stacking several graph convolution layers, the nodes can access higher order neighbourhood information without substantial increase in computational expense. We propose two types of node connectivity in the graph adjacency: (i) one predefined and based on a regular node neighbourhood, and (ii) one dynamically computed during training and using the nearest neighbour nodes in the feature space. We have applied this method to the task of segmenting the airway tree from chest CT scans. Experiments have been performed on 32 CTs from the Danish Lung Cancer Screening Trial dataset. We evaluate the performance of the UNet-GNN models with two types of graph adjacency and compare it with the baseline UNet.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Long, J., Shelhamer, E., Darrell, T.: Fully convolutional networks for semantic segmentation. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR) (2015)
Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W.M., Frangi, A.F. (eds.) MICCAI 2015. LNCS, vol. 9351, pp. 234–241. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24574-4_28
Scarselli, F., Gori, M., Tsoi, A.C., Hagenbuchner, M., Monfardini, G.: The graph neural network model. IEEE Trans. Neural Netw. 20(1), 61–80 (2009)
Kipf, T.N., Welling, M.: Semi-supervised classification with graph convolutional networks. In: International Conference on Learning Representations (2017)
Lo, P., et al.: Extraction of airways from CT (EXACT’09). IEEE Trans. Med. Imaging 31(11), 2093–2107 (2012)
Meng, Q., Roth, H.R., Kitasaka, T., Oda, M., Ueno, J., Mori, K.: Tracking and segmentation of the airways in chest CT using a fully convolutional network. In: Descoteaux, M., Maier-Hein, L., Franz, A., Jannin, P., Collins, D.L., Duchesne, S. (eds.) MICCAI 2017. LNCS, vol. 10434, pp. 198–207. Springer, Cham (2017). https://doi.org/10.1007/978-3-319-66185-8_23
Juarez, A.G.-U., Tiddens, H.A.W.M., de Bruijne, M.: Automatic airway segmentation in chest CT using convolutional neural networks. In: Stoyanov, D., et al. (eds.) RAMBO/BIA/TIA -2018. LNCS, vol. 11040, pp. 238–250. Springer, Cham (2018). https://doi.org/10.1007/978-3-030-00946-5_24
Selvan, R., et al.: Extraction of airways using graph neural networks. In: 1st Conference on Medical Imaging with Deep Learning, Amsterdam (2018)
Shin, S.Y., Lee, S., Yon, I.D., Lee, K.M.: Deep vessel segmentation by learning graphical connectivity. ArXiv preprint arXiv:1806.02279 (2018)
Petersen, J., et al.: Optimal surface segmentation using flow lines to quantify airway abnormalities in chronic obstructive pulmonary disease. Med. Image Anal. 18, 531–541 (2014)
Lo, P., Sporring, J., Ashraf, H., Pedersen, J.H., de Bruijne, M.: Vessel-guided airway tree segmentation: a voxel classification approach. Med. Image Anal. 14(4), 527–538 (2010)
Lo, P., Sporring, J., Pedersen, J.J.H., de Bruijne, M.: Airway tree extraction with locally optimal paths. In: Yang, G.-Z., Hawkes, D., Rueckert, D., Noble, A., Taylor, C. (eds.) MICCAI 2009. LNCS, vol. 5762, pp. 51–58. Springer, Heidelberg (2009). https://doi.org/10.1007/978-3-642-04271-3_7
Pedersen, J., Jesper, H., et al.: The Danish randomized lung cancer CT screening trial overall design and results of the prevalence round. J. Thorac. Oncol. 4(5), 608–614 (2009)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2019 Springer Nature Switzerland AG
About this paper
Cite this paper
Garcia-Uceda Juarez, A., Selvan, R., Saghir, Z., de Bruijne, M. (2019). A Joint 3D UNet-Graph Neural Network-Based Method for Airway Segmentation from Chest CTs. In: Suk, HI., Liu, M., Yan, P., Lian, C. (eds) Machine Learning in Medical Imaging. MLMI 2019. Lecture Notes in Computer Science(), vol 11861. Springer, Cham. https://doi.org/10.1007/978-3-030-32692-0_67
Download citation
DOI: https://doi.org/10.1007/978-3-030-32692-0_67
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-32691-3
Online ISBN: 978-3-030-32692-0
eBook Packages: Computer ScienceComputer Science (R0)
