Dina Abdelhafiz
ABSTRACT
Automatic extraction of breast mass in mammogram (MG) images is a challenging task due to the varying sizes, shapes, and textures of masses. Moreover, the density of MGs makes mass detection very challenging since masses can be hidden in dense MGs. In this paper, we propose a residual deep learning (DL) system for mass segmentation and classification in mammography. The overall proposed system consists of two cascaded parts: 1) a residual attention U-Net model (RU-Net) to precisely segment mass lesions in MG images, followed by 2) a ResNet classifier to classify the detected binary segmented lesions into benign or malignant. The proposed semantic based CNN model, RU-Net, has the basic architecture of the U-Net model, which extracts contextual information combining low-level feature with high-level ones. We have modified the U-Net structure by adding residual attention modules in order to preserve the spatial and context information, help the network have deeper architecture, and handles the gradient vanishing problem. We compared the performance of the proposed RU-Net model with those of state-of-the-art two semantic segmentation models, and two object detectors using public databases. We also examined the effect of the breast density on the accuracy of localizing and segmenting the breast masses. Our proposed model shows superior performance compared to the other DL methods in detecting and segmenting masses, especially for heterogeneously dense and dense MG images, in terms of intersection over union (IOU) and the Dice index coefficient (DI). Moreover, our results show that the cascaded ResNet model, trained using binary-scale images, classify the masses to benign or malignant with higher accuracy compared to the ResNet model that is trained on gray-scale images.
- Dina Abdelhafiz, Sheida Nabavi, Reda Ammar, and Clifford Yang. 2017. Survey on deep convolutional neural networks in mammography. In 2017 IEEE 7th International Conference on Computational Advances in Bio and Medical Sciences (ICCABS). IEEE, 1--1.Google Scholar
Cross Ref
- Dina Abdelhafiz, Sheida Nabavi, Reda Ammar, and Clifford Yang. 2018. The Effect of Pre-Processing on Breast Cancer Detection Using Convolutional Neural Networks. Poster session presented at the meeting of the IEEE International Symposium on Biomedical Imaging,Washington, DC (2018).Google Scholar
- Dina Abdelhafiz, Sheida Nabavi, Reda Ammar, Clifford Yang, and Jinbo Bi. 2018. Convolutional Neural Network for Automated Mass Segmentation in Mammography. In 2018 IEEE 8th International Conference on Computational Advances in Bio and Medical Sciences (ICCABS). IEEE, 1--1.Google Scholar
- Dina Abdelhafiz, Clifford Yang, Reda Ammar, and Sheida Nabavi. 2019. Deep convolutional neural networks for mammography: advances, challenges and applications. BMC Bioinformatics 20, 11 (06 Jun 2019), 281.Google Scholar
- Mugahed A Al-antari, Mohammed A Al-masni, Mun-Taek Choi, Seung-Moo Han, and Tae-Seong Kim. 2018. A fully integrated computer-aided diagnosis system for digital X-ray mammograms via deep learning detection, segmentation, and classification. International Journal of Medical Informatics 117 (2018), 44--54.Google ScholarCross Ref
- Mohammed A Al-masni, Mugahed A Al-antari, JM Park, Geon Gi, Tae-Yeon Kim, Patricio Rivera, Edwin Valarezo, S-M Han, and T-S Kim. 2017. Detection and classification of the breast abnormalities in digital mammograms via regional convolutional neural network. In 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 1230--1233.Google Scholar
- Mohammed A Al-masni, Mugahed A Al-antari, Jeong-Min Park, Geon Gi, TaeYeon Kim, Patricio Rivera, Edwin Valarezo, Mun-Taek Choi, Seung-Moo Han, and Tae-Seong Kim. 2018. Simultaneous detection and classification of breast masses in digital mammograms via a deep learning YOLO-based CAD system. Computer methods and programs in biomedicine 157 (2018), 85--94.Google Scholar
- Vijay Badrinarayanan, Alex Kendall, and Roberto Cipolla. 2015. Segnet: A deep convolutional encoder-decoder architecture for image segmentation. arXiv preprint arXiv:1511.00561 (2015).Google Scholar
- Corinne Balleyguier, Salma Ayadi, Kim Van Nguyen, Daniel Vanel, Clarisse Dromain, and Robert Sigal. 2007. BIRADS classification in mammography. European journal of radiology 61, 2 (2007), 192--194.Google Scholar
- Antonio Cardoso, Jaime Cardoso, Maria Jo?o Cardoso, Ines Moreira, Igor Amaral, and In's Campos Domingues. 2012. INbreast: Towards a Full Field Digital Mammographic Database. (2012).Google Scholar
- Yoni Choukroun, Ran Bakalo, Rami Ben-Ari, Ayelet Akselrod-Ballin, Ella Barkan, and Pavel Kisilev. 2017. Mammogram Classification and Abnormality Detection from Nonlocal Labels using Deep Multiple Instance Neural Network. (2017).Google Scholar
- Alberto Garcia-Garcia, Sergio Orts-Escolano, Sergiu Oprea, Victor VillenaMartinez, Pablo Martinez-Gonzalez, and Jose Garcia-Rodriguez. 2018. A survey on deep learning techniques for image and video semantic segmentation. Applied Soft Computing 70 (2018), 41--65.Google ScholarCross Ref
- M Jayesh George and S Perumal Sankar. 2017. Efficient preprocessing filters and mass segmentation techniques for mammogram images. In 2017 IEEE International Conference on Circuits and Systems (ICCS). IEEE, 408--413.Google ScholarCross Ref
- Ross Girshick. 2015. Fast r-cnn. In Proceedings of the IEEE international conference on computer vision. 1440--1448. Google ScholarDigital Library
- Kaiming He, Georgia Gkioxari, Piotr Dollár, and Ross Girshick. 2017. Mask r-cnn. In Computer Vision (ICCV), 2017 IEEE International Conference on. IEEE, 2980--2988.Google ScholarCross Ref
- Kaiming He, Xiangyu Zhang, Shaoqing Ren, and Jian Sun. 2016. Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770--778.Google ScholarCross Ref
- M Heath, K Bowyer, D Kopans, R Moore, and P Kegelmeyer. 2000. The digital database for screening mammography. Digital mammography (2000), 431--434.Google Scholar
- Gao Huang, Yu Sun, Zhuang Liu, Daniel Sedra, and Kilian Q Weinberger. 2016. Deep networks with stochastic depth. In European Conference on Computer Vision. Springer, 646--661.Google ScholarCross Ref
- Sergey Ioffe and Christian Szegedy. 2015. Batch normalization: Accelerating deep network training by reducing internal covariate shift. arXiv preprint arXiv:1502.03167 (2015).Google ScholarDigital Library
- Alex Krizhevsky, Ilya Sutskever, and Geoffrey E Hinton. 2012. Imagenet classification with deep convolutional neural networks. In Advances in neural information processing systems. 1097--1105. Google ScholarDigital Library
- Geert Litjens, Thijs Kooi, Babak Ehteshami Bejnordi, Arnaud Arindra Adiyoso Setio, Francesco Ciompi, Mohsen Ghafoorian, Jeroen AWM van der Laak, Bram Van Ginneken, and Clara I Sánchez. 2017. A survey on deep learning in medical image analysis. Medical image analysis 42 (2017), 60--88.Google Scholar
- MA Guevara Lopez, NG Posada, Daniel C Moura, Raúl Ramos Pollán, José M Franco Valiente, César Suárez Ortega, M Solar, G Diaz-Herrero, IMAP Ramos, J Loureiro, et al. 2012. BCDR: a breast cancer digital repository. In 15th International Conference on Experimental Mechanics.Google Scholar
- Fausto Milletari, Nassir Navab, and Seyed-Ahmad Ahmadi. 2016. V-net: Fully convolutional neural networks for volumetric medical image segmentation. In 2016 Fourth International Conference on 3D Vision (3DV). IEEE, 565--571.Google ScholarCross Ref
- Arnau Oliver, Jordi Freixenet, Joan Marti, Elsa Perez, Josep Pont, Erika RE Denton, and Reyer Zwiggelaar. 2010. A review of automatic mass detection and segmentation in mammographic images. Medical image analysis 14, 2 (2010), 87--110.Google Scholar
- Sinno Jialin Pan and Qiang Yang. 2010. A survey on transfer learning. IEEE Transactions on knowledge and data engineering 22, 10 (2010), 1345--1359. Google ScholarDigital Library
- Stephen M Pizer, R Eugene Johnston, James P Ericksen, Bonnie C Yankaskas, and Keith E Muller. 1990. Contrast-limited adaptive histogram equalization: speed and effectiveness. In {1990} Proceedings of the First Conference on Visualization in Biomedical Computing. IEEE, 337--345.Google Scholar
- Waseem Rawat and Zenghui Wang. 2017. Deep convolutional neural networks for image classification: A comprehensive review. Neural computation 29, 9 (2017), 2352--2449. Google ScholarDigital Library
- Joseph Redmon, Santosh Divvala, Ross Girshick, and Ali Farhadi. 2016. You only look once: Unified, real-time object detection. In Proceedings of the IEEE conference on computer vision and pattern recognition. 779--788.Google ScholarCross Ref
- Reza Reiazi, Reza Paydar, Ali Abbasian Ardakani, and Maryam Etedadialiabadi. {n. d.}. Mammography lesion detection using Faster R-CNN detector. Computer Science & Information Technology ({n. d.}), 111.Google Scholar
- Shaoqing Ren, Kaiming He, Ross Girshick, and Jian Sun. 2017. Faster R-CNN: towards real-time object detection with region proposal networks. IEEE Transactions on Pattern Analysis & Machine Intelligence 6 (2017), 1137--1149. Google ScholarDigital Library
- Dezs Ribli, Anna Horváth, Zsuzsa Unger, Péter Pollner, and István Csabai. 2018. Detecting and classifying lesions in mammograms with Deep Learning. Scientific reports 8, 1 (2018), 4165.Google Scholar
- Olaf Ronneberger, Philipp Fischer, and Thomas Brox. 2015. U-net: Convolutional networks for biomedical image segmentation. In International Conference on Medical image computing and computer-assisted intervention. Springer, 234--241.Google ScholarCross Ref
- Nitish Srivastava, Geoffrey Hinton, Alex Krizhevsky, Ilya Sutskever, and Ruslan Salakhutdinov. 2014. Dropout: a simple way to prevent neural networks from overfitting. The Journal of Machine Learning Research 15, 1 (2014), 1929--1958. Google ScholarDigital Library
- Jonas Teuwen, Sil van de Leemput, Albert Gubern-Mérida, Alejandro RodriguezRuiz, Ritse Mann, and Babak Ehteshami Bejnordi. 2018. Soft tissue lesion detection in mammography using deep neural networks for object detection. (2018).Google Scholar
- Fei Wang, Mengqing Jiang, Chen Qian, Shuo Yang, Cheng Li, Honggang Zhang, Xiaogang Wang, and Xiaoou Tang. 2017. Residual attention network for image classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 3156--3164.Google ScholarCross Ref
- Pengcheng Xi, Chang Shu, and Rafik Goubran. 2018. Abnormality Detection in Mammography using Deep Convolutional Neural Networks. arXiv preprint arXiv:1803.01906 (2018).Google Scholar
- Liliang Zhang, Liang Lin, Xiaodan Liang, and Kaiming He. 2016. Is faster r-cnn doing well for pedestrian detection?. In European conference on computer vision. Springer, 443--457.Google ScholarCross Ref
- Wentao Zhu, Xiang Xiang, Trac D Tran, Gregory D Hager, and Xiaohui Xie. 2018. Adversarial deep structured nets for mass segmentation from mammograms. In Biomedical Imaging (ISBI 2018), 2018 IEEE 15th International Symposium on. IEEE, 847--850.Google ScholarCross Ref
- Lian Zou, Shaode Yu, Tiebao Meng, Zhicheng Zhang, Xiaokun Liang, and Yaoqin Xie. 2019. A Technical Review of Convolutional Neural Network-Based Mammographic Breast Cancer Diagnosis. Computational and Mathematical Methods in Medicine 2019 (2019).Google Scholar
Index Terms
- Residual Deep Learning System for Mass Segmentation and Classification in Mammography
Recommendations
Early detection and classification of abnormality in prior mammograms using image-to-image translation and YOLO techniques
Highlights- Early breast cancer diagnosis requires accurate abnormality detection and classification
Abstract Background and ObjectiveComputer-aided-detection (CAD) systems have been developed to assist radiologists on finding suspicious lesions in mammogram. Deep Learning technology have recently succeeded to increase the chance ...
Robust automatic classification of benign and malignant microcalcification and mass in digital mammography
Breast cancer is the most dangerous cancer among women and second mortality among them. Mammography is the efficient methodology used in early finding of breast cancer. However, mammograms requires high amount of skill and there is a possibility of ...
Representation learning for mammography mass lesion classification with convolutional neural networks
HighlightsInnovative representation learning framework for breast cancer lesion classification.A hybrid CNN method to learn image-based features in a supervised way.New breast cancer benchmarking dataset to support computer-aided diagnosis methods. ...
Comments