Elsevier

Neurocomputing

Volume 116, 20 September 2013, Pages 62-75
Neurocomputing

Three-dimensional virtual colonoscopy for automatic polyps detection by artificial neural network approach: New tests on an enlarged cohort of polyps

https://doi.org/10.1016/j.neucom.2012.03.026Get rights and content

Abstract

Introduction and objective

In computer aided diagnosis (CAD) tools searching for colonrectal polyps and based on three dimensions virtual colonoscopy (3DVC) using computed tomography (CT) images, the reduction of the occurrence of false-positives (FPs) still represents a challenge because they are source of unreliability. Following an encouraging previous supervised approach Bevilacqua et al., Three-dimensional Virtual Colonoscopy for Polyps Detection by Supervised Artificial Neural Networks D.-S. Huang et al. (Eds.): ICIC, LNBI 6840, Springer-Verlag, Berlin Heidelberg, (2011), pp. 596–603, the aim of this work is to discuss, in details, how the adopted strategies, designed and tested on an initial reduced data set, reveals good performance and robustness in terms of FPs reduction on an enlarged cohort of new cases.

Materials and methods

At the beginning, materials consisted only in 10 different polyps, diagnosed, by expert radiologists, in 6 different patients, scanning 16 rows helical CT multi slices with a resolution of 1 mm. Moreover from those 10 polyps only 7 polyps were initially used for the analysis, excluding 2 tumors with diameter bigger than 1 cm, and one polyp hardly recognizable due to fecal stool. In this paper, thanks to a new accurate phase of collecting data, materials grow impressively and then consist in total of 43 polyps all useful for the study. The whole data set was merged by using the former data set of colonrectal exams from the clinical operative unit called “Sezione di Diagnostica per Immagini” of Di.M.I.M.P. of Policlinico of Bari and the new ones coming from two new collaborations: the Oncology department of Faculty of Medicine of University of Pisa participating, as the former, to the IMPACT study (Italian Multicenter Polyps Accuracy CTC Study) Regge, Linear and nonlinear feedforward neural network classifiers: a comprehensive understanding, J. Intell. Syst., 9 (1) 1999, 1–38 and, more recently, the operative unit of radiology of the “Istituto Tumori Giovanni Paolo II” of Bari. Starting from computed tomography colonography (CTC) images, several volumes were scanned by means of three different supervised artificial neural networks (ANNs) architectures based on error back propagation training algorithm Huang and Ma, Linear and nonlinear feedforward neural network classifiers: a comprehensive understanding, J. Intell. Syst., 9 (1) 1999, 1–38. All the training sets were built by using polyps and non-polyps sub-volume samples, whose dimensions were correlated to the volume of the polyps to be detected.

Results

The performance of the best ANN architecture, trained by using a training set of 27 sessile polyps from the new 43 available dataset, were evaluated in terms of FPs and false-negatives and compared to the results shown in Bevilacqua et al., Three-dimensional Virtual Colonoscopy for Polyps Detection by Supervised Artificial Neural Networks D.-S. Huang et al. (Eds.): ICIC, LNBI 6840, Springer-Verlag, Berlin Heidelberg, (2011), pp. 596–603 where a cross validation strategy was used to overcome the small number of the old available dataset Huang, The bottleneck behaviour in linear feedforward neural network classifiers and their breakthrough, J. Comput. Sci. Technol., 14 (1) 1999, 34–43. Good performances in terms of generalization and robustness of the previous work, are then shown by the fact that the free-response operator characteristic analysis do not change significantly thanks to the enlargement of the available data.

Conclusions

This testing determined that the supervised ANN approach is consistent and reveals good performance; at the same time it is fairly intuitive that it is necessary to train a method by using polyps and non-polyps samples and that, for this reason, the overall performance could be improved by a larger dataset diagnosed by expert radiologists.

Introduction

The colon and rectal cancers are estimated to be the third carcinoma death cause in western countries, where their incidence is still growing. Every year approximately 678.000 new cases are diagnosed in the world and 150.000 in Europe [5]. Although this form of cancer is more curable than other forms of digestive apparatus carcinoma, the possibilities of 5 years surviving from the diagnosis stands at 40–50%, reaching 80–90% in early cases [6]. Polyp is a general term used to describe a benign (non-cancerous) growth on the lining, or inside, of a mucous membrane. This includes mucous membranes that are found in the digestive tract, including the colon, and the nasal passages. Other areas with mucous membranes, such as the mouth, uterus, bladder, and the genital areas can develop polyps as well. If the polyps are attached to the surface by a narrow elongated stalk, they are said to be pedunculated, where if no stalk is present, they are said to be sessile as shown in Fig. 1. Polyps are considered pre-cancerous, which means that they are not cancer, but if left untreated, they may develop into cancer, for this reason statistics show how important is to detect colorectal neoplasia at an early stage in order to ensure the effectiveness of the therapies and reduce the risk of death. Screening programs are, in this perspective, fundamental instruments of diagnosis. A traditionally diffused screening test is optical colonoscopy, performed by inserting an optical fiber probe into the patients intestine; this allows the visualization of the entire colon and the identification and removal of polyps. In most cases, the patient needs to be sedated, thus causing discomfort and a high risk for anesthetic complications, and in any case this is an expensive test and may take more than 1 h.

Computed tomography colonography (CTC), also known as virtual colonoscopy, is instead one of the most recent screening test techniques. It is based on the processing of digital images obtained via computed tomography (CT) scan or magnetic resonance, followed by a virtual reconstruction of the lumen used to navigate the whole colon [7]. This system is attracting the interests of the scientific community mainly because it is non-invasive, consequently not painful, and not hazardous to the patient. Moreover it allows the exploration of the entire colon lumen, even in cases of angles and other obstructions of the organ preventing the use of traditional optical colonoscopy but, therefore, involves specialized imaging software to elaborate volumetric CT data. The aim of this work is to develope a computer-aided diagnosis (CAD) system for CTC that could interact with the 3D reconstruction and rendering of the colon lumen. It refers to the possibility to automatically detect polyps and display them in order to fasten radiologists reviews. Although many CAD architectures have been investigated, the occurrence of false-positives (FPs) is still a problem that can lead to less confidence of behalf of technicians in the system and to the eventuality of non-distinction [8], [9].

Section snippets

Materials

At the beginning of this study [1] the data set available, obtained by using a 16 row helical CT multi slice scanner with a 1 mm resolution, consists initially of 10 volumetric regions diagnosed as polyps by expert radiologists in 6 different patients, and of a number of several regions belonging to the same patients correctly detected as colon folds and then used as samples of non polyps. Then previously, only 7 polyps were useful for the analysis, excluding 2 tumors, with a diameter bigger

Segmentation of volumes of interest

The segmentation is an important task in medical imaging [10] and also for colon segmentation several techniques are proposed in literature: in [11] the image gradient is used to identify colonic walls, since there is a sudden transition from high CT number corresponding to a tissue and lower CT number corresponding to colon lumen. In [12] we reported in details a survey of colon segmentation algorithms that use anatomical information or are based on geometric deformable models and presented

Methods: Polyps detection using three different supervised artificial neural networks (ANNs) architectures

The most well known ANN approaches to this particular CAD problem in literature adopted 2D or 3D techniques designed by using several different architectures. For this reason, a preliminary step to this research consisted in surveying a number of these methods in order to understand how to merge them and obtain the most comprehensive system possible. Many of the commonly detected FPs, often being Haustral folds, residual stool and extracolonic structures such as rectal tubes, share some

Three different supervised artificial neural networks (ANNs) architectures summary

The first method uses a cascade of two ANNs working both with 3D input data with particular attention to the evaluation of the effectiveness of the shape feature for the recognition task. The second method uses a sequence of two ANNs: a 2D one scans CT slices in order to find possible polyps centers, and a 3D one processes the spheres centered where stated by the first ANN, in order to select them with a threshold process and allow an easy final discrimination. For the realization of this

Final results

The first method resulted to be the fastest. A complete scan in fact took, on the same test PC, about 50 min, mostly due to the fact that the second ANN only examined a single image for each volume. However it also returned the worst results, since even though it has been capable of detecting all the polyps in the dataset, it returned also an average number of 25 FPs per exam. It has been then concluded that even though shape information is fundamental to the pattern recognition task, it is

Conclusions

In this paper three different supervised ANNs approaches have been presented for automatic polyp detection in 3D virtual colonoscopy. Unfortunately since now we were able to collect only a small number of polyps for this study; thus, we are limited in explaining from a practical point of view the achieved generalisation about the detection accuracy of our CAD scheme. Anyway both 2D and 3D techniques proved to be efficient and complementary, although trained with a small number of cases; the

Acknowledgments

I would like to thank Prof. Giuseppe Angelelli of the “Sezione di Diagnostica per Immagini”, Policlinico Universitario di Bari, Prof. Emanuele Neri of the Oncology department of the Faculty of Medicine of University of Pisa, and Dr. Carlo Florio of the “Unità Operativa di Radiologia”, Istituto Tumori Giovanni Paolo II di Bari. I also wish to thank all the physicians and technicians working in the previous units for useful discussions.

Vitoantonio Bevilacqua was born in Bari (Italy) in 1969 and obtained both the Bachelor Degree in Electronic Engineering and the Ph.D. in Electrical Engineering from Polytechnic of Bari in 1996 and 2000, respectively. He is currently a Tenured Assistant Professor in Computing Systems at the Department of Electrical and Electronic Engineering of Polytechnic of Bari where he teaches C/C++ Programming, Expert Systems, Medical Informatics and Image Processing. Since 1996 he has been working and

References (25)

  • Z. Wang et al.

    Reduction of false positives by internal features for polyp detection in CT-based virtual colonoscopy

    Med. Phys.

    (2005)
  • D.L. Pham et al.

    Current methods in medical image segmentation

    Annu. Rev. Biomed. Eng.

    (2000)
  • Cited by (25)

    • An innovative neural network framework to classify blood vessels and tubules based on Haralick features evaluated in histological images of kidney biopsy

      2017, Neurocomputing
      Citation Excerpt :

      The classifier was trained using all the 101 features presented previously extracted from a data set randomly divided in three parts: Training Set (50%), Validation Set (30%) and Test Set (20%). An Artificial Neural Network (ANN) is an information processing paradigm that is inspired by the way in which the biological nervous system processes information: ANN have been extensively used to model complex input/output relations for diverse aims, such as classification, control, optimization, estimation in numerous applications fields, such as medical, robotic, manufacturing, transportation, financial and many more [29,17,30]. The key element of the ANN paradigm is the structure of the information processing system, which is composed of a large number of highly interconnected processing elements (neurons) that cooperate to solve specific problems.

    • Discrimination between tumour epithelium and stroma via perception-based features

      2015, Neurocomputing
      Citation Excerpt :

      Computer-assisted classification of tumour epithelium and stroma through digital image processing could be a real possibility to eliminate – or at least reduce – the variability observed among human experts. During the last years, computer-assisted analysis of tissue images has benefited from the steady improvement in imaging technologies as well as from the development of new image descriptors [6–8]. Among them, Local Binary Patterns (LBP) and variants have received a great deal of attention due to their high discrimination capability, ease of implementation and low computational cost [9–11].

    • Employing box plots to build high-dimensional manufacturing models for new products in TFT-LCD plants

      2014, Neurocomputing
      Citation Excerpt :

      This work takes 20 pilot run samples (a new 39″ 4K2K product) with nine processing input factors and 72 output results from the Array process as an example to implement the proposed approach of small data set learning. In this paper, a back-propagation neural network (BPN) is employed to model with the samples, since these kinds of artificial neural networks have been developed in many related applications [9–15] and can deal with multiple output data. Empirically, a neural network can converge to a robust learning model after feeding a fair amount of samples.

    • Artificial neural networks for feedback control of a human elbow hydraulic prosthesis

      2014, Neurocomputing
      Citation Excerpt :

      Hence, in the subsequent section we show how to design an artificial neural network in order to effectively and efficiently compute such an inversion, while keeping a good precision in order to avoid errors propagating through the feedback loop that would worsen the control action. An Artificial Neural Network (ANN) is an information processing paradigm that is inspired by the way in which the biological nervous system processes information: ANN have been extensively used to model complex input/output relations for diverse aims, such as classification, control, optimization, estimation, in numerous applications fields, such as the medical, robotic, manufacturing, transportation, financial sectors and many more [1,2,9,11–16]. The key element of the ANN paradigm is the structure of the information processing system, which is composed of a large number of highly interconnected processing elements (neurons) that cooperate to solve specific problems.

    • Lite-Deep : Improved Auto Encoder-Decoder for Polyp Segmentation

      2021, 2021 8th International Conference on Smart Computing and Communications: Artificial Intelligence, AI Driven Applications for a Smart World, ICSCC 2021
    • Polyps Segmentation using Fuzzy Thresholding in HSV Color Space

      2020, Proceedings of 2020 IEEE-HYDCON International Conference on Engineering in the 4th Industrial Revolution, HYDCON 2020
    View all citing articles on Scopus

    Vitoantonio Bevilacqua was born in Bari (Italy) in 1969 and obtained both the Bachelor Degree in Electronic Engineering and the Ph.D. in Electrical Engineering from Polytechnic of Bari in 1996 and 2000, respectively. He is currently a Tenured Assistant Professor in Computing Systems at the Department of Electrical and Electronic Engineering of Polytechnic of Bari where he teaches C/C++ Programming, Expert Systems, Medical Informatics and Image Processing. Since 1996 he has been working and investigating in the field of computer vision and image processing, neural networks, evolutionary algorithms, and hybrid expert systems. The main applications of his research are in real world, in biometry, in medicine and recently in bioinformatics and systems biology. In 2000 he was involved as Visiting Researcher in an EC funded TMR (Trans-Mobility of Researchers) network (ERB FMRX-CT97-0127) called CAMERA (CAd Modeling Environment from Range Images) and worked in Manchester (UK) in the field of geometric feature extraction and 3D objects reconstruction. He has published more than 70 papers in refereed journals, books, international conferences proceedings and chaired several sessions such as Speech Recognition, Biomedical Informatics, Intelligent Image Processing and Bioinformatics in international conferences.

    He won the Best Paper Award at International Conference on Intelligent Computing held in Shanghai (ICIC 2008), he was Program Chair of ICIC 2009, Publication Chair of ICIC 2010, Tutorial Chair of ICIC 2011 and is Publication Chair of ICIC 2012. On July 2011, he was invited as lecturer at International School on Medical Imaging using Bio-inspired and Soft Computing-Miere (Spain) MIBISOC FP7-PEOPLE-ITN-2008. GA N. 238819-where presented his research on Intelligent Tumors Computer Aided Early Diagnosis and Therapy: Neural network and Genetic Algorithms frameworks.

    Please visit http://www.vitoantoniobevilacqua.it for further activities details.

    View full text