Skip to main content

Advertisement

Log in

Video summarization based tele-endoscopy: a service to efficiently manage visual data generated during wireless capsule endoscopy procedure

  • Mobile Systems
  • Published:
Journal of Medical Systems Aims and scope Submit manuscript

An Erratum to this article was published on 10 September 2014

Abstract

Wireless capsule endoscopy (WCE) has great advantages over traditional endoscopy because it is portable and easy to use. More importantly, WCE combined with mobile computing ensures rapid transmission of diagnostic data to hospitals and enables off-site senior gastroenterologists to offer timely decision making support. However, during this WCE process, video data are produced in huge amounts, but only a limited amount of data is actually useful for diagnosis. The sharing and analysis of this video data becomes a challenging task due the constraints such as limited memory, energy, and communication capability. In order to facilitate efficient WCE data collection and browsing tasks, we present a video summarization-based tele-endoscopy service that estimates the semantically relevant video frames from the perspective of gastroenterologists. For this purpose, image moments, curvature, and multi-scale contrast are computed and are fused to obtain the saliency map of each frame. This saliency map is used to select keyframes. The proposed tele-endoscopy service selects keyframes based on their relevance to the disease diagnosis. This ensures the sending of diagnostically relevant frames to the gastroenterologist instead of sending all the data, thus saving transmission costs and bandwidth. The proposed framework also saves storage costs as well as the precious time of doctors in browsing patient’s information. The qualitative and quantitative results are encouraging and show that the proposed service provides video keyframes to the gastroenterologists without discarding important information.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

Notes

  1. http://www.synmed.co.uk/index.htm

  2. http://www.youtube.com/watch?v=zBYbFQzldtU

References

  1. Jovanov, E., and Milenkovic, A., Body area networks for ubiquitous healthcare applications: opportunities and challenges. J. Med. Syst. 35(5):1245–1254, 2011.

    Article  Google Scholar 

  2. Baig, M. M., and Gholamhosseini, H., Smart health monitoring systems: an overview of design and modeling. J. Med. Syst. 37(2):1–14, 2013.

    Article  Google Scholar 

  3. Ahn, C. H., Choi, J.-W., Beaucage, G., Nevin, J. H., Lee, J.-B., Puntambekar, A., and Lee, J. Y., Disposable smart lab on a chip for point-of-care clinical diagnostics. Proc. IEEE 92(1):154–173, 2004.

    Article  Google Scholar 

  4. Yuce, M. R., Ng, S. W., Myo, N. L., Khan, J. Y., and Liu, W., Wireless body sensor network using medical implant band. J. Med. Syst. 31(6):467–474, 2007.

    Article  Google Scholar 

  5. Karargyris, A., and Bourbakis, N., Wireless capsule endoscopy and endoscopic imaging: A survey on various methodologies presented. Eng Med Biol Mag IEEE 29(1):72–83, 2010.

    Article  Google Scholar 

  6. Nesbitt, T. S., Cole, S. L., Pellegrino, L., and Keast, P., Rural outreach in home telehealth: assessing challenges and reviewing successes. Telemed J E-Health 12(2):107–113, 2006.

    Article  Google Scholar 

  7. Chakraborty, C., Gupta, B., and Ghosh, S. K., A Review on Telemedicine-Based WBAN Framework for Patient Monitoring. Telemed e-Health 19(8):619–626, 2013.

    Article  Google Scholar 

  8. Touati, F., and Tabish, R., U-healthcare system: State-of-the-art review and challenges. J. Med. Syst. 37(3):1–20, 2013.

    Article  Google Scholar 

  9. Lee, H.-G., Choi, M.-K., Shin, B.-S., and Lee, S.-C., Reducing redundancy in wireless capsule endoscopy videos. Comput. Biol. Med. 43(6):670–82, 2013.

    Article  Google Scholar 

  10. Ejaz, N., Mehmood, I., and Wook Baik, S., Efficient visual attention based framework for extracting key frames from videos. Image Communication, Signal Processing, 2012.

    Google Scholar 

  11. Mehmood, I., Ejaz, N., Sajjad, M., and Baik, S. W., Prioritization of brain MRI volumes using medical image perception model and tumor region segmentation. Comput. Biol. Med. 43(10):1471–1483, 2013.

    Article  Google Scholar 

  12. Sajjad, M., Mehmood, I., and Baik, S. W., Sparse Representations-Based Super-Resolution of Key-Frames Extracted from Frames-Sequences Generated by a Visual Sensor Network. Sensors 14(2):3652–3674, 2014.

    Article  Google Scholar 

  13. Li, B., and Meng, M.-H., Tumor recognition in wireless capsule endoscopy images using textural features and SVM-based feature selection. Inform Technol Biomed IEEE Trans 16(3):323–329, 2012.

    Article  Google Scholar 

  14. Pan, G., Yan, G., Qiu, X., and Cui, J., Bleeding detection in wireless capsule endoscopy based on probabilistic neural network. J. Med. Syst. 35(6):1477–1484, 2011.

    Article  Google Scholar 

  15. Chen D, Meng M-H, Wang H, Hu C, Liu Z A novel strategy to label abnormalities for wireless capsule endoscopy frames sequence. In: Information and Automation (ICIA), 2011 I.E. International Conference on, 2011. IEEE, pp 379–383

  16. Sainju, S., Bui, F. M., and Wahid, K. A., Automated bleeding detection in capsule endoscopy videos using statistical features and region growing. J. Med. Syst. 38(4):1–11, 2014.

    Article  Google Scholar 

  17. Kundel, H. L., History of research in medical image perception. J. Am. Coll. Radiol. 3(6):402–408, 2006.

    Article  Google Scholar 

  18. Shapley, R., and Hawken, M. J., Color in the cortex: single-and double-opponent cells. Vis. Res. 51(7):701–717, 2011.

    Article  Google Scholar 

  19. Chen, Y., Lee, J., (2012) A Review of Machine-Vision-Based Analysis of Wireless Capsule Endoscopy Video. Diagnostic and therapeutic endoscopy 2012

  20. Kumar, R., Zhao, Q., Seshamani, S., Mullin, G., Hager, G., and Dassopoulos, T., Assessment of crohn’s disease lesions in wireless capsule endoscopy images. Biomed Eng IEEE Trans 59(2):355–362, 2012.

    Article  Google Scholar 

  21. Li, B., and Meng, M. Q.-H., Computer-based detection of bleeding and ulcer in wireless capsule endoscopy images by chromaticity moments. Comput. Biol. Med. 39(2):141–147, 2009.

    Article  Google Scholar 

  22. Tjoa, M., Krishnan, S., Doraiswami, R., Automated diagnosis for segmentation of colonoscopic images using chromatic features. In: Electrical and Computer Engineering, 2002. IEEE CCECE 2002. Canadian Conference on, 2002. IEEE, pp 1177–1180

  23. Li, B.-P., and Meng, M. Q.-H., Comparison of Several Texture Features for Tumor Detection in CE Images. J. Med. Syst. 36(4):2463–2469, 2012.

    Article  Google Scholar 

  24. Li, B., Meng, M.-H., Zhao, Q., Wireless capsule endoscopy video summary. In: Robotics and Biomimetics (ROBIO), 2010 I.E. International Conference on, 2010. IEEE, pp 454–459

  25. Bashar, M. K., Kitasaka, T., Suenaga, Y., Mekada, Y., and Mori, K., Automatic detection of informative frames from wireless capsule endoscopy images. Med. Image Anal. 14(3):449–470, 2010.

    Article  Google Scholar 

  26. Ioannis, K., Tsevas, S., Maglogiannis, I., Iakovidis DK Enabling distributed summarization of wireless capsule endoscopy video. In: Imaging Systems and Techniques (IST), 2010 I.E. International Conference on, 2010. IEEE, pp 17–21

  27. Iakovidis, D. K., Tsevas, S., and Polydorou, A., Reduction of capsule endoscopy reading times by unsupervised image mining. Comput. Med. Imaging Graph. 34(6):471–478, 2010.

    Article  Google Scholar 

  28. Ma, Y.-F., Hua, X.-S., Lu, L., and Zhang, H.-J., A generic framework of user attention model and its application in video summarization. Multimedia IEEE Trans 7(5):907–919, 2005.

    Article  Google Scholar 

  29. Engel, S., Zhang, X., and Wandell, B., Colour tuning in human visual cortex measured with functional magnetic resonance imaging. Nature 388(6637):68–71, 1997.

    Article  Google Scholar 

  30. Itti, L., Koch, C., and Niebur, E., A model of saliency-based visual attention for rapid scene analysis. Pattern Anal Mach Intell IEEE Trans 20(11):1254–1259, 1998.

    Article  Google Scholar 

  31. Crow, F. C., Summed-area tables for texture mapping. In: ACM SIGGRAPH Computer Graphics, 1984. vol 3. ACM, pp 207–212

  32. Viola, P., Jones, M., Rapid object detection using a boosted cascade of simple features. In: Computer Vision and Pattern Recognition, 2001. CVPR 2001. Proceedings of the 2001 I.E. Computer Society Conference on, 2001. IEEE, pp I-511–I-518 vol. 511

  33. Hu, M.-K., Visual pattern recognition by moment invariants. Inform Theory IRE Trans 8(2):179–187, 1962.

    Article  MATH  Google Scholar 

  34. Murphy, T., Matlin, M., Finkel, L.H., Curvature covariation as a factor in perceptual salience. In: Neural Engineering, 2003. Conference Proceedings. First International IEEE EMBS Conference on, 2003. IEEE, pp 16–19

  35. Hoffman, D. D., and Singh, M., Salience of visual parts. Cognition 63(1):29–78, 1997.

    Article  Google Scholar 

  36. GastroLab http://www.gastrolab.net/.

  37. WCEVideoAtlas http://www.wceatlas.org/index.php.

Download references

Acknowledgments

This research is supported by Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (2013R1A1A2012904).

Author disclosure statement

No competing financial interests exist.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Sung Wook Baik.

Additional information

This article is part of the Topical Collection on Mobile Systems

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mehmood, I., Sajjad, M. & Baik, S.W. Video summarization based tele-endoscopy: a service to efficiently manage visual data generated during wireless capsule endoscopy procedure. J Med Syst 38, 109 (2014). https://doi.org/10.1007/s10916-014-0109-y

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s10916-014-0109-y

Keywords

Navigation