Skip to main content

A Neural Markovian Multiresolution Image Labeling Algorithm

  • Conference paper
  • First Online:
Intelligent Computing (SAI 2020)

Part of the book series: Advances in Intelligent Systems and Computing ((AISC,volume 1229))

Included in the following conference series:

  • 731 Accesses

Abstract

This paper describes the results of formally evaluating the MCV (Markov concurrent vision) image labeling algorithm which is a (semi-) hierarchical algorithm commencing with a partition made up of single pixel regions and merging regions or subsets of regions using a Markov random field (MRF) image model. It is an example of a general approach to computer vision called concurrent vision in which the operations of image segmentation and image classification are carried out concurrently. While many image labeling algorithms output a single partition, or segmentation, the MCV algorithm outputs a sequence of partitions and this more elaborate structure may provide information that is valuable for higher level vision systems. With certain types of MRF the component of the system for image evaluation can be implemented as a hardwired feed forward neural network. While being applicable to images (i.e. 2D signals), the algorithm is equally applicable to 1D signals (e.g. speech) or 3D signals (e.g. video sequences) (though its performance in such domains remains to be tested). The algorithm is assessed using subjective and objective criteria with very good results.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Mashford, J.S.: A method for the development of parallel concurrent machine vision systems. In: Proceedings of ICCIMA 1998 (International Conference on Computational Intelligence and Multimedia Applications 1998), pp. 378–383.World Scientific (1998)

    Google Scholar 

  2. Mashford, J.S., Dai, W., Drogemuller, R., Marksjö, B.: Image classifier and scene understanding systems of multi-agent teams. In: Proceedings of 2000 IEEE International Conference on Systems, Man and Cybernetics, Nashville, Tennessee, USA, 1460-146 (2000)

    Google Scholar 

  3. Mashford, J.S.: A neural Markovian concurrent vision system for object identification and tracking. In: Proceedings of the 2004 International Conference on Computational Intelligence for Modelling, Control and Automation. Gold Coast, Australia (2004)

    Google Scholar 

  4. Mashford, J.: Image segmentation using the MCV image labeling algorithm. In: Proceedings of the International Conference on Image Processing, Computer Vision and Pattern Recognition, Las Vegas, pp. 728–732 (2013)

    Google Scholar 

  5. Mashford, J., Lipkin, F., Olie, C., Cuchennec, M., Song, Y.: Automatic interpretation of remotely sensed images for urban form assessment. In: International Conference on Image Analysis and Recognition ICIAR 2014, Portugal. Lecture Notes in Computer Science, vol. 8814, pp. 441–449. Springer (2014)

    Google Scholar 

  6. Li, S.Z.: Markov Random Field Modelling in Image Analysis. Springer, London (2001)

    Book  Google Scholar 

  7. Zhang, Y., Hartley, R., Mashford, J., Burn, S.: Superpixels via pseudo-boolean optimization. In: Proceedings of IEEE International Conference on Computer Vision, Barcelona, Spain, pp. 1387–1394 (2011)

    Google Scholar 

  8. Panjwani, D.K., Healy, G.: Markov random field models for unsupervised segmentation of textured color images. IEEE Trans. Pattern Anal. Mach. Intell. 17(10), 939–954 (1995)

    Article  Google Scholar 

  9. Wilson, R., Li, C.-T.: A class of discrete multiresolution random fields and its application to image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 25(1), 42–56 (2002)

    Article  Google Scholar 

  10. Kato, Z., Pong, T.-C.: A Markov random field image segmentation model for color textured images. Image Vis. Comput. 24, 1103–1114 (2006)

    Article  Google Scholar 

  11. Sharon, E., Galun, M., Sharon, D., Basri, R., Brandt, A.: Hierarchy and adaptivity in segmenting visual scenes. Nature 442, 810–813 (2006)

    Article  Google Scholar 

  12. Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings of 8th International Conference on Computer Vision, vol. 2, pp. 416–423 (2001)

    Google Scholar 

  13. Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Süsstruck, S.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2281 (2012)

    Article  Google Scholar 

  14. Unnikrishnan, R., Pantofaru, C., Herbert, M.: Toward objective evaluation of image segmentation algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 29(6), 929–944 (2007)

    Article  Google Scholar 

  15. Meilǎ, M.: Comparing clusterings - an information based distance. J. Multivar. Anal. 98, 873–895 (2007)

    Article  MathSciNet  Google Scholar 

  16. Xie, S., Tu, Z.: Holistically-nested edge detection. Int. J. Comput. Vis. 125(1–3), 3–18 (2017)

    Article  MathSciNet  Google Scholar 

  17. Shi, J., Malik, J.: Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22, 888–905 (2000)

    Article  Google Scholar 

  18. Cour, T., Benezit, F., Shi, J.: Spectral segmentation with multiscale graph decomposition. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1124–1131 (2005)

    Google Scholar 

  19. Li, Z., Wu , X.-M., Chang, S.-F.: Segmentation using superpixels: a bipartite graph partitioning approach. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 789–796 (2012)

    Google Scholar 

  20. Zhou, Y., Bai, X., Liu, W., Latecki, L.J.: Fusion with diffusion for robust visual tracking. In: Advances in Neural Information Processing System, pp. 2978–2986 (2012)

    Google Scholar 

  21. Wang, J., Jia, Y., Hua, X.-S., Zhang, C., Quan, L.: Normalized tree partitioning for image segmentation. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)

    Google Scholar 

  22. Liang, B., Zhang, J.: KmsGC: an unsupervised color image segmentation algorithm based on means clustering and graph cut. Math. Probl. Eng. 2014, 1–13 (2014)

    Google Scholar 

  23. Wang, X., Tang, Y., Masnou, S., Chen, L.: A global/local affinity graph for image segmentation. IEEE Trans. Image Process. 24, 1399–1411 (2015)

    Article  MathSciNet  Google Scholar 

  24. Yang, A.Y., Wright, J., Ma, Y., Sastry, S.S.: Unsupervised segmentation of natural images via lossy data compression. Comput. Vis. Image Underst. 110, 212–225 (2008)

    Article  Google Scholar 

  25. Mobahi, H., Rao, S.R., Yang, A.Y., Sastry, S.S., Ma, Y.: Segmentation of natural images by texture and boundary compression. Int. J. Comput. Vis. 95, 86–98 (2011)

    Article  Google Scholar 

  26. Yin, S., Qian, Y., Gong, M.: Unsupervised hierarchical image segmentation through fuzzy entropy maximization. Pattern Recogn. 68, 245–259 (2017)

    Article  Google Scholar 

Download references

Acknowledgments

The work described in this paper was partially funded by the Commonwealth Scientific and Industrial Research Organisation (CSIRO, Australia). Also the authors would like to thank Mike Rahilly, Lachlan McAlpine and Geoff Bryan for help with this work.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to John Mashford .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Mashford, J., Lane, B., Ciesielski, V., Lipkin, F. (2020). A Neural Markovian Multiresolution Image Labeling Algorithm. In: Arai, K., Kapoor, S., Bhatia, R. (eds) Intelligent Computing. SAI 2020. Advances in Intelligent Systems and Computing, vol 1229. Springer, Cham. https://doi.org/10.1007/978-3-030-52246-9_27

Download citation

Publish with us

Policies and ethics