Abstract
This paper describes the results of formally evaluating the MCV (Markov concurrent vision) image labeling algorithm which is a (semi-) hierarchical algorithm commencing with a partition made up of single pixel regions and merging regions or subsets of regions using a Markov random field (MRF) image model. It is an example of a general approach to computer vision called concurrent vision in which the operations of image segmentation and image classification are carried out concurrently. While many image labeling algorithms output a single partition, or segmentation, the MCV algorithm outputs a sequence of partitions and this more elaborate structure may provide information that is valuable for higher level vision systems. With certain types of MRF the component of the system for image evaluation can be implemented as a hardwired feed forward neural network. While being applicable to images (i.e. 2D signals), the algorithm is equally applicable to 1D signals (e.g. speech) or 3D signals (e.g. video sequences) (though its performance in such domains remains to be tested). The algorithm is assessed using subjective and objective criteria with very good results.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Mashford, J.S.: A method for the development of parallel concurrent machine vision systems. In: Proceedings of ICCIMA 1998 (International Conference on Computational Intelligence and Multimedia Applications 1998), pp. 378–383.World Scientific (1998)
Mashford, J.S., Dai, W., Drogemuller, R., Marksjö, B.: Image classifier and scene understanding systems of multi-agent teams. In: Proceedings of 2000 IEEE International Conference on Systems, Man and Cybernetics, Nashville, Tennessee, USA, 1460-146 (2000)
Mashford, J.S.: A neural Markovian concurrent vision system for object identification and tracking. In: Proceedings of the 2004 International Conference on Computational Intelligence for Modelling, Control and Automation. Gold Coast, Australia (2004)
Mashford, J.: Image segmentation using the MCV image labeling algorithm. In: Proceedings of the International Conference on Image Processing, Computer Vision and Pattern Recognition, Las Vegas, pp. 728–732 (2013)
Mashford, J., Lipkin, F., Olie, C., Cuchennec, M., Song, Y.: Automatic interpretation of remotely sensed images for urban form assessment. In: International Conference on Image Analysis and Recognition ICIAR 2014, Portugal. Lecture Notes in Computer Science, vol. 8814, pp. 441–449. Springer (2014)
Li, S.Z.: Markov Random Field Modelling in Image Analysis. Springer, London (2001)
Zhang, Y., Hartley, R., Mashford, J., Burn, S.: Superpixels via pseudo-boolean optimization. In: Proceedings of IEEE International Conference on Computer Vision, Barcelona, Spain, pp. 1387–1394 (2011)
Panjwani, D.K., Healy, G.: Markov random field models for unsupervised segmentation of textured color images. IEEE Trans. Pattern Anal. Mach. Intell. 17(10), 939–954 (1995)
Wilson, R., Li, C.-T.: A class of discrete multiresolution random fields and its application to image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 25(1), 42–56 (2002)
Kato, Z., Pong, T.-C.: A Markov random field image segmentation model for color textured images. Image Vis. Comput. 24, 1103–1114 (2006)
Sharon, E., Galun, M., Sharon, D., Basri, R., Brandt, A.: Hierarchy and adaptivity in segmenting visual scenes. Nature 442, 810–813 (2006)
Martin, D., Fowlkes, C., Tal, D., Malik, J.: A database of human segmented natural images and its application to evaluating segmentation algorithms and measuring ecological statistics. In: Proceedings of 8th International Conference on Computer Vision, vol. 2, pp. 416–423 (2001)
Achanta, R., Shaji, A., Smith, K., Lucchi, A., Fua, P., Süsstruck, S.: SLIC superpixels compared to state-of-the-art superpixel methods. IEEE Trans. Pattern Anal. Mach. Intell. 34(11), 2274–2281 (2012)
Unnikrishnan, R., Pantofaru, C., Herbert, M.: Toward objective evaluation of image segmentation algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 29(6), 929–944 (2007)
Meilǎ, M.: Comparing clusterings - an information based distance. J. Multivar. Anal. 98, 873–895 (2007)
Xie, S., Tu, Z.: Holistically-nested edge detection. Int. J. Comput. Vis. 125(1–3), 3–18 (2017)
Shi, J., Malik, J.: Normalized cuts and image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 22, 888–905 (2000)
Cour, T., Benezit, F., Shi, J.: Spectral segmentation with multiscale graph decomposition. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1124–1131 (2005)
Li, Z., Wu , X.-M., Chang, S.-F.: Segmentation using superpixels: a bipartite graph partitioning approach. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 789–796 (2012)
Zhou, Y., Bai, X., Liu, W., Latecki, L.J.: Fusion with diffusion for robust visual tracking. In: Advances in Neural Information Processing System, pp. 2978–2986 (2012)
Wang, J., Jia, Y., Hua, X.-S., Zhang, C., Quan, L.: Normalized tree partitioning for image segmentation. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
Liang, B., Zhang, J.: KmsGC: an unsupervised color image segmentation algorithm based on means clustering and graph cut. Math. Probl. Eng. 2014, 1–13 (2014)
Wang, X., Tang, Y., Masnou, S., Chen, L.: A global/local affinity graph for image segmentation. IEEE Trans. Image Process. 24, 1399–1411 (2015)
Yang, A.Y., Wright, J., Ma, Y., Sastry, S.S.: Unsupervised segmentation of natural images via lossy data compression. Comput. Vis. Image Underst. 110, 212–225 (2008)
Mobahi, H., Rao, S.R., Yang, A.Y., Sastry, S.S., Ma, Y.: Segmentation of natural images by texture and boundary compression. Int. J. Comput. Vis. 95, 86–98 (2011)
Yin, S., Qian, Y., Gong, M.: Unsupervised hierarchical image segmentation through fuzzy entropy maximization. Pattern Recogn. 68, 245–259 (2017)
Acknowledgments
The work described in this paper was partially funded by the Commonwealth Scientific and Industrial Research Organisation (CSIRO, Australia). Also the authors would like to thank Mike Rahilly, Lachlan McAlpine and Geoff Bryan for help with this work.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2020 Springer Nature Switzerland AG
About this paper
Cite this paper
Mashford, J., Lane, B., Ciesielski, V., Lipkin, F. (2020). A Neural Markovian Multiresolution Image Labeling Algorithm. In: Arai, K., Kapoor, S., Bhatia, R. (eds) Intelligent Computing. SAI 2020. Advances in Intelligent Systems and Computing, vol 1229. Springer, Cham. https://doi.org/10.1007/978-3-030-52246-9_27
Download citation
DOI: https://doi.org/10.1007/978-3-030-52246-9_27
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-030-52245-2
Online ISBN: 978-3-030-52246-9
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)