Oge Marques
Liam M. Mayron
Gustavo B. Borba
ABSTRACT
Recent research on computational modeling of visual attention has demonstrated that a bottom-up approach to identifying salient regions within an image can be applied to diverse and practical problems for which conventional machine vision techniques have not succeeded in producing robust solutions. This paper proposes a new method for extracting regions of interest (ROIs) from images using models of visual attention. It is presented in the context of improving content-based image retrieval (CBIR) solutions by implementing a biologically-motivated, unsupervised technique of grouping together images whose salient ROIs are perceptually similar. In this paper we focus on the process of extracting the salient regions of an image. The excellent results obtained with the proposed method have demonstrated that the ROIs of the images can be independently indexed for comparison against other regions on the basis of similarity for use in a CBIR solution.
- R. Baeza-Yates and B. Ribeiro-Neto. Modern Information Retrieval. Addison-Wesley/ACM Press, New York, 1999. Google Scholar
Digital Library
- A. Bamidele, F. W. M. Stentiford, and J. Morphett. An attention-based approach to content based image retrieval. British Telecommunications Advanced Research Technology Journal on Intelligent Spaces (Pervasive Computing), 22(3), July 2004. Google ScholarDigital Library
- C. Carson, S. Belongie, H. Greenspan, and J. Malik. Blobworld: Image segmentation using expectation-maximization and its application to image querying. IEEE Transactions on Pattern Analysis and Machine Intelligence, 24(8):1026--1038, Aug. 2002. Google ScholarDigital Library
- E. Y. Chang, K.-T. Cheng, W.-C. Lai, C.-T. Wu, C. Chang, and Y.-L. Wu. PBIR: perception-based image retrieval-a system that can quickly capture subjective image query concepts. In ACM Multimedia, pages 611--614, 2001. Google ScholarDigital Library
- C. Colombo and A. Del Bimbo. Visible image retrieval. In V. Castelli and L. D. Bergman, editors, Image Databases: Search and Retrieval of Digital Imagery, chapter 2, pages 11--33. John Wiley & Sons, Inc., New York, NY, USA, 2002.Google Scholar
- B. Draper, K. Baek, and J. Boody. Implementing the expert object recognition pathway. In International Conference on Vision Systems, Graz, Austria, 2003.Google ScholarCross Ref
- D. Hoiem, R. Sukthankar, H. Schneiderman, and L. Huston. Object-based image retrieval using the statistical structure of images. In CVPR (2), pages 490--497, 2004. Google ScholarDigital Library
- L. Itti. Models of Bottom-Up and Top-Down Visual Attention. PhD thesis, California Institute of Technology, Pasadena, California, Jan 2000. Google ScholarDigital Library
- L. Itti, C. Gold, and C. Koch. Visual attention and target detection in cluttered natural scenes. Optical Engineering, 40(9):1784--1793, Sep 2001.Google ScholarCross Ref
- L. Itti and C. Koch. A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research, 40(10-12):1489--1506, May 2000.Google ScholarCross Ref
- L. Itti and C. Koch. Computational modeling of visual attention. Nature Reviews Neuroscience, 2(3):194--203, Mar 2001.Google ScholarCross Ref
- L. Itti and C. Koch. Feature combination strategies for saliency-based visual attention systems. Journal of Electronic Imaging, 10(1):161--169, Jan 2001.Google ScholarCross Ref
- L. Itti, C. Koch, and E. Niebur. A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(11):1254--1259, Nov 1998. Google ScholarDigital Library
- Y. Li and L. Shapiro. Object recognition for content-based image retrieval. http://www.cs.washington.edu/homes/shapiro/dagstuhl3.pdf.Google Scholar
- W. Y. Ma and B. S. Manjunath. Netra: a toolbox for navigating large image databases. Multimedia Systems, 7(3):184--198, May 1999. Google ScholarDigital Library
- O. Marques and N. Barman. Semi-automatic semantic annotation of images using machine learning techniques. In International Semantic Web Conference, pages 550--565, 2003.Google ScholarDigital Library
- O. Marques and B. Furht. MUSE: A content-based image search and retrieval system using relevance feedback. Multimedia Tools and Applications, 17(1):21--50, 2002. Google ScholarDigital Library
- O. Marques, L. M. Mayron, H. R. Gamba, and G. B. Borba. An attention-driven model for grouping similar images with image retrieval applications. Eurasip Journal on Applied Signal Processing (submitted). Google ScholarDigital Library
- V. Navalpakkam and L. Itti. Modeling the influence of task on attention. Vision Research, 45(2):205--231, Jan 2005.Google ScholarCross Ref
- D. Noton and L. Stark. Scanpaths in Eye Movements during Pattern Perception. Science, 171:308--311, Jan. 1971.Google ScholarCross Ref
- A. Oliva. Gist of a scene. In L. Itti, G. Rees, and J. Tsotsos, editors, Neurobiology of Attention, chapter 41. Academic Press, Elsevier, 2005.Google Scholar
- Y. Rui, T. S. Huang, and S.-F. Chang. Image retrieval: current techniques, promising directions and open issues. Journal of Visual Communication and Image Representation, 10:39--62, Mar. 1999.Google ScholarDigital Library
- U. Rutishauser, D. Walther, C. Koch, and P. Perona. Is bottom-up attention useful for object recognition. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 11--37, 2004. Google ScholarDigital Library
- A. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(12):1349--1380, Dec. 2000. Google ScholarDigital Library
- F. Stentiford. An attention based similarity measure with application to content based information retrieval. In Proceedings of the Storage and Retrieval for Media Databases conference, SPIE Electronic Imaging, Santa Clara, CA, 2003.Google ScholarCross Ref
- Y. Tao and W. I. Grosky. Image matching using the OBIR system with feature point histograms. In VDB, pages 192--197, 1998. Google ScholarDigital Library
- D. Walther, L. Itti, M. Riesenhuber, T. Poggio, and C. Koch. Attentional selection for object recognition - a gentle way. In Lecture Notes in Computer Science, volume 2525, pages 472--479, Nov 2002. Google ScholarDigital Library
Index Terms
- Using visual attention to extract regions of interest in the context of image retrieval
Recommendations
Content-based image retrieval using computational visual attention model
It is a very challenging problem to well simulate visual attention mechanisms for content-based image retrieval. In this paper, we propose a novel computational visual attention model, namely saliency structure model, for content-based image retrieval. ...
A Model of Visual Attention for Natural Image Retrieval
ISCC-C '13: Proceedings of the 2013 International Conference on Information Science and Cloud Computing CompanionIn this paper, saliency textons model is proposed to encode color, orientation and saliency cue and spatial information as image features for CBIR, where the image representation is so called saliency textons histogram. Experimental results indicate ...
Content-based image retrieval using local visual attention feature
Content-based image retrieval (CBIR) has been an active research topic in the last decade. As one of the promising approaches, salient point based image retrieval has attracted many researchers. However, the related work is usually very time consuming, ...
Comments