Xin-Jing Wang
Wei-Ying Ma
Gui-Rong Xue
ABSTRACT
In this paper, we propose an iterative similarity propagation approach to explore the inter-relationships between Web images and their textual annotations for image retrieval. By considering Web images as one type of objects, their surrounding texts as another type, and constructing the links structure between them via webpage analysis, we can iteratively reinforce the similarities between images. The basic idea is that if two objects of the same type are both related to one object of another type, these two objects are similar; likewise, if two objects of the same type are related to two different, but similar objects of another type, then to some extent, these two objects are also similar. The goal of our method is to fully exploit the mutual reinforcement between images and their textual annotations. Our experiments based on 10,628 images crawled from the Web show that our proposed approach can significantly improve Web image retrieval performance.
- Antonini, M., Barlaud, M., Mathieu, P., and Daubchies, I., Image Coding Using Wavelet Transform, IEEE Trans. on Image Processing. 1(2). (Apr. 1992). 205--220.Google Scholar
Digital Library
- Barnard, K., Forsyth, D. Learning the Semantic of Words and Pictures. ICCV (2001).Google Scholar
- Barnard, K., Duygulu, P., and Forsyth, D. Clustering Art. CVPR (2001), 434--439Google Scholar
- Blei, D.M., and Jordan, M.I. Modeling Annotated Data. SIGIR (2003). Google ScholarDigital Library
- Cai, D., Yu, S.P., Wen, J.R., and W.-Y. Ma, Extracting Content Structure for Web Pages Based on Visual Representation, APWeb (2003), 406--417 Google ScholarDigital Library
- Cai, D., Yu, S.P., Wen, J.R., and W.-Y. Ma, VIPS: a Vision-Based Page Segmentation Algorithm, Microsoft Technical Report (2003), MSR-TR-2003-79Google Scholar
- Cascia, M.L., Sethi, S., and Sclaroff, S. Combining Textual and Visual Cues for Content-based Image Retrieval on the World Wide Web. Proc. IEEE Workshop on Content-Based Access of Image and Video Libraries, (1998) Google ScholarDigital Library
- Chen, Z., Liu, W.Y., Zhang, F., Li, M.J. and Zhang, H.J. Web Mining for Web Image Retrieval, Journal of the American Society for Information Science and Technology, 52(10), (2001), 831--839. Google ScholarDigital Library
- Duffing, G. Text-Image Interaction for Image Retrieval and Semi-Automatic Indexing. 20th Annual BCS-IRSG Colloquium on IR, (1998) Google ScholarDigital Library
- Gibson, D., Kleinberg, J., and Paghavan, P. Inferring Web Communities From Link Topology. In Proc. 9th ACM Conference on Hypertext and Hypermedia, (1998), 225--234 Google ScholarDigital Library
- Huang, J., Kumar, S.R., Mitra, M., Zhu, W.J. and Zabih R. Image Indexing Using Color Correlograms, In Proc. IEEE Conference on CVPR., (1997) 762--768 Google ScholarDigital Library
- Kandola, J., Shawe-Taylor, J., Cristianini, N. Learning Semantic Similarity. NIPS (2002)Google Scholar
- Kleinberg, J. Authoritative Sources in a Hyperlinked Environment. In Proc. of the 9th ACM-SIAM Symposium on Discrete Algorithms, (1998) Google ScholarDigital Library
- Neville, J., and Jensen, D. Iterative Classification in Relational Data. Proceedings of the AAAI 2000 Workshop, AAAI Press. (2000). 42--49.Google Scholar
- Salton, G., and Buckley, C. Term Weighting Approaches in Automatic Text Retrieval. Information Processing and Management, 24(5). (1988). 513--523. Google ScholarDigital Library
- Slattery, S., and Craven, M. Combining Statistical and Relational Methods in Hypertext Domains, In Proc. ILP. (1998) Google ScholarDigital Library
- Srihari, R.K., Rao, A.B., Han, B., Munirathnam, S., and Wu, X.Y. A Model For Multimodal Information Retrieval. ICME (2000)/.Google Scholar
- Stricker, M., and Orengo, M. Similarity of Color Images, In Storage and Retrieval for Image and Video Databases III, SPIE 2420, (Feb. 1995), 381--392Google Scholar
- Wang, J.D., Zeng, H.J., Chen Z., Lu, H.J., Tao, L., and Ma, W.Y. ReCoM: Reinforcement Clustering of Multi-Type Interrelated Data Objects. SIGIR (2003). Google ScholarDigital Library
- Westerveld, T. Probabilistic Multimedia Retrieval. SIGIR (2002) Google ScholarDigital Library
- Xue, G.R., Zeng, H.J., Chen Z., Ma, W.Y., and Yu Y. Similarity Spreading: A Unified Framework for Similarity Calculation of Interrelated Objects. WWW (2004) Google ScholarDigital Library
- Zhou, X.S., and Huang T.S. Unifying Keywords and Visual Contents in Image Retrieval. IEEE MultiMedia 9(2) (2002), 23--33. Google ScholarDigital Library
Index Terms
- Multi-model similarity propagation and its application for web image retrieval
Recommendations
Web Image Retrieval Re-Ranking with Relevance Model
WI '03: Proceedings of the 2003 IEEE/WIC International Conference on Web IntelligenceWeb image retrieval is a challenging task that requires efforts from image processing, link structure analysis, and web text retrieval. Since content-based image retrieval is still considered very difficult, most current large-scale web image search ...
Region-based semantic similarity propagation for image retrieval
PCM'06: Proceedings of the 7th Pacific Rim conference on Advances in Multimedia Information ProcessingIn order to reduce the gap between low-level image features and high-level image semantics, various long term learning strategies were integrated into content-based image retrieval system. The strategies always use the semantic relationships among ...
Image Retrieval System for Web: Webscope-CBIR
DEXA '00: Proceedings of the 11th International Workshop on Database and Expert Systems ApplicationsWith the widespread usage of images on Web, the retrieval need for images has been increasing rapidly. But traditional text retrieval system is not fit for the application of image retrieval. We therefore designed Webscope-CBIR, an image retrieval ...
Comments