Abstract
We present here SIMPLIcity (Semantics-sensitive Integrated Matching for Picture LIbraries), an image retrieval system using semantics classification and integrated region matching (IRM) based upon image segmentation. The SIMPLIcity system represents an image by a set of regions, roughly corresponding to objects, which are characterized by color, texture, shape, and location. The system classifies images into categories which are intended to distinguish semantically meaningful differences, such as textured versus nontextured, indoor versus outdoor, and graph versus photograph. Retrieval is enhanced by narrowing down the searching range in a database to a particular category and exploiting semantically-adaptive searching methods. A measure for the overall similarity between images, the IRM distance, is defined by a region-matching scheme that integrates properties of all the regions in the images. This overall similarity approach reduces the adverse effect of inaccurate segmentation, helps to clarify the semantics of a particular region, and enables a simple querying interface for region-based image retrieval systems. The application of SIMPLIcity to a database of about 200,000 general-purpose images demonstrates accurate retrieval at high speed. The system is also robust to image alterations.
This work was supported in part by the National Science Foundation’s Digital Libraries initiative. We would like to thank the help of Oscar Firschein and anonymous reviewers. An on-line demonstration is provided at http://www-DB.Stanford.EDU/IMAGE/
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
J. Bigun and J. M. H. du Buf, “N-folded symmetries by complex moments in Gabor space,” IEEE-PAMI, vol. 16, no. 1, pp. 80–87, 1994.
C. Carson, M. Thomas, S. Belongie, J. M. Hellerstein, and J. Malik, “Blobworld: A system for region-based image indexing and retrieval,” Third Int. Conf. on Visual Information Systems, June 1999.
I. Daubechies, Ten Lectures on Wavelets, Capital City Press, 1992.
A. Gupta and R. Jain, “Visual information retrieval,” Comm. Assoc. Comp. Mach., vol. 40, no. 5, pp. 70–79, May 1997.
J. Li, R. M. Gray, “Text and Picture Segmentation by the Distribution Analysis of Wavelet Coeffcients,” Int. Conf. Image Processing, Chicago, Oct. 1998.
J. Li, J. Z. Wang, G. Wiederhold, “Classiffcation of Textured and Non-textured Images Using Region Segmentation,” Int. Conf. Image Processing, Vancouver, Canada, Sept. 2000.
J. Li, J. Z. Wang, G. Wiederhold, “IRM: Integrated Region Matching for Image Retrieval,” ACM Multimedia Conf., Los Angeles, 2000.
W. Y. Ma and B. Manjunath, “NaTra: A toolbox for navigating large image databases,” Proc. IEEE Int. Conf. Image Processing, pp. 568–71, Santa Barbara, 1997.
W. Niblack, R. Barber, W. Equitz, M. Flickner, E. Glasman, D. Petkovic, P. Yanker, C. Faloutsos, and G. Taubin, “The QBIC project: querying images by content using color, texture, and shape,” Proc. SPIE-Int. Soc. Opt. Eng., in Storage and Retrieval for Image and Video Database, vol. 1908, pp. 173–87, 1993.
A. Pentland, R. W. Picard, and S. Sclaroff, “Photobook: Content-based manipulation of image databases,” SPIE Storage and Retrieval Image and Video Databases II, San Jose, 1995.
Y. Rubner, Perceptual Metrics for Image Database Navigation, Ph.D. Dissertation, Computer Science Department, Stanford University, May 1999.
G. Sheikholeslami, W. Chang, and A. Zhang, “Semantic clustering and querying on heterogeneous features for visual data,” ACM Multimedia, pp. 3–12, Bristol, UK, 1998.
J. R. Smith and S.-F. Chang, “Visualseek: A fully automated content-based image query system,” Proc. Int. Conf. Image Processing, Lausanne, Switzerland, 1996.
J. R. Smith and C. S. Li, “Image classi_cation and querying using composite region templates,” Journal of Computer Vision and Image Understanding, vol.75, no.1–2, pp. 165–74, Academic Press, 1999.
M. Szummer and R. W. Picard, “Indoor-outdoor image classification,” Int. Workshop on Content-basedAccess of Image and Video Databases, pp. 42–51, Jan. 1998.
M. Unser, “ Texture classification and segmentation using wavelet frames,” IEEE Trans. Image Processing, vol.4, no. 11, pp. 1549–1560, Nov. 1995.
A. Vailaya, A. Jain, H. J. Zhang, “On image classification: city vs. landscape,” Proceedings IEEE Workshop on Content-Based Access of Image and Video Libraries, pp. 3–8, Santa Barbara, CA, 1 June 1998.
J. Z. Wang, G. Wiederhold, O. Firschein, and X. W. Sha, “Content-based image indexing and searching using Daubechies’ wavelets,” International Journal of Digital Libraries, vol. 1, no. 4, pp. 311–328, 1998.
J. Z. Wang, J. Li, G. Wiederhold, O. Firschein, “System for screening objection-able images,” Computer Communications Journal, vol. 21, no. 15, pp. 1355–60, Elsevier Science, 1998.
J. Z. Wang, M. A. Fischler, “Visual similarity, judgmental certainty and stereo correspondence,” Proceedings of DARPA Image Understanding Workshop, Morgan Kaufiman, Monterey, 1998.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Wang, J.Z., Li, J., Wiederholdy, G. (2000). SIMPLIcity: Semantics-sensitive Integrated Matching for Picture LIbraries. In: Laurini, R. (eds) Advances in Visual Information Systems. VISUAL 2000. Lecture Notes in Computer Science, vol 1929. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-40053-2_32
Download citation
DOI: https://doi.org/10.1007/3-540-40053-2_32
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41177-2
Online ISBN: 978-3-540-40053-0
eBook Packages: Springer Book Archive