Giorgio Giacinto
ABSTRACT
High retrieval precision in content-based image retrieval can be attained by adopting relevance feedback mechanisms. The main difficulties in exploiting relevance information are i) the gap between user perception of similarity and the similarity computed in the feature space used for the representation of image content, and ii) the availability of few training data (users typically label a few dozen of images). At present, SVM are extensively used to learn from relevance feedback due to their capability of effectively tackling the above difficulties. However, the performances of SVM depend on the tuning of a number of parameters. In this paper a different approach based on the nearest neighbor paradigm is proposed. Each image is ranked according to a relevance score depending on nearest-neighbor distances. This approach is proposed both in low-level feature spaces, and in "dissimilarity spaces", where image are represented in terms of their dissimilarities from the set of relevant images. Reported results show that the proposed approach allows recalling a higher percentage of images with respect to SVM-based techniques.
- Aha, DW., Kibler, D., Albert, MK. Instance Based learning Algorithms. Machine Learning 6, 1991, 37--66 Google Scholar
Digital Library
- Althoff, K-D. Case-Based Reasoning. In Chang S. K. (ed.) Handbook on Software Engineering and Knowledge Engineering, World Scientific, 2001, 549--588Google Scholar
- Bhanu, B., Dong, D. Concepts Learning with Fuzzy Clustering and Relevance Feedback. In: Perner, P. (Ed.): Machine Learning and Data Mining in Pattern Recognition. LNAI 2123, Springer-Verlag, Berlin, 2001, 102--116 Google ScholarDigital Library
- Breunig, M., Kriegel, H-P, Ng, R, Sander, J. LOF: indentifying density-based local outliers. In Proc. of the ACM SIGMOD 2000 Int. Conf. on management of data, 2000. Google ScholarDigital Library
- Bruno, E., Loccoz, N., Maillet, S. Learning user queries in multimodal dissimilarity spaces. Proc. of the 3rd Int'l Workshop on Adaptive Multimedia Retrieval, 2005. Google ScholarDigital Library
- Cox, I. J., Miller, M. L., Minka, T. P., Papathomas TV, Yianilos, P. N. The Bayesian image retrieval system, PicHunter: theory, implementation, and psychophysical experiments. IEEE Trans. on Image Processing 9, 2000, 20--37Google ScholarDigital Library
- Dasarathy, D. V. (Ed.) Nearest Neighbor Norms: NN Pattern Classification Techniques. IEEE Press, 2001.Google Scholar
- Del Bimbo, A. Visual Information Retrieval. Morgan Kaufmann Pub. Inc., San Francisco, CA, 1999 Google ScholarDigital Library
- Duda, R. O., Hart, P. E., Stork, D. G. Pattern Classification. John Wiley and Sons, Inc., New York, 2001. Google ScholarDigital Library
- Duin, R. P. W., de Ridder, D., Tax, D. M. J. Experiments with object based discriminant functions: a featureless approach to pattern recognition. Pattern Recognition Letters 18, 1997, 1159--1166 Google ScholarDigital Library
- Frederix, G., Caenen, G., Pauwels, E. J. PARISS: Panoramic, Adaptive and Reconfigurable Interface for Similairty Search. Proc. of ICIP 2000 Intern. Conf. on Image Processing. WA 07.04, vol. III, 2000, 222--225Google Scholar
- Giacinto, G., Roli F. Dissimilarity Representation of Images for Relevance Feedback in Content-Based Image Retrieval. In: Perner P. (Ed.) Machine Learning and Data Mining in Pattern Recognition. LNAI 2734, Springer-Verlag, Berlin, 2003, 202--214Google Scholar
- Giacinto, G, Roli, F. Bayesian Relevance Feedback for Content-Based Image Retrieval. Pattern Recognition 37, 2004, 1499--1508Google ScholarCross Ref
- Giacinto, G., Roli, F. Instance-Based Relevance Feedback for Image Retrieval. In Saul L. K., Weiss Y., and Bottou L.: Advances in Neural Information Processing Systems 17, MIT Press, 2005, 489--496Google Scholar
- Hastie, T., Tibshirani, R., Friedman, J. The elements of statistical learning. Springer, 2001Google ScholarCross Ref
- Ishikawa, Y., Subramanys, R., Faloutsos, C. MindReader: Querying databases through multiple examples. In Proceedings. of the 24th VLDB Conference, 1998, 433--438 Google ScholarDigital Library
- Lew, M. S., Sebe, N., Djeraba, C., Jain, R. Content-Based Multimedia Information Retrieval: State of the Art and Challenges. ACM Trans. On Multimedia Computing, Communications and Applications 2, 2006, 1--19 Google ScholarDigital Library
- Lindenbaum, M., Markovitch, S., Rusakov, D. Selective Sampling for Nearest Neighbor Classifiers, Machine Learning, 54, 2004, 125--152 Google ScholarDigital Library
- McG Squire, D., Müller, W., Müller, H., Pun, T. Content-based query of image databases: inspirations from text retrieval. Pattern Recognition Letters 21, 2000, 1193--1198 Google ScholarDigital Library
- Nguyen, G. P., Worring, M., Smeulders, AWM. Similarity learning via dissimilarity space in CBIR. Proc. of the 8th ACM Int'l workshop on Multimedia Information retrieval, 2006, 107--116 Google ScholarDigital Library
- Ortega, M., Rui, Y., Chakrabarti, K., Porkaew, K., Mehrotra, S., Huang, T. S. Supporting ranked boolean similarity queries in MARS. IEEE Trans. on KDE 10, 1998, 905--925 Google ScholarDigital Library
- Pekalska, E., Duin, RPW. Dissimilarity representations allow for building good classifiers. Pattern Recognition Letters 23, 2002, 943--956 Google ScholarDigital Library
- Pekalska, E., Duin, RPW. The dissimilarity representation for pattern recognition: foundations and applications. World Scientific Publishing, 2005. Google ScholarDigital Library
- Peng, J., Bhanu, B., Qing, S. Probabilistic feature relevance learning for content-based image retrieval. Computer Vision and Image Understanding 75, 1999, 150--164 Google ScholarDigital Library
- Rui, Y., Huang, T. S., Mehrotra, S. Content-based image retrieval with relevance feedback in MARS. In Proceedings of the IEEE International Conference on Image Processing, IEEE Press, 1997, 815--818Google ScholarCross Ref
- Rui, Y, Huang, TS. Relevance Feedback Techniques in Image retrieval. In Lew M. S. (ed.): Principles of Visual Information Retrieval. Springer-Verlag, London, 2001, 219--258 Google ScholarDigital Library
- Salton, G., McGill, MJ. Introduction to modern information retrieval. McGraw-Hill, New York, 1998 Google ScholarDigital Library
- Santini, S., Jain R. Similarity Measures. IEEE Trans. on Pattern Analysis and Machine Intelligence 21, 1999, 871--883 Google ScholarDigital Library
- Santini, S., Jain, R. Integrated browsing and querying for image databases. IEEE Multimedia 7, 2000, 26--39 Google ScholarDigital Library
- Sclaroff, S., La Cascia, M., Sethi, S., Taycher, L. Mix and Match Features in the ImageRover search engine. In Lew M. S. (ed.): Principles of Visual Information Retrieval. Springer-Verlag, London, 2001, 219--258 Google ScholarDigital Library
- Smeulders, AWM, Worring, M., Santini, S., Gupta, A., Jain, R. Content-based image retrieval at the end of the early years. IEEE Trans. on Pattern Analysis and Machine Intelligence 22, 2000, 1349--1380 Google ScholarDigital Library
- Tao, D., Tang, X., Li, X., Rui, Y. Direct Kernel Biased Discriminant Analysis: A New Content-based Image Retrieval Relevance Feedback Algorithm. IEEE Trans. on Multimedia 8, 2006, 716--727 Google ScholarDigital Library
- Tao, D, Tang, X., Li, X., Wu, X. Asymmetric Bagging and Random Subspace for Support Vector Machines-Based Relevance Feedback in Image Retrieval. IEEE Trans. on Pattern Analysis and Machine Intelligence 28, 2006, 1088--1099 Google ScholarDigital Library
- Tax, D. One-class classification. PhD thesis, Delft University of Technology, The Netherlands, 2001Google Scholar
- Tieu, K., Viola, P. Boosting Image Retrieval. Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 1, 2001, 228--235Google Scholar
- Tong. S, Chang, E. Support Vector Machine Active Learning for Image Retrieval. Proc. ACM Int'l Conf. Multimedia, 2001, 107--118 Google ScholarDigital Library
- Zhang L. Lin, F., Zhang. B. Support Vector Machine Learning for Image Retrieval. Proc. IEEE Int'l Conf. Image Processing, 2001, 721--724Google ScholarCross Ref
- Zhou, X. Huang, TS. Small Sample Learning During Multimedia Retrieval Using Biasmap. Proc. IEEE Int'l Conf. Computer Vision and Pattern Recognition, vol. 1, 2001, 11--17Google Scholar
- Zhou, X., Huang, TS. Relevance Feedback for Image Retrieval: A Comprehensive Review," ACM Multimedia Systems 8, 2003, 536--544Google ScholarCross Ref
Index Terms
- A nearest-neighbor approach to relevance feedback in content based image retrieval
Recommendations
On-line content-based image retrieval system using joint querying and relevance feedback scheme
In a high-level semantic retrieval process, we utilize the search engine to retrieve a large number of images using a given text-based query. In a low-level image retrieval process, the system provides a similar image search function for the user to ...
Interactive content-based image retrieval using relevance feedback
Database search engines are generally used in a one-shot fashion in which a user provides query information to the system and, in return, the system provides a number of database instances to the user. A relevance feedback system allows the user to ...
Novel Relevance Feedback Approach to Content-Based Image Retrieval
CSSS '12: Proceedings of the 2012 International Conference on Computer Science and Service SystemIn content-based image retrieval systems, relevance feedback is an important way to narrow the gap between low-level features and high-level conception. Relevant images were often considered in traditional relevant feedback. But irrelevant images weren'...
Comments