Deng Cai
Jiawei Han
ABSTRACT
Relevance feedback is a well established and effective framework for narrowing down the gap between low-level visual features and high-level semantic concepts in content-based image retrieval. In most of traditional implementations of relevance feedback, a distance metric or a classifier is usually learned from user's provided negative and positive examples. However, due to the limitation of the user's feedbacks and the high dimensionality of the feature space, one is often confront with the issue of the curse of the dimensionality. Recently, several researchers have considered manifold ways to address this issue, such as Locality Preserving Projections, Augmented Relation Embedding, and Semantic Subspace Projection. In this paper, by using techniques from spectral graph embedding and regression, we propose a unified framework, called spectral regression, for learning an image subspace. This framework facilitates the analysis of the differences and connections between the algorithms mentioned above. And more crucially, it provides much faster computation and therefore makes the retrieval system capable of responding to the user's query more efficiently.
- M. Antonini, M. Barlaud, P. Mathieu, and I. Daubechies. Image coding using wavelet. IEEE Transactions on Image Processing, 1(2):205--220, 1992.Google Scholar
Digital Library
- M. Belkin and P. Niyogi. Laplacian eigenmaps and spectral techniques for embedding and clustering. In Advances in Neural Information Processing Systems 14, pages 585--591. MIT Press, Cambridge, MA, 2001.Google ScholarDigital Library
- D. Cai, X. He, and J. Han. Spectral regression for dimensionality reduction. Technical report, UIUC, UIUCDCS-R-2007-2856, May 2007.Google Scholar
- D. Cai, X. He, and J. Han. SRDA: An efficient algorithm for large scale discriminant analysis. Technical report, UIUC, UIUCDCS-R-2007-2857, May 2007.Google Scholar
- J. Canny. A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell., 8(6):679--698, 1986. Google ScholarDigital Library
- F. R. K. Chung. Spectral Graph Theory, volume 92 of Regional Conference Series in Mathematics. AMS, 1997.Google Scholar
- S. Guattery and G. L. Miller. Graph embeddings and laplacian eigenvalues. SIAM Journal on Matrix Analysis and Applications, 21(3):703--723, 2000. Google ScholarDigital Library
- T. Hastie, R. Tibshirani, and J. Friedman. The Elements of Statistical Learning: Data Mining, Inference, and Prediction. New York: Springer-Verlag, 2001.Google Scholar
- J. He, M. Li, H.-J. Zhang, H. Tong, and C. Zhang. Manifold-ranking based image retrieval. In Proceedings of the ACM Conference on Multimedia, New York, October 2004. Google ScholarDigital Library
- X. He. Incremental semi-supervised subspace learning for image retrieval. In Proceedings of the ACM Conference on Multimedia, New York, October 2004. Google ScholarDigital Library
- X. He and P. Niyogi. Locality preserving projections. In Advances in Neural Information Processing Systems 16. MIT Press, Cambridge, MA, 2003.Google Scholar
- X. He, S. Yan, Y. Hu, P. Niyogi, and H.-J. Zhang. Face recognition using laplacianfaces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(3):328--340, 2005. Google ScholarDigital Library
- J. Huang, S. R. Kumar, M. Mitra, W.-J. Zhu, and R. Zabih. Image indexing using color correlograms. pages 762--768, 1997. Google ScholarDigital Library
- D. P. Huijsmans and N. Sebe. How to complete performance graphs in content-based image retrieval: Add generality and normalize scope. IEEE Transactions on Pattern Analysis and Machine Intelligence, 27(2):245--251, 2005. Google ScholarDigital Library
- Y.-Y. Lin, T.-L. Liu, and H.-T. Chen. Semantic manifold learning for image retrieval. In Proceedings of the ACM Conference on Multimedia, Singapore, November 2005. Google ScholarDigital Library
- C. L. Novak and S. A. Shafer. Anatomy of a color histogram. In Proc. IEEE Conf. Computer Vision and Pattern Recognition Machine Learning (CVPR'92), pages 599--605, 1992.Google ScholarCross Ref
- C. C. Paige and M. A. Saunders. Algorithm 583 LSQR: Sparse linear equations and least squares problems. ACM Transactions on Mathematical Software, 8(2):195--209, June 1982. Google ScholarDigital Library
- C. C. Paige and M. A. Saunders. LSQR: An algorithm for sparse linear equations and sparse least squares. ACM Transactions on Mathematical Software, 8(1):43--71, March 1982. Google ScholarDigital Library
- R. Penrose. A generalized inverse for matrices. In Proceedings of the Cambridge Philosophical Society, volume 51, pages 406--413, 1955.Google ScholarCross Ref
- S. Roweis and L. Saul. Nonlinear dimensionality reduction by locally linear embedding. Science, 290(5500):2323--2326, 2000.Google ScholarCross Ref
- Y. Rui, T. S. Huang, M. Ortega, and S. Mehrotra. Relevance feedback: A power tool for interative content-based image retrieval. IEEE Transactions on Circuits and Systems for Video Technology, 8(5), 1998. Google ScholarDigital Library
- A. W. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain. Content-based image retrieval at the end of the early years. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(12):1349--1380, 2000. Google ScholarDigital Library
- G. W. Stewart. Matrix Algorithms Volume I: Basic Decompositions. SIAM, 1998.Google Scholar
- G. W. Stewart. Matrix Algorithms Volume II: Eigensystems. SIAM, 2001. Google ScholarDigital Library
- M. A. Stricker and M. Orengo. Similarity of color images. In Storage and Retrieval for Image and Video Databases (SPIE), pages 381--392, 1995.Google ScholarCross Ref
- J. Tenenbaum, V. de Silva, and J. Langford. A global geometric framework for nonlinear dimensionality reduction. Science, 290(5500):2319--2323, 2000.Google ScholarCross Ref
- S. Tong and E. Chang. Support vector machine active learning for image retrieval. In Proceedings of the ninth ACM international conference on Multimedia, pages 107--118, 2001. Google ScholarDigital Library
- J. Yu and Q. Tian. Learning image manifolds by semantic subspace projection. In Proceedings of the ACM Conference on Multimedia, Santa Barbara, October 2006. Google ScholarDigital Library
Index Terms
- Spectral regression: a unified subspace learning framework for content-based image retrieval
Recommendations
Semantic Subspace Projection and Its Applications in Image Retrieval
One of the most challenging problems for image retrieval applications is to find the optimal mapping between high-level semantic concept and low-level features. Traditional approaches often assume that images with same semantic label share strong visual ...
Image retrieval based on incremental subspace learning
Many problems in information processing involve some form of dimensionality reduction, such as face recognition, image/text retrieval, data visualization, etc. The typical linear dimensionality reduction algorithms include principal component analysis (...
Image retrieval using nonlinear manifold embedding
The huge number of images on the Web gives rise to the content-based image retrieval (CBIR) as the text-based search techniques cannot cater to the needs of precisely retrieving Web images. However, CBIR comes with a fundamental flaw: the semantic gap ...
Comments