Regular Article
Query by Sketch and Relevance Feedback for Content-Based Image Retrieval over the Web

https://doi.org/10.1006/jvlc.1999.0145Get rights and content

Abstract

Content-based image retrieval systems are being actively investigated owing to their ability to retrieve images based on the actual visual content rather than by manually associated textual descriptions. This paper considers the issues related to the porting of such systems to the World Wide Web and proposes some ways to solve them. To substantiate our ideas, we propose a web-based image retrieval system that allows the user to express a query as a simple sketch portraying ‘what’ she/he is looking for. The system relies on a three-layer relevance feedback architecture to progressively refine retrieval results according to the user's preferences. We also emphasize the use of the vector space model for features representation and the cosine distance for similarity ranking. Performances are presented using both well-assessed information retrieval measures and subjective evaluation criteria.

References (36)

  • Communications of the ACM

    (1997)
  • ACM Multimedia Systems

    (1995)
  • V. N. Gudivada, V. V. Raghavan, 1995, Picture retrieval systems: a unified perspective and research issues, CS9503,...
  • IEEE Computer

    (1995)
  • M. Flickner

    Query by image and video content: the QBIC system

    IEEE Computer

    (1995)
  • W. Niblak

    The QBIC project: querying images by content using color texture and shape

    (1993)
  • P.M. Kelly et al.

    Query by image example: the CANDID approach

    (1995)
  • V.E. Ogle et al.

    Chabot: retrieval from a relational database of images

    IEEE Computers

    (1995)
  • R. Bach

    The virage image search engine: an open framework for image management

    (1996)
  • A. Yoshitaka

    Knowledge-assisted content-based retrieval for multimedia databases

    IEEE Multimedia

    (1994)
  • J.K. Wu et al.

    Identifying faces using multiple retrievals

    IEEE Multimedia

    (1994)
  • J. Bach et al.

    A visual information management system for the interactive retrieval of faces

    IEEE Transactions of Knowledge and Data Engineering

    (1993)
  • S.W. Smoliar et al.

    Content-based video indexing and retrieval

    IEEE Multimedia

    (1994)
  • H. Zhang et al.

    Automatic partitioning of full motion video

    ACM Multimedia Systems

    (1993)
  • J.R. Smith et al.

    VisualSEEK: a fully automated content-based image query system

    (1996)
  • W.Y. Ma et al.

    NETRA: a toolbox for navigating large image databases

    (1997)
  • R.W. Picard et al.

    Finding similar patterns in large image databases

    (1993)
  • Cited by (25)

    • A spatio-temporal pyramid matching for video retrieval

      2013, Computer Vision and Image Understanding
      Citation Excerpt :

      First, The temporal information on videos adds more complexity of dimensions of data, so queries could be more complex than typical text-based ones. In addition, the representations of these queries generated by simple sketch tools [9,10] are so primitive or generic compared with text-represented queries, they would lead either wrong or diverse query results. More complex querying system (such as dynamical construction of hierarchical structures on targeting videos [11]) requires more elaboration on queries by users, which could be more error-prone.

    • From metric to topology: Determining relations in discrete space

      2015, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
    View all citing articles on Scopus
    View full text