Skip to main content
SpringerLink
Log in

Efficient processing of video containment queries by using composite ordinal features

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Video containment queries find the videos that have similar sequence of frames to query video clips. Applying sequence matching to all possible subsequences for video containment queries is computationally expensive for large volumes of video data. In this paper, we propose an efficient candidate segment selection scheme, which selects only a small set of subsequences to be matched to the query sequence, by using a cluster of similar frames, called a frame cluster. We also propose a new type of the ordinal feature, called a composite ordinal feature that allows multiple ranks to certain cells. In experiments with large scale video data sets, we show our method improves the query response time by efficiently selecting a set of subsequences for sequence matching.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

References

  1. Adjeroh DA, Lee MC, King I (1999) A distance measure for video sequences. Comput Vis Image Underst 75(1):25–45

    Article  Google Scholar 

  2. Bertini M, Bimbo AD, Nunziati W (2006) Video clip matching using MPEG-7 descriptors and edit distance. In: Conference on image and video retrieval, LNCS, vol 4071, pp 133–142

  3. Bhat DN, Nayar SK (1998) Ordinal measures for image correspondence. IEEE Trans Pattern Anal Mach Intell 20(4):415–423

    Article  Google Scholar 

  4. Chen L, Stentiford FWM (2008) Video sequence matching based on temporal ordinal measurement. Pattern Recogn Lett 29(13):1824–1831

    Article  Google Scholar 

  5. Chiu C, Wang H (2010) Time-series linear search for video copies based on compact signature manipulation and containment relation modeling. IEEE Trans Circuits Syst Video Technol 20(11):1603–1613

    Article  Google Scholar 

  6. Chiu CY, Li CH, Wang HA, Chen CS, Chien LF (2006) A time warping based approach for video copy detection. In: Proceeding of the 18th IEEE international conference of pattern recognition, ICPR’06. IEEE, pp 228–231

  7. Chiu CY, Wang HM, Chen CS (2010) Fast min-hashing indexing and robust spatio-temporal matching for detecting video copies. ACM Trans Multimed Comput Commun Appl 6(2):1–23

    Article  Google Scholar 

  8. Chiu CY, Tsai TH, Han CW, Hsieh CY, Li SY (2013) Efficient video stream monitoring for near-duplicate detection and localization in a large-scale repository. ACM Trans Inf Syst 31(4):1–27

    Article  Google Scholar 

  9. Hampapur A, Hyun K, Bolle RM (2001) Comparison of sequence matching techniques for video copy detection. In: Proceeding of SPIE 4676, storage and retrieval for media databases, vol 2002, p 194

  10. Hua X, Chen X, Zhang H (2004) Robust video signature based on ordinal measure. In: Proceeding of the IEEE international conference on image Processing, ICIP’04. IEEE, pp 685–688

  11. Huang Z, Shen HT, Shao J, Cui B, Zhou X (2010) Practical online near-duplicate subsequence detection for continuous video streams. IEEE Trans Multimedia 12(5):386–398

    Article  Google Scholar 

  12. Jagadish HV, Ooi BC, Tan KL, Yu C, Zhang R (2005) iDistance: an adaptive B + -tree based indexing method for nearest neighbor search. ACM Trans Database Syst 30(2):364–397

    Article  Google Scholar 

  13. Jun W, Lee Y, Jun B (2015) Duplicate video detection for large-scale multimedia. Multimed Tools Appl:1–14

  14. Kim C, Vasudev B (2005) Spatiotemporal sequence matching for efficient video copy detection. IEEE Trans Circuits Syst Video Technol 15(1):127–132

    Article  Google Scholar 

  15. Knuth ED (1998) The art of programming, volume 3: sorting and searching. Addison-Wesley, pp 11–17

  16. Law-To J, Chen L, Joly A, Laptev I, Buisson O, Gouret-Brunet V, Boujemaa N, Stentiford F (2007) Video copy detection: a comparative study. In: Proceedings of the ACM international conference on image and video retrieval, CIVR’07. ACM, pp 371–378

  17. Liu J, Huang Z, Cai H, Shen HT, Ngo CW, Wang W (2013) Near-duplicate video retrieval: current research and feature trends. ACM Comput Surv 45(4):1–23

    Article  Google Scholar 

  18. Liu H, Lu H, Xue X (2013) A segmentation and graph-based video sequence matching method for video copy detection. IEEE Trans Knowl Data Eng 25(8):1706–1718

    Article  Google Scholar 

  19. Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60(2):91–110

    Article  Google Scholar 

  20. Lu H, Ooi BC, Shen HT, Xue X (2006) Hierarchical indexing structure for efficient similarity search in video retrieval. IEEE Trans Knowl Data Eng 18 (11):1544–1559

    Article  Google Scholar 

  21. Lucas BD, Kanade T (1981) An iterative image registration technique with an application to stereo vision. In: Proceeding of the 7th international joint conference of on artificial intelligent, IJCAI’81, pp 121–130

  22. Shao J, Huang Z, Shen HT, Zhou X, Lim E, Li Y (2008) Batch nearest neighbor search for video retrieval. IEEE Trans Multimedia 10(3):409–420

    Article  Google Scholar 

  23. Shen H, Shao J (2009) Effective and efficient query processing for video subsequence identification. IEEE Trans Knowl Data Eng 21(3):321–334

    Article  Google Scholar 

  24. Sivic J, Zisserman A (2003) Video google: a text retrieval approach to object matching in videos. In: Proceeding of the 9th IEEE international conference on computer vision. IEEE, pp 1–8

  25. Wu X, Hauptmann AG, Ngo CW (2007) Practical elimination of near-duplicates from web video search. In: Proceeding of the 15th ACM international conference on multimedia, ACMMM’07. ACM, pp 218–227

  26. Yeh MC, Cheng KT (2009) Video copy detection by fast sequence matching. In: Proceeding of the ACM international conference on image and video retrieval. ACM, pp 1–7

  27. Zhang J, Ren J, Chang F, Wood T, Kender J (2012) Fast near-duplicate video retrieval via motion time series matching. In: Proceeding of the IEEE international conference on multimedia and expo. IEEE, pp 842–847

  28. Zhou X, Zhou X, Chen L, Bouguettaya A (2012) Efficient subsequence matching over large video databases. VLDB J 21(4):489–508

    Article  Google Scholar 

Download references

Acknowledgments

This work was supported by the Bio-Synergy Research Project (NRF-2013M3A9C4078137) of the MSIP(Ministry of Science, ICT and Future Planning), Korea, through the NRF, and by the MSIP, Korea under the ITRC support program (IITP-2015-H8501-15-1013) supervised by the IITP.

Author information

Authors and Affiliations

  1. School of Computing, KAIST, 373-1 Guseong-Dong, Yuseong-Gu, Daejeon, 305-701, South Korea

    Jung Hyuk Seo & Myoung Ho Kim

Authors
  1. Jung Hyuk Seo
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Myoung Ho Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Myoung Ho Kim.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Seo, J.H., Kim, M.H. Efficient processing of video containment queries by using composite ordinal features. Multimed Tools Appl 76, 2891–2910 (2017). https://doi.org/10.1007/s11042-016-3270-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-016-3270-0

Keywords

Search

Navigation