Skip to main content
SpringerLink
Log in

Boosting video tracking performance by means of Tabu Search in intelligent visual surveillance systems

  • Published:
Journal of Heuristics Aims and scope Submit manuscript

Abstract

In this paper, we present a fast and efficient technique for the data association problem applied to visual tracking systems. Visual tracking process is formulated as a combinatorial hypotheses search with a heuristic evaluation function taking into account structural and specific information such as distance, shape, color, etc.

We introduce a Tabu Search algorithm which performs a search on an indirect space. A novel problem formulation allows us to transform any solution into the real search space, which is needed for fitness calculation, in linear time. This new formulation and the use of auxiliary structures yields a fast transformation from a blob-to-track assignment space to the real shape and position of tracks space (while calculating fitness in an incremental fashion), which is key in order to produce efficient and fast results. Other previous approaches are based on statistical techniques or on evolutionary algorithms. These techniques are quite efficient and robust although they cannot converge as fast as our approach.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Angus, J., Zhou, H., Bea, C., Becket-Lemus, L., Klose, J., Tubbs, S.: Genetic algorithms in passive tracking. Technical report, Claremont Graduate School, Math. Clinic Report (1993)

  • Arulampalam, M.S., Maskell, S., Gordon, N., Clapp, T.: A tutorial on particle filters for online nonlinear/non-Gaussian Bayesian tracking. IEEE Trans. Signal Process. 50(2), 174–188 (2002) [see also IEEE Transactions on Acoustics, Speech, and Signal Processing]

    Article  Google Scholar 

  • Baluja, S.: Population-based incremental learning: a method for integrating genetic search based function optimization and competitive learning. Technical Report CMU-CS-94-163, CMU-CS, Pittsburgh, PA (1994)

  • Beymer, D., Konolige, K.: Real-time tracking of multiple people using continuous detection (1999)

  • Blackman, S.S., Popoli, R.: Design and Analysis of Modern Tracking Systems. Artech House, Norwood (1999)

    MATH  Google Scholar 

  • Broida, T.J., Chellappa, R.: Estimation of object motion parameters from noisy images. IEEE Trans. Pattern Anal. Mach. Intell. 8(1), 90–99 (1986)

    Article  Google Scholar 

  • Castanedo, F., Patricio, M.A., Garcia, J., Molina, J.M.: Extending surveillance systems capabilities using bdi cooperative sensor agents. In: VSSN ’06: Proceedings of the 4th ACM International Workshop on Video Surveillance and Sensor Networks, pp. 131–138. Assoc. Comput. Mach., New York (2006)

    Chapter  Google Scholar 

  • Cestnik, B.: Estimating probabilities: a crucial task in machine learning. In: ECAI, pp. 147–149 (1990)

  • Chang, Y.L., Aggarwal, J.K.: Neural network optimization for multi-target multi-sensor passive tracking. In: Proc. IEEE Workshop on Visual Motion, pp. 268–273 (1991)

  • Chen, T.P., Haussecker, H., Bovyrin, A., Belenov, R., Rodyushkin, K., Kuranov, A., Eruhimov, V.: Computer vision workload analysis: case study of video surveillance systems. Intel Technol. J. 9(2), 109–118 (2005)

    Google Scholar 

  • Comaniciu, D., Meer, P.: Mean shift: a robust approach toward feature space analysis. IEEE Trans. Pattern Anal. Mach. Intell. 24(5), 603–619 (2002)

    Article  Google Scholar 

  • Comaniciu, D., Ramesh, V., Meer, P.: Kernel-based object tracking. IEEE Trans. Pattern Anal. Mach. Intell. 25(5), 564–575 (2003)

    Article  Google Scholar 

  • Cordon, O., Damas, S.: Image registration with iterated local search. J. Heuristics 12(1–2), 73–94 (2006)

    Article  MATH  Google Scholar 

  • Cox, I.J., Hingorani, S.L.: An efficient implementation of Reid’s multiple hypothesis tracking algorithm and its evaluation for the purpose of visual tracking. IEEE Trans. Pattern Anal. Mach. Intell. 18(2), 138–150 (1996)

    Article  Google Scholar 

  • de Bonet, J.S., Isbell, C.L., Jr., Viola, P.: MIMIC: Finding optima by estimating probability densities. In: Mozer, M.C., Jordan, M.I., Petsche, T. (eds.) Advances in Neural Information Processing Systems, vol. 9, p. 424. MIT Press, Cambridge (1997)

    Google Scholar 

  • Djuric, P.M., Kotecha, J.H., Zhang, J., Huang, Y., Ghirmai, T., Bugallo, M.F., Miguez, J.: Particle filtering. IEEE Signal Process. Mag. 19–38 (2003)

  • Dotu, I., Van Hentenryck, P.: Scheduling social golfers locally. In: CP-AIOR-05 (2005)

  • Ferryman, J.M., Maybank, S.J., Worrall, A.D.: Visual surveillance for moving vehicles. Int. J. Comput. Vis. 37(2), 187–197 (2000)

    Article  MATH  Google Scholar 

  • Glover, F., Laguna, M.: Modern Heuristic Techniques for Combinatorial Problems. Blackwell Scientific, Oxford (1993)

    MATH  Google Scholar 

  • Goldberg, D.E.: Genetic Algorithms in Search, Optimization and Machine Learning. Addison–Wesley, Reading (1989)

    MATH  Google Scholar 

  • Grunert, F., Funke, B., Irnich, S.: Local search for vehicle routing and scheduling problems: review and conceptual integration. J. Heuristics 11(4), 267–306 (2005)

    Article  Google Scholar 

  • Han, M., Xu, W., Tao, H., Gong, Y.: An algorithm for multiple object trajectory tracking. In: CVPR 2004: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 01, pp. 864–871 (2004)

  • Harik, G.R., Lobo, F.G., Goldberg, D.E.: The compact genetic algorithm. IEEE Trans. Evol. Comput. 3(4), 287 (1999)

    Article  Google Scholar 

  • Harvey, W., Winterer, T.: Solving the MOLR and social golfers problems. In: CP-05 (2005)

  • Hillis, D.B.: Using a genetic algorithm for multi-hypothesis tracking. In: ICTAI ’97: Proceedings of the 9th International Conference on Tools with Artificial Intelligence, p. 112. IEEE Computer Society, Washington (1997)

    Chapter  Google Scholar 

  • Huwer, S., Niemann, H.: 2d-object tracking based on projection-histograms. In: 5th European Conference on Computer Vision, pp. 861–876 (1998)

  • Kan, W.Y., Krogmeier, J.V.: A generalization of the pda target tracking algorithm using hypothesis clustering. Sign. Syst. Comput. 2, 878–882 (1996)

    Google Scholar 

  • Kincaid, R.K., Laba, K.E.: Reactive Tabu Search and sensor selection in active structural acoustic control problems. J. Heuristics 4(3), 199–220 (1998)

    Article  MATH  Google Scholar 

  • Kitagawa, G.: Non-Gaussian state-space modeling of nonstationary time series. J. Am. Stat. Assoc. 82, 1032–1063 (1987)

    Article  MATH  MathSciNet  Google Scholar 

  • Larraaga, P., Lozano, J.A.: Estimation of Distribution Algorithms: A New Tool for Evolutionary Computation. Kluwer Academic, Norwell (2001)

    Google Scholar 

  • Mühlenbein, H.: The equation for response to selection and its use for prediction. Evol. Comput. 5(3), 303–346 (1997)

    Article  Google Scholar 

  • Mühlenbein, H., Mahnig, T.: The factorized distribution algorithm for additively decompressed functions. In: 1999 Congress on Evolutionary Computation, pp. 752–759. IEEE Service Center, Piscataway (1999)

    Google Scholar 

  • OpenCV. intel.com/technology/computing/opencv/index.htm

  • Patricio, M.A., Carbó, J., Pérez, O., García, J., Molina, J.M.: Multi-agent framework in visual sensor networks. EURASIP J. Adv. Signal Process. 2007, 98639 (2007a). doi:10.1155/2007/98639, 21 pp.

    Article  Google Scholar 

  • Patricio, M.A., García, J., Berlanga, A., Molina, J.M.: Video tracking association problem using estimation of distribution algorithms in complex scenes. In: Artificial Intelligence and Knowledge Engineering Applications: A Bioinspired Approach: First International Work-Conference on the Interplay Between Natural and Artificial Computation. Lecture Notes in Computer Science. Springer, Berlin (2007b)

    Google Scholar 

  • Patricio, M.A., Castanedo, F., Berlanga, A., Perez, O., Garcia, J., Molina, J.M.: Computational intelligence in visual sensor networks: improving video processing systems. In: Computational Intelligence in Multimedia Processing: Recent Advances. Studies in Computational Intelligence, vol. 96, pp. 351–377. Springer, Berlin (2008)

    Chapter  Google Scholar 

  • Pisinger, D., Faroe, O., Zachariasen, M.: Guided local search for final placement VLSI design. J. Heuristics 9(3), 269–295 (2003)

    Article  MATH  MathSciNet  Google Scholar 

  • Regazzoni, C.S., Vernazza, G., Fabri, G. (eds.): Highway Traffic Monitoring. Kluwer Academic, Norwell (1998a)

    Google Scholar 

  • Regazzoni, C.S., Vernazza, G., Fabri, G. (eds.): Security in Ports: the User Requirements for Surveillance System. Kluwer Academic, Norwell (1998b)

    Google Scholar 

  • Ruan, Y., Willett, P.: Multiple model pmht and its application to the benchmark radar tracking problem. IEEE Trans. Aerosp. Electron. Syst. 40(4), 1337–1350 (2004)

    Article  Google Scholar 

  • Shams, S.: Neural network optimization for multi-target multi-sensor passive tracking. In: Proceedings of the IEEE, vol. 84, pp. 1442–1457 (1996)

  • Stauffer, C., Grimson, W.E.L.: Adaptive background mixture models for real-time tracking. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2. IEEE Computer Society, Los Alamitos (1999)

    Google Scholar 

  • University of Ljubljana Machine Vision Group. Cvbase ’06 workshop on computer vision based analysis in sport environments, found at url: http://vision.fe.uni-lj.si/cvbase06/ (2001)

  • Xiao-Rong, L., Bar-Shalom, Y.: Multitarget-Multisensor Tracking. Principles and Techniques (1995)

  • Yeddanapudi, M., Bar-Shalom, Y., Pattipati, K.: IMM estimation for multitarget-multisensor air traffic surveillance. In: Proceedings of the IEEE, vol. 85, pp. 80–96 (1997)

  • Yilmaz, A., Javed, O., Shah, M.: Object tracking: a survey. ACM Comput. Surv. 38(4), 13 (2006)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Brown University, Box 1910, Providence, RI, 02912, USA

    Ivan Dotu

  2. Universidad Carlos III de Madrid Avda. Universidad Carlos III, 22, 28270, Colmenarejo, Madrid, Spain

    Miguel A. Patricio, A. Berlanga, J. García & José M. Molina

Authors
  1. Ivan Dotu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Miguel A. Patricio
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. Berlanga
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. J. García
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. José M. Molina
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Miguel A. Patricio.

Additional information

This work was supported in part by Projects CICYT TIN2008-06742-C02-02/TSI, CICYT TEC2008-06732-C02-02/TEC, CAM CONTEXTS (S2009/TIC-1485) and DPS2008-07029-C02-02.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Dotu, I., Patricio, M.A., Berlanga, A. et al. Boosting video tracking performance by means of Tabu Search in intelligent visual surveillance systems. J Heuristics 17, 415–440 (2011). https://doi.org/10.1007/s10732-010-9140-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10732-010-9140-4

Keywords

Search

Navigation