Abstract
An overview is given of a vision system for locating, recognising and tracking multiple vehicles, using an image sequence taken by a single camera mounted on a moving vehicle. The camera motion is estimated by matching features on the ground plane from one image to the next. Vehicle detection and hypothesis generation are performed using template correlation and a 3D wire frame model of the vehicle is fitted to the image. Once detected and identified, vehicles are tracked using dynamic filtering. A separate batch mode filter obtains the 3D trajectories of nearby vehicles over an extended time. Results are shown for a motorway image sequence.
Similar content being viewed by others
References
Bertozzi, M. and Broggi, A. 1996. Real-time lane and obstacle detection on the GOLD system. In Proceedings IEEE Intelligent Vehicles Symposium, pp. 213–218.
Betke, M., Haritaoglu, E., and Davis, L. 1996. Multiple vehicle detection and tracking in hard real-time. In Proceedings IEEE Intelligent Vehicles Symposium, pp. 351–356.
Beymer, D. and Malik, J. 1996. Tracking vehicles in congested traffic. In Proceedings IEEE Intelligent Vehicles Symposium, pp. 130–135.
Dellaert, F., Pomerleau, D., and Thorpe, C. 1998. Model-based car tracking integrated with a road follower. In Proceedings International Conference on Robotics and Automation, ICRA'98, pp. 1189–1194.
Dickmanns, E. and Mysliwetz, B. 1992. Recursive 3D road and relative ego-state recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):199–213.
Dickmanns, E.D. 1997. Vehicles capable of dynamic vision. In Proceedings International Joint Conference on Artificial Intelligence, IJCAI, Nagoya, Japan, pp. 1577–1592.
Ferryman, J.M., Worrall, A.D., Sullivan, G.D., and Baker, K.D. 1995. Visual surveillance using deformable models of vehicles. In Proceedings International Symposium on Intelligent Robotic Systems, Pisa, Italy, pp. 295–302.
Fischler, M.A. and Bolles, R.C. 1981. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications ACM, 24:381–395.
Gennery, D. 1992. Visual tracking of known three-dimensional objects. International Journal of Computer Vision, 7(3):243–270.
Giachetti, A., Campani, M., and Torre, V. 1994. The use of optical flow for autonomous navigation. In Proceedings 3rd European Conference on Computer Vision, pp. 146–151.
Harris, C. 1992. Tracking with rigid models. In Active Vision, A. Blake and A. Yuille (Eds.). MIT Press: Cambridge, USA.
Harris, C. and Stephens, M. 1988. A Combined corner and edge detector. In Proceedings Alvey Vision Conference, University of Manchester, pp. 147–151.
Kanatani, K. 1993. Geometric Computation for Machine Vision. Oxford Science Publications. Oxford Engineering Science Series No. 37.
Koller, D., Weber, J., and Malik, J. 1994. Towards realtime visual based tracking in cluttered traffic scenes. In Proceedings IEEE Intelligent Vehicles Symposium, Press W.H. Ten pp. 201–206.
Luong, Q.-T., Weber, J., Koller, D., and Malik, J. 1995. An integrated stereo-based approach to automatic vehicle guidance. In Proceedings International Conference on Computer Vision, ICCV'95, Boston, pp. 12–20.
Matthews, N.D., An, P.E., and Harris, C.J. 1995. Vehicle detection and recognition for autonomous intelligent cruise control. Technical Report, Department of Electronics and Computer Science, University of Southampton, UK.
Maybank, S.J., Worrall, A.D., and Sullivan, G.D. 1996. Filter for car tracking based on acceleration and steering angle. In Proceedings British Machine Vision Conference 1996, Vol. 2, R.B. Fisher and E. Trucco (Eds.). BMVA, pp. 615–624.
Press, W.H., Ten Kolsky, S.A., Vetterling, W.T., and Flannery, B.P. 1986. Numerical Recipes. Cambridge University Press.
Schmid, M. 1994. An approach to model-based 3D recognition of vehicles in real time by machine vision. In Proceedings International Conference on Intelligent Robots and Systems, IROS'94, 3, Munich, Germany.
Smith, S.M. 1995. ASSET-2: Real-time motion segmentation and shape tracking. In Proceedings International Conference on Computer Vision, pp. 237–244.
Sullivan, G.D. 1994. Visual interpretation of known objects in constrained scenes, Phil. Trans. R.Soc. Lon., B, 337, pp. 361–370.
Sullivan, G.D. 1994. Model-based vision for traffic scenes using the ground-plane constraint. In Real-time Computer Vision, D. Terzopoulos and C. Brown (Eds.). Cambridge University Press.
Tan, T.N., Sullivan, G.D., and Baker, K.D. 1996. Efficient gradient-based object localisation and recognition. In Proceedings International Conference on Computer Vision and Pattern Recognition, San Francisco, pp. 397–402.
Thomanek, F. and Dickmanns, D. 1992. Obstacle Detection, Tracking and state estimation for autonomous road vehicle guidance. In Proceedings International Conference on Robotics and Automation, ICRA'92, Raleigh, NC, p. 1399.
Tian, T.Y., Tomasi, C., and Heeger, D.J. 1996. Comparison of approaches to egomotion computation. In Proceedings International Conference on Computer Vision and Pattern Recognition, San Francisco, pp. 315–320.
Weber, J. 1995. Further results on the use of binocular vision for highway driving, transportation sensors and controls: Collision avoidance, traffic management and ITS. In Proceedings International Society for Optical Engineering. SPIE, Vol. 2595.
Wolfram, S. 1996. The Mathematica Book, 3rd ed. Wolfram Media/Cambridge University Press.
Worrall, A.D., Baker, K.D., and Sullivan, G.D. 1989. Model-based perspective inversion, Image and Vision Computing Journal, 7(1):17–23, 1989.
Worrall, A.D., Sullivan, G.D., and Baker, K.D. 1993. Advances in model-based traffic vision. In Proceedings 4th British Machine Vision Conference. BMVA Press, pp. 559–568.
Worrall, A.D., Sullivan, G.D., and Baker, K.D. 1994. A simple, intuitive camera calibration tool for natural images. In Proceedings 5th British Machine Vision Conference, pp. 781–790.
Wu, J.J., Rink, R.E., Caelli, T.M., and Gourishamkar, V.G. 1989. Recovery of the3Dlocation and motion of a rigid object through camera image (An extended Kalman filter approach). International Journal of Computer Vision, 2:373–394.
Zhao, L. and Thorpe, C. 1998. Qualitative and quantitative car tracking from a range image. In Proceedings International Conference on Computer Vision and Pattern Recognition, pp. 496–501.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Ferryman, J.M., Maybank, S.J. & Worrall, A.D. Visual Surveillance for Moving Vehicles. International Journal of Computer Vision 37, 187–197 (2000). https://doi.org/10.1023/A:1008155721192
Issue Date:
DOI: https://doi.org/10.1023/A:1008155721192