Abstract
A system capable of performing robust live ego-motion estimation for perspective cameras is presented. The system is powered by random sample consensus with preemptive scoring of the motion hypotheses. A general statement of the problem of efficient preemptive scoring is given. Then a theoretical investigation of preemptive scoring under a simple inlier–outlier model is performed. A practical preemption scheme is proposed and it is shown that the preemption is powerful enough to enable robust live structure and motion estimation.
Similar content being viewed by others
References
Triggs, B., McLauchlan, P., Hartley, R., Fitzgibbon, A.: Bundle adjustment—a modern synthesis. Springer Lecture Notes on Computer Science, vol. 1883, pp. 298–375. Springer Verlag, Berlin Heidelberg New York (2000)
Fischler, M., Bolles, R.: Random sample consensus: a paradigm for model fitting with application to image analysis and automated cartography. Commun. Assoc. Comp. Mach. 24, 381–395 (1981)
Torr, P., Zisserman, A.: MLESAC: a new robust estimator with application to estimating image geometry. Comput. Vision Image Understand. 78, 138–156 (2000)
Torr, P., Murray, D.: The development and comparison of robust methods for estimating the fundamental matrix. Int. J. Comput. Vision 24(3), 271–300 (1997)
Torr, P., Murray, D.: Outlier detection and motion segmentation. In: SPIE Sensor Fusion Conference VI, pp. 432–443, September 1993
Zhang, Z.: Determining the epipolar geometry and its uncertainty: a review. Int. J. Comput. Vision 27(2), 161–195 (1998)
Beardsley, P., Zisserman, A., Murray, D.: Sequential updating of projective and affine structure from motion. Int. J. Comput. Vision 23(3), 235–259 (1997)
Nistér, D.: Reconstruction from uncalibrated sequences with a hierarchy of trifocal tensors. In: Proceedings of the European Conference on Computer Vision, vol. 1, pp. 649–663 (2000)
Nistér, D.: In: Automatic dense reconstruction from uncalibrated video sequences. PhD Thesis, Royal Institute of Technology KTH, ISBN 91-7283-053-0, March 2001
Pollefeys, M., Koch, R., Van Gool, L.: Self-calibration and metric reconstruction in spite of varying and unknown internal camera parameters. Int. J. Comput. Vision 32(1), 7–25 (1999)
Pollefeys, M., Verbiest, F., Van Gool, L.: Surviving dominant planes in uncalibrated structure and motion recovery. In: Proceedings of the European Conference on Computer Vision, vol. 2, pp. 837–851 (2002)
Torr, P., Fitzgibbon, A., Zisserman, A.: The problem of degeneracy in structure and motion recovery from uncalibrated image sequences. Int. J. Comput. Vision 32(1), 27–44 (1999)
2d3 Ltd. Boujou, http://www.2d3.com
Oliensis, J.: A critique of structure from motion algorithms. Comput. Vision Image Understand. 80, 172–214 (2000)
Nistér, D.: An efficient solution to the five-point relative pose problem. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 195–202 (2003)
Hartley, R., Silpa-Anan, C.: Reconstruction from two views using approximate calibration. In: Proceedings of the 5th Asian Conference on Computer Vision, Melbourne, Australia, January 2002
Björkman, M., Eklundh, J.: Real-time epipolar geometry estimation and disparity. In: Proceedings of the International Conference on Computer Vision, pp. 234–241 (1999)
Chiuso, A., Favaro, P., Jin, H., Soatto, S.: 3-D motion and structure causally integrated over time: implementation. In: Proceedings of the European Conference on Computer Vision. Lecture Notes in Computer Science, vol. 1842, pp. 735–750. Springer Verlag, Berlin Heidelberg New York (2000)
Jin, H., Favaro, P., Soatto, S.: Real-time 3-D motion and structure from point features: a front-end system for vision-based control and interaction. In: Proceedings of the IEEE Interantional Conference on Computer Vision and Pattern Recognition, pp. 778–779 (2000)
Jin, H., Favaro, P., Soatto, S.: Real-time feature tracking and outlier rejection with changes in illumination. In: International Conference on Computer Vision, pp. 684–689 (2001)
Chum, O., Matas, J.: Randomized RANSAC with T d,d test. In: Proceedings of the British Machine Vision Conference, pp. 448–457 (2002)
Tordoff, B., Murray, D.: Guided sampling and consensus for motion estimation. In: Proceedings of the European Conference on Computer Vision. Springer Lecture Notes on Computer Science, vol. 2350, pp. 82–96 (2002)
Haralick, R., Lee, C., Ottenberg, K., Nölle, M.: Review and analysis of solutions of the three point perspective pose estimation problem. Int. J. Comput. Vision 13(3), 331–356 (1994)
Press, W., Teukolsky, S., Vetterling, W., Flannery, B.: Numerical recipes in C. Cambridge University Press, Cambridge (1988)
Lacey, A., Pinitkarn, N., Thacker, N.: An evaluation of the performance of RANSAC algorithms for stereo camera calibration. In: Proceedings of British Machine Vision Conference, pp. 646–655 (2000)
Author information
Authors and Affiliations
Corresponding author
Additional information
Prepared through collaborative participation in the Robotics Consortium sponsored by the U.S. Army Research Laboratory under the Collaborative Technology Alliance Program, Cooperative Agreement DAAD19-01-2-0012. The U.S. Government is authorized to reproduce and distribute reprints for Government purposes notwithstanding any copyright notation thereon.
David Nistér received PhD degree in computer vision, numerical analysis and computing science from the Royal Institute of Technology (KTH), Stockholm, Sweden, with the thesis ‘Automatic Dense Reconstruction from Uncalibrated Video Sequences’. He is currently an assistant professor at the Computer Science Department and the Center for Visualization and Virtual Environments, University of Kentucky, Lexington. Before joining UK, he was a researcher in the Vision Technologies Laboratory, Sarnoff Corporation, Princeton, and Visual Technology, Ericsson Research, Stockholm, Sweden. His research interests include computer vision, computer graphics, structure from motion, multiple view geometry, Bayesian formulations, tracking, recognition, image and video compression. He is a member of the IEEE and American Mensa.
Rights and permissions
About this article
Cite this article
Nistér, D. Preemptive RANSAC for live structure and motion estimation. Machine Vision and Applications 16, 321–329 (2005). https://doi.org/10.1007/s00138-005-0006-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-005-0006-y