Abstract
This paper extends the recovery of structure and motion to image sequences with several independently moving objects. The motion, structure, and camera calibration are all a-priori unknown. The fundamental constraint that we introduce is that multiple motions must share the same camera parameters. Existing work on independent motions has not employed this constraint, and therefore has not gained over independent static-scene reconstructions.
We show how this constraint leads to several new results in structure and motion recovery, where Euclidean reconstruction becomes possible in the multibody case, when it was underconstrained for a static scene. We show how to combine motions of high-relief, low-relief and planar objects. Additionally we show that structure and motion can be recovered from just 4 points in the uncalibrated, fixed camera, case.
Experiments on real and synthetic imagery demonstrate the validity of the theory and the improvement in accuracy obtained using multibody analysis.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
M. Armstrong, A. Zisserman, and R. Hartley. Self-calibration from image triplets. In Proc. ECCV, LNCS 1064/5, pages 3–16. Springer-Verlag, 1996.
S. Avidan and A. Shashua. Trajectory triangulation of lines: Reconstruction of a 3D point moving along a line from a monocular image sequence. In Proc. CVPR, pages II:62–66, 1999.
M. J. Black and P. Anandan. A framework for the robust estimation of optical flow. In Proc. ICCV, pages 231–236, 1993.
S. Bougnoux. From Projective to Euclidean space under any practical situation, a criticism of self-calibration. In Proc. ICCV, pages 790–796, Jan 1998.
J. Costeira and T. Kanade. A multibody factorization method for independently moving objects. IJCV, 29(3): 159–179, 1998.
C. Debrunner and N. Ahuja. Motion and structure factorization and segmentation of long multiple motion image sequences. In G. Sandini, editor, Proc. ECCV, pages 217–221. Springer-Verlag, 1992.
O. D. Faugeras. Three-Dimensional Computer Vision: a Geometric Viewpoint. MIT Press, 1993.
O. D. Faugeras, Q. Luong, and S. Maybank. Camera self-calibration: Theory and experiments. In Proc. ECCV, LNCS 588, pages 321–334. Springer-Verlag, 1992.
A. W. Fitzgibbon and A. Zisserman. Automatic camera recovery for closed or open image sequences. In Proc. ECCV, pages 311–326. Springer-Verlag, Jun 1998.
C. W. Gear. Multibody grouping from motion images. IJCV, 29(2): 133–150, 1998.
C. J. Harris and M. Stephens. A combined corner and edge detector. In Alvey Vision Conf., pages 147–151, 1988.
R. I. Hartley. Estimation of relative camera positions for uncalibrated cameras. In Proc. ECCV, LNCS 588, pages 579–587. Springer-Verlag, 1992.
R. I. Hartley. Euclidean reconstruction from uncalibrated views. In J. Mundy, A. Zisserman, and D. Forsyth, editors, Applications of Invariance in Computer Vision, LNCS 825, pages 237–256. Springer-Verlag, 1994.
R. I. Hartley and A. Zisserman. Multiple View Geometry in Computer Vision. Cambridge University Press, ISBN: 0521623049, 2000.
A. Heyden and K. Astrom. Flexible calibration: Minimal cases for auto-calibration. In Proc. ICCV, pages 350–355, 1999.
G. Newsam, D. Huynh, M. Brooks, and H. Pan. Recovering unknown focal lengths in self-calibration: an essentially linear algorithm and degenerate configurations. In Proc. 18th ISPRS Congress, (International Archives of Photogrammetry and Remote Sensing (IAPRS), vol. XXXI), 1996.
M. Pollefeys. Self-calibration and metric 3D reconstruction from uncalibrated image sequences. PhD thesis, ESAT-PSI, K.U.Leuven, 1999.
M. Pollefeys, R. Koch, and L. Van Gool. Self calibration and metric reconstruction in spite of varying and unknown internal camera parameters. In Proc. ICCV, pages 90–96, 1998.
M. Pollefeys, L. Van Gool, and A. Oosterlinck. The modulus constraint: a new constraint for self-calibration. In Proc. ICPR, pages 31–42, 1996.
A. Shashua, S. Avidan, and M. Werman. Trajectory triangulation over conic sections. In Proc. ICCV, pages 330–336, 1999.
D. Sinclair. Articulation detection for locally rigid objects. In R. Mohr and C. Wu, editors, Europe-China Workshop on Geometrical Modelling and Invariants for Computer Vision, pages 136–142. Xidan University Press, 1995.
P. Sturm. Critical motion sequences for the self-calibration of cameras and stereo systems with variable focal length. In Proc. BMVC, 1999.
P. H. S. Torn Motion segmentation and outlier detection. PhD thesis, Dept. of Engineering Science, University of Oxford, 1995.
P. H. S. Torr, A. W. Fitzgibbon, and A. Zisserman. Maintaining multiple motion model hypotheses over many views to recover matching and structure. In Proc. ICCV, pages 485–491, Jan 1998.
P. H. S. Torr and D. W. Murray. Statistical detection of independent movement from a moving camera. Image and Vision Computing, 1(4):180–187, May 1993.
P. H. S. Torr, A. Zisserman, and D. W. Murray. Motion clustering using the trilinear constraint over three views. In R. Mohr and C. Wu, editors, Europe-China Workshop on Geometrical Modelling and Invariants for Computer Vision, pages 118–125. Xidan University Press, 1995.
W. Triggs. Auto-calibration and the absolute quadric. In Proc. CVPR, pages 609–614, 1997.
W. Triggs. Autocalibration from planar scenes. In Proc. ECCV, 1998.
T. Vieville and D. Lingrand. Using singular displacements for uncalibrated monocular vision systems. In Proc. ECCV, LNCS 1064/1065, pages 207–216. Springer-Verlag, 1996.
R. G. Willson and S. A. Shafer. What is the center of the image? J. Opt. Soc. Am., 11(11):2946–2955, Nov 1994.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Fitzgibbon, A.W., Zisserman, A. (2000). Multibody Structure and Motion: 3-D Reconstruction of Independently Moving Objects. In: Computer Vision - ECCV 2000. ECCV 2000. Lecture Notes in Computer Science, vol 1842. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45054-8_58
Download citation
DOI: https://doi.org/10.1007/3-540-45054-8_58
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-67685-0
Online ISBN: 978-3-540-45054-2
eBook Packages: Springer Book Archive