Abstract
We study the problem of aligning two 3D line reconstructions in projective, affine, metric or Euclidean space.
We introduce the 6 × 6 3D line motion matrix that acts on Plücker coordinates. We characterize its algebraic properties and its relation to the usual 4 × 4 point motion matrix, and propose various methods for estimating 3D motion from line correspondences, based on cost functions defined in images or 3D space. We assess the quality of the different estimation methods using simulated data and real images.
Similar content being viewed by others
References
Andreff, N., Espiau, B., and Horaud, R. 2000. Visual servoing from lines. In International Conference on Robotics and Automation, San Francisco.
Bartoli, A. and Sturm, P. 2001. The 3D line motion matrix and alignment of line reconstructions. In Proceedings of the Conference on Computer Vision and Pattern Recognition, Kauai, Hawaii, USA, IEEE Computer Society Press, vol. I, pp. 287–292.
Buchanan, T. 1992. Critical sets for 3D reconstruction using lines. In Proceedings of the 2nd European Conference on Computer Vision, G. Sandini (Ed.), Springer-Verlag, Santa Margherita Ligure, Italy, pp. 730–738.
Canny J. 1986. A computational approach to edge detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 8(6):679–698.
Csurka, G., Demirdjian, D., and Horaud, R. 1999. Finding the collineation between two projective reconstructions. Computer Vision and Image Understanding, 75(3):260–268.
Demirdjian, D. and Horaud, R. 2000. Motion-egomotion discrimination and motion segmentation from image-pair streams. Computer Vision and Image Understanding, 78(1):53–68.
Devernay, F. and Faugeras, O. 1996. From projective to euclidean reconstruction. In Proceedings of the Conference on Computer Vision and Pattern Recognition, San Francisco, California, USA, pp. 264–269.
Faugeras, O. and Mourrain, B. 1995. On the geometry and algebra of the point and line correspondences between in images. In Proceedings of the 5th International Conference on Computer Vision,Cambridge,Massachusetts, USA, pp. 951–956.
Faugeras, O.D. and Toscani, G. 1987. Camera calibration for 3D computer vision. In Proceedings of International Workshop on Machine Vision and Machine Intelligence, Tokyo, Japan.
Gill, P.E., Murray, W., and Wright, M.H. 1981. Practical Optimization. Academic Press.
Hager, G. and Toyama, K. 1998. X vision: A portable substrate for real-time vision applications. CVIU, 69(1):23–37.
Hartley, R.I. 1997. Lines and points in three views and the trifocal tensor. International Journal of Computer Vision, 22(2):125–140.
Hartley, R.I. and Zisserman, A. 2000. Multiple View Geometry in Computer Vision. Cambridge University Press.
Horaud, R., Csurka, G., and Demirdjian, D. 2000. Stereo calibration from rigid motions. IEEE Transactions on Pattern Analysis and Machine Intelligence, 22(12):1446–1452.
Horaud, R., Dornaika, F., and Espiau, B. 1997.Visually guided object grasping. IEEE Transactions on Robotics and Automation.
Horn, B.K.P., Hilden, H.M., and Negahdaripour, S. 1988. Closedform solution of absolute orientation using orthonormal matrices. Journal of the Optical Society of America A, 5(7):1127–1135.
Liebowitz, D. and Zisserman, A. 1998. Metric rectification for perspective images of planes. In Proceedings of the Conference on Computer Vision and Pattern Recognition, Santa Barbara, California, USA, pp. 482–488.
Liu, Y., Huang, T.S., and Faugeras, O.D. 1990. Determination of camera location from 2D to 3D line and point correspondences. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(1):28–37.
Luong, Q.T. and Faugeras, O. 1996. The fundamental matrix: Theory, algorithms and stability analysis. International Journal of Computer Vision, 17(1):43–76.
Luong, Q.T. and Vieville, T. 1996. Canonic representations for the geometries of multiple projective views. Computer Vision and Image Understanding, 64(2):193–229.
Navab, N. and Faugeras, O.D. 1997. The critical sets of lines for camera displacement estimation: A mixed euclidean-projective and constructive approach. International Journal of Computer Vision, 23(1):17–44.
Schmid, C. and Zisserman, A. 1997. Automatic line matching across views. In Proceedings of the Conference on Computer Vision and Pattern Recognition, Puerto Rico, USA, pp. 666–671.
Spetsakis, M. and Aloimonos, J. 1990. Structure from motion using line correspondences. International Journal of Computer Vision, 4:171–183.
Taylor, C.J. and Kriegman, D.J. 1995. Structure and motion from line segments in multiple images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(11):1021–1032.
Zhang, Z. 1994. Estimating motion and structure from correspondences of line segments between two perspective images. IEEE Transactions on Pattern Analysis and Machine Intelligence, 17(12):1129–1139.
Zhang, Z. 1998. Determining the epipolar geometry and its uncertainty: A review. International Journal of Computer Vision, 27(2):161–195.
Zhang, Z. and Faugeras, O.D. 1990. Tracking and grouping 3D line segments. In Proceedings of the 3rd International Conference on Computer Vision, Osaka, Japan, pp. 577–580.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Bartoli, A., Sturm, P. The 3D Line Motion Matrix and Alignment of Line Reconstructions. International Journal of Computer Vision 57, 159–178 (2004). https://doi.org/10.1023/B:VISI.0000013092.07433.82
Issue Date:
DOI: https://doi.org/10.1023/B:VISI.0000013092.07433.82