Skip to main content
SpringerLink
Log in

Surface Reconstruction from Multiple Views Using Apparent Contours and Surface Texture

  • Chapter
Confluence of Computer Vision and Computer Graphics

Part of the book series: NATO Science Series ((ASHT,volume 84))

Abstract

We describe a novel approach to reconstructing the complete surface of an object from multiple views, where the camera circumnavigates the object. The approach combines the information available from the apparent contour with the information available from the imaged surface texture.

It is demonstrated that this approach of combining two information sources has significant advantages over using either the contour or texture alone: first, the geometric constraints available are complementary, so that the deficiencies of one source can be overcome by the strengths of the other; second, judicious use of the two sources enables an efficient automatic reconstruction algorithm to be developed.

In particular we make the following contributions: it is shown that the set of epipolar tangencies generates an epipolar net at which the visual hull coincides with the surface; a statistical cost function is defined which incorporates terms for error in image intensity similarity and geometric error in the apparent contour; and, an improved photo-consistency constraint is developed for space carving.

Examples of automatically generated texture-mapped graphical models are given for various objects and camera motions. The objects may contain concavities, and have non-trivial topology.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 54.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. N. Ayache and O. D. Faugeras. Building a consistent 3D representation of a mobile robot environment by combining multiple stereo views. In Proc. International Joint Conference on Artificial Intelligence, pages 808–810, 1987.

    Google Scholar 

  2. H. H. Baker and T. O. Binford. Depth from edge and intensity based stereo. In IJCAI81, pages 631–636, 1981.

    Google Scholar 

  3. P. Beardsley, P. Torr, and A. Zisserman. 3D model acquisition from extended image sequences. In Proc. European Conference on Computer Vision, LNCS 1064/1065, pages 683–695. Springer-Verlag, 1996.

    Google Scholar 

  4. R. Berthilsson and K. Åström. Reconstruction of 3-D curves from 2-D images using affine shape methods for curves. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, 1997.

    Google Scholar 

  5. E. Boyer and M.O. Berger. 3D surface reconstruction using occluding contours. International Journal of Computer Vision, 22(3):219–233, March 1997.

    Article  Google Scholar 

  6. R. Cipolla, K. Åström, and P. Giblin. Motion from the frontier of curved surfaces. In Proc. 5th International Conference on Computer Vision, Boston, pages 269–275, 1995.

    Google Scholar 

  7. R. Cipolla and A. Blake. Surface shape from the deformation of apparent contours. International Journal of Computer Vision, 9(2):83–112, 1992.

    Article  Google Scholar 

  8. G. Cross, A. W. Fitzgibbon, and A. Zisserman. Parallax geometry of smooth surfaces in multiple views. In Proc. 7th International Conference on Computer Vision, Kerkyra, Greece, pages 323–329, September 1999.

    Chapter  Google Scholar 

  9. G. Cross and A. Zisserman. Quadric surface reconstruction from dual-space geometry. In Proc. 6th International Conference on Computer Vision, Bombay, India, pages 25–31, January 1998.

    Google Scholar 

  10. O. Faugeras and R. Keriven. Complete dense stereovision using level set methods. In Proc. 5th European Conference on Computer Vision, Freiburg, Germany, pages 379–393, 1998.

    Google Scholar 

  11. A. W. Fitzgibbon, G. Cross, and A. Zisserman. Automatic 3D model construction for turn-table sequences. In R. Koch and L. Van Gool, editors, 3D Structure from Multiple Images of Large-Scale Environments, LNCS 1506, pages 155–170. Springer-Verlag, June 1998.

    Chapter  Google Scholar 

  12. A. W. Fitzgibbon and A. Zisserman. Automatic camera recovery for closed or open image sequences. In Proc. European Conference on Computer Vision, pages 311–326. Springer-Verlag, June 1998.

    Google Scholar 

  13. P. Giblin and R. Weiss. Reconstruction of surfaces from profiles. In Proc. 1st International Conference on Computer Vision, London, pages 136–144, London, 1987.

    Google Scholar 

  14. W. E. L. Grimson. From Images to Surfaces: A Computational Study of the Human Early Visual System. MIT Press, 1981.

    Google Scholar 

  15. T. Joshi, N. Ahuja, and J. Ponce. Structure and motion estimation from dynamic silhouettes under perspective projection. In Proc. 5th International Conference on Computer Vision, Boston, pages 290–295, 1995.

    Google Scholar 

  16. R. Koch. 3D surface reconstruction from stereoscopic image sequences. In Proc. 5th International Conference on Computer Vision, Boston, pages 109–114, 1995.

    Google Scholar 

  17. J. J. Koenderink. What does the occluding contour tell us about solid shape? Perception, 13:321–330, 1984.

    Article  Google Scholar 

  18. K. Kutulakos. Affine surface reconstruction by purposive viewpoint control. In Proc. 5th International Conference on Computer Vision, Boston, pages 894–901, 1995.

    Google Scholar 

  19. K. Kutulakos and S. Seitz. What do N photographs tell us about 3D shape? Technical Report 680, University of Rochester, January 1998.

    Google Scholar 

  20. K. Kutulakos and S. Seitz. A theory of shape by space carving. In Proc. 7th International Conference on Computer Vision, Kerkyra, Greece, pages 307–314, 1999.

    Chapter  Google Scholar 

  21. A. Laurentini. The visual hull concept for silhouette-based image understanding. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(2):150–162, February 1994.

    Article  Google Scholar 

  22. W. N. Martin and J. K. Aggarwal. Volumetric description of objects from multiple views. IEEE Transactions on Pattern Analysis and Machine Intelligence, 5(2): 150–158, March 1983.

    Article  Google Scholar 

  23. T. McInerney and D. Terzopoulos. Topologically adaptable snakes. In Proc. 5th International Conference on Computer Vision, Boston, pages 840–845, 1995.

    Google Scholar 

  24. S. B. Pollard, J. E. W. Mayhew, and J. P. Frisby. PMF: A stereo correspondence algorithm using a disparity gradient limit. Perception, 14:449–470, 1985.

    Article  Google Scholar 

  25. J. Porrill and S. B. Pollard. Curve matching and stereo calibration. Image and Vision Computing, 9(1):45–50, 1991.

    Article  Google Scholar 

  26. J. H. Rieger. Three dimensional motion from fixed points of a deforming profile curve. Optics Letters, 9(1):123–125, 1986.

    Article  Google Scholar 

  27. S.M. Seitz and C.R. Dyer. Photorealistic scene reconstruction by voxel coloring. In Proc. IEEE Conference on Computer Vision and Pattern Recognition, Puerto Rico, pages 1067–1073, 1997.

    Google Scholar 

  28. J. A. Sethian. Level Set Methods. Cambridge University Press, Cambridge, 1998.

    Google Scholar 

  29. A. Shashua and S. Toelg. The quadric reference surface: Theory and applications. In Proc. International Conference on Computer Vision, 1997.

    Google Scholar 

  30. S. Sullivan and J. Ponce. Automatic model construction and pose estimation from photographs using triangular splines. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20(10).1091–1096, October 1998.

    Article  Google Scholar 

  31. R. Szeliski. Rapid octree construction from image sequences. CVGIP, 58(1):23–32, July 1993.

    Article  Google Scholar 

  32. R. Szeliski and R. Weiss. Robust shape recovery from occluding contours using a linear smoother. International Journal of Computer Vision, 28(1):27–44, June 1998.

    Article  Google Scholar 

  33. R. Vaillant and O. D. Faugeras. Using extremal boundaries for 3-D object modeling. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2): 157–173, February 1992.

    Article  Google Scholar 

  34. Z. Zhang, R. Deriche, O. D. Faugeras, and Q. Luong. A robust technique for matching two uncalibrated images through the recovery of the unknown epipolar geometry. Artificial Intelligence, 78:87–119, 1995.

    Article  Google Scholar 

Download references

Authors
  1. Geoffrey Cross
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Andrew Zisserman
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Faculty of Computer and Information Science, University of Ljubljana, Tržaška 25, SI-1000, Ljubljana, Slovenia

    Aleš Leonardis Dipl.Ing. (1985), M.Sc. (1988) and Ph.D. (1993) (Associate Professor of computer and information science) & Franc Solina Dipl.Ing. (1979), M.Sc. (1982) and Ph.D. (1987) (Professor of computer and information science) (Associate Professor of computer and information science) &  (Professor of computer and information science)

  2. GRASP Laboratory, Department of Computer and Information Science, University of Pennsylvania, 19104-6389, Philadelphia, PA, USA

    Ruzena Bajcsy Ph.D. in 1967, Ph.D. in 1972 (Director of the Directorate for Computer and Information Science and Engineering (CISE) (Director of the Directorate for Computer and Information Science and Engineering (CISE)

  3. National Science Foundation, Washington, USA

    Ruzena Bajcsy Ph.D. in 1967, Ph.D. in 1972 (Director of the Directorate for Computer and Information Science and Engineering (CISE) (Director of the Directorate for Computer and Information Science and Engineering (CISE)

Rights and permissions

Reprints and permissions

Copyright information

© 2000 Springer Science+Business Media Dordrecht

About this chapter

Cite this chapter

Cross, G., Zisserman, A. (2000). Surface Reconstruction from Multiple Views Using Apparent Contours and Surface Texture. In: Leonardis, A., Solina, F., Bajcsy, R. (eds) Confluence of Computer Vision and Computer Graphics. NATO Science Series, vol 84. Springer, Dordrecht. https://doi.org/10.1007/978-94-011-4321-9_2

Download citation

  • DOI: https://doi.org/10.1007/978-94-011-4321-9_2

  • Publisher Name: Springer, Dordrecht

  • Print ISBN: 978-0-7923-6612-6

  • Online ISBN: 978-94-011-4321-9

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation