Skip to main content
SpringerLink
Log in

A Geometric Analysis of Light Field Rendering

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

Recently, many image-based modeling and rendering techniques have been successfully designed to render photo-realistic images without the need for explicit 3D geometry. However, these techniques (e.g., light field rendering (Levoy, M. and Hanrahan, P., 1996. In SIGGRAPH 1996 Conference Proceedings, Annual Conference Series, Aug. 1996, pp. 31–42) and Lumigraph (Gortler, S.J., Grzeszczuk, R., Szeliski, R., and Cohen, M.F., 1996. In SIGGRAPH 1996 Conference Proceedings, Annual Conference Series, Aug. 1996, pp. 43–54)) may require a substantial number of images. In this paper, we adopt a geometric approach to investigate the minimum sampling problem for light field rendering, with and without geometry information of the scene. Our key observation is that anti-aliased light field rendering is equivalent to eliminating the “double image” artifacts caused by view interpolation.

Specifically, we present a closed-form solution of the minimum sampling rate for light field rendering. The minimum sampling rate is determined by the resolution of the camera and the depth variation of the scene. This rate is ensured if the optimal constant depth for rendering is chosen as the harmonic mean of the maximum and minimum depths of the scene. Moreover, we construct the minimum sampling curve in the joint geometry and image space, with the consideration of depth discontinuity. The minimum sampling curve quantitatively indicates how reduced geometry information can be compensated by increasing the number of images, and vice versa. Experimental results demonstrate the effectiveness of our theoretical analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Adelson, E.H. and Bergen, J.R. 1991. The plenoptic function and the elements of early vision. In Computational Models of Visual Processing, M.S. Landy and J.A. Movshon (Eds.), MIT Press, chap. 1, pp. 3-20.

  • Ayres, F. Jr. 1967. Theory and Problems of Projective Geometry. McGraw-Hill Inc.

  • Buehler, C., Bosse, M., McMillan, L., Gortler, S., and Cohen, M. 2001. Unstructured lumigraph rendering. In SIGGRAPH 2001 Conference Proceedings, Annual Conference Series, Aug. 2001, pp. 425-432.

  • Camahort, E., Lerios, A., and Fussell, D. 1998. Uniformly sampled light fields. In Proceedings of 9th EurographicsWorkshop on Rendering, pp. 117-130.

  • Chai, J.-X., Tong, X., Chan, C.-C., and Shum, H.-Y. 2000. Plenoptic sampling. In SIGGRAPH 2000 Conference Proceedings, Annual Conference Series, July 2000, pp. 307-318.

  • Chen, W.-C., Bouguet, J.-Y., Chu, M.H., and Grzeszczuk, R. 2002. Light field mapping: Efficient representation and hardware rendering of surface light fields. In SIGGRAPH 2002 Conference Proceedings, Annual Conference Series, Aug. 2002, pp. 447-456.

  • Chen, S.E. and Williams, L. 1993. View interpolation for image synthesis. In SIGGRAPH 1993 Conference Proceedings, J.T. Kajiya, (Ed.), vol. 27 of Annual Conference Series, Aug. 1993, pp. 279-288.

  • Gortler, S.J., Grzeszczuk, R., Szeliski, R., and Cohen, M.F. 1996. The lumigraph. In SIGGRAPH 1996 Conference Proceedings, Annual Conference Series, Aug. 1996, pp. 43-54.

  • Halle, M. 1994. Holographic stereograms as discrete imaging systems. In Practical Holography VIII, volume Proc. SPIE Vol. 2176, pp. 73-84.

    Google Scholar 

  • Hlaváč, V., Leonardis, A., and Werner, T. 1996. Automatic selection of reference views for image-based scene representations. In Proc. of ECCV'96, pp. 526-535.

  • Isaksen, A., McMillan, L., and Gortler, S.J. 2000. Dynamically reparameterized light fields. In SIGGRAPH 2000 Conference Proceedings, Annual Conference Series, July 2000, pp. 297-306.

  • Levoy, M. and Hanrahan, P. 1996. Light field rendering. In SIGGRAPH 1996 Conference Proceedings, Annual Conference Series, Aug. 1996, pp. 31-42.

  • Lin, Z. and Shum, H.-Y. 2000. On the number of samples needed in light field rendering with constant-depth assumption. In Proceedings of IEEE Computer Vision and Pattern Recognition 2000 (CVPR 2000) Conference, Hilton Head Island, South Carolina, USA, June 2000, pp. 588-579.

  • Nishino, K., Sato, Y., and Ikeuchi, K. 2001. Eigen-texture method: Appearance compression and synthesis based on a 3d model. IEEE Transactions on Pattern Pattern Analysis and Machine Intelligence, 23(11):1257-1265.

    Google Scholar 

  • Romeny, B. (Ed.) 1994. Geometry-Driven Diffusion in Computer Vision. Kluwer Academic Publishers: Netherlands.

    Google Scholar 

  • Schirmacher, H., Heidrich, W., and Seidel, H. 1999. Adaptive acquisition of lumigraphs from synthetic scenes. In Proceedings of Eurographics'99, pp. 151-159.

  • Shade, J., Gortler, S., He, L.-W., and Szeliski, R. 1998. Layered depth images. In SIGGRAPH 1998 Conference Proceedings, Annual Conference Series, July 1998, pp. 231-242.

  • Shum, H.-Y. and He, L.-W. 1999. Rendering with concentric mosaics. In SIGGRAPH 1999 Conference Proceedings, Annual Conference Series, Aug., pp. 299-306.

  • Shum, H.-Y., Wang, L., and Chai, J. 2001. Rendering by manifold hopping. In SIGGRAPH 2001 Technical Sketch, Aug. 2001, p. 253.

  • Sloan, P.P., Cohen, M.F., and Gortler, S.J. 1997. Time critical lumigraph rendering. In Symposium on Interactive 3D Graphics, pp. 17-23.

  • Tekalp, A.M. 1995. Digital Video Processing. Prentice Hall.

  • Wood, D.N. et al. 2000. Surface light fields for 3d photography. In SIGGRAPH 2000 Conference Proceedings, Annual Conference Series, pp. 287-296.

  • Wu, M. and Shum, H.-Y. 2000. Real-time stereo rendering of concentric mosaics with linear interpolation. In IEEE/SPIE Visual Communications and Image Processing (VCIP) 2000, June 2000, pp. 23-30.

  • Xu, G. and Zhang, Z. 1996. Epipolar Geometry in Stereo, Motion and Object Recognition: A Unified Approach. Kluwer Academic Publishers.

  • Zhang, C. and Li, J. 2000. Compression of lumigraph with multiple reference frame (mrf) prediction and just-in-time rendering. In IEEE Data Compression Conference, pp. 253-262.

Download references

Author information

Authors and Affiliations

  1. Microsoft Research Asia, Beijing, 100080, People's Republic of China

    Zhouchen Lin & Heung-Yeung Shum

Authors
  1. Zhouchen Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Heung-Yeung Shum
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Lin, Z., Shum, HY. A Geometric Analysis of Light Field Rendering. International Journal of Computer Vision 58, 121–138 (2004). https://doi.org/10.1023/B:VISI.0000015916.91741.27

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:VISI.0000015916.91741.27

Search

Navigation