Cyril Soler
Abstract
Optical systems used in photography and cinema produce depth-of-field effects, that is, variations of focus with depth. These effects are simulated in image synthesis by integrating incoming radiance at each pixel over the lense aperture. Unfortunately, aperture integration is extremely costly for defocused areas where the incoming radiance has high variance, since many samples are then required for a noise-free Monte Carlo integration. On the other hand, using many aperture samples is wasteful in focused areas where the integrand varies little. Similarly, image sampling in defocused areas should be adapted to the very smooth appearance variations due to blurring. This article introduces an analysis of focusing and depth-of-field in the frequency domain, allowing a practical characterization of a light field's frequency content both for image and aperture sampling. Based on this analysis we propose an adaptive depth-of-field rendering algorithm which optimizes sampling in two important ways. First, image sampling is based on conservative bandwidth prediction and a splatting reconstruction technique ensures correct image reconstruction. Second, at each pixel the variance in the radiance over the aperture is estimated and used to govern sampling. This technique is easily integrated in any sampling-based renderer, and vastly improves performance.
- Agarwal, S., Ramamoorthi, R., Belongie, S., and Jensen, H. W. 2003. Structured importance sampling of environment maps. ACM Trans. Graph. 22, 3, 605--612. Google Scholar
Digital Library
- Barsky, B. A., Horn, D. R., Klein, S. A., Pang, J. A., and Yu, M. 2003. Camera models and optical systems used in computer graphics: Part II, image based techniques. In Proceedings of the International Conference on Computational Science and its Applications. Google ScholarDigital Library
- Basri, R. and Jacobs, D. 2003. Lambertian reflectance and linear subspaces. IEEE Trans. Pattern Anal. Mach. Intell. 25, 2, 218--233. Google ScholarDigital Library
- Bolin, M. R. and Meyer, G. W. 1995. A frequency based ray tracer. In Computer Graphics. Annual Conference Series. ACM SIGGRAPH, 409--418. Google ScholarDigital Library
- Bolin, M. R. and Meyer, G. W. 1998. A perceptually based adaptive sampling algorithm. In Computer Graphics. Annual Conference Series. ACM SIGGRAPH, 299--309. Google ScholarDigital Library
- Chai, J.-X., Chan, S.-C., Shum, H.-Y., and Tong, X. 2000. Plenoptic sampling. In Computer Graphics. Annual Conference Series. ACM SIGGRAPH, 307--318. Google ScholarDigital Library
- Chen, M. and Arvo, J. 2000. Theory and application of specular path perturbation. ACM Trans. Graph. 19, 4, 246--278. Google ScholarDigital Library
- Cook, R. L., Carpenter, L., and Catmull, E. 1987. The Reyes image rendering architecture. Comput. Graphics (SIGGRAPH'87) 21, 4, 95--102. Google ScholarDigital Library
- Cook, R. L., Porter, T., and Carpenter, L. 1984. Distributed ray tracing. Comput. Graphics (SIGGRAPH'84) 18, 3, 137--145. Google ScholarDigital Library
- Durand, F., Holzschuch, N., Soler, C., Chan, E., and Sillion, F. X. 2005. A frequency analysis of light transport. ACM Trans. Graph. 24, 3, 1115--1126. Google ScholarDigital Library
- Ferwerda, J. A., Shirley, P., Pattanaik, S. N., and Greenberg, D. P. 1997. A model of visual masking for computer graphics. In Computer Graphics. Annual Conference Series. ACM SIGGRAPH, 143--152. Google ScholarDigital Library
- Haeberli, P. and Akeley, K. 1990. The accumulation buffer: Hardware support for high-quality rendering. Comput. Graph. 24, 4. Google ScholarDigital Library
- Igehy, H. 1999. Tracing ray differentials. In Computer Graphics. Annual Conference Series. ACM SIGGRAPH, 179--186. Google ScholarDigital Library
- Isaksen, A., McMillan, L., and Gortler, S. J. 2000. Dynamically reparameterized light fields. In Computer Graphics. Annual Conference Series. ACM SIGGRAPH, 297--306. Google ScholarDigital Library
- Kolb, C., Hanrahan, P. M., and Mitchell, D. 1995. A realistic camera model for computer graphics. In Computer Graphics. Annual Conference Series. ACM SIGGRAPH, 317--324. Google ScholarDigital Library
- Kraus, M. and Strengert, M. 2007. Depth-of-Field rendering by pyramidal image processing. Computer Graphics Forum 26, 3, 645--654.Google ScholarCross Ref
- Mitchell, D. P. 1991. Spectrally optimal sampling for distributed ray tracing. Computer Graphics 25, 4, 157--164. Google ScholarDigital Library
- Mitchell, D. P. 1996. Consequences of stratified sampling in graphics. In Computer Graphics. Annual Conference Series. ACM SIGGRAPH, 277--280. Google ScholarDigital Library
- Myszkowski, K. 1998. The visible differences predictor: Applications to global illumination problems. In Proceedings of the Workshop on Rendering. Eurographics, 223--236.Google ScholarCross Ref
- Ng, R. 2005. Fourier slice photography. ACM Trans. Graph. 24, 3, 735--744. Google ScholarDigital Library
- Ostromoukhov, V., Donohue, C., and Jodoin, P.-M. 2004. Fast hierarchical importance sampling with blue noise properties. ACM Trans. Graph. 23, 3, 488--495. Google ScholarDigital Library
- Potmesil, M. and Chakravarty, I. 1981. A lens and aperture camera model for synthetic image generation. Comput. Graph., 297--305. Google ScholarDigital Library
- Ramamoorthi, R. and Hanrahan, P. 2001. A signal-processing framework for inverse rendering. In Computer Graphics. Annual Conference Series. ACM SIGGRAPH, 117--128. Google ScholarDigital Library
- Ramamoorthi, R. and Hanrahan, P. 2004. A signal-processing framework for reflection. ACM Trans. Graph. 23, 4, 1004--1042. Google ScholarDigital Library
- Ramamoorthi, R., Mahajan, D., and Belhumeur, P. 2007. A first order analysis of lighting, shading, and shadows. ACM Trans. Graph. 26, 1. Google ScholarDigital Library
- Shinya, M., Takahashi, T., and Naito, S. 1987. Principles and applications of pencil tracing. Comput. Graph. 21, 4. Google ScholarDigital Library
- Stokes, W. A., Ferwerda, J. A., Walter, B., and Greenberg, D. P. 2004. Perceptual illumination components: A new approach to efficient, high quality global illumination rendering. ACM Trans. Graph. 23, 3, 742--749. Google ScholarDigital Library
- Suykens, F. and Willems, Y. 2001. Path differentials and applications. In Proceedings of the EG Workshop on Rendering. Eurographics, 257--268. Google ScholarDigital Library
- Walter, B., Arbree, A., Bala, K., and Greenberg, D. P. 2006. Multidimensional lightcuts. ACM Trans. Graph. 26, 3, 1081--1088. Google ScholarDigital Library
- Ward, G. J. and Heckbert, P. 1992. Irradiance gradients. In Proceedings of the EG Workshop on Rendering. Eurographics, 85--98.Google Scholar
- Zhou, T., Chen, J., and Pullen, M. 2007. Accurate depth of field simulation in real time. Comput. Graph. Forum 26, 1, 15--23.Google ScholarCross Ref
Index Terms
- Fourier depth of field
Recommendations
Fast 4D Sheared Filtering for Interactive Rendering of Distribution Effects
Soft shadows, depth of field, and diffuse global illumination are common distribution effects, usually rendered by Monte Carlo ray tracing. Physically correct, noise-free images can require hundreds or thousands of ray samples per pixel, and take a long ...
Real-time depth of field using multi-layer filtering
i3D '15: Proceedings of the 19th Symposium on Interactive 3D Graphics and GamesWe present a novel technique for rendering depth of field that addresses difficult overlap cases, such as close, but out-of-focus, geometry in the near-field. Such scene configurations are not managed well by state-of-the-art post-processing approaches ...
Relighting with the Reflected Irradiance Field: Representation, Sampling and Reconstruction
Image-based relighting (IBL) is a technique to change the illumination of an image-based object/scene. In this paper, we define a representation called the reflected irradiance field which records the light reflected from a scene as viewed at a fixed ...
Comments