Abstract
Most imaging sensors have limited dynamic range and hence are sensitive to only a part of the illumination range present in a natural scene. The dynamic range can be improved by acquiring multiple images of the same scene under different exposure settings and then combining them. In this paper, we describe a camera design for simultaneously acquiring multiple images. The cross-section of the incoming beam from a scene point is partitioned into as many parts as the required number of images. This is done by splitting the aperture into multiple parts and directing the beam exiting from each in a different direction using an assembly of mirrors. A sensor is placed in the path of each beam and exposure of each sensor is controlled either by appropriately setting its exposure parameter, or by splitting the incoming beam unevenly. The resulting multiple exposure images are used to construct a high dynamic range image. We have implemented a video-rate camera based on this design and the results obtained are presented.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Brajovic, V. and Kanade, T. 1996. A sorting image sensor: An example of massively parallel intensity-to-time processing for low latency computational sensors. In IEEE Conference on Robotics and Automation, pp. 1638–1643.
Burt, P.J. and Kolczynski, R.J. 1993. Enhanced image capture through fusion. In International Conference on Computer Vision, pp. 173–182.
Debevec, P.E. and Malik, J. 1997. Recovering high dynamic range radiance maps from photographs. In Proceedings of ACM, SIGGRAPH, pp. 369–378.
EIO. 2000. Optics and Optical Instruments Catalog. Edmund Industrial Optics.
Harada, K. 2000. Image generating device having adjustable sensitivity. 6141049, United States Patent.
Harvey, R.P. 1998. Optical beam splitter and electronic high speed camera incorporating such a beam splitter. US 5734507, United States Patent.
Healey, G.E. and Kondepudy, R. 1994. Radiometric CCD camera calibration and noise estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 16(3):267–276.
Hideaki, D., Yasuhiko, H., Yukio, K., and Masataka, S. 1996. Image sensor. 8223491, Japanese Patent.
Hiura, S. and Matsuyama, T. 1998. Depth measurement by the multifocus camera. In Conference on Computer Vision and Pattern Recognition, pp. 953–959.
Ikeda, E. 1998. Image data processing apparatus for processing combined image signals in order to extend dynamic range. 5801773, United States Patent.
Kaneko, T., Ohmi, T., Ohya, N., Kawahara, N., and Hattori, T. 1997. A new, compact and quick response dynamic focusing lens. In International Conference on Solid-State Sensors and Actuators, pp. 63–66.
Kaneko, Y., Saitoh, M., Hamaguchi, I., Uehira, K., and Komiya, K. 1993. Image forming apparatus for forming image corresponding to subject, dividing optical image corresponding to the subject into plural adjacent optical image parts. 5194959, United States Patent.
Kingslake, R. 1983. Optical System Design. Academic Press.
Madden, B.C. 1996. Extended intensity range imaging. Technical Report MS-CIS-93-96, Grasp Lab, University of Pennsylvania.
Mann, S. and Picard, R.W. 1995. On being 'undigital' with digital cameras: Extending dynamic range by combining differently exposed pictures. In Proceedings of IS&T 46th Annual Conference, pp. 422–428.
Mitsunaga, T. and Nayar, S.K. 1999. Radiometric self calibration. In Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 374–380.
Nayar, S.K. and Mitsunaga, T. 2000. High dynamic range imaging: Spatially varying pixel exposures. In Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 472–479.
Rubin, L.B., Lazarev, V.V., and Rakhimov, A.T. 1998. Optical system for partitioning a real image. 5835278, United States Patent.
Saito, K. 1996. Electronic image pickup device. Technical Report 8340486, Japanese Patent.
Simoncelli, E. and Farid, H. 1998. Direct differential range estimation using optical masks. In Proceedings of European Conference on Computer Vision, vol. 2, pp. 953–959.
Street, R.A. 1998. High dynamic range segmented pixel sensor array. 5789737, United States Patent.
Takahashi, K., Hieda, T., Satoh, C., Masui, T., Kobayashi, T., and Yoshimura, K. 1997. Image sensing device with diverse storage times used in picture composition. 5638118, United States Patent.
Tsutomu, K. 1998. Image pickup device. 10069011, Japanese Patent.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Aggarwal, M., Ahuja, N. Split Aperture Imaging for High Dynamic Range. International Journal of Computer Vision 58, 7–17 (2004). https://doi.org/10.1023/B:VISI.0000016144.56397.1a
Issue Date:
DOI: https://doi.org/10.1023/B:VISI.0000016144.56397.1a