Skip to main content
SpringerLink
Log in

Images as Embedded Maps and Minimal Surfaces: Movies, Color, Texture, and Volumetric Medical Images

  • Published:
International Journal of Computer Vision Aims and scope Submit manuscript

Abstract

We extend the geometric framework introduced in Sochen et al. (IEEE Trans. on Image Processing, 7(3):310–318, 1998) for image enhancement. We analyze and propose enhancement techniques that selectively smooth images while preserving either the multi-channel edges or the orientation-dependent texture features in them. Images are treated as manifolds in a feature-space. This geometrical interpretation lead to a general way for grey level, color, movies, volumetric medical data, and color-texture image enhancement.

We first review our framework in which the Polyakov action from high-energy physics is used to develop a minimization procedure through a geometric flow for images. Here we show that the geometric flow, based on manifold volume minimization, yields a novel enhancement procedure for color images. We apply the geometric framework and the general Beltrami flow to feature-preserving denoising of images in various spaces.

Next, we introduce a new method for color and texture enhancement. Motivated by Gabor's geometric image sharpening method (Gabor, Laboratory Investigation, 14(6):801–807, 1965), we present a geometric sharpening procedure for color images with texture. It is based on inverse diffusion across the multi-channel edge, and diffusion along the edge.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Alvarez, L. and Mazorra, L. 1994. Signal and image restoration using shock filters and anisotropic diffusion. SIAM J. Numer. Anal, 31:590–605.

    Google Scholar 

  • Blake, A. and Zisserman, A. 1987. Visual Reconstruction. MIT Press: Cambridge, Massachusetts.

    Google Scholar 

  • Blomgren, P. and Chan, T.F. 1996. Color TV: Total variation methods for restoration of vector valued images. Cam TR, UCLA.

  • Blomgren, P. and Chan, T.F. 1998. Color TV: Total variation methods for restoration of vector valued images. IEEE Trans. on Image Processing, 7(3):304–309.

    Google Scholar 

  • Bovik, A.C., Clark, M., and Geisler, W.S. 1990. Multichannel texture analysis using localized spatial filters. IEEE Trans. on PAMI, 12(1):55–73.

    Google Scholar 

  • Caselles, V., Kimmel, R., and Sapiro, G. 1995. Geodesic active contours. In Proceedings ICCV'95, Boston, Massachusetts, June 1995, pp. 694–699.

  • Chambolle, A. 1994. Partial differential equations and image processing. In Proceedings IEEE ICIP, Austin, Texas, Nov. 1994, Vol. 1, pp. 16–20.

    Google Scholar 

  • Cottet, G.H. and Germain, L. 1993. Image processing through reaction combined with nonlinear diffusion. Math. Comp., 61:659–673.

    Google Scholar 

  • Daubechies, I. 1990. The wavelet transform, time frequency localization and signal analysis. IEEE Trans. Information Theory, 36(5):961–1004.

    Google Scholar 

  • Di Zenzo, S. 1986. A note on the gradient of a multi image. Computer Vision, Graphics, and Image Processing, 33:116–125.

    Google Scholar 

  • Duffin, R.J. and Schaeffer, A.C. 1952. A class of nonharmonic Fourier series. Trans. Am. Math. Soc., 72:341–366.

    Google Scholar 

  • El-Fallah, A.I. and Ford, G.E. 1998. On mean curvature diffusion in nonlinear image filtering. Pattern Rec. Letters, 19:433–437.

    Google Scholar 

  • El-Fallah, A.I., Ford, G.E., Algazi V.R., and Estes, R.R. 1994. The invariance of edges and corners under mean curvature diffusions of images. In Processing III SPIE, Vol. 2421, pp. 2–14.

    Google Scholar 

  • Gabor, D. 1965. Information theory in electron microscopy. Laboratory Investigation, 14(6):801–807.

    Google Scholar 

  • von Helmholtz, H. 1896. Handbuch der Psychologischen Optik. Voss: Hamburg.

    Google Scholar 

  • Kichenassamy, S., Kumar, A., Olver, P., Tannenbaum, A., and Yezzi, A. 1995. Gradient flows and geometric active contour models. In Proceedings ICCV'95, Boston, Massachusetts, June 1995, pp. 810–815.

  • Kimmel, R. 1998. A natural norm for color processing. In Proc. of 3rd Asian Conf. on Computer Vision, Hong Kong, Springer-Verlag, LNCS 1351. Jan. 1998, pp. 88–95.

    Google Scholar 

  • Kimmel, R., Malladi, R., and Sochen, N. 1998. Image processing via the beltrami operator. In Proc. of 3-rd Asian Conf. on Computer Vision, HongKong, Jan. 1998. Springer-Verlag, LNCS 1351, pp. 574–581.

  • Kimmel, R. and Sochen, N. 1999. Geometric-variational approach for color image enhancement and segmentation. In Proc. 2nd Int. Conference on Scale-Space Theories in Computer Vision Geometric Image Flows, Nonlinear Diffusion, Functional Minimisation, and Linear Scale-Space, Corfu, Sept. 1999.

  • Kimmel, R., Sochen, N., and Malladi, R. 1997. From high energy physics to low level vision. In Lecture Notes in Computer Science: First International Conference on Scale-Space Theory in Computer Vision. Springer-Verlag, Vol. 1252, pp. 236–247.

    Google Scholar 

  • Lee, T.S. 1996. Image representation using2DGabor-wavelets. IEEE Trans. on PAMI, 18(10):959–971.

    Google Scholar 

  • Lee, T.S., Mumford, D., and Yuille, A.L. 1992. Texture segmentation by minimizing vector valued energy functionals: the couple-membrane model. In Lecture Notes in Computer Science, 588, Computer Vision: ECCV'92, G. Sandini (Ed.). Springer-Verlag, pp. 165–173.

  • Lindenbaum, M., Fischer, M., and Bruckstein, A.M. 1994. On Gabor's contribution to image enhancement. Pattern Recognition, 27(1):1–8.

    Google Scholar 

  • MacAdam, D.L. 1942. Visual sensitivity to color differences in daylight. J. Opt. Soc. Am., 32:247.

    Google Scholar 

  • MacAdam, D.L. 1943. Specification of small chromaticity differences, J. Opt. Soc. Am., 33:18.

    Google Scholar 

  • Malladi, R. and Sethian, J.A. 1996. Image processing: Flows under min/max curvature and mean curvature. Graphical Models and Image Processing, 58(2):127–141, March 1996.

    Google Scholar 

  • Manjunath, B.S. and Ma, W.Y. 1996. Texture features for browsing and retrieval of image data. IEEE Trans. on PAMI, 18(8):837–841.

    Google Scholar 

  • Masters, T. 1996. Signal and Image Processing with Neural Networks: A CCC Sourcebook. Wiley: New York.

    Google Scholar 

  • Mumford, D. and Shah, J. 1985. Boundary detection by minimizing functionals. In Proceedings of CVPR, Computer Vision and Pattern Recognition, San Francisco, pp. 22–26.

  • Olshausen, B.A. and Field, D.J. 1996. Emergence of simple-cell receptive field properties by learning a sparse code for natural images. Nature, 381:607–609.

    Google Scholar 

  • Osher, S.J. and Rudin, L.I. 1990. Feature-oriented image enhancement using shock filters. SIAM J. Numer. Analy., 27(4):919–940, August 1990.

    Google Scholar 

  • Perona, P. and Malik, J. 1990. Scale-space and edge detection using anisotropic diffusion. IEEE-PAMI, 12:629–639.

    Google Scholar 

  • Polyakov, A.M. 1981. Quantum geometry of bosonic strings. Physics Letters B, 103B(3):207–210.

    Google Scholar 

  • Porat, M. and Zeevi, Y.Y. 1988. The generalized Gabor scheme of image representation in biological and machine vision. IEEE Trans. on PAMI, 10(4):452–468.

    Google Scholar 

  • Proesmans, M., Pauwels, E., and van Gool, L. 1994. Coupled geometry-driven diffusion equations for low level vision. In Geometric-Driven Diffusion in Computer Vision, B.M. ter Haar Romeny (Ed.). Kluwer Academic Publishers: The Netherlands. pp. 191–228.

    Google Scholar 

  • Richardson, T. and Mitter, S. 1994. Approximation, computation, and distoration in the variational formulation. In Geometric-Driven Diffusion in Computer Vision, B.M. ter Haar Romeny (Ed.). Kluwer Academic Publishers: The Netherlands.

    Google Scholar 

  • ter Haar Romeny, B.M. (Ed.). 1994. Geometric Driven Diffusion in Computer Vision. Kluwer Academic Publishers: The Netherlands.

    Google Scholar 

  • Rubner, Y. and Tomasi, C. 1996. Coalescing texture descriptors. In Proceedings of the ARPA Image Understanding Workshop, Feb. 1996, pp. 927–936.

  • Rudin, L., Osher, S., and Fatemi, E. 1992. Nonlinear total variation based noise removal algorithms. Physica D, 60:259–268.

    Google Scholar 

  • Sapiro, G. 1996. Vector-valued active contours. In Proceedings IEEE CVPR'96, pp. 680–685.

  • Sapiro, G. and Ringach, D. 1996a. Anisotropic diffusion of multivalued images. In 12th Int. Conf. on Analysis and Optimization of Systems: Images, Wavelets and PDE's, London Springer, Lecture Notes in Control and Information Sciences, Vol. 219, pp. 134–140.

    Google Scholar 

  • Sapiro, G. and Ringach, D.L. 1996b. Anisotropic diffusion of multivalued images with applications to color filtering. IEEE Trans. Image Proc., 5:1582–1586.

    Google Scholar 

  • Schrödinger, E. 1920. Grundlinien einer theorie der farbenmetrik in tagessehen. Ann. Physik, 63:481.

    Google Scholar 

  • Shah, J. 1996a. A common framework for curve evolution, segmentation and anisotropic diffusion. In Proceedings IEEE CVPR'96, pp. 136–142.

  • Shah, J. 1996b. Curve evolution and segmentation functionals: Application to color images. In Proceedings IEEE ICIP'96, pp. 461–464.

  • Sochen, N., Kimmel, R., and Malladi, R. 1996. From high energy physics to low level vision. Report LBNL 39243, LBNL, UC Berkeley, CA 94720, August 1996. Presented in ONR workshop, UCLA, Sept. 5, 1996.

    Google Scholar 

  • Sochen, N., Kimmel, R., and Malladi, R. 1998. A general framework for low level vision. IEEE Trans. on Image Processing, 7(3):310–318.

    Google Scholar 

  • Sochen, N. and Zeevi, Y.Y. 1998. Images as manifolds embedded in a spatial feature non-Euclidean space. In IEEE ICIP'98, Chicago, IL, pp. 166–170.

  • Steiner, A., Kimmel, R., and Bruckstein, A.M. 1998. Shape enhancement and exaggeration. Graphical Models and Image Processing, 60(2):112–124.

    Google Scholar 

  • Stiles,S. 1946. A modified Helmholtz line element in brightness-colour space. Proc. Phys. Soc. (London), 58:41.

    Google Scholar 

  • Vos, J.J. and Walraven, P.L. 1972. An analytical desription of the line element in the zonefluctuation model of color vision II. The derivative of the line element. Vision Research, 12:1345–1365.

    Google Scholar 

  • Weickert, J. 1994. Scale-space properties of nonlinear diffusion filtering with diffusion tensor. Report no. 110, Laboratory of Technomathematics, University of Kaiserslautern, P.O. Box 3049, 67653 Kaiserslautern, Germany.

    Google Scholar 

  • Weickert, J. 1995. Multiscale texture enhancement. In Lecture Notes in Computer Science, Vol. 970: Computer Analysis of Images and Patterns, Springer, pp. 230–237.

  • Weickert, J. 1997. Coherence-enhancing diffusion of colour images. In Proc. VII National Symposium on Pattern Rec. and Image Analysis, Barcelona, Vol. 1, pp. 239–244.

    Google Scholar 

  • Weickert, J. 1998. Anisotropic Diffusion in Image Processing. Teubner: Stuttgart. ISBN 3-519-02606-6.

    Google Scholar 

  • Weickert, J. 1999. Coherence-enhancing diffusion in color images. Image and Vision Computing, 17(3/4):199–210.

    Google Scholar 

  • Whitaker, R. and Gerig, G. 1994. Vector-valued diffusion. In Geometric-Driven Diffusion in Computer Vision, B.M. ter Haar Romeny (Ed.). Kluwer Academic Publishers: The Netherlands, pp. 93–134.

    Google Scholar 

  • Wyszecki, G. and Stiles, W.S. 1982. Color Science: Concepts and Methods, Qualitative Data and Formulae (2nd ed.). John Wiley & Sons.

  • Yanowitz, S.D. and Bruckstein, A.M. 1989. A new method for image segmentation. Computer Vision, Graphics, and Image Processing, 46:82–95.

    Google Scholar 

  • Yezzi, A. 1998. Modified curvature motion for image smoothing and enhancement. IEEE Trans. IP, 7(3):345–352.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, Technion, Haifa, 32000, Israel

    R. Kimmel

  2. Lawrence Berkeley National Laboratory, University of California, Berkeley, CA, 94720, USA

    R. Malladi

  3. Dept. of Applied Mathematics, School of Mathematical Science, Tel Aviv University, Tel Aviv, 69978, Israel

    N. Sochen

Authors
  1. R. Kimmel
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. R. Malladi
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. N. Sochen
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kimmel, R., Malladi, R. & Sochen, N. Images as Embedded Maps and Minimal Surfaces: Movies, Color, Texture, and Volumetric Medical Images. International Journal of Computer Vision 39, 111–129 (2000). https://doi.org/10.1023/A:1008171026419

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1008171026419

Search

Navigation