Skip to main content

The minimization of certain nondifferentiable sums of eigenvalues of symmetric matrices

  • Chapter
  • First Online:
Nondifferentiable Optimization

Part of the book series: Mathematical Programming Studies ((MATHPROGRAMM,volume 3))

Abstract

Properties of the sum of the q algebraically largest eigenvalues of any real symmetric matrix as a function of the diagonal entries of the matrix are derived. Such a sum is convex but not necessarily everywhere differentiable. A convergent procedure is presented for determining a minimizing point of any such sum subject to the condition that the trace of the matrix is held constant. An implementation of this procedure is described and numerical results are included.

Minimization problems of this kind arose in graph partitioning studies [8]. Use of existing procedures for minimizing required either a strategy for selecting, at each stage, a direction of search from the subdifferential and an appropriate step along the direction chosen [10,13] or computationally feasible characterizations of certain enlargements of subdifferentials [1,6] neither of which could be easily determined for the given problem. The arguments use results from eigenelement analysis and from optimization theory.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. D.P. Bertsekas and S.K. Mitter, “Steepest descent for optimization problems with nondifferentiable cost functions,” Proceedings of the 5th Annual Princeton Conference on Information Sciences and Systems, 1971.

    Google Scholar 

  2. Jane Cullum and W.E. Donath, “A block generalization of the symmetric s-step Lanczos algorithm”, IBM RC 4845 (May 1974).

    Google Scholar 

  3. Jane Cullum, W.E. Donath and P. Wolf, “An algorithm for minimizing certain non-differentiable convex functions”, IBM RC 4611 (November 1973).

    Google Scholar 

  4. Haskell B. Curry, “The method of steepest descent for nonlinear minimization problems,” Quarterly of Applied Mathematics 2, 258–261.

    Google Scholar 

  5. John Danskin, The theory of max-min (Springer, Berlin, 1964).

    Google Scholar 

  6. V.F. Demyanov, “Seeking a minimax on a bounded set”, Doklady Akademii Nauk SSSR 191 (1970) [in Russian; English transl.: Soviet Mathematics Doklady 11 (1970) 517–521].

    Google Scholar 

  7. W.E. Donath and A.J. Hoffman, “Algorithms for partitioning of graphs and computer logic based on eigenvectors of connection matrices,” IBM Technical Disclosure Bulletin 15 (3) (1972) 938–944.

    Google Scholar 

  8. W.E. Donath and A.J. Hoffman, “Lower bounds for the partitioning of graphs,” IBM Journal of Research and Development 17 (5) (1973) 420–425.

    Article  MATH  MathSciNet  Google Scholar 

  9. H.G. Eggleston, Convexity (Cambridge University Press, London, 1958).

    MATH  Google Scholar 

  10. Ju. Ermol’ev, “Methods of solution of nonlinear extremal, problems,” Kibernetika 4 (1966) 1–14.

    MathSciNet  Google Scholar 

  11. Ky Fan, “On a theorem of Weyl concerning eigenvalues of linear transformations,” Proceedings of the National Academy of Sciences of the U.S.A. 35 (1949) 652–655.

    Article  Google Scholar 

  12. E. Gilbert, “An iterative procedure for computing the minimum of a quadratic form on a convex set,” SIAM Journal Control 4 (1) (1966) 61–80.

    Article  MATH  Google Scholar 

  13. M. Held, P. Wolfe and H.P. Crowder, “Validation of subgradient optimization”, IBM RC 4462 (August 1973).

    Google Scholar 

  14. M. Newman and A. Pipano, “Fast model extraction in NASTRAN via the FEER computer Progrma NASTRAN: User’s experiences” Sept. 11–12 1973, NASA Langley Research Center, Hampton, Virgina.

    Google Scholar 

  15. R.T. Rockafellar, Convex analysis (Princeton University Press, Princeton, N.J., 1970).

    MATH  Google Scholar 

  16. H. Rutishauser, “Computational aspects of F.L. Bauer’s simultaneous iteration method,” Numerische Mathematik 13 (1969) 4–13.

    Article  MATH  Google Scholar 

  17. J.H. Wilkinson, The algebraic eigenvalue problem (Clarendon Press, Oxford, 1965).

    MATH  Google Scholar 

  18. Philip Wolfe, “A method of conjugate subgradients for minimizing nondifferentiable functions, Mathematical Programming Study 3 (1975) 145–173 (this volume).

    MathSciNet  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

M. L. Balinski Philip Wolfe

Rights and permissions

Reprints and permissions

Copyright information

© 1975 The Mathematical Programming Society

About this chapter

Cite this chapter

Cullum, J., Donath, W.E., Wolfe, P. (1975). The minimization of certain nondifferentiable sums of eigenvalues of symmetric matrices. In: Balinski, M.L., Wolfe, P. (eds) Nondifferentiable Optimization. Mathematical Programming Studies, vol 3. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0120698

Download citation

  • DOI: https://doi.org/10.1007/BFb0120698

  • Received:

  • Revised:

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-00763-7

  • Online ISBN: 978-3-642-00764-4

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics