Skip to main content
Log in

A trust-region framework for managing the use of approximation models in optimization

  • Research Papers
  • Published:
Structural optimization Aims and scope Submit manuscript

Abstract

This paper presents an analytically robust, globally convergent approach to managing the use of approximation models of varying fidelity in optimization. By robust global behaviour we mean the mathematical assurance that the iterates produced by the optimization algorithm, started at an arbitrary initial iterate, will converge to a stationary point or local optimizer for the original problem. The approach presented is based on the trust region idea from nonlinear programming and is shown to be provably convergent to a solution of the original high-fidelity problem. The proposed method for managing approximations in engineering optimization suggests ways to decide when the fidelity, and thus the cost, of the approximations might be fruitfully increased or decreased in the course of the optimization iterations. The approach is quite general. We make no assumptions on the structure of the original problem, in particular, no assumptions of convexity and separability, and place only mild requirements on the approximations. The approximations used in the framework can be of any nature appropriate to an application; for instance, they can be represented by analyses, simulations, or simple algebraic models. This paper introduces the approach and outlines the convergence analysis.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Avriel, M.; Williams, A.C. 1970: Complementary geometric programming.SIAM J. Appl. Math. 19, 125–141

    Google Scholar 

  • Barthelemy, J.-F.M.; Haftka, R.T. 1993: Approximation concepts for optimum structural design — a review.Struct. Optim. 5, 129–144

    Google Scholar 

  • Braibant, V.; Fleury, C. 1985: An approximation-concepts approach to shape optimal design.Comp. Meth. Appl. Mech. & Eng. 53, 119–148

    Google Scholar 

  • Carter, R.G. 1986:Multi-model algorithms for optimization. Ph.D. Thesis, Rice University, Houston, TX, USA

    Google Scholar 

  • Carter, R.G. 1991: On the global convergence of trust region algorithms using inexact gradient information.SIAM J. Num. Analysis 28, 251–265

    Google Scholar 

  • Chang, K.J.; Haftka, R.T.; Giles, G.L.; Kao, P.-J. 1993: Sensitivity-based scaling for approximating structural response.J. Aircraft 30, 283–288

    Google Scholar 

  • Dennis, Jr., J.E.; Schnabel, R.B. 1983:Numerical methods for unconstrained optimization and nonlinear equations. Englewood Cliffs, N.J.: Prentice Hall

    Google Scholar 

  • Dennis, J.E.; Torezon, V. 1997: Managing approximation models in optimization. In: Alexandrov, N.; Hussanini, M.Y. (eds.)Multidisciplinary design optimization state of the art, pp. 330–347. Philadelphia: SIAM

    Google Scholar 

  • Duffin, R.J.; Peterson, E.L.; Zener, C.M. 1967:Geometric programming, New York: John Wiley & Sons

    Google Scholar 

  • Fleury, C.; Braibant, V. 1986: Structural optimization a new dual method using mixed variables.Int. J. Num. Meth. Eng. 23, 409–428

    Google Scholar 

  • Friedlander, A.; Martínez, J.M.; Santos, S.A. 1996: A new trust region algorithm for bound constrained minimization.Tech. Report, Dept. Appl. Math., University of Campinas, Brazil

    Google Scholar 

  • Gay, D.M. 1982: On convergence testing in model/trust-region algorithms for unconstrained optimization.Computing Science Tech. Report No. 104, Bell Laboratories

  • Gill, P.E.; Murray, W.; Wright, M.H. 1981:Practical optimization. London: Academic Press

    Google Scholar 

  • Haftka, R.T.; Shore, C.P. 1979: Approximation methods for combined thermal/structural design.Tech. Report 1428, NASA

  • Hajela, P. 1986: Geometric programming strategles in large-scale structural synthesis.AIAA J. 24, 1173–1178

    Google Scholar 

  • Heinkenschloss, M. 1994: On the solution of a two ball trust region subproblem.Math. Prog. 64, 249–276

    Google Scholar 

  • Moré, J.J. 1983: Recent developments in algorithms and software for trust region methods. In: Bachem, A.; Grötschel, M.; Korte, B. (eds.)Mathematical programming. The state of the the art, pp. 258–287. Berlin, Heidelberg, New York: Springer

    Google Scholar 

  • Morris, A.J. 1972a: Approximation and complementary geometric programming.SIAM J. Appl. Math. 23, 527–531

    Google Scholar 

  • Morris, A.J. 1972b: Structural optimization by geometric programming.Int. J. Solids & Struct. 8, 847–864

    Google Scholar 

  • Morris, A.J. 1974: The optimisation of statically indeterminate structures by means of approximate geometric programming. In:Advisory Group for Aerospace Research and Development, Proc. No. 123, 2nd Symp. on Structural Optimization, pp. 6-1-6-15

  • Powell, M.J.D. 1975: Convergence properties of a class of minimization algorithms. In: Mangasarian, O.L.; Meyer, R.R.; Robinson, S.M. (eds.)Nonlinear programming 2, pp. 1–27. New York: Academic Press

    Google Scholar 

  • Schmit, L.A., Jr.; Farshi, B. 1974: Some approximation concepts for structural synthesis.AIAA J. 12, 692–699

    Google Scholar 

  • Schmit, L.A., Jr.; Fleury, C. 1980: Structural synthesis by combining approximation concepts and dual methods.AIAA J. 18, 1252–1260

    Google Scholar 

  • Schmit, L.A., Jr.; Miura, H. 1976: Approximation concepts for efficient structural synthesis.Tech. Report CR-2552, NASA

  • Schultz, G.A.; Schnabel, B.; Byrd, R.H. 1985: A family of trust region based algorithms for unconstrained minimization with strong global convergence properties.SIAM J. Num. Analysis 22, 47–67

    Google Scholar 

  • Sorensen, D.C. 1982: Newton's method with a model trust region modification.SIAM J. Num. Analysis 19, 409–426

    Google Scholar 

  • Starnes, J.H., Jr.; Haftka, R.T. 1979: Preliminary design of composite wings for buckling, strength, and displacement constraints.J. Aircraft 16, 564–570

    Google Scholar 

  • Storaasli, O.O.; Sobieszczanski-Sobieski, J. 1974: On the accuracy of Taylor approximation for structure resizing.AIAA J. 12, 231–233

    Google Scholar 

  • Templeman, A.B.; Winterbottom, S.K. 1974: Structural design applications of geometric programming. In:Advisory Group for Aerospace Research and Development, Proc. No. 123, 2nd Symp. on Structural Optimization, pp. 5-1-5-15

  • Vanderplaats, G.N. 1984:Numerical optimization techniques for engineering design. McGraw-Hill

Download references

Author information

Authors and Affiliations

Authors

Additional information

Communicated by J. Sobieski

This research was supported by the Dept. of Energy grant DEFG03-95ER25257 and Air Force Office of Scientific Research grant F49620-95-1-0210

This research was supported by the National Aeronautics and Space Administration under NASA Contract No. NAS1-19480 while the author was in residence at the Institute for Computer Applications in Science and Engineering (ICASE), NASA Langley Research Center, Hampton, VA 23681, USA

This research was supported by the Air Force Office of Scientific Research grant F49620-95-1-0210 and by the National Aeronautics and Space Administration under NASA Contract No. NAS1-19480 while the author was in residence at the Institute for Computer Applications in Science and Engineering (ICASE), NASA Langley Research Center, Hampton, VA 23681, USA

Rights and permissions

Reprints and permissions

About this article

Cite this article

Alexandrov, N.M., Dennis, J.E., Lewis, R.M. et al. A trust-region framework for managing the use of approximation models in optimization. Structural Optimization 15, 16–23 (1998). https://doi.org/10.1007/BF01197433

Download citation

  • Received:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01197433

Keywords

Navigation