Abstract
In Ref. 1, Nocedal and Overton proposed a two-sided projected Hessian updating technique for equality constrained optimization problems. Although local two-step Q-superlinear rate was proved, its global convergence is not assured. In this paper, we suggest a trust-region-type, two-sided, projected quasi-Newton method, which preserves the local two-step superlinear convergence of the original algorithm and also ensures global convergence. The subproblem that we propose is as simple as the one often used when solving unconstrained optimization problems by trust-region strategies and therefore is easy to implement.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Nocedal, J., andOverton, M. L.,Projected Hessian Updating Algorithms for Nonlinearly Constrained Optimization, SIAM Journal on Numerical Analysis, Vol. 22, pp. 821–850, 1985.
Zhang, J., andZhu, D.,Some Improved Two-Sided Projected Quasi-Newton Algorithms and Their Convergence, Part 1: Method and Global Convergence, Acta Mathematicae Applicatae Sinica (English Series), Vol. 5, pp. 33–45, 1989.
Zhang, J., andZhu, D.,Some Improved Two-Sided Projected Quasi-Newton Algorithms and Their Convergence, Part 2: Local Convergence Rate and Numerical Results, Acta Mathematicae Applicatae Sinica (English Series), Vol. 5, pp. 46–59, 1989.
Bertsekas, D. P.,Constrained Optimization and Lagrange Multiplier Methods, Academic Press, New York, New York, 1982.
Fletcher, R.,An Exact Penalty Function for Nonlinear Programming with Inequalities, Mathematical Programming, Vol. 5, pp. 129–150, 1973.
Moré, J. J., andSorensen, D. C.,Computing a Trust Region Step, SIAM Journal on Scientific and Statistical Computing, Vol. 4, pp. 553–572, 1983.
Moré, J. J.,Recent Developments in Algorithms and Software for Trust Region Methods, Mathematical Programming: The State of the Art, Edited by A. Bachem, M. Grotschel, and B. Korte, Springer-Verlag, Berlin, Germany, pp. 258–287, 1983.
Boggs, P. T., andTolle, J. W.,A Family of Descent Functions for Constrained Optimization, SIAM Journal on Numerical Analysis, Vol. 21, pp. 1146–1161, 1984.
Sorenson, D. C.,Newton's Method with a Model Trust-Region Modification, SIAM Journal on Numerical Analysis, Vol. 19, pp. 406–426, 1982.
Celis, M. R., Dennis, J. R. E., andTapia, R. A.,A Trust Region Strategy for Nonlinear Equality Constrained Optimization, Numerical Optimization 1984, Edited by P. T. Boggs, R. H. Byrd, and R. B. Schnabel, Society for Industrial and Applied Mathematics, Philadelphia, Pennsylvania, pp. 71–82, 1984.
Byrd, R. H., Schnabel, R. B., andShultz, A. G.,A Trust Region Algorithm for Nonlinear Constrained Optimization, SIAM Journal on Numerical Analysis, Vol. 24, pp. 1152–1170, 1987.
Powell, M. J. D., andYuan, Y.,A Trust Region Method for Equality Constrained Optimization, Report No. DAMTP-1986/NA2, Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, England, 1986.
Author information
Authors and Affiliations
Additional information
Communicated by D. F. Shanno
This research was supported in part by the National Natural Science Foundation of China.
Rights and permissions
About this article
Cite this article
Zhang, J.Z., Zhu, D.T. Projected quasi-Newton algorithm with trust region for constrained optimization. J Optim Theory Appl 67, 369–393 (1990). https://doi.org/10.1007/BF00940481
Issue Date:
DOI: https://doi.org/10.1007/BF00940481