Skip to main content
Log in

An overview of bilevel optimization

  • Published:
Annals of Operations Research Aims and scope Submit manuscript

Abstract

This paper is devoted to bilevel optimization, a branch of mathematical programming of both practical and theoretical interest. Starting with a simple example, we proceed towards a general formulation. We then present fields of application, focus on solution approaches, and make the connection with MPECs (Mathematical Programs with Equilibrium Constraints).

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Aiyoshi, E., & Shimizu, K. (1981). Hierarchical decentralized systems and its new solution by a barrier method. IEEE Transactions on Systems, Man, and Cybernetics, 11, 444–449.

    Article  Google Scholar 

  • Aiyoshi, E., & Shimizu, K. (1984). A solution method for the static constrained Stackelberg problem via penalty method. IEEE Transactions on Automatic Control, 29, 1111–1114.

    Article  Google Scholar 

  • Al-Khayal, F. A., Horst, R., & Pardalos, P. M. (1992). Global optimization of concave functions subject to quadratic constraints: an application in nonlinear bilevel programming. Annals of Operations Research, 34, 125–147.

    Article  Google Scholar 

  • Anandalingam, G., & Friesz, T. (1992). Hierarchical optimization: an introduction. Annals of Operations Research, 34, 1–11.

    Article  Google Scholar 

  • Audet, C., Hansen, P., Jaumard, B., & Savard, G. (1997). Links between linear bilevel and mixed 0-1 programming problems. Journal of Optimization Theory and Applications, 93, 273–300.

    Article  Google Scholar 

  • Auslender, A. (1976). Optimisation: méthodes numériques. Paris: Masson.

    Google Scholar 

  • Bard, J. F. (1988). Convex two-level optimization. Mathematical Programming, 40, 15–27.

    Article  Google Scholar 

  • Bard, J. F. (1998). Practical bilevel optimization. Nonconvex optimization and its applications (Vol. 30) Dordrecht: Kluwer Academic.

    Google Scholar 

  • Bard, J. F., & Falk, J. (1982). An explicit solution to the multi-level programming problem. Computers and Operations Research, 9, 77–100.

    Article  Google Scholar 

  • Bard, J. F., & Moore, J. T. (1990). A branch and bound algorithm for the bilevel programming problem. SIAM Journal of Scientific and Statistical Computing, 11, 281–292.

    Article  Google Scholar 

  • Bard, J. F., Plummer, J., & Sourie, J. C. (2000). A bilevel programming approach to determining tax credits for biofuel production. European Journal of Operational Research, 120, 30–46.

    Article  Google Scholar 

  • Ben-Ayed, O. (1993). Bilevel linear programming. Computers and Operations Research, 20, 485–501.

    Article  Google Scholar 

  • Ben-Ayed, O., & Blair, C. (1990). Computational difficulties of bilevel linear programming. Operations Research, 38, 556–560.

    Google Scholar 

  • Bi, Z., Calamai, P. H., & Conn, A. R. (1989). An exact penalty function approach for the linear bilevel programming problem. Technical Report #167-O-310789, Department of Systems Design Engineering, University of Waterloo.

  • Bi, Z., Calamai, P. H., & Conn, A. R. (1991). An exact penalty function approach for the nonlinear bilevel programming problem. Technical Report #180-O-170591, Department of Systems Design Engineering, University of Waterloo.

  • Bialas, W., & Karwan, M. (1984). Two-level linear programming. Management Science, 30, 1004–1020.

    Google Scholar 

  • Bialas, W., Karwan, M., & Shaw, J. (1980). A parametric complementarity pivot approach for two-level linear programming. Technical Report 80-2, State University of New York at Buffalo, Operations Research Program.

  • Bracken, J., & McGill, J. (1973). Mathematical programs with optimization problems in the constraints. Operations Research, 21, 37–44.

    Google Scholar 

  • Bracken, J., & McGill, J. (1974). Defense applications of mathematical programs with optimization problems in the constraints. Operations Research, 22, 1086–1096.

    Google Scholar 

  • Bracken, J., & McGill, J. (1978). Production and marketing decisions with multiple objectives in a competitive environment. Journal of Optimization Theory and Applications, 24, 449–458.

    Article  Google Scholar 

  • Brotcorne, L., Labbé, M., Marcotte, P., & Savard, G. (2001). A bilevel model for toll optimization on a multicommodity transportation network. Transportation Science, 35, 1–14.

    Article  Google Scholar 

  • Candler, W., & Norton, R. (1977). Multilevel programming. Technical Report 20, World Bank Development Research Center, Washington D.C., USA.

  • Candler, W., & Townsley, R. (1982). A linear two-level programming problem. Computers and Operations Research, 9, 59–76.

    Article  Google Scholar 

  • Case, L. M. (1999). An 1 penalty function approach to the nonlinear bilevel programming problem. PhD thesis, University of Waterloo, Ontario, Canada.

  • Chen, Y., & Florian, M. (1992). On the geometric structure of linear bilevel programs: a dual approach. Technical Report CRT-867, Centre de Recherche sur les Transports, Université de Montréal, Montréal, QC, Canada.

  • Chen, Y., Florian, M., & Wu, S. (1992). A descent dual approach for linear bilevel programs. Technical Report CRT-866, Centre de Recherche sur les Transports, Université de Montréal, Montréal, QC, Canada.

  • Clarke, F. H. (1990). Optimization and nonsmooth analysis. Philadelphia: SIAM.

    Google Scholar 

  • Colson, B. (September 1999). Mathematical programs with equilibrium constraints and nonlinear bilevel programming problems. Master’s thesis, Department of Mathematics, FUNDP, Namur, Belgium.

  • Colson, B. (October 2002). BIPA (BIlevel programming with approximation methods): software guide and test problems. Technical Report CRT-2002-38, Centre de Recherche sur les Transports, Université de Montréal, Montréal, QC, Canada.

  • Colson, B., Marcotte, P., & Savard, G. (March 2005a). A trust-region method for nonlinear programming: algorithm and computational experience. Computational Optimization and Applications, 30.

  • Colson, B., Marcotte, P., & Savard, G. (2005b). Bilevel programming: a survey. 4OR, 3, 87–107.

    Article  Google Scholar 

  • Conn, A. R., Gould, N. I. M., & Toint, Ph. L. (2000). Trust-region methods. Philadelphia: SIAM.

    Google Scholar 

  • Constantin, I., & Florian, M. (1995). Optimizing frequencies in a transit network: a nonlinear bi-level programming approach. International Transactions in Operational Research, 2, 149–164.

    Article  Google Scholar 

  • Côté, J.-P., Marcotte, P., & Savard, G. (2003). A bilevel modeling approach to pricing and fare optimization in the airline industry. Journal of Revenue and Pricing Management, 2, 23–36.

    Article  Google Scholar 

  • Dempe, S. (1992a). A necessary and a sufficient optimality condition for bilevel programming problems. Optimization, 25, 341–354.

    Google Scholar 

  • Dempe, S. (1992b). Optimality conditions for bilevel programming problems. In P. Kall (Ed.), System modelling and optimization (pp. 17–24). Heidelberg: Springer.

    Google Scholar 

  • Dempe, S. (2002). Foundations of bilevel programming. Nonconvex optimization and its applications, (Vol. 61). Dordrecht: Kluwer Academic.

    Google Scholar 

  • Dempe, S. (2003). Annotated bibliography on bilevel programming and mathematical programs with equilibrium constraints. Optimization, 52, 333–359.

    Article  Google Scholar 

  • Dirkse, S. P., & Ferris, M. C. (1999). Modeling and solution environments for MPEC: gams & matlab. In M. Fukushima, & L. Qi (Eds.), Reformulation: nonsmooth, piecewise smooth, semismooth and smoothing methods (pp. 127–148). Dordrecht: Kluwer Academic.

    Google Scholar 

  • Edmunds, T., & Bard, J. F. (1991). Algorithms for nonlinear bilevel mathematical programs. IEEE Transactions on Systems, Man, and Cybernetics, 21, 83–89.

    Article  Google Scholar 

  • Facchinei, F., Jiang, H., & Qi, L. (1996). A smoothing method for mathematical programs with equilibrium constraints. Technical Report R03-96, Università di Roma “La Sapienza”, Dipartimento di Informatica e Sistemistica.

  • Falk, J. E., & Liu, J. (1995). On bilevel programming, Part I : general nonlinear cases. Mathematical Programming, 70, 47–72.

    Google Scholar 

  • Fletcher, R., & Leyffer, S. (2002). Numerical experience with solving MPECs by nonlinear programming methods. Numerical Analysis Report NA/210, Department of Mathematics, University of Dundee, Dundee, Scotland.

  • Fletcher, R., Leyffer, S., Ralph, D., & Scholtes, S. (2002). Local convergence of SQP methods for Mathematical Programs with Equilibrium Constraints. Numerical Analysis Report NA/209, Department of Mathematics, University of Dundee, Dundee, Scotland.

  • Florian, M., & Chen, Y. (1995). A coordinate descent method for the bi-level o-d matrix adjustment problem. International Transactions in Operational Research, 2, 165–179.

    Google Scholar 

  • Fortuny-Amat, J., & McCarl, B. (1981). A representation and economic interpretation of a two-level programming problem. Journal of the Operational Research Society, 32, 783–792.

    Article  Google Scholar 

  • Fukushima, M. (1992). Equivalent differentiable optimization problems and descent methods for asymmetric variational inequality problems. Mathematical Programming, 53, 99–110.

    Article  Google Scholar 

  • Fukushima, M., & Pang, J.-S. (1999). Complementarity constraint qualifications and simplified B-stationarity conditions for mathematical programs with equilibrium constraints. Computational Optimization and Applications, 13, 111–136.

    Article  Google Scholar 

  • Garey, M. R., & Johnson, D. S. (1979). Computers and intractability: a guide to the theory of NP-completeness. New York: Freeman.

    Google Scholar 

  • Hansen, P., Jaumard, B., & Savard, G. (September 1992). New branch-and-bound rules for linear bilevel programming. SIAM Journal on Scientific and Statistical Computing, 13, 1194–1217.

    Article  Google Scholar 

  • Haurie, A., Loulou, R., & Savard, G. (1992). A two player game model of power cogeneration in new england. IEEE Transactions on Automatic Control, 37, 1451–1456.

    Article  Google Scholar 

  • Hearn, D. W., & Ramana, M. V. (1998). Solving congestion toll pricing models. In P. Marcotte (Ed.), Equilibrium and advanced transportation modelling (pp. 109–124). Dordrecht: Kluwer Academic.

    Google Scholar 

  • Hobbs, B. F., & Nelson, S. K. (1992). A nonlinear bilevel model for analysis of electric utility demand-side planning issues. Annals of Operations Research, 34, 255–274.

    Article  Google Scholar 

  • Hsu, S., & Wen, U. (1989). A review of linear bilevel programming problems. In Proceedings of the National Science Council, Republic of China, Part A: Physical Science and Engineering (Vol. 13, pp. 53–61).

  • Ishizuka, Y., & Aiyoshi, E. (1992). Double penalty method for bilevel optimization problems. Annals of Operations Research, 34, 73–88.

    Article  Google Scholar 

  • Jaumard, B., Savard, G., & Xiong, J. (January 2000). A new algorithm for the convex bilevel programming problem. Technical Report, Ecole Polytechnique de Montréal.

  • Jeroslow, R. G. (1985). The polynomial hierarchy and a simple model for competitive analysis. Mathematical Programming, 32, 146–164.

    Article  Google Scholar 

  • Jian, H., & Ralph, D. (December 1997). Smooth SQP methods for mathematical programs with nonlinear complementarity constraints. Manuscript, Department of Mathematics and Statistics, University of Melbourne.

  • Júdice, J. J., & Faustino, A. (1988). The solution of the linear bilevel programming problem by using the linear complementarity problem. Investigação Operacional, 8, 77–95.

    Google Scholar 

  • Júdice, J. J., & Faustino, A. (1992). A sequential LCP method for bilevel linear programming. Annals of Operations Research, 34, 89–106.

    Article  Google Scholar 

  • Júdice, J. J., & Faustino, A. (1994). The linear-quadratic bilevel programming problem. Information Systems and Operational Research, 32, 87–98.

    Google Scholar 

  • Kara, B. Y., & Verter, V. (2004). Designing a road network for hazardous materials transportation. Transportation Science, 38, 188–196.

    Article  Google Scholar 

  • Kolstad, C. D. (1985). A review of the literature on bi-level mathematical programming. Technical Report LA-10284-MS, Los Alamos National Laboratory, Los Alamos, New Mexico, USA.

  • Kolstad, C. D., & Lasdon, L. S. (1990). Derivative estimation and computational experience with large bilevel mathematical programs. Journal of Optimization Theory and Applications, 65, 485–499.

    Article  Google Scholar 

  • Labbé, M., Marcotte, P., & Savard, G. (1998). A bilevel model of taxation and its applications to optimal highway pricing. Management Science, 44, 1595–1607.

    Google Scholar 

  • Larsson, T., & Patriksson, M. (1998). Side constrained traffic equilibrium models–traffic management through link tolls. In P. Marcotte, S. Nguyen (Eds.), Equilibrium and advanced transportation modelling (pp. 125–151). Dordrecht: Kluwer Academic.

    Google Scholar 

  • LeBlanc, L. J. (1973). Meathematical programming algorithms for large scale network equilibrium and network design problems. PhD thesis, Northwestern University, Evanston, Illinois.

  • Leyffer, S. MacMPEC–AMPL collection of Mathematical Programs with Equilibrium Constraints. Available at http://www-unix.mcs.anl.gov/~leyffer/MacMPEC/.

  • Liu, G., Han, J., & Wang, S. (May 1998). A trust region algorithm for bilevel programming problems. Chinese Science Bulletin, 43, 820–824.

    Article  Google Scholar 

  • Loridan, P., & Morgan, J. (1996). Weak via strong Stackelberg problem: new results. Journal of Global Optimization, 8, 263–287.

    Article  Google Scholar 

  • Luo, Z.-Q., Pang, J.-S., & Ralph, D. (1996). Mathematical programs with equilibrium constraints. Cambridge: Cambridge University Press.

    Google Scholar 

  • Marcotte, P. (1986). Network design problem with congestion effects: a case of bilevel programming. Mathematical Programming, 34, 23–36.

    Article  Google Scholar 

  • Marcotte, P., & Savard, G. (2005). Bilevel programming: a combinatorial perspective. In: D. Avis, A. Hertz, & O. Marcotte (Eds.), Graph theory and combinatorial optimization. Boston: Kluwer Academic.

    Google Scholar 

  • Marcotte, P., & Zhu, D. L. (1996). Exact and inexact penalty methods for the generalized bilevel programming problem. Mathematical Programming, 74, 141–157.

    Google Scholar 

  • Marcotte, P., Savard, G., & Semet, F. (2004). A bilevel programming approach to the travelling salesman problem. Operations Research Letters, 32, 240–248.

    Article  Google Scholar 

  • Migdalas, A. (1995). Bilevel programming in traffic planning: models, methods and challenge. Journal of Global Optimization, 7, 381–405.

    Article  Google Scholar 

  • Migdalas, A., Pardalos, P. M., & Värbrand, P. (Eds.) (1997). Multilevel optimization: algorithms and applications, nonconvex optimization and its applications (Vol. 20). Dordrecht: Kluwer Academic.

    Google Scholar 

  • Nash, J. (1951). Non-cooperative games. Annals of Mathematics, 54, 286–295.

    Article  Google Scholar 

  • Outrata, J. (1993). Necessary optimality conditions for Stackelberg problems. Journal of Optimization Theory and Applications, 76, 305–320.

    Article  Google Scholar 

  • Outrata, J. (1994). On optimization problems with variational inequality constraints. SIAM Journal on Optimization, 4, 340–357.

    Article  Google Scholar 

  • Outrata, J., & Kocvara, M. (2006). Effective reformulations of the truss topology design problem. Optimization and Engineering, 7, 201–219.

    Article  Google Scholar 

  • Outrata, J., Kočvara, M., & Zowe, J. (1998). Nonsmooth approach to optimization problems with equilibrium constraints: theory, applications and numerical results, Nonconvex optimization and its applications (Vol. 28). Dordrecht: Kluwer Academic.

    Google Scholar 

  • Pang, J. S., & Trinkle, J. C. (1996). Complementarity formulations and existence of solutions of dynamic multi-rigid-body contact problems with coulomb friction. Mathematical Programming, 73, 199–226.

    Article  Google Scholar 

  • Papavassilopoulos, G. (1982). Algorithms for static Stackelberg games with linear costs and polyhedral constraints. In Proceedings of the 21st IEEE Conference on Decisions and Control (pp. 647–652).

  • Patriksson, M. (1994). The traffic assignment problem—models and methods. Utrecht: VSP BV.

    Google Scholar 

  • Ralph, D. (November 1998). Optimization with equilibrium constraints: a piecewise SQP approach. Manuscript, Department of Mathematics and Statistics, University of Melbourne.

  • Savard, G. (April 1989). Contribution à la programmation mathématique à deux niveaux. PhD thesis, Ecole Polytechnique de Montréal, Université de Montréal, Montréal, QC, Canada.

  • Savard, G., & Gauvin, J. (1994). The steepest descent direction for the nonlinear bilevel programming problem. Operations Research Letters, 15, 265–272.

    Article  Google Scholar 

  • Scheel, H., & Scholtes, S. (2000). Mathematical programs with complementarity constraints: Stationarity, optimality, and sensitivity. Mathematics of Operations Research, 25, 1–22.

    Article  Google Scholar 

  • Scholtes, S. (2001). Convergence properties of a regularisation scheme for mathematical programs with complementarity constraints. SIAM Journal on Optimization, 11, 918–936.

    Article  Google Scholar 

  • Scholtes, S. (May 2002). Combinatorial structures in nonlinear programming. Optimization Online. Available on the Internet at the address http://www.optimization-online.org/DB_HTML/2002/05/477.html.

  • Scholtes, S., & Stöhr, M. (1999). Exact penalization of mathematical programs with equilibrium constraints. SIAM Journal on Control and Optimization, 37, 617–652.

    Article  Google Scholar 

  • Sherali, H. D., Soyster, A. L., & Murphy, F. H. (1983). Stackelberg-Nash-Cournot equilibria: characterizations and computations. Operations Research, 31, 253–276.

    Article  Google Scholar 

  • Shimizu, K., & Aiyoshi, E. (1981). A new computational method for Stackelberg and min-max problems by use of a penalty method. IEEE Transactions on Automatic Control, 26, 460–466.

    Article  Google Scholar 

  • Shimizu, K., Ishizuka, Y., & Bard, J. F. (1997). Nondifferentiable and two-level mathematical programming. Dordrecht: Kluwer Academic.

    Google Scholar 

  • Stackelberg, H. (1952). The theory of market economy. Oxford: Oxford University Press.

    Google Scholar 

  • Thoai, N. V., Yamamoto, Y., & Yoshise, A. (May 2002). Global optimization method for solving mathematical programs with linear complementarity constraints. Discussion Paper No. 987, Institute of Policy and Planning Sciences, University of Tsukuba, Japan.

  • Tuy, H., Migdalas, A., & Värbrand, P. (1993). A global optimization approach for the linear two-level program. Journal of Global Optimization, 3, 1–23.

    Article  Google Scholar 

  • Van Ackere, A. (1993). The principal/agent paradigm: characterizations and computations. European Journal of Operations Research, 70, 83–103.

    Article  Google Scholar 

  • Vicente, L. N., & Calamai, P. H. (1994). Bilevel and multilevel programming: a bibliography review. Journal of Global Optimization, 5, 291–306.

    Article  Google Scholar 

  • Vicente, L. N., & Calamai, P. H. (1995). Geometry and local optimality conditions for bilevel programs with quadratic strictly convex lower levels. In: D. Du, & M. Pardalos (Eds.), Minimax and applications. Nonconvex optimization and its applications (Vol. 4, pp. 141–151). Dordrecht: Kluwer Academic.

    Google Scholar 

  • Vicente, L. N., Savard, G., & Júdice, J. J. (1994). Descent approaches for quadratic bilevel programming. Journal of Optimization Theory and Applications, 81, 379–399.

    Article  Google Scholar 

  • Vicente, L. N., Savard, G., & Júdice, J. J. (1996). The discrete linear bilevel programming problem. Journal of Optimization Theory and Applications, 89, 597–614.

    Article  Google Scholar 

  • Wen, U., & Hsu, S. (1991). Linear bi-level programming problems—a review. Journal of the Operational Research Society, 42, 125–133.

    Article  Google Scholar 

  • Ye, J. J., & Zhu, D. L. (1995). Optimality conditions for bilevel programming problems. Optimization, 33, 9–27.

    Google Scholar 

  • Yezza, A. (1996). First-order necessary optimality conditions for general bilevel programming problems. JOTA, 89, 189–219.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Benoît Colson.

Additional information

B. Colson now at SAMTECH s.a., Liège, Belgium.

This article is an updated version of a paper that appeared in 4OR 3, 87–107, 2005.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Colson, B., Marcotte, P. & Savard, G. An overview of bilevel optimization. Ann Oper Res 153, 235–256 (2007). https://doi.org/10.1007/s10479-007-0176-2

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10479-007-0176-2

Keywords

Navigation