Skip to main content
SpringerLink
Log in

The absolute maximum payoff in differential games and optimal control

  • Contributed Papers
  • Published:
Journal of Optimization Theory and Applications Aims and scope Submit manuscript

Abstract

This paper deals with a differential game or optimal control problem in which the payoff is the maximum (or minimum), during play, of some scalar functionK of the statex. This unconventional payoff has many practical applications. By defining certain auxiliary games for a significant class of problems, one can show how to solve the general case where more than one maximum ofk(t)=K[x(t)] occurs under optimal play. For a subclass of such problems, it is found thatclosed optimal solutions can exist on certain surfaces in the playing space. As the playing interval becomes indefinitely long, the open optimal trajectories converge to (or diverge from) such surfaces. In particular, for two-dimensional problems of this subclass, the closed optimal trajectories are periodic and called periodic barriers. They are analogous to limit cycles in uncontrolled nonlinear systems.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Isaacs, R.,Differential Games, John Wiley and Sons, New York, 1965.

    Google Scholar 

  2. Johnson, C. D.,Optimal Control with Chebychev Minimax Performance Index, Journal of Basic Engineering, Vol. 89, Series D, 1967.

  3. Berkovitz, L. D.,A Variational Approach to Differential Games, Annals of Mathematical Studies, No. 52, Advances in Game Theory, Princeton University Press, Princeton, New Jersey, 1964.

    Google Scholar 

  4. Berkovitz, L. D.,Necessary Conditions for Optimal Strategies in a Class of Differential Games and Control Problems, SIAM Journal on Control, Vol. 5, No. 1, 1967.

  5. Leitmann, G.,Two-Person Zero-Sum Games: A Geometric Approach, Paper presented at the 36th National Meeting of the Operations Research Society of America, Miami, Florida, 1969.

  6. Bryson, A. E., Jr., andHo, Y. C.,Applied Optimal Control, Chapter 9, Blaisdell Publishing Company, Waltham, Massachusetts, 1969.

    Google Scholar 

  7. Minorsky, N.,Nonlinear Oscillations, D. Van Nostrand Company, Princeton, New Jersey, 1962.

    Google Scholar 

  8. Stern, T. E.,Theory of Nonlinear Networks and Systems, Addison-Wesley Publishing Company, Reading, Massachusetts, 1965.

    Google Scholar 

  9. Ragade, R. K., andSarna, I. G.,A Game Theoretic Approach to Optimal Control in the Presence of Uncertainty, IEEE Transactions on Automatic Control, Vol. AC-12, No. 4, 1967.

Download references

Author information

Authors and Affiliations

  1. Controls Group, Applied Physics Laboratory, The Johns Hopkins University, Silver Spring, Maryland

    E. P. Cunningham (Staff Engineer)

Authors
  1. E. P. Cunningham
    View author publications

    You can also search for this author in PubMed Google Scholar

Additional information

Communicated by G. Leitmann

The writer is indebted to Dr. R. Isaacs for many stimulating conversations in connection with this study.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Cunningham, E.P. The absolute maximum payoff in differential games and optimal control. J Optim Theory Appl 7, 258–286 (1971). https://doi.org/10.1007/BF00928707

Download citation

  • Received:

  • Revised:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF00928707

Keywords

Search

Navigation