Skip to main content
Log in

Balanced realizations of regime-switching linear systems

  • Original Article
  • Published:
Mathematics of Control, Signals, and Systems Aims and scope Submit manuscript

Abstract

In this work, we establish a framework for balanced realization of linear systems subject to regime switching modulated by a continuous-time Markov chain with a finite state space. First, a definition of balanced realization is given. Then a ρ-balanced realization is developed to approximate the system of balancing equations, which is a system of time-varying algebraic equations. When the state space of the Markov chain is large, the computational effort becomes a real concern. To resolve this problem, we introduce a two-time-scale formulation and use decomposition/aggregation and averaging techniques to reduce the computational complexity. Based on the two-time-scale formulation, further approximation procedures are developed. Numerical examples are also presented for demonstration.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Anderson BDO, Moore JB (1990) Optimal control: linear quadratic methods. Prentice Hall, Englewood Cliffs

  2. Courtois PJ (1977). Decomposability: queueing and computer system applications. Academic, New York

    MATH  Google Scholar 

  3. Glover K (1984). All optimal Hankel norm approximations of linear multivariable systems and their L-error bounds. Int J Control 39: 1145–1193

    Article  Google Scholar 

  4. Graham A (1981). Kronecker product and matrix calculus with applications. Ellis Horwood Ltd., Chechester

    Google Scholar 

  5. Helmke U and Moore JB (1994). Optimization and dynamical systems. Springer, New York

    Google Scholar 

  6. Imae J, Perkins JE and Moore JB (1992). Toward time-varying balanced realization via Riccati equations. Math Control Signals Syst 5: 313–326

    Article  MATH  Google Scholar 

  7. Ji Y and Chizeck HJ (1992). Jump linear quadratic Gaussian control in continuous-time. IEEE Trans Automat Control 37: 1884–1892

    Article  MATH  Google Scholar 

  8. Li X, Zhou XY and Ait Rami M (2003). Indefinite stochastic linear quadratic control with Markovian jumps in infinte time horizon. J Global Optim 27: 149–175

    Article  MATH  Google Scholar 

  9. Mariton M and Bertrand P (1985). Robust jump linear quadratic control: a mode stabilizing solution. IEEE Trans Autom Control 30: 1145–1147

    Article  MATH  Google Scholar 

  10. Mariton M (1990). Jump linear systems in automatic control. Marcel Dekker, New~York

    Google Scholar 

  11. Magnus JR and Neudecker H (1999). Matrix differential calculus with applications in statistics and econometrics. Wiley, Chichester

    MATH  Google Scholar 

  12. Moore BC (1981). Principal component in linear systems: controllability, observability and model reduction. IEEE Trans Autom Control 26: 17–31

    Article  MATH  Google Scholar 

  13. Perkins JE, Helmke U and Moore JB (1990). Balanced realizations via gradient flow techniques. Sys Control Lett 14: 369–379

    Article  MATH  Google Scholar 

  14. Sandberg H and Rantzer A (2004). Balanced truncation of linear time-varying systems. IEEE Trans Autom Control 49: 217–229

    Article  Google Scholar 

  15. Shokoohi S, Silverman LM and Van Dooren PM (1983). Linear time variable systems: balancing and model reduction. IEEE Trans Autom Control 28: 810–822

    Article  MATH  Google Scholar 

  16. Sethi SP and Zhang Q (1994). Hierarchical decision making in stochastic manufacturing systems. Birkhäuser, Boston

    MATH  Google Scholar 

  17. Simon HA and Ando A (1961). Aggregation of variables in dynamic systems. Econometrica 29: 111–138

    Article  MATH  Google Scholar 

  18. Verriest EI and Kailath T (1983). On generalized balanced realizations. IEEE Trans Autom Control 28: 833–844

    Article  MATH  Google Scholar 

  19. Yin G and Dey S (2003). Weak convergence of hybrid filtering problems involving nearly completely decomposable hidden Markov chains. SIAM J Control Optim 41: 1820–1842

    Article  MATH  Google Scholar 

  20. Yin G, Krishnamurthy V and Ion C (2004). Regime switching stochastic approximation algorithms with application to adaptive discrete stochastic optimization. SIAM J Optim 14: 1187–1215

    Article  MATH  Google Scholar 

  21. Yin G, Liu YJ and Yang H (2006). Bounds of ruin probability for regime-switching models using time scale separation. Scand Actuar J 2006: 111–127

    Article  MATH  Google Scholar 

  22. Yin G and Zhang Q (1998). Continuous-time Markov chains and applications: a singular lerturbation approach. Springer, New York

    Google Scholar 

  23. Yin G and Zhang Q (2005). Discrete-time Markov chains: two-time-scale methods and applications. Springer, New York

    MATH  Google Scholar 

  24. Yin G, Zhang Q and Badowski G (2000). Asymptotic properties of a singularly perturbed Markov chain with inclusion of transient states. Ann Appl Probab 10: 549–572

    Article  MATH  Google Scholar 

  25. Zhang Q and Yin G (1999). On nearly optimal controls of hybrid LQG problems. IEEE Trans Autom Control 44: 2271–2282

    Article  MATH  Google Scholar 

  26. Zhou XY and Yin G (2003). Markowitz’s mean-variance portfolio selection with regime switching: a continuous-time model. SIAM J Control Optim 42: 1466–1482

    Article  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to G. Yin.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Liu, Y.J., Yin, G., Zhang, Q. et al. Balanced realizations of regime-switching linear systems. Math. Control Signals Syst. 19, 207–234 (2007). https://doi.org/10.1007/s00498-007-0019-3

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00498-007-0019-3

Keywords

Navigation