Abstract
In this work, we establish a framework for balanced realization of linear systems subject to regime switching modulated by a continuous-time Markov chain with a finite state space. First, a definition of balanced realization is given. Then a ρ-balanced realization is developed to approximate the system of balancing equations, which is a system of time-varying algebraic equations. When the state space of the Markov chain is large, the computational effort becomes a real concern. To resolve this problem, we introduce a two-time-scale formulation and use decomposition/aggregation and averaging techniques to reduce the computational complexity. Based on the two-time-scale formulation, further approximation procedures are developed. Numerical examples are also presented for demonstration.
Similar content being viewed by others
References
Anderson BDO, Moore JB (1990) Optimal control: linear quadratic methods. Prentice Hall, Englewood Cliffs
Courtois PJ (1977). Decomposability: queueing and computer system applications. Academic, New York
Glover K (1984). All optimal Hankel norm approximations of linear multivariable systems and their L-error bounds. Int J Control 39: 1145–1193
Graham A (1981). Kronecker product and matrix calculus with applications. Ellis Horwood Ltd., Chechester
Helmke U and Moore JB (1994). Optimization and dynamical systems. Springer, New York
Imae J, Perkins JE and Moore JB (1992). Toward time-varying balanced realization via Riccati equations. Math Control Signals Syst 5: 313–326
Ji Y and Chizeck HJ (1992). Jump linear quadratic Gaussian control in continuous-time. IEEE Trans Automat Control 37: 1884–1892
Li X, Zhou XY and Ait Rami M (2003). Indefinite stochastic linear quadratic control with Markovian jumps in infinte time horizon. J Global Optim 27: 149–175
Mariton M and Bertrand P (1985). Robust jump linear quadratic control: a mode stabilizing solution. IEEE Trans Autom Control 30: 1145–1147
Mariton M (1990). Jump linear systems in automatic control. Marcel Dekker, New~York
Magnus JR and Neudecker H (1999). Matrix differential calculus with applications in statistics and econometrics. Wiley, Chichester
Moore BC (1981). Principal component in linear systems: controllability, observability and model reduction. IEEE Trans Autom Control 26: 17–31
Perkins JE, Helmke U and Moore JB (1990). Balanced realizations via gradient flow techniques. Sys Control Lett 14: 369–379
Sandberg H and Rantzer A (2004). Balanced truncation of linear time-varying systems. IEEE Trans Autom Control 49: 217–229
Shokoohi S, Silverman LM and Van Dooren PM (1983). Linear time variable systems: balancing and model reduction. IEEE Trans Autom Control 28: 810–822
Sethi SP and Zhang Q (1994). Hierarchical decision making in stochastic manufacturing systems. Birkhäuser, Boston
Simon HA and Ando A (1961). Aggregation of variables in dynamic systems. Econometrica 29: 111–138
Verriest EI and Kailath T (1983). On generalized balanced realizations. IEEE Trans Autom Control 28: 833–844
Yin G and Dey S (2003). Weak convergence of hybrid filtering problems involving nearly completely decomposable hidden Markov chains. SIAM J Control Optim 41: 1820–1842
Yin G, Krishnamurthy V and Ion C (2004). Regime switching stochastic approximation algorithms with application to adaptive discrete stochastic optimization. SIAM J Optim 14: 1187–1215
Yin G, Liu YJ and Yang H (2006). Bounds of ruin probability for regime-switching models using time scale separation. Scand Actuar J 2006: 111–127
Yin G and Zhang Q (1998). Continuous-time Markov chains and applications: a singular lerturbation approach. Springer, New York
Yin G and Zhang Q (2005). Discrete-time Markov chains: two-time-scale methods and applications. Springer, New York
Yin G, Zhang Q and Badowski G (2000). Asymptotic properties of a singularly perturbed Markov chain with inclusion of transient states. Ann Appl Probab 10: 549–572
Zhang Q and Yin G (1999). On nearly optimal controls of hybrid LQG problems. IEEE Trans Autom Control 44: 2271–2282
Zhou XY and Yin G (2003). Markowitz’s mean-variance portfolio selection with regime switching: a continuous-time model. SIAM J Control Optim 42: 1466–1482
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Liu, Y.J., Yin, G., Zhang, Q. et al. Balanced realizations of regime-switching linear systems. Math. Control Signals Syst. 19, 207–234 (2007). https://doi.org/10.1007/s00498-007-0019-3
Received:
Revised:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00498-007-0019-3