Skip to main content
Log in

Recursive and Iterative Least Squares Parameter Estimation Algorithms for Multiple-Input–Output-Error Systems with Autoregressive Noise

  • Published:
Circuits, Systems, and Signal Processing Aims and scope Submit manuscript

Abstract

This paper considers the parameter estimation of a multiple-input–output-error system with autoregressive noise. In order to solve the problem of the information vector containing unknown inner variables, an auxiliary model-based recursive generalized least squares algorithm and a least squares-based iterative algorithm are proposed according to the auxiliary model identification idea and the iterative search principle. The simulation results indicate that the least squares-based iterative algorithm can generate more accurate parameter estimates than the auxiliary model-based recursive generalized least squares algorithm. Two examples are given to test the proposed algorithms.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6

Similar content being viewed by others

References

  1. A. Cristofaro, S. Pettinari, Fault accommodation for multi-input linear sampled-data systems. Int. J. Adapt. Control Signal Process. 29, 835–854 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  2. F. Ding, X.H. Wang, L. Mao, L. Xu, Joint state and multi-innovation parameter estimation for time-delay linear systems and its convergence based on the Kalman filtering. Digital Signal Process. 62, 211–223 (2017)

    Article  Google Scholar 

  3. F. Ding, F.F. Wang, L. Xu, T. Hayat, A. Alsaedi, Parameter estimation for pseudo-linear systems using the auxiliary model and the decomposition technique. IET Control Theory Appl. 11(3), 390–400 (2017)

    Article  MathSciNet  Google Scholar 

  4. F. Ding, F.F. Wang, L. Xu, M.H. Wu, Decomposition based least squares iterative identification algorithm for multivariate pseudo-linear ARMA systems using the data filtering. J. Frankl. Inst. 354(3), 1321–1339 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  5. F. Ding, L. Xu, Q.M. Zhu, Performance analysis of the generalised projection identification for time-varying systems. IET Control Theory Appl. 10(18), 2506–02514 (2016)

    Article  MathSciNet  Google Scholar 

  6. L. Feng, M.H. Wu, Q.X. Li et al., Array factor forming for image reconstruction of one-dimensional nonuniform aperture synthesis radiometers. IEEE Geosci. Remote Sens. Lett. 13(2), 237–241 (2016)

    Article  Google Scholar 

  7. G.X. Gu, S. Wan, L. Qiu, Networked stabilization for multi-input systems over quantized fading channels. Automatica 61, 1–8 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  8. Y. Ji, F. Ding, Multiperiodicity and exponential attractivity of neural networks with mixed delays. Circuits Syst. Signal Process. 36(6), 2558–2573 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  9. Y. Ji, X.M. Liu, Unified synchronization criteria for hybrid switching-impulsive dynamical networks. Circuits Syst. Signal Process. 34(5), 1499–1517 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  10. M.H. Li, X.M. Liu, F. Ding, Least-squares-based iterative and gradient-based iterative estimation algorithms for bilinear systems. Nonlinear Dyn. 89(1), 197–211 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  11. M.H. Li, X.M. Liu, F. Ding, The maximum likelihood least squares based iterative estimation algorithm for bilinear systems with autoregressive noise. J. Frankl. Inst. 354(12), 4861–4881 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  12. M.H. Li, X.M. Liu, F. Ding, The gradient based iterative estimation algorithms for bilinear systems with autoregressive noise. Circuits Syst. Signal Process. (2017). doi:10.1007/s00034-017-0527-4

    MathSciNet  MATH  Google Scholar 

  13. H. Li, Y. Shi, W. Yan, Distributed receding horizon control of constrained nonlinear vehicle formations with guaranteed \(\gamma \)-gain stability. Automatica 68, 148–154 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  14. H. Li, Y. Shi, W. Yan, On neighbor information utilization in distributed receding horizon control for consensus-seeking. IEEE Trans. Cybern. 46(9), 2019–2027 (2016)

    Article  Google Scholar 

  15. H. Li, W.S. Yan, Y. Shi, Continuous-time model predictive control of under-actuated spacecraft with bounded control torques. Automatica 75, 144–153 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  16. J.H. Li, W.X. Zheng, J.P. Gu, L. Hua, Parameter estimation algorithms for Hammerstein output error systems using Levenberg–Marquardt optimization method with varying interval measurements. J. Frankl. Inst. 354(1), 316–331 (2017)

    Article  MathSciNet  MATH  Google Scholar 

  17. X.G. Liu, J. Lu, Least squares based iterative identification for a class of multirate systems. Automatica 46(3), 549–554 (2010)

    Article  MathSciNet  MATH  Google Scholar 

  18. Y.W. Mao, F. Ding, Multi-innovation stochastic gradient identification for Hammerstein controlled autoregressive systems based on the filtering technique. Nonlinear Dyn. 79(3), 1745–1755 (2015)

    Article  MATH  Google Scholar 

  19. D.D. Meng, Recursive least squares and multi-innovation gradient estimation algorithms for bilinear stochastic systems. Circuits Syst. Signal Process. 35(3), 1052–1065 (2016)

    MathSciNet  MATH  Google Scholar 

  20. G. Mercère, L. Bako, Parameterization and identification of multivariable state-space systems: a canonical approach. Automatica 47(8), 1547–1555 (2011)

    Article  MathSciNet  MATH  Google Scholar 

  21. S. Mobayen, An LMI-based robust tracker for uncertain linear systems with multiple time-varying delays using optimal composite nonlinear feedback technique. Nonlinear Dyn. 80, 917–927 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  22. J. Na, G. Herrmann, K.Q. Zhang, Improving transient performance of adaptive control via a modified reference model and novel adaptation. Int. J. Robust Nonlinear Control 27(8), 1351–1372 (2017)

    Article  MATH  Google Scholar 

  23. J. Na, M.N. Mahyuddin, G. Herrmann et al., Robust adaptive finite-time parameter estimation and control for robotic systems. Int. J. Robust Nonlinear Control 25(16), 3045–3071 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  24. J. Na, J. Yang, X.M. Ren et al., Robust adaptive estimation of nonlinear system with time-varying parameters. Int. J. Adapt. Control Signal Process. 29(8), 1055–1072 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  25. J. Na, J. Yang, X. Wu et al., Robust adaptive parameter estimation of sinusoidal signals. Automatica 53, 376–384 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  26. A. Nasirin, S.K. Nguang, A. Swain, Adaptive sliding mode control for a class of MIMO nonlinear systems with uncertainties. J. Frankl. Inst. 351(4), 2048–2061 (2014)

    Article  MathSciNet  MATH  Google Scholar 

  27. J. Pan, X. Jiang, X.K. Wan, W.F. Ding, A filtering based multi-innovation extended stochastic gradient algorithm for multivariable control systems. Int. J. Control Autom. Syst. 15(3), 1189–1197 (2017)

    Article  Google Scholar 

  28. J. Pan, X.H. Yang, H.F. Cai, B.X. Mu, Image noise smoothing using a modified Kalman filter. Neurocomputing 173, 1625–1629 (2016)

    Article  Google Scholar 

  29. X.K. Wan, Y. Li, C. Xia, M.H. Wu, J. Liang, N. Wang, A T-wave alternans assessment method based on least squares curve fitting technique. Measurement 86, 93–100 (2016)

    Article  Google Scholar 

  30. Y.J. Wang, F. Ding, Recursive parameter estimation algorithms and convergence for a class of nonlinear systems with colored noise. Circuits Syst. Signal Process. 35(10), 3461–3481 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  31. Y.J. Wang, F. Ding, Recursive least squares algorithm and gradient algorithm for Hammerstein–Wiener systems using the data filtering. Nonlinear Dyn. 84(2), 1045–1053 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  32. Y.J. Wang, F. Ding, Novel data filtering based parameter identification for multiple-input multiple-output systems using the auxiliary model. Automatica 71, 308–313 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  33. Y.J. Wang, F. Ding, The filtering based iterative identification for multivariable systems. IET Control Theory Appl. 10(8), 894–902 (2016)

    Article  MathSciNet  Google Scholar 

  34. X.H. Wang, F. Ding, Convergence of the recursive identification algorithms for multivariate pseudo-linear regressive systems. Int. J. Adapt. Control Signal Process. 30(6), 824–842 (2016)

    Article  MathSciNet  Google Scholar 

  35. X.H. Wang, F. Ding, Joint estimation of states and parameters for an input nonlinear state-space system with colored noise using the filtering technique. Circuits Syst. Signal Process. 35(2), 481–500 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  36. X.H. Wang, F. Ding, Recursive parameter and state estimation for an input nonlinear state space system using the hierarchical identification principle. Signal Process. 117, 208–218 (2015)

    Article  Google Scholar 

  37. D.Q. Wang, Hierarchical parameter estimation for a class of MIMO Hammerstein systems based on the reframed models. Appl. Math. Lett. 57, 13–19 (2016)

    Article  MathSciNet  MATH  Google Scholar 

  38. D.Q. Wang, L. Mao, F. Ding, Recasted models based hierarchical extended stochastic gradient method for MIMO nonlinear systems. IET Control Theory Appl. 11(4), 476–485 (2017)

    Article  MathSciNet  Google Scholar 

  39. H.N. Wu, J.W. Wang, Observer design and output feedback stabilization for nonlinear multivariable systems with diffusion PDE-governed sensor dynamics. Nonlinear Dyn. 72, 615–628 (2013)

    Article  MathSciNet  MATH  Google Scholar 

  40. L. Xu, A proportional differential control method for a time-delay system using the Taylor expansion approximation. Appl. Math. Comput. 236, 391–399 (2014)

    MathSciNet  MATH  Google Scholar 

  41. L. Xu, Application of the Newton iteration algorithm to the parameter estimation for dynamical systems. J. Comput. Appl. Math. 288, 33–43 (2015)

    Article  MathSciNet  MATH  Google Scholar 

  42. L. Xu, The damping iterative parameter identification method for dynamical systems based on the sine signal measurement. Signal Process. 120, 660–667 (2016)

    Article  Google Scholar 

  43. L. Xu, The parameter estimation algorithms based on the dynamical response measurement data. Adv. Mech. Eng. 9(9) (2017). doi:10.1177/1687814017730003

  44. L. Xu, L. Chen, W.L. Xiong, Parameter estimation and controller design for dynamic systems from the step responses based on the Newton iteration. Nonlinear Dyn. 79(3), 2155–2163 (2015)

    Article  MathSciNet  Google Scholar 

  45. L. Xu, F. Ding, The parameter estimation algorithms for dynamical response signals based on the multi-innovation theory and the hierarchical principle. IET Signal Process. 11(2), 228–237 (2017)

    Article  Google Scholar 

  46. L. Xu, F. Ding, Recursive least squares and multi-innovation stochastic gradient parameter estimation methods for signal modeling. Circuits Syst. Signal Process. 36(4), 1735–1753 (2017)

    Article  MATH  Google Scholar 

  47. L. Xu, F. Ding, Y. Gu, A. Alsaedi, T. Hayat, A multi-innovation state and parameter estimation algorithm for a state space system with d-step state-delay. Signal Process. 140, 97–103 (2017)

    Article  Google Scholar 

  48. N. Zhao, M.H. Wu, J.J. Chen, Android-based mobile educational platform for speech signal processing. Int. J. Electr. Eng. Educ. 54(1), 3–16 (2017)

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the Natural Science Foundation of Shandong Province (China, ZR2016FL08) and the Science Foundation of Jining University (China, 2016QNKJ01).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jiling Ding.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ding, J. Recursive and Iterative Least Squares Parameter Estimation Algorithms for Multiple-Input–Output-Error Systems with Autoregressive Noise. Circuits Syst Signal Process 37, 1884–1906 (2018). https://doi.org/10.1007/s00034-017-0636-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00034-017-0636-0

Keywords

Navigation