Abstract
The optimal control of stochastic processes through sensor estimation of probability density functions is given a geometric setting via information theory and the information metric. Information theory identifies the exponential distribution as the maximum entropy distribution if only the mean is known and the Γ distribution if also the mean logarithm is known. The surface representing Γ models has a natural Riemannian information metric. The exponential distributions form a one-dimensional subspace of the two-dimensional space of all Γ distributions, so we have an isometric embedding of the random model as a subspace of the Γ models. This geometry provides an appropriate structure on which to represent the dynamics of a process and algorithms to control it. This short paper presents a comparative study on the parameter estimation performance between the geodesic equation and the B-spline function approximations when they are used to optimize the parameters of the Γ family distributions. In this case, the B-spline functions are first used to approximate the Γ probability density function on a fixed length interval; then the coefficients of the approximation are related, through mean and variance calculations, to the two parameters (i.e. μ and β) in Γ distributions. A gradient based parameter tuning method has been used to produce the trajectories for (μ, β) when B-spline functions are used, and desired results have been obtained which are comparable to the trajectories obtained from the geodesic equation.
Similar content being viewed by others
References
Amari, S.-I.: Differential Geometrical Methods in Statistics, Springer Lecture Notes in Statist. 28, Springer-Verlag, Berlin, 1985.
Dodson, C. T. J.: Gamma manifolds and stochastic geometry. In: Proceedings of the Workshop on Recent Topics in Differential Geometry, Santiago de Compostela 16–19 July 1997, Public. Depto. Geometría y Topología 89 (1998), 85-92.
Dodson, C. T. J.: Systems of connections for parametric models. In: C.T.I. Dodson (ed.), Proceedings of the Workshop on Geometrization of Statistical Theory, 28–31 October 1987, ULDM Publications, University of Lancaster, pp. 153-170, 1987.
Dodson, C. T. J. and Poston, T: Tensor Geometry Graduate Texts in Mathematics 130, Springer-Verlag, Berlin, Heidelberg, New York, 1991.
Dodson, C. T. J. and Sampson, W.W.: Modeling a class of stochastic porous media, Appl. Math. Lett. 10(2) (1997), 87-89.
Dodson, C. T. J. and Sampson, W. W.: Spatial statistics of stochastic fibre networks, J. Statist. Phys. 96 (1/2) (1999), 447-458.
Fisher, R. A.: Theory of statistical estimation, Proc. Camb. Phil. Soc. 122 (1925), 700-725.
Jaynes, E. T.: Information theory and statistical inference, Phys. Rev. 106 (1957), 620-630 and 108 (1957), 171-190.
Lauritzen, S. L.: Statistical manifolds. In: Differential Geometry in Statistical Inference, Inst. Math. Stat. Lecture Notes, Vol. 10, Berkeley, 1987, pp. 163-218.
Rao, C. R.: Information and accuracy attainable in the estimation of statistical parameters, Bull. Calcutta Math. Soc. 37 (1945), 81-91.
Tribus, M.: Thermostatics and Thermodynamics, D. Van Nostrand, Princeton N.J., 1961.
Tribus, M., Evans, R. and Crellin, G.: The use of entropy in hypothesis testing. In: Proceedings of the 10th National Symposium on Reliability and Quality Control, 7–9 January 1964.
Wang, H.: Neural network based control for output probability density functions for nonlinear stochastic systems and its applications. In: Proceedings of the 6th European Congress on Intelligent Techniques and Soft Computing, Aachen, 1998.
Wang, H.: Robust control of the output probability density functions formultivariable stochastic systems with guaranteed stability, IEEE Transactions on Automatic Control, Vol. 44, pp. 2103-2107, 1999.
Wang, H.: Bounded Dynamic Stochastic Distributions, Modelling and Control, Springer-Verlag, London, 2000.
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Dodson, C.T.J., Wang, H. Iterative Approximation of Statistical Distributions and Relation to Information Geometry. Statistical Inference for Stochastic Processes 4, 307–318 (2001). https://doi.org/10.1023/A:1012289028897
Issue Date:
DOI: https://doi.org/10.1023/A:1012289028897