Abstract
An axiomatic characterization of an information-theoretic quantity associated with a pair of probability distributions having the same number of elements has been given. This quantity, under additional suitable conditions, leads to Kullback's information and Kerridge's inaccuracy concepts. By modifying one of the axioms, the two-parameter generalization of these is obtained.
Similar content being viewed by others
References
J. Aczel,Lectures on Functional Equations and their Applications, Academic Press, New York (1966).
L. L. Campbell, Characterization of Entropy of Probability Distributions on the Real Line.Information and Control 21:329–338 (1972).
A. Feinstein,Foundations of Information Theory, McGraw-Hill, New York (1958).
B. Forte and Z. Daroczy, A Characterization of Shannon's Entropy,Bull.UMI 4:631–635 (1968).
J. Havrda and F. Charvat, Quantification Method of Classification Processes. Concept of Structurala-Entropy,Kybernetika 3:30–35 (1967).
A. Hobson, A New Theorem of Information Theory.J. Stat. Phys. 1:383–391 (1969).
Pl. Kannappan, On Shannon's Entropy, Directed-Divergence and Inaccuracy,Z. Wahrs. verw. Geb. 22:95–100 (1972).
Pl. Kannappan, On Directed Divergence and Inaccuracy,Z. Wahrs. verw. Geb. 25:49–55 (1972).
D. F. Kerridge, Inaccuracy and Inference,J. Royal Statist. Soc., Ser. B 23:184–194 (1961).
S. Kullback,Information Theory and Statistics, Wiley, New York (1959).
P. N. Rathie and Pl. Kannappan, A Directed-Divergence Function of Typeβ, Information and Control 20:38–45 (1972).
B. D. Sharma and Ram Autar, On Characterization of a Generalized Inaccuracy Measure in Information Theory,J. Appl. Probability 10:464–468 (1973).
B. D. Sharma and Ram Autar, Relative Information Functions and Their Type (α, β) Generalizations,Metrika 21 (1973).
Author information
Authors and Affiliations
Rights and permissions
About this article
Cite this article
Sharma, B.D., Taneja, I.J. On axiomatic characterization of information-theoretic measures. J Stat Phys 10, 337–346 (1974). https://doi.org/10.1007/BF01012255
Received:
Issue Date:
DOI: https://doi.org/10.1007/BF01012255