Skip to main content
Log in

On axiomatic characterization of information-theoretic measures

  • Articles
  • Published:
Journal of Statistical Physics Aims and scope Submit manuscript

Abstract

An axiomatic characterization of an information-theoretic quantity associated with a pair of probability distributions having the same number of elements has been given. This quantity, under additional suitable conditions, leads to Kullback's information and Kerridge's inaccuracy concepts. By modifying one of the axioms, the two-parameter generalization of these is obtained.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. J. Aczel,Lectures on Functional Equations and their Applications, Academic Press, New York (1966).

    Google Scholar 

  2. L. L. Campbell, Characterization of Entropy of Probability Distributions on the Real Line.Information and Control 21:329–338 (1972).

    Google Scholar 

  3. A. Feinstein,Foundations of Information Theory, McGraw-Hill, New York (1958).

    Google Scholar 

  4. B. Forte and Z. Daroczy, A Characterization of Shannon's Entropy,Bull.UMI 4:631–635 (1968).

    Google Scholar 

  5. J. Havrda and F. Charvat, Quantification Method of Classification Processes. Concept of Structurala-Entropy,Kybernetika 3:30–35 (1967).

    Google Scholar 

  6. A. Hobson, A New Theorem of Information Theory.J. Stat. Phys. 1:383–391 (1969).

    Google Scholar 

  7. Pl. Kannappan, On Shannon's Entropy, Directed-Divergence and Inaccuracy,Z. Wahrs. verw. Geb. 22:95–100 (1972).

    Google Scholar 

  8. Pl. Kannappan, On Directed Divergence and Inaccuracy,Z. Wahrs. verw. Geb. 25:49–55 (1972).

    Google Scholar 

  9. D. F. Kerridge, Inaccuracy and Inference,J. Royal Statist. Soc., Ser. B 23:184–194 (1961).

    Google Scholar 

  10. S. Kullback,Information Theory and Statistics, Wiley, New York (1959).

    Google Scholar 

  11. P. N. Rathie and Pl. Kannappan, A Directed-Divergence Function of Typeβ, Information and Control 20:38–45 (1972).

    Google Scholar 

  12. B. D. Sharma and Ram Autar, On Characterization of a Generalized Inaccuracy Measure in Information Theory,J. Appl. Probability 10:464–468 (1973).

    Google Scholar 

  13. B. D. Sharma and Ram Autar, Relative Information Functions and Their Type (α, β) Generalizations,Metrika 21 (1973).

Download references

Author information

Authors and Affiliations

Authors

Rights and permissions

Reprints and permissions

About this article

Cite this article

Sharma, B.D., Taneja, I.J. On axiomatic characterization of information-theoretic measures. J Stat Phys 10, 337–346 (1974). https://doi.org/10.1007/BF01012255

Download citation

  • Received:

  • Issue Date:

  • DOI: https://doi.org/10.1007/BF01012255

Key words

Navigation