Skip to main content

Classical and Quantum Information Theory

  • Chapter
  • First Online:
Quantum Communications

Part of the book series: Signals and Communication Technology ((SCT))

  • 3043 Accesses

Abstract

The purpose of this chapter is to provide an overview of Quantum Information theory starting from Classical Information Theory, with the aim to: (1) define information mathematically and quantitatively, (2) represent the information in an efficient way (through data compression) for storage and transmission, and (3) ensure the protection of information (through encoding) in the presence of noise and other impairments. In Classical Information theory, the above goals are accomplished in accordance to the laws of Classical Physics. In Quantum Information theory, they are based on quantum mechanical principles and are intrinsically richer than in their Classical counterpart, because of intriguing resources, as entanglement; also, they are more interesting and challenging.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 99.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 139.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Considering that \(\lim _{p \rightarrow 0^+} p \log p=0\), the convention is assuming \(0 \log 0 = 0 \).

  2. 2.

    An alternative prove is based on the concept of relative entropy (see [4]).

  3. 3.

    The change of notation \(S(\rho _{AB})\rightarrow S(A,B)\), \(S(\rho _A)\rightarrow S(A)\), etc., are frequently used in the literature, where the density operator are replaced by the label of the system.

  4. 4.

    Note the 2D matrix representing \(\rho _{AB}\) through the lexicographical order.

  5. 5.

    Equivalently, an IID source may be viewed as a stationary random process \(\{A_\infty \}=(A_1,A_2,\ldots )\) with independent symbols and therefore completely specified by an ensemble \((\mathcal {A},p_A)\), where \(p_A(a), a\in \mathcal {A}\) is the common probability distribution, giving \(p_A(a)=\mathrm{{P}}[A_n=a]\) for any \(n\). From the random process one can extract words of any length, \((A_1,\ldots ,A_L)\), which, by the stationarity of the random process and the independence of its symbols, turn out to be \(L\)-tuples of IID random variables.

  6. 6.

    We continue with the convention of denoting random quantities by upper case, as \(A\) and \(X^L\), and their realizations by the corresponding lower case letters, as \(a\) and \(x^L\).

  7. 7.

    Intuitively, the tensor product of two channel maps \(\varPhi _1\) and \(\varPhi _2\) acts as the parallel of the two channels in a composite Hilbert space \({\mathcal {H}}_1\otimes {\mathcal {H}}_2\). Specifically, one has [2]

    $$ \varPhi _1\otimes \varPhi _2=(\varPhi _1\otimes Id_2)\circ (Id_1\otimes \varPhi _2) $$

    where \(\circ \) is the concatenation (\(\varPhi _1\circ \varPhi _2\) is obtained by application of \(\varPhi _2\) at the output of \(\varPhi _1\)), \(Id_1\) and \(Id_2\) are the identity channels in \({\mathcal {H}}_1\) and \({\mathcal {H}}_2\), respectively. The interpretation becomes clear when \( \rho _{12}=\rho _{1}\otimes \rho _{2}\), where

    $$ (\varPhi _1\otimes \varPhi _2)[\rho _{1}\otimes \rho _{2}]= \varPhi _1[ \rho _{1}]\otimes \varPhi _2[ \rho _{2}]. $$

    Roughly speaking, we can say that in the channel \(\varPhi ^{\otimes L}\) each “component” of the input state sees the channel \(\varPhi \).

References

  1. C.E. Shannon, A mathematical theory of communication. Bell Syst. Tech. J. 27(3), 379–423 (1948)

    Article  MATH  MathSciNet  Google Scholar 

  2. A.S. Holevo, V. Giovannetti, Quantum channels and their entropic characteristics. Rep. Prog. Phys. 75(4), 046001 (2012)

    Article  MathSciNet  Google Scholar 

  3. R.W. Hartley, Transmission of information. Bell Syst. Tech. J. 7, 535–564 (1928)

    Article  Google Scholar 

  4. T. Cover, J. Thomas, Elements of Information Theory (Wiley, New York, 1991)

    Book  MATH  Google Scholar 

  5. C. Weedbrook, S. Pirandola, R. García-Patrón, N.J. Cerf, T.C. Ralph, J.H. Shapiro, S. Lloyd, Gaussian quantum information. Rev. Mod. Phys. 84, 621–669 (2012)

    Article  Google Scholar 

  6. A.S. Holevo, M. Sohma, O. Hirota, Capacity of quantum Gaussian channels. Phys. Rev. A 59, 1820–1828 (1999)

    Article  Google Scholar 

  7. S. Olivares, Quantum optics in the phase space. Eur. Phys. J. Spec. Top. 203(1), 3–24 (2012)

    Article  Google Scholar 

  8. M.A. Nielsen, I.L. Chuang, Quantum Computation and Quantum Information (Cambridge University Press, Cambridge, 2000)

    MATH  Google Scholar 

  9. D.A. Huffman, A method for the construction of minimum redundancy codes. Proc. IRE 40, 1098–1101 (1952)

    Article  Google Scholar 

  10. B.L. Schumaker, C.M. Caves, New formalism for two-photon quantum optics. II. Mathematical foundation and compact notation. Phys. Rev. A 31, 3093–3111 (1985)

    Article  MathSciNet  Google Scholar 

  11. N. Datta, Quantum entropy and information, in Quantum Information, Computation and Cryptography, Lecture Notes in Physics, vol. 808, ed. by F. Benatti, M. Fannes, R. Floreanini, D. Petritis (Springer, Berlin, 2010), pp. 175–214

    Google Scholar 

  12. A.S. Holevo, Complementary channels and the additivity problem. Theory Probab. Appl. 51(1), 92–100 (2007)

    Article  MATH  MathSciNet  Google Scholar 

  13. L.B. Levitin, Optimal quantum measurements for two pure and mixed states, in Quantum Communications and Measurement, ed. by V. Belavkin, O. Hirota, R. Hudson (Springer, US, 1995), pp. 439–448

    Chapter  Google Scholar 

  14. M.M. Wilde, Quantum Information Theory (Cambridge University Press, Cambridge, 2013). Cambridge Books Online

    Book  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Gianfranco Cariolaro .

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Cariolaro, G. (2015). Classical and Quantum Information Theory. In: Quantum Communications. Signals and Communication Technology. Springer, Cham. https://doi.org/10.1007/978-3-319-15600-2_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-15600-2_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-15599-9

  • Online ISBN: 978-3-319-15600-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics