Statistical View of Information Theory, A
摘要
Information Theory has origins and applications in several fields such as: thermodynamics, communication theory, computer science, economics, biology, mathematics, probability and statistics. Due to this diversity, there are numerous information measures in the literature. Kullback (Information theory and statistics. Gloucester, 1978), Sakamoto et al. (Akaike information criterion statistics. KTK, 1986), and Pardo (Statistical Inference Based on Divergence Measures. Chapman & Hall, London, 2006) have applied several of these measures to almost all statistical inference problems.