Information Entropy of Probability Distributions

Information Entropy of Probability Distributions

Alvin Sherman Library 1054

Entropy is the crucial concept of thermodynamics and statistical mechanics. In recent years, the entropy of probability distribution has been used as a traffic descriptor in ATM networks. The thermodynamic entropy of an ATM traffic stream is a useful tool for predicting cell-loss ratios and cell-delay. In this paper we determine the entropies of classical continuous probability distributions. Using Java programs, we implement a numerical algorithm to compute various information entropies of probability distributions. Our results are also demonstrated interactively through a data-driven Website.