| entropy.MillerMadow {entropy} | R Documentation |
entropy.MillerMadow estimates the Shannon entropy H of the random variable Y
from the corresponding observed counts y using the Miller-Madow correction
to the empirical entropy).
entropy.MillerMadow(y, unit=c("log", "log2", "log10"))
y |
vector of counts. |
unit |
the unit in which entropy is measured. |
The Miller-Madow entropy estimator (1955) is the bias-corrected empirical entropy estimate.
Note that the Miller-Madow estimator is not a plug-in estimator, hence there are no explicit underlying bin frequencies.
entropy.MillerMadow returns an estimate of the Shannon entropy.
Korbinian Strimmer (http://strimmerlab.org).
Miller, G. 1955. Note on the bias of information estimates. Info. Theory Psychol. Prob. Methods II-B:95-100.
# load entropy library
library("entropy")
# observed counts for each bin
y = c(4, 2, 3, 0, 2, 4, 0, 0, 2, 1, 1)
# estimate entropy using Miller-Madow method
entropy.MillerMadow(y)
# compare to empirical estimate
entropy.empirical(y)