Entropy Estimators#

infomeasure.estimators.entropy Package#

Classes#

AnsbEntropyEstimator(*data[, K, ...])

Asymptotic NSB entropy estimator.

BayesEntropyEstimator(*data, alpha[, K, base])

Bayesian entropy estimator.

BonachelaEntropyEstimator(*args, **kwargs)

Bonachela (Bonachela-Hinrichsen-Muñoz) entropy estimator for discrete data.

ChaoShenEntropyEstimator(*args, **kwargs)

Chao-Shen entropy estimator.

ChaoWangJostEntropyEstimator(*args, **kwargs)

Advanced bias-corrected Shannon entropy estimator using coverage estimation.

DiscreteEntropyEstimator(*args, **kwargs)

Standard Shannon entropy estimator for discrete data using maximum likelihood.

GrassbergerEntropyEstimator(*args, **kwargs)

Discrete Grassberger entropy estimator.

KernelEntropyEstimator(*data, bandwidth, kernel)

Kernel entropy estimator for continuous data using Kernel Density Estimation (KDE).

KozachenkoLeonenkoEntropyEstimator(*data[, ...])

Kozachenko-Leonenko entropy estimator for continuous data.

MillerMadowEntropyEstimator(*args, **kwargs)

Discrete Miller-Madow entropy estimator.

NsbEntropyEstimator(*data[, K, base])

NSB (Nemenman-Shafee-Bialek) entropy estimator.

OrdinalEntropyEstimator(*data, embedding_dim)

Estimator for the Ordinal / Permutation entropy.

RenyiEntropyEstimator(*data[, k, alpha, base])

Estimator for the Rényi entropy.

ShrinkEntropyEstimator(*args, **kwargs)

Shrinkage (James-Stein) entropy estimator.

TsallisEntropyEstimator(*data[, k, q, base])

Estimator for the Tsallis entropy.

ZhangEntropyEstimator(*args, **kwargs)

Zhang entropy estimator for discrete data.

Class Inheritance Diagram#

Inheritance diagram of infomeasure.estimators.entropy.ansb.AnsbEntropyEstimator, infomeasure.estimators.entropy.bayes.BayesEntropyEstimator, infomeasure.estimators.entropy.bonachela.BonachelaEntropyEstimator, infomeasure.estimators.entropy.chao_shen.ChaoShenEntropyEstimator, infomeasure.estimators.entropy.chao_wang_jost.ChaoWangJostEntropyEstimator, infomeasure.estimators.entropy.discrete.DiscreteEntropyEstimator, infomeasure.estimators.entropy.grassberger.GrassbergerEntropyEstimator, infomeasure.estimators.entropy.kernel.KernelEntropyEstimator, infomeasure.estimators.entropy.kozachenko_leonenko.KozachenkoLeonenkoEntropyEstimator, infomeasure.estimators.entropy.miller_madow.MillerMadowEntropyEstimator, infomeasure.estimators.entropy.nsb.NsbEntropyEstimator, infomeasure.estimators.entropy.ordinal.OrdinalEntropyEstimator, infomeasure.estimators.entropy.renyi.RenyiEntropyEstimator, infomeasure.estimators.entropy.shrink.ShrinkEntropyEstimator, infomeasure.estimators.entropy.tsallis.TsallisEntropyEstimator, infomeasure.estimators.entropy.zhang.ZhangEntropyEstimator