Subjectivity in Application of the Principle of Maximum EntropyReport as inadecuate

Subjectivity in Application of the Principle of Maximum Entropy - Download this document for free, or read online. Document in PDF available to download.

Complete prior statistical information is currently required in the majority of statistical evaluations of complex models. The principle of maximum entropy is often utilized in this context to fill in the missing pieces of available information and is normally claimed to be fair and objective. A rarely discussed aspect is that it relies upon testable information, which is never known but estimated, i.e. results from processing of raw data. The subjective choice of this processing strongly affects the result. Less conventional posterior completion of information is equally accurate but is computationally superior to prior, as much less information enters the analysis. Our recently proposed methods of lean deterministic sampling are examples of very few approaches that actively promote the use of minimal incomplete prior information. The inherited subjective character of maximum entropy distributions and the often critical implications of prior and posterior completion of information are here discussed and illustrated, from a novel perspective of consistency, rationality, computational efficiency and realism.


Maximum; Entropy; Bayes; Monte Carlo; Uncertainty; Covariance; Deterministic; Sampling; Testable; Information; Model; Calculation; Simulation

Cite this paper

J. Hessling -Subjectivity in Application of the Principle of Maximum Entropy,- Open Journal of Statistics, Vol. 3 No. 6A, 2013, pp. 1-8. doi: 10.4236-ojs.2013.36A001.

Author: Jan Peter Hessling



Related documents