Jeffreys prior

Jeffreys prior

In Bayesian probability, the Jeffreys prior (called after Harold Jeffreys) is a
non-informative prior distribution proportional to the square rootof the Fisher information:

: p( heta) propto sqrt{I( heta | y)}

and is invariant under reparameterization of heta.

It's an important uninformative (objective) prior.

It allows us to describe our knowledge on phi , a transformation of heta with an improper uniform distribution. This also implies the resulting likelihood function, L(phi|X) should be asymptotically translated by changes in data. Due to asymptotical normality, this means only the first moment will vary when data is updated.

It can be derived as follows:

We need an injective transformation of heta such that our prior under this transformation is uniform. It gives us "no information". We then use the following relation:

: I(phi | y) = left(frac{d heta}{dphi} ight)^2I( heta | y)

To conclude,

: frac{dphi}{d heta} propto sqrt{I( heta | y)}

: phi propto int_ {}sqrt{I( heta | y)} d heta

From a practical and mathematical standpoint, a valid reason to use this noninformative prior instead of others, like the ones obtained through a limit in conjugate families of distributions, is that it best represents the lack of knowledge when a certain parametric family is chosen, and it is linked with strong Bayesian statistics results.

In general, use of Jeffreys priors violates the likelihood principle; some statisticians therefore regard their use as unjustified.Fact|date=December 2007

References

*cite journal
last= Jeffreys | first=H. | authorlink=Harold Jeffreys
year = 1946
title = An Invariant Form for the Prior Probability in Estimation Problems
journal = Proceedings of the Royal Society of London. Series A, Mathematical and Physical Sciences
volume = 186
issue = 1007
pages = 453–461
url = http://links.jstor.org/sici?sici=0080-4630(19460924)186%3A1007%3C453%3AAIFFTP%3E2.0.CO%3B2-J
doi = 10.1098/rspa.1946.0056

*cite book
last= Jeffreys | first=H. | authorlink=Harold Jeffreys
year = 1939
title = Theory of Probability
publisher = Oxford University Press


Wikimedia Foundation. 2010.

Игры ⚽ Поможем сделать НИР

Look at other dictionaries:

  • Prior probability — Bayesian statistics Theory Bayesian probability Probability interpretations Bayes theorem Bayes rule · Bayes factor Bayesian inference Bayesian network Prior · Posterior · Likelihood …   Wikipedia

  • Harold Jeffreys — Infobox Scientist name = Harold Jeffreys box width = image width =150px caption = Harold Jeffreys birth date = 22 April 1891 birth place = death date = 18 March 1989 death place = residence = citizenship = nationality = ethnicity = field =… …   Wikipedia

  • Alec Jeffreys — Infobox Scientist name = Sir Alec Jeffreys image width = caption = birth date = birth date and age|1950|1|9|df=y birth place = Oxford, United Kingdom nationality = British death date = death place = field = Genetics work institutions = University …   Wikipedia

  • Baron Jeffreys — is a title that has been created twice, once in the Peerage of England and once in the Peerage of the United Kingdom. The first creation came in the Peerage of England on May 16 1685 when the lawyer and later Lord Chancellor George Jeffreys was… …   Wikipedia

  • Hierarchical Bayes model — The hierarchical Bayes method is one of the most important topics in modern Bayesian analysis. It is a powerful tool for expressing rich statistical models that more fully reflect a given problem than a simpler model could. Given data x,! and… …   Wikipedia

  • List of statistics topics — Please add any Wikipedia articles related to statistics that are not already on this list.The Related changes link in the margin of this page (below search) leads to a list of the most recent changes to the articles listed below. To see the most… …   Wikipedia

  • Exponential distribution — Not to be confused with the exponential families of probability distributions. Exponential Probability density function Cumulative distribution function para …   Wikipedia

  • Credible interval — Bayesian statistics Theory Bayesian probability Probability interpretations Bayes theorem Bayes rule · Bayes factor Bayesian inference Bayesian network Prior · Posterior · Likelihood …   Wikipedia

  • Fiducial inference — was a form of statistical inference put forward by R A Fisher in an attempt to perform inverse probability without prior probability distributions.A fiducial interval may be used instead of a confidence interval or a Bayesian credible interval in …   Wikipedia

  • List of mathematics articles (J) — NOTOC J J homomorphism J integral J invariant J. H. Wilkinson Prize for Numerical Software Jaccard index Jack function Jacket matrix Jackson integral Jackson network Jackson s dimensional theorem Jackson s inequality Jackson s theorem Jackson s… …   Wikipedia

Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”