Some Bayesian Concepts

Scott A. Pardo
Additional contact information
Scott A. Pardo: Ascensia Diabetes Care

Chapter Chapter 12 in Empirical Modeling and Data Analysis for Engineers and Applied Scientists, 2016, pp 185-196 from Springer

Abstract: Abstract Bayesian statistical methods are based on Bayes’ theorem, which was described in Chap. 1 . Suppose X represents a continuously-valued random variable, and f(x|θ) is its density function given parameter θ. In the Bayesian world, the parameter θ is also treated as a random variable, with a density function g(θ). This density is referred to as the prior density for θ, inasmuch as it is formulated prior to obtaining any observations of X. The idea is that g(θ) represents our prior belief about the likelihood that θ takes on a value in any particular range. Generally, g(θ) is also a function of some other parameters, which we will call hyperparameters, whose values are chosen to reflect the prior belief about the possible range of values for θ. The observation of X, call it x, is assumed to be dependent on the value of θ. The dependency is expressed as a likelihood function, symbolized by L(x|θ). Once the data, x, are observed, the Bayesian would like to update his or her belief concerning the probability that the unknown parameter, θ, falls in any particular range. The updated belief is expressed as a conditional density function, called the posterior density, and is expressed as g(θ|x). Bayes’ theorem provides a method for deriving the posterior density given the prior density and the likelihood function: g θ | x = L x | θ g θ ∫ − ∞ + ∞ L x | τ g τ d τ $$ g\left(\theta \Big|x\right)=\frac{L\left(x\Big|\theta \right)g\left(\theta \right)}{{\displaystyle {\int}_{-\infty}^{+\infty }}L\left(x\Big|\tau \right)g\left(\tau \right)d\tau } $$ Conjugacy is a condition that greatly simplifies computations. A likelihood function and a prior distribution are said to be a conjugate pair if the resulting posterior distribution is of the same form as the prior. For conjugate pairs, the posterior distribution has hyperparameters whose values are generally a closed-form function of the prior hyperparameters and the data. Generally this relationship is the reason why conjugacy greatly simplifies computations.

Keywords: Posterior Distribution; Monte Carlo Markov Chain; Likelihood Function; Prior Distribution; Credible Interval (search for similar items in EconPapers)
Date: 2016
References: Add references at CitEc
Citations:

There are no downloads for this item, see the EconPapers FAQ for hints about obtaining it.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:spr:sprchp:978-3-319-32768-6_12

Ordering information: This item can be ordered from
http://www.springer.com/9783319327686

DOI: 10.1007/978-3-319-32768-6_12

Access Statistics for this chapter

More chapters in Springer Books from Springer
Bibliographic data for series maintained by Sonal Shukla () and Springer Nature Abstracting and Indexing ().