Skip to content

Side 120

Bayesian Inference

A framework for updating uncertainty when new evidence arrives, with explicit separation between prior assumptions, data-generating models and posterior conclusions.

prior→likelihood→posterior→prediction→decision
04lenses
16working concepts
V0content
SS-1.0standard

Bayesian inference is structured belief revision.

The posterior combines what was plausible before the data with how compatible the observed data are with competing parameter values.

01 · Prior

Represent uncertainty before the current data.

Priors can encode previous evidence, domain constraints or deliberately weak information.

02 · Likelihood

Specify how data would arise under the model.

The likelihood is a model of evidence conditional on parameters, not the probability that the model is true.

03 · Posterior

Update uncertainty after observing data.

The posterior redistributes probability according to both prior structure and evidential fit.

04 · Normalization

Compare possibilities on a common probability scale.

The denominator ensures probabilities sum correctly and can be computationally difficult in complex models.

Bayesian answers inherit the assumptions of the model.

A posterior can be internally precise while the model is externally wrong.

01 · Generative model

Describe how observable data could be produced.

Thinking generatively exposes hidden assumptions about noise, dependence and sampling.

02 · Hierarchy

Share information across related units.

Multilevel models partially pool estimates rather than forcing complete independence or complete equality.

03 · Latent variables

Represent unobserved structure explicitly.

Latent states can explain observed dependence while introducing identifiability challenges.

04 · Prior predictive check

Ask what the model predicts before seeing data.

Implausible simulated outcomes reveal priors or likelihoods that encode unrealistic worlds.

Inference should be checked, not merely computed.

Posterior summaries are trustworthy only when the computation converges and the model can reproduce relevant features of the data.

01 · Posterior predictive

Simulate replicated data from the fitted model.

Systematic mismatch reveals dimensions the model fails to capture.

02 · Sensitivity

Vary priors and assumptions.

Conclusions that change sharply under reasonable alternatives should be reported as fragile.

03 · Convergence

Check numerical stability.

Sampling diagnostics assess whether computational approximations explored the posterior adequately.

04 · Calibration

Evaluate long-run inferential behavior.

Intervals and probabilities should be interpreted with awareness of model assumptions and repeated-use properties.

Inference and action are separate steps.

A posterior describes uncertainty; a decision additionally requires values, losses and feasible actions.

01 · Predictive distribution

Move from parameters to future outcomes.

Predictions integrate uncertainty rather than substituting a single best estimate.

02 · Loss

State what errors cost.

Different asymmetric losses can rationally produce different actions from the same posterior.

03 · Value of information

Measure whether more evidence could change action.

Additional data matter when they are likely to alter an important decision.

04 · Model averaging

Retain uncertainty across plausible models.

Averaging can reduce overconfidence when no single model dominates.

Bayes' rule is simple; modeling is not. Most of the real judgment lies in defining the model, choosing priors, checking fit and deciding what the posterior is actually allowed to support.