Bayesian A/B Test Calculator

Compare two conversion variants with posterior probability under a visible beta prior.

A
B

P(B beats A)

Enter counts

Uses a visible beta prior.

Posterior mean A

0%

Posterior mean B

0%

Posterior details
MetricValue
Export

posterior = Beta(alpha + conversions, beta + visitors - conversions) How?

How this is calculated

Each conversion rate has a beta prior and binomial likelihood. The calculator samples paired posterior rates with a deterministic seed, reports the share where B is greater than A, and uses empirical quantiles for the difference interval.

Formula: posterior = Beta(alpha + conversions, beta + visitors - conversions)

Sources

  1. Evan Miller Formulas for Bayesian A/B Testing. Evan Miller. Retrieved .
  2. Bayesian Data Analysis. Columbia University. Retrieved .

Method last reviewed