A/B Test Calculator

Compare two conversion rates or two means with a named frequentist test, effect size, and confidence interval.

Outcome type
A
B
Tails

p-value

Enter values

Two-sided is the default.

A

-

B

-

Test details
MetricValue
Export

z = (pB - pA) / sqrt(pPool(1 - pPool)(1/nA + 1/nB)) How?

How this is calculated

Conversion mode uses a two-proportion z-test for the p-value and a Newcombe Wilson interval for B minus A. Mean mode uses Welch's two-sample t-test, so equal variances are not assumed.

Formula: z = (pB - pA) / sqrt(pPool(1 - pPool)(1/nA + 1/nB))

Sources

  1. statsmodels proportions_ztest. statsmodels. Retrieved .
  2. statsmodels confint_proportions_2indep. statsmodels. Retrieved .

Method last reviewed