Data template

A/B Test Significance Calculator

Whether a conversion difference is real or noise — z-score, p-value and a plain verdict.

$12one payment, yours to keep

✓Instant download
✓Every later version free
✓Commercial use
✓No signup, no watermark

19: live formulas, each one recalculated and checked
4: columns: Measure, Control (A), Variant (B), What it means
11: figures worked out for you

A marketer checking a result is real · Teams running tests on modest traffic — usually looking for this when one variant looks better but the sample may be too small.

Need more than one? All 9 Data templates for $39 — $119 bought separately. All 66 for $99.

Works in Excel 2013 and later, Microsoft 365, Google Sheets and LibreOffice Calc. Set up to print on one page wide. Version 1, updated 25 September 2026.

There are free templates. Why this one?

There are, and some are fine. The difference is what has been checked. This file was built from scratch, then every formula in it was recalculated by a separate checker that compares each result against an independently worked-out answer — 19 of them here. A template that looks right and totals wrong is worse than no template at all, and that is the usual failing of one downloaded from a search result.

It also opens with sample rows already filled in, so you can see every formula working before you touch it, and it is set up to print without fighting the page setup. No email wall, no signup, no watermark, and you can use it commercially.

About this A/B Test Significance Calculator template

A higher conversion rate in a test does not always mean the change worked; it could be chance. This Excel A/B test significance calculator takes visitors and conversions for the control and the variant and runs a standard two-proportion z-test, one visible step at a time.

It shows each conversion rate with its 95% range, the absolute and relative uplift, the z-score, the two-tailed p-value and a plain-English verdict, plus a check that there are enough conversions to trust the result.

Good for

→Checking landing page and email tests
→Deciding whether to roll out a winning variant
→Explaining a test result to people who are not statisticians

What it works out for you

Result

→Absolute difference
→Relative uplift
→Pooled conversion rate
→Standard error of the difference
→Z-score
→P-value (two-tailed)
→Confidence
→Significant at 95%?
→Verdict
→Sample check
→Extra visitors needed for a clean read

What is inside the A/B Test Significance Calculator template

The table has 4 columns. Calculated columns fill themselves in; the rest are yours to type over.

→Measure
→Control (A)
→Variant (B)
→What it means

How to use the A/B Test Significance Calculator in Excel

Enter visitors and conversions for each variant. Everything below is a standard two-proportion z-test, written out step by step so you can check the working.

The file opens with sample rows so you can see every formula working before you change anything. Type your own figures over them. When you need more rows, insert them inside the existing block rather than underneath it, so the totals keep covering every row.

Functions and formulas it uses

Every one of these exists in Excel, Google Sheets and LibreOffice, so the file behaves the same wherever you open it.

ABSIFIFERRORMINNORM.S.DISTSQRT

Questions about the A/B Test Significance Calculator

What does the p-value mean?

Roughly, how likely a difference at least this large would be if the two versions really performed the same. Below 0.05 is the usual threshold for calling a result significant at 95%.