All frameworks and cheat sheets

Reference table

One churn result, four ways to report it

Table showing one onboarding result, churn down from 12% to 9%, as a relative reduction, an absolute reduction, a number needed to treat and an annual count.
Same experiment, four rows. The first one gets presented, and it is the one that makes the effect look biggest.

A worked example that reports one onboarding experiment, 90-day churn falling from 12 percent to 9 percent, in four formats: relative risk reduction, absolute risk reduction, number needed to treat and expected annual saves. Each row shows what the format leads a reader to conclude and what it leaves out. Product and research teams can use it to rewrite a percentage lift as a count of accounts that can be costed.

Where this appears

What's in this reference table

FormatThe numberWhat readers concludeWhat it hides
Relative risk reductionCuts 90-day churn by 25 percentThis is a large effectThe baseline. A 25 percent cut of 0.4 percent is nothing
Absolute risk reductionCuts 90-day churn by 3 percentage pointsThis is a modest, real effectHow much work is needed to collect it
Number needed to treatFix onboarding for 34 accounts to save 1This costs something per unit of outcomeNothing much: this is the honest form
Expected annual outcome400 accounts per quarter, so about 48 saves a yearThis is what it is worthNothing, provided the baseline is right

Use this image

Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:

html
<a href="https://www.koji.so/visuals/churn-effect-four-formats-relative-absolute-nnt"><img src="https://www.koji.so/visuals/churn-effect-four-formats-relative-absolute-nnt/churn-effect-four-formats-relative-absolute-nnt.png" alt="Table showing one onboarding result, churn down from 12% to 9%, as a relative reduction, an absolute reduction, a number needed to treat and an annual count." width="1200" height="691" /></a>
<p>Source: <a href="https://www.koji.so/visuals/churn-effect-four-formats-relative-absolute-nnt">One churn result, four ways to report it</a>, Koji</p>