All frameworks and cheat sheets

Reference table

Adjusted Wald intervals for small-sample completion rates

Table of 95% adjusted Wald confidence intervals for usability completion rates, showing that 5 of 5 successes fits a true rate as low as 51%.
A perfect score from five people still leaves the true rate anywhere from 51% to 100%. Source: Koji calculation, adjusted Wald method (Agresti and Coull, 1998)

A lookup table of 95% adjusted Wald confidence intervals for common usability test results, from 4 of 5 to 70 of 100 completions. It shows how wide the range is with 5 to 20 participants and why getting to about 10 points either side takes around 100. The values are calculated with the adjusted Wald method from Agresti and Coull, which Sauro and Lewis recommend for small-sample completion rates. Report the observed rate with its interval.

Where this appears

What's in this reference table

ObservedCompletion rate95% adjusted Wald interval
4 of 580%36% to 98%
5 of 5100%51% to 100%
7 of 1070%39% to 90%
9 of 1090%57% to 100%
10 of 10100%68% to 100%
14 of 2070%48% to 86%
70 of 10070%60% to 78%

Use this image

Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:

html
<a href="https://www.koji.so/visuals/adjusted-wald-confidence-intervals-completion-rates-table"><img src="https://www.koji.so/visuals/adjusted-wald-confidence-intervals-completion-rates-table/adjusted-wald-confidence-intervals-completion-rates-table.png" alt="Table of 95% adjusted Wald confidence intervals for usability completion rates, showing that 5 of 5 successes fits a true rate as low as 51%." width="1200" height="781" /></a>
<p>Source: <a href="https://www.koji.so/visuals/adjusted-wald-confidence-intervals-completion-rates-table">Adjusted Wald intervals for small-sample completion rates</a>, Koji</p>