All frameworks and cheat sheets

Reference table

Usability testing methods by sample size and time

Table comparing five usability testing methods by when to use each, typical sample size and time, from moderated remote to hallway tests.
Pick the method by the question you need answered, then budget the people and the time.

A comparison of five usability testing methods: moderated remote, unmoderated remote, AI-moderated voice, in-person and guerrilla or hallway testing. For each one it lists when it fits, a typical number of participants and how long a round usually takes. Use it to plan a test before you recruit anyone.

Where this appears

What's in this reference table

MethodWhen to useTypical sampleTime
Moderated remoteAmbiguous flows, early concepts, complex enterprise UX5 to 82 to 3 weeks
Unmoderated remoteValidated flows, A/B variants, broad demographic coverage15 to 303 to 7 days
AI-moderated (voice)Both of the above, plus scale and 24/7 availability20 to 100+1 to 5 days
In-personHardware, physical environments, accessibility studies5 to 122 to 4 weeks
Guerrilla or hallwayQuick directional check on a single screen3 to 5Hours

Use this image

Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:

html
<a href="https://www.koji.so/visuals/usability-testing-methods-sample-size-and-time"><img src="https://www.koji.so/visuals/usability-testing-methods-sample-size-and-time/usability-testing-methods-sample-size-and-time.png" alt="Table comparing five usability testing methods by when to use each, typical sample size and time, from moderated remote to hallway tests." width="1200" height="873" /></a>
<p>Source: <a href="https://www.koji.so/visuals/usability-testing-methods-sample-size-and-time">Usability testing methods by sample size and time</a>, Koji</p>