Checklist
Usability metrics checklist: 5 mistakes to avoid
A five-point checklist for reporting usability metrics without fooling yourself. It covers timing only successful attempts, using the median or geometric mean for skewed time data, adding a confidence interval to every success rate, measuring satisfaction next to success, and keeping task wording fixed between rounds. Use it before sharing a benchmark with stakeholders.
What's in this checklist
- Report time on task for successful attempts only
- Use the median or geometric mean on small samples, not the arithmetic mean
- Give every success rate a confidence interval
- Measure satisfaction as well as success
- Keep task wording identical between benchmark rounds
Use this image
Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:
html
<a href="https://www.koji.so/visuals/usability-metrics-mistakes-checklist"><img src="https://www.koji.so/visuals/usability-metrics-mistakes-checklist/usability-metrics-mistakes-checklist.png" alt="Checklist of five usability metrics mistakes to avoid, from timing failed attempts to changing task wording between benchmark rounds." width="1200" height="630" /></a>
<p>Source: <a href="https://www.koji.so/visuals/usability-metrics-mistakes-checklist">Usability metrics checklist: 5 mistakes to avoid</a>, Koji</p>
