All frameworks and cheat sheets

Reference table

9 research biases and how to counter them

Table of nine research biases, grouped by researcher, participant and study design, with one way to counter each in user research.
Most studies carry several of these at once. Check which ones your plan leaves open before you recruit.

A one-page summary of the nine biases that most often distort user research: confirmation, anchoring and framing on the researcher side, social desirability, acquiescence, recall and demand characteristics on the participant side, and selection and survivorship in the study design. Each row gives one practical counter. Use it to review a discussion guide or a recruitment plan before a study starts.

Where this appears

What's in this reference table

BiasWhere it livesOne way to counter it
Confirmation biasResearcherWrite questions that could disprove your hypothesis
Anchoring biasResearcherAnalyze each interview before rereading earlier notes
Framing biasResearcherAsk about the experience, not about the problem
Social desirability biasParticipantAsk about past behavior, not future intentions
Acquiescence biasParticipantFollow every yes with a request for detail
Recall biasParticipantAsk about specific, recent instances
Demand characteristicsParticipantKeep observers out of the session room
Selection biasStudy designRecruit through several channels, including people who struggled
Survivorship biasStudy designInterview churned users alongside active ones

Use this image

Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:

html
<a href="https://www.koji.so/visuals/nine-research-biases-and-counters-table"><img src="https://www.koji.so/visuals/nine-research-biases-and-counters-table/nine-research-biases-and-counters-table.png" alt="Table of nine research biases, grouped by researcher, participant and study design, with one way to counter each in user research." width="1200" height="1036" /></a>
<p>Source: <a href="https://www.koji.so/visuals/nine-research-biases-and-counters-table">9 research biases and how to counter them</a>, Koji</p>