Checklist
Research bias audit checklist
Eleven checks to run before any user research study, covering study design, the discussion guide, data collection and analysis. They target the biases that slip in most often: confirmation, framing, social desirability, demand characteristics and selection. Keep it next to the study plan. In Koji every participant gets the same neutral wording, which helps with the data collection checks.
Where this appears
What's in this checklist
- Write down your hypothesis so you can see where you were wrong
- Screen in people who could challenge the hypothesis
- Recruit from more than one channel
- Check every question for loaded language or an assumed answer
- Include questions designed to disprove your hypothesis
- Ask about past behavior, not future intentions
- Make it safe for people to give negative feedback
- Limit observers and visible researcher reactions
- Code every interview, not only the ones that fit
- Look for disconfirming evidence as hard as confirming evidence
- Have someone outside the study design review the analysis
Use this image
Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:
html
<a href="https://www.koji.so/visuals/research-bias-audit-checklist"><img src="https://www.koji.so/visuals/research-bias-audit-checklist/research-bias-audit-checklist.png" alt="Checklist of eleven checks to run before a study, covering the hypothesis, recruitment, question wording, data collection and analysis." width="1080" height="1080" /></a>
<p>Source: <a href="https://www.koji.so/visuals/research-bias-audit-checklist">Research bias audit checklist</a>, Koji</p>
