All frameworks and cheat sheets

Checklist

Bias-control checklist for user interview studies

Checklist of ten bias checks for a user interview study, from writing a null hypothesis and reviewing the guide to synthesizing after all interviews.
Ten checks to run before, during and after a study, so the findings hold up
Download PNGRead the full guide

A ten-point checklist for keeping cognitive bias out of a user interview study. It covers the hypothesis and null hypothesis, a peer review of the discussion guide, a minimum share of behavioral questions, the sample frame, a neutral moderator, when to synthesize, checking against behavioral data, sensitive topics and a peer review of findings. Print it or keep it beside your research plan. An AI moderator like Koji takes care of the neutral moderator check.

Where this appears

What's in this checklist

  • Write down your hypothesis and your null hypothesis
  • Have someone else review the discussion guide for leading questions
  • Make at least 60% of questions about past behavior, not hypotheticals
  • Define the sample frame and document who you excluded
  • Use a moderator with no stake in the outcome
  • Synthesize after all interviews, not after each one
  • Check self-reported findings against behavioral data
  • Use indirect framings or low-judgment moderation for sensitive topics
  • Include at least 3 questions whose answers would change your mind
  • Plan a peer review of the findings before they ship

Use this image

Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:

html
<a href="https://www.koji.so/visuals/interview-bias-control-checklist"><img src="https://www.koji.so/visuals/interview-bias-control-checklist/interview-bias-control-checklist.png" alt="Checklist of ten bias checks for a user interview study, from writing a null hypothesis and reviewing the guide to synthesizing after all interviews." width="1080" height="1080" /></a>
<p>Source: <a href="https://www.koji.so/visuals/interview-bias-control-checklist">Bias-control checklist for user interview studies</a>, Koji</p>

Related

Table of seven participant-side biases in user interviews, from social desirability and recency bias to the Hawthorne effect, with a countermeasure for each.

Participant biases in user interviews and how to counter them

Table of seven researcher-side biases in user interviews, from confirmation and anchoring bias to the halo effect, each with what it does and a countermeasure.

Researcher biases in user interviews and how to counter them

Checklist for reading win-loss interviews: code by deal, count unprompted mentions, compare with wins, and pick one change per pattern.

How to read win-loss interviews