All frameworks and cheat sheets

Checklist

Checklist to validate synthetic user research

Eight checks to run before an AI persona finding reaches a roadmap

Checklist of eight steps for validating synthetic user research with real participants, from saving the AI output to logging what the model missed.
Print this before the first real interview, and tick it off per claim.

A checklist for UX researchers who need to check AI persona findings against real people. It covers saving the synthetic output, writing testable claims, screening the right audience and scoring each claim afterwards. Use it before and after a validation round of interviews. Koji can run the interviews with real participants.

Where this appears

What's in this checklist

  • Synthetic output saved and dated before any real interview
  • Each claim written so a participant could contradict it
  • Claims ranked by the decision they would change
  • Real participants match the audience the persona stood for
  • Synthetic transcripts kept out of the interview context
  • Questions ask about past behavior, not future opinions
  • Every claim scored: confirmed, contradicted, reversed or not raised
  • Misses logged: what real people raised that the model did not

Use this image

Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:

html
<a href="https://www.koji.so/visuals/synthetic-research-validation-checklist"><img src="https://www.koji.so/visuals/synthetic-research-validation-checklist/synthetic-research-validation-checklist.png" alt="Checklist of eight steps for validating synthetic user research with real participants, from saving the AI output to logging what the model missed." width="1080" height="1080" /></a>
<p>Source: <a href="https://www.koji.so/visuals/synthetic-research-validation-checklist">Checklist to validate synthetic user research</a>, Koji</p>