Checklist
How to run AI interviews you can trust

Six habits that make AI-moderated interviews hold up: mix structured questions with open probing, accept only themes backed by verbatim quotes, filter bad conversations with a quality gate, probe for the reason behind each answer, read a sample of transcripts, and interview enough people. Use it as a pre-launch and pre-readout check for any AI interview study, in Koji or another tool.
Where this appears
What's in this checklist
- Mix structured questions with open probing, so you have numbers to check the story against
- Only trust themes that link to verbatim quotes and the messages they came from
- Keep a quality gate that drops low-effort and fraudulent conversations before analysis
- Probe the why behind each answer, not just the first reply
- Read a sample of transcripts yourself
- Interview enough people for themes to become patterns
Use this image
Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:
html
<a href="https://www.koji.so/visuals/trustworthy-ai-interviews-checklist"><img src="https://www.koji.so/visuals/trustworthy-ai-interviews-checklist/trustworthy-ai-interviews-checklist.png" alt="Checklist of six ways to make AI interviews trustworthy: structured questions, quoted themes, a quality gate, probing, transcript checks and enough people." width="1200" height="630" /></a>
<p>Source: <a href="https://www.koji.so/visuals/trustworthy-ai-interviews-checklist">How to run AI interviews you can trust</a>, Koji</p>




