Checklist
What to check in an AI interview pilot

A checklist for the small pilot you run before launching an AI-moderated study to everyone. A pilot of three to five interviews can show questions people misread, answer options that do not cover what people say, follow-ups in the wrong tone, a study that is too long or too short, and brief wording the AI takes the wrong way. Read the full transcripts, adjust, then launch.
Where this appears
What's in this checklist
- Questions participants keep misreading
- Answer options that miss what people say, shown by a lot of Other answers
- Probing instructions that lead to off-tone follow-ups
- A study that feels too long or too rushed
- Brief wording the AI reads differently than you meant
- Read the transcripts, not just the themes, then fix the brief and questions
Use this image
Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:
html
<a href="https://www.koji.so/visuals/ai-interview-pilot-checklist"><img src="https://www.koji.so/visuals/ai-interview-pilot-checklist/ai-interview-pilot-checklist.png" alt="Checklist for a three to five interview pilot: misread questions, missing options, off-tone probes, study length and brief wording, then read the transcripts." width="1200" height="630" /></a>
<p>Source: <a href="https://www.koji.so/visuals/ai-interview-pilot-checklist">What to check in an AI interview pilot</a>, Koji</p>




