All frameworks and cheat sheets

Question bank

RFP questions for AI interview moderation quality

Question bank of seven RFP questions about AI interview moderation: unscripted follow-ups, probing depth, voice or text, leading questions and AI disclosure.
Ask for a recorded sample session to check the answer to the first question.

Seven questions to put to any vendor of AI-moderated interviews, covering whether the AI asks real follow-up questions, how deep it probes, voice and text support, how it avoids leading participants, AI disclosure and whether you can test it before launch. Part of a 45-question RFP bank for user research platforms. Disclosure matters more since EU AI Act transparency rules apply from August 2026.

Where this appears

What's in this question bank

Follow-up questions

  1. Does the AI ask unscripted follow-up questions, or does it read a fixed script?
  2. What triggers a follow-up: a shallow answer, a contradiction, an emotional cue?
  3. How many follow-up levels deep will it probe on a single topic?

Format and safeguards

  1. Does the platform support voice interviews, text, or both? What changes in output quality between them?
  2. How do you prevent the AI from leading the participant toward a desired answer?
  3. Is the participant told they are speaking with an AI, and at what point?
  4. Can we review and adjust the AI's behaviour before launching to real participants?

Use this image

Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:

html
<a href="https://www.koji.so/visuals/rfp-questions-ai-moderation-quality"><img src="https://www.koji.so/visuals/rfp-questions-ai-moderation-quality/rfp-questions-ai-moderation-quality.png" alt="Question bank of seven RFP questions about AI interview moderation: unscripted follow-ups, probing depth, voice or text, leading questions and AI disclosure." width="1200" height="642" /></a>
<p>Source: <a href="https://www.koji.so/visuals/rfp-questions-ai-moderation-quality">RFP questions for AI interview moderation quality</a>, Koji</p>