{"site":{"name":"Koji","description":"AI-native customer research platform that helps teams conduct, analyze, and synthesize customer interviews at scale.","url":"https://www.koji.so","contentTypes":["blog","documentation"],"lastUpdated":"2026-05-13T13:20:37.350Z"},"content":[{"type":"documentation","id":"967eba65-2d19-45c8-b096-d08eccf0d14d","slug":"how-to-customize-interview-questions","title":"How to Customize AI Interview Questions: A Step-by-Step Guide","url":"https://www.koji.so/docs/how-to-customize-interview-questions","summary":"Customizing interview questions in Koji takes minutes: open your study brief, edit the question list, choose a question type (open_ended, scale, single_choice, multiple_choice, ranking, yes_no), and set follow-up probing depth. The AI interviewer adapts every question to the participant's answer in real time — so you write the question once, and Koji handles the conversation.","content":"## What customizing interview questions actually means in Koji\n\nCustomizing interview questions in Koji means editing the **core question list** inside your study brief and setting how the **AI interviewer** asks, follows up on, and probes each one. Unlike a static survey form where you write a fixed list of questions and hope respondents stay on track, Koji turns your questions into a **conversational script** that adapts to each participant in real time.\n\nYou write the question once. The AI handles follow-ups, clarifications, scale anchoring, and probing for specifics — automatically. This is what makes platforms like Koji 10x faster than traditional research tools where every probe has to be manually moderated by a human researcher.\n\nThis guide walks through the full customization workflow: editing core questions, choosing question types, tuning AI behavior, and validating the guide before launch.\n\n## Quick answer: how to customize questions in 5 steps\n\n1. Open your study and click into the **Research Brief**.\n2. Scroll to the **Questions** section and click any question to edit text, type, or probing settings.\n3. Pick a **question type** — open-ended for stories, scale for ratings, single/multiple choice for forced selection, ranking for prioritization, yes/no for binary signals.\n4. Set **follow-up depth** (0 to 3) — higher values mean the AI probes deeper on each answer.\n5. **Preview the interview** to test the conversational flow, then publish.\n\nThe rest of this guide explains what each setting does, when to use it, and how to avoid common mistakes.\n\n## The 6 question types Koji supports\n\nEvery customized question carries a `type` that determines how the AI asks it, how the text UI renders it, and how the report visualizes it. Picking the right type up front is the most important part of customization.\n\n### Open-ended\nFree-form qualitative answers. The AI probes for specifics, examples, and emotional context. Use for \"tell me about the last time…\", \"walk me through how you…\", or any question where the *story* matters more than a number. Reports show thematic summaries with verbatim quotes.\n\n### Scale\nNumeric ratings on a configurable range (1-5, 0-10, 1-100). Use for NPS, CSAT, satisfaction, importance, agreement. Set `scaleMin`, `scaleMax`, and optional anchor labels. Reports show distribution charts. Turn on the **anchor probe** to have the AI ask \"You gave it a 7 — what would push it to a 10?\" automatically.\n\n### Single choice\nPick one option from a list. Use for plan tier, role, primary use case, or any mutually exclusive selection. Voice mode reads the options aloud; text mode renders a radio widget. Reports show frequency bars.\n\n### Multiple choice\nPick one or more from a list. Use for \"which of these have you tried\", \"which features matter most\", or any non-exclusive selection. Reports show stacked frequency.\n\n### Ranking\nDrag-to-rank an ordered list. Use for prioritization, preference order, or buying-criteria importance. Reports show average rank position and full rank distributions.\n\n### Yes / no\nBinary signal. Use for screening, awareness checks, or definitive decisions. Reports show pie/donut charts.\n\n> **Koji tip:** Most great interview guides mix **2-3 open-ended questions** for the texture with **3-5 structured questions** for the comparable metrics. See the [structured questions guide](/docs/structured-questions-guide) for in-depth examples.\n\n## How to edit core question text\n\nClick any question in the brief to inline-edit. Good question text follows three rules:\n\n1. **Anchor to past behavior, not hypothetical futures.** \"Tell me about the last time you tried to…\" beats \"Would you ever use…\". This is the Mom Test principle, and Koji's methodology frameworks embed it directly into the AI's probing logic.\n2. **One idea per question.** Compound questions (\"How easy was it AND would you recommend it?\") confuse both humans and the AI. Split them.\n3. **Use the participant's language, not yours.** \"Software you use to track customer interviews\" beats \"research repository solution\".\n\nFor starter wording, browse [customer interview questions examples](/docs/customer-interview-questions-examples) or generate a draft with the [AI interview questions generator](/docs/ai-interview-questions-generator).\n\n## Tuning AI follow-up probing per question\n\nEvery question has a **probing** setting that controls how aggressively the AI follows up. The settings:\n\n- **maxFollowUps: 0** — Just ask the question, accept the first answer, move on. Use for screener and yes/no questions where probing wastes time.\n- **maxFollowUps: 1** (default) — One natural follow-up. Catches surface-level answers and asks for one example or one piece of reasoning.\n- **maxFollowUps: 2** — Two probes. Best for the 2-3 most important questions in the guide.\n- **maxFollowUps: 3** — Deep probing. Use sparingly; only for the single most strategic question because it adds 60-90 seconds of conversation each time.\n\nYou can also pass custom `instructions` like \"If they mention a workaround, ask how often they use it\" — the AI uses these as guardrails when deciding what to probe. See [probing and follow-up questions](/docs/probing-and-follow-up-questions) for examples.\n\n## Customizing for voice vs text interviews\n\nKoji runs the same customized guide in **voice mode** (real spoken conversation) and **text mode** (chat-style messaging). One key difference:\n\n- **Voice mode** asks every question conversationally. Choice options are read aloud. The participant speaks naturally.\n- **Text mode** renders structured questions as **interactive widgets** — sliders for scales, radio buttons for single choice, checkboxes for multiple choice, drag-to-rank for ranking. Open-ended questions appear as normal chat prompts.\n\nMost teams customize one guide and let respondents pick the modality. Compare [voice vs text interviews](/docs/voice-vs-text-interviews) for when each mode shines.\n\n## Customizing a template guide for a new audience\n\nTemplates are the fastest way to start. Pick from [research interview templates](/docs/research-interview-templates), then customize:\n\n1. **Swap the persona language.** Replace \"B2B SaaS buyer\" with \"ecommerce shopper\" everywhere in question text.\n2. **Re-rank the questions.** Move the most strategic question to position 3-4 (after rapport, before fatigue).\n3. **Adjust probing depth.** A 15-minute discovery interview can afford `maxFollowUps: 2` on a few questions; a 5-minute pulse check should stay at 1 across the board.\n4. **Update the methodology framework.** Switching from a Mom Test guide to a Jobs to be Done guide changes the AI's entire probing posture — use the framework toggle inside the brief.\n\n## Testing before you launch\n\nAlways preview your customized guide before sharing the link. From the study page:\n\n1. Click **Preview Interview** to run yourself through the guide in either modality.\n2. Try giving deliberately vague answers — watch how the AI probes. If probing feels too aggressive, lower `maxFollowUps`. If it gives up too quickly, raise it.\n3. Check that every required question is reached even with a slow conversation.\n4. If you're using a structured question type, verify the widget renders correctly in text mode.\n\nA 5-minute preview catches 90% of guide issues before you spend credits on real participants.\n\n## Common customization mistakes\n\n- **Too many core questions.** 10+ questions cause drop-off. Cut to 5-7 strong ones and let probing do the rest.\n- **Mixing screening into the interview.** Use [screener questions](/docs/screener-questions-guide) up front to filter respondents — keep the core guide focused on insight gathering.\n- **Setting every question to maxFollowUps: 3.** This balloons interview length to 25-30 minutes. Pick your top 2-3 questions for deep probing.\n- **Editing live without preview.** Always preview after changes; widget rendering and probing behavior can surprise you.\n\n## Related Resources\n\n- [Structured Questions Guide](/docs/structured-questions-guide) — full reference for the 6 question types\n- [Writing Interview Questions](/docs/writing-interview-questions) — principles for question wording\n- [AI Interview Questions Generator](/docs/ai-interview-questions-generator) — draft a guide from a research goal\n- [Customer Interview Questions Examples](/docs/customer-interview-questions-examples) — proven starter questions\n- [Probing and Follow-Up Questions](/docs/probing-and-follow-up-questions) — how AI follow-ups work\n- [AI Interviewer Tuning Guide](/docs/ai-interviewer-tuning-guide) — deeper AI behavior controls\n- [Editing the Brief Manually](/docs/editing-the-brief-manually) — full brief-editing reference","category":"Study Design","lastModified":"2026-05-13T03:16:10.467783+00:00","metaTitle":"How to Customize Interview Questions (AI-Moderated) | Koji","metaDescription":"Step-by-step guide to customizing interview questions in Koji — edit core questions, add 6 structured question types, tune AI follow-up depth, and adapt your guide for any audience.","keywords":["customize interview questions","edit interview questions","customizing interview questions","custom ai interview","interview question customization","customize user research questions","tune interview guide"],"aiSummary":"Customizing interview questions in Koji takes minutes: open your study brief, edit the question list, choose a question type (open_ended, scale, single_choice, multiple_choice, ranking, yes_no), and set follow-up probing depth. The AI interviewer adapts every question to the participant's answer in real time — so you write the question once, and Koji handles the conversation.","aiPrerequisites":["A Koji account (free tier works)","A draft study or new research goal","5 minutes"],"aiLearningOutcomes":["How to edit core interview questions from the brief","When to use each of the 6 structured question types","How to set AI follow-up probing depth per question","How to adapt a template guide for a new audience","How to test changes before launching the study"],"aiDifficulty":"beginner","aiEstimatedTime":"6 minutes"}],"pagination":{"total":1,"returned":1,"offset":0}}