{"site":{"name":"Koji","description":"AI-native customer research platform that helps teams conduct, analyze, and synthesize customer interviews at scale.","url":"https://www.koji.so","contentTypes":["blog","documentation"],"lastUpdated":"2026-11-10T01:06:22.347Z"},"content":[{"type":"documentation","id":"967eba65-2d19-45c8-b096-d08eccf0d14d","slug":"how-to-customize-interview-questions","title":"How to Customize AI Interview Questions: A Step-by-Step Guide","url":"https://www.koji.so/docs/how-to-customize-interview-questions","summary":"Customizing interview questions in Koji takes minutes: open your study brief, edit the question list, choose a question type (open-ended, scale, single choice, multiple choice, ranking, yes/no or price test), set the scale range, pick limits and option order, and set how many follow-ups the AI asks. The AI interviewer adapts every question to the participant's answer in real time, so you write the question once and Koji handles the conversation.","content":"## What customizing interview questions actually means in Koji\n\nCustomizing interview questions in Koji means editing the **core question list** inside your study brief and setting how the **AI interviewer** asks, follows up on, and probes each one. Unlike a static survey form where you write a fixed list of questions and hope respondents stay on track, Koji turns your questions into a **conversational script** that adapts to each participant in real time.\n\nYou write the question once. The AI handles follow-ups, clarifications, scale anchoring and probing for specifics on its own, so no moderator has to sit in on every session.\n\nThis guide walks through the full customization workflow: editing core questions, choosing question types, setting options and scales, tuning AI behavior, and validating the guide before launch.\n\n## Quick answer: how to customize questions in 5 steps\n\n1. Open your study and click into the **Research Brief**.\n2. Scroll to the **Questions** section and click any question to edit its text, type or follow-up settings. You can also ask the research assistant in plain words (\"shuffle the options on question 3\", \"make question 2 a 0 to 10 scale\").\n3. Pick a **question type**: open-ended for stories, scale for ratings, single or multiple choice for selections, ranking for prioritization, yes/no for binary signals, or a price test to find what people would pay.\n4. Set **Follow-Up Questions** (None, or 1 to 3 follow-ups). Higher values mean the AI probes deeper on each answer.\n5. **Preview the interview** to test the conversational flow, then publish.\n\nThe rest of this guide explains what each setting does, when to use it, and how to avoid common mistakes.\n\n![Koji question editor showing open ended, 1 to 10 scale and single choice questions with follow-up settings](/email/shots/shot-question-types.jpg \"Each question carries its own type and follow-up setting in the brief\")\n\n## The question types Koji supports\n\nEvery question has a type that decides how the AI asks it, how the text interview shows it, and how the report charts it. Picking the right type up front is the most important part of customization.\n\n### Open-ended\nFree-form qualitative answers. The AI probes for specifics, examples and emotional context. Use for \"tell me about the last time…\", \"walk me through how you…\", or any question where the *story* matters more than a number. Reports show thematic summaries with verbatim quotes.\n\n### Scale\nNumeric ratings for NPS, CSAT, satisfaction, importance or agreement. Pick the range from the scale menu on the question: the four common ranges come first (1 to 5 for satisfaction, 1 to 7 for agreement, 0 to 10 for NPS, and 1 to 10), followed by shorter ranges from 1 to 2 up to 1 to 9. Give each end a label (\"Very dissatisfied\", \"Very satisfied\") in the Low label and High label fields. The labels move with the ends, so if you change a 1 to 5 scale to 1 to 7, your labels stay on the lowest and highest points. When you ask the research assistant to add or reword a scale question, it sets both end labels too, and keeps the ones you wrote when it rewords the question. Reports show distribution charts. Turn on **Score-aware probing** to have the AI follow up differently on high and low scores (\"You gave it a 7. What would push it to a 10?\").\n\n### Single choice\nPick one option from a list. Use for role, primary use case, or any mutually exclusive selection. Voice mode reads the options aloud; text mode shows a radio list. Reports show frequency bars.\n\n### Multiple choice\nPick one or more from a list. Use for \"which of these have you tried\", \"which features matter most\", or any non-exclusive selection. By default participants pick any number. Reports show stacked frequency. See \"Setting how many options people pick\" below for exact and ranged limits.\n\n### Ranking\nDrag-to-rank an ordered list. Use for prioritization, preference order, or buying-criteria importance. Reports show average rank position and full rank distributions.\n\n### Yes / no\nBinary signal. Use for awareness checks or definitive decisions. Reports show pie or donut charts.\n\n### Price test (Gabor-Granger)\nEnter a ladder of 3 to 10 prices and Koji asks each participant how likely they are to buy at one price at a time, moving up or down until it finds the highest price they would still buy at, then asks why. The report shows the share who would buy at each price and the revenue each price implies. Set one up with the [price test setup guide](/docs/price-test-setup-guide), or read the [Gabor-Granger pricing method](/docs/gabor-granger-pricing-method) for the method behind it.\n\n> **Koji tip:** Most great interview guides mix **2-3 open-ended questions** for the texture with **3-5 structured questions** for the comparable metrics. See the [structured questions guide](/docs/structured-questions-guide) for in-depth examples.\n\n## Setting how many options people pick\n\nUnder the options of a multiple choice question, a menu sets how many a participant picks:\n\n- **Any number** (the default).\n- **Exact number**: \"Choose exactly 3\". Use it for \"pick your top three\".\n- **Range**: set an \"at least\" and an \"at most\", such as 2 to 4, or only an upper limit (\"Choose up to 2\").\n\nExact numbers and ranges need at least three options. In a text interview the participant sees the rule (\"Choose 3\", \"Choose up to 3\", \"Choose 2 to 4\") and the answer has to fit it. In a voice interview the AI asks them to adjust when they pick too many or too few. Pick limits are not available on screening questions, where each option already decides who qualifies.\n\nYou can set the same thing by asking the research assistant: \"make question 4 pick exactly three\" or \"let people choose up to two\".\n\n## Setting the order options appear in\n\nPeople pick the first options they see more often than the ones further down. For single choice, multiple choice and ranking questions, the order menu under the options gives you three settings:\n\n- **Order as shown**: everyone sees the list as you wrote it. Use it for ordered answers such as frequency, agreement, price bands or time ranges.\n- **Randomize order**: each participant sees the options in a different order. Use it for unordered lists such as brands, features, reasons or tools.\n- **Randomize except last**: shuffles the list but keeps the last 1, 2 or 3 options in place, for \"Other\" or \"None of the above\". Keeping the last 1 needs at least three options, and each extra kept option needs one more.\n\nEach participant keeps their order if they refresh the page, and reports always list the options in your original order. The research assistant applies these settings when you ask (\"shuffle the options but keep None of the above last\"). For when randomizing helps and when it hurts, read the [survey randomization guide](/docs/survey-randomization-guide).\n\n## How to edit core question text\n\nClick any question in the brief to edit it inline. Good question text follows three rules:\n\n1. **Anchor to past behavior, not hypothetical futures.** \"Tell me about the last time you tried to…\" beats \"Would you ever use…\". This is the Mom Test principle, and Koji's interviewer follows it when it probes.\n2. **One idea per question.** Compound questions (\"How easy was it AND would you recommend it?\") confuse both humans and the AI. Split them.\n3. **Use the participant's language, not yours.** \"Software you use to track customer interviews\" beats \"research repository solution\".\n\nKeep the scale framing out of the question text. Write \"How likely are you to recommend us to a colleague?\" and set the range and end labels on the question, rather than adding \"(1 = not at all, 10 = very)\" to the wording.\n\nFor starter wording, browse [customer interview questions examples](/docs/customer-interview-questions-examples) or generate a draft with the [AI interview questions generator](/docs/ai-interview-questions-generator).\n\n## Tuning AI follow-up probing per question\n\nEvery question has a **Follow-Up Questions** setting that controls how far the AI follows up:\n\n- **None (skip)**: ask the question, accept the first answer, move on. Use for quick factual and yes/no questions where probing wastes time.\n- **1 follow-up** (the default): one natural follow-up. Catches surface-level answers and asks for one example or one piece of reasoning.\n- **2 follow-ups**: best for the 2-3 most important questions in the guide.\n- **3 follow-ups**: deep probing. Use sparingly, only for the single most strategic question, because it adds noticeably to the length of every interview.\n\nYou can also write **custom follow-up guidance** such as \"If they mention a workaround, ask how often they use it\". The AI uses it when deciding what to probe. See [probing and follow-up questions](/docs/probing-and-follow-up-questions) for examples.\n\n## Customizing for voice vs text interviews\n\nKoji runs the same customized guide in **voice mode** (real spoken conversation) and **text mode** (chat-style messaging). One key difference:\n\n- **Voice mode** asks every question conversationally. Choice options are read aloud. The participant speaks naturally.\n- **Text mode** shows structured questions as **interactive widgets**: buttons or sliders for scales, radio buttons for single choice, checkboxes for multiple choice, drag-to-rank for ranking. Open-ended questions appear as normal chat prompts.\n\nMost teams customize one guide and let respondents pick the modality. Compare [voice vs text interviews](/docs/voice-vs-text-interviews) for when each mode shines.\n\n## Customizing a template guide for a new audience\n\nTemplates are the fastest way to start. Pick from [research interview templates](/docs/research-interview-templates), then customize:\n\n1. **Swap the persona language.** Replace \"B2B SaaS buyer\" with \"ecommerce shopper\" everywhere in question text.\n2. **Re-rank the questions.** Move the most strategic question to position 3-4 (after rapport, before fatigue).\n3. **Adjust probing depth.** A 15-minute discovery interview can afford 2 follow-ups on a few questions; a 5-minute pulse check should stay at 1 across the board.\n4. **Check the option settings.** Lists copied from a template keep their order and pick limits, so review them for the new audience.\n\n## Testing before you launch\n\nAlways preview your customized guide before sharing the link. From the study page:\n\n1. Click **Preview Interview** to run yourself through the guide in either modality.\n2. Try giving deliberately vague answers and watch how the AI probes. If probing feels too aggressive, lower the follow-ups. If it gives up too quickly, raise them.\n3. Check that every required question is reached even with a slow conversation.\n4. In text mode, check that each structured question shows the right widget, the pick rule and the scale labels.\n\nA 5-minute preview catches most guide issues before you spend credits on real participants.\n\n## Common customization mistakes\n\n- **Too many core questions.** 10+ questions cause drop-off. Cut to 5-7 strong ones and let probing do the rest.\n- **Mixing screening into the interview.** Use [screener questions](/docs/screener-questions-guide) up front to filter respondents and keep the core guide focused on insight gathering.\n- **Setting every question to 3 follow-ups.** This balloons interview length to 25-30 minutes. Pick your top 2-3 questions for deep probing.\n- **Shuffling an ordered list.** Randomize brands and features, never \"Daily, Weekly, Monthly\".\n- **Editing live without preview.** Always preview after changes; widget rendering and probing behavior can surprise you.\n\n## Related Resources\n\n- [Structured Questions Guide](/docs/structured-questions-guide): full reference for every question type\n- [Survey Randomization Guide](/docs/survey-randomization-guide): when to shuffle options\n- [Writing Interview Questions](/docs/writing-interview-questions): principles for question wording\n- [AI Interview Questions Generator](/docs/ai-interview-questions-generator): draft a guide from a research goal\n- [Customer Interview Questions Examples](/docs/customer-interview-questions-examples): proven starter questions\n- [Probing and Follow-Up Questions](/docs/probing-and-follow-up-questions): how AI follow-ups work\n- [AI Interviewer Tuning Guide](/docs/ai-interviewer-tuning-guide): deeper AI behavior controls","category":"Study Design","lastModified":"2026-11-08T05:09:34.166333+00:00","metaTitle":"How to Customize Interview Questions (AI-Moderated) | Koji","metaDescription":"Step-by-step guide to customizing interview questions in Koji: pick a question type, set scales, pick limits and option order, tune AI follow-ups and adapt your guide.","keywords":["customize interview questions","edit interview questions","customizing interview questions","custom ai interview","interview question customization","customize user research questions","tune interview guide"],"aiSummary":"Customizing interview questions in Koji takes minutes: open your study brief, edit the question list, choose a question type (open-ended, scale, single choice, multiple choice, ranking, yes/no or price test), set the scale range, pick limits and option order, and set how many follow-ups the AI asks. The AI interviewer adapts every question to the participant's answer in real time, so you write the question once and Koji handles the conversation.","aiPrerequisites":["A Koji account (free tier works)","A draft study or new research goal","5 minutes"],"aiLearningOutcomes":["How to edit core interview questions from the brief","When to use each of the 6 structured question types","How to set AI follow-up probing depth per question","How to adapt a template guide for a new audience","How to test changes before launching the study"],"aiDifficulty":"beginner","aiEstimatedTime":"6 minutes"}],"pagination":{"total":1,"returned":1,"offset":0}}