{"site":{"name":"Koji","description":"AI-native customer research platform that helps teams conduct, analyze, and synthesize customer interviews at scale.","url":"https://www.koji.so","contentTypes":["blog","documentation"],"lastUpdated":"2026-06-01T07:51:00.979Z"},"content":[{"type":"documentation","id":"097988e7-70fc-445b-8896-ca815fe5c7f9","slug":"multiple-choice-questions-ai-interviews","title":"Multiple Choice Questions in AI Interviews: Capture Multi-Select Data With Conversational Depth","url":"https://www.koji.so/docs/multiple-choice-questions-ai-interviews","summary":"Koji's multiple_choice question type captures multi-select array data (string[]) in AI interviews. Renders as checkboxes in text mode and conversational option-listing in voice mode. Supports allowOther with automatic thematic coding of free-form responses. AI probes meaningful selections to capture qualitative reasoning. Reports show stacked frequency charts plus co-occurrence patterns and \"Other\" theme clusters. One of six structured question types alongside open_ended, scale, single_choice, ranking, and yes_no.","content":"\n# Multiple Choice Questions in AI Interviews: Capture Multi-Select Data With Conversational Depth\n\nMultiple choice questions are the workhorse of every survey ever built. Pick all that apply. Check all boxes. Select up to three. They are how you collect frequency data on what features customers use, what competitors they considered, what jobs they hire your product to do, and a thousand other things where one participant might legitimately choose more than one answer.\n\nIn Koji AI interviews, multi-select questions work like you'd expect — but with a critical twist: the AI follows up on each interesting selection with a contextual probe. Instead of getting back a flat string of selected options, you get the selections plus a synthesized qualitative summary of *why* participants chose them. This guide covers Koji's `multiple_choice` question type end to end: how it works, when to use it, how it differs from `single_choice`, and how to design multi-select questions that surface real insight at scale.\n\n## What Is a Multiple Choice Question in Koji?\n\nIn Koji's structured question system, `multiple_choice` is one of six question types — alongside `open_ended`, `scale`, `single_choice`, `ranking`, and `yes_no`. It lets the participant select **one or more** options from a list. Unlike `single_choice`, which is mutually exclusive, multi-choice acknowledges that real life is overlapping: a customer can use your product for two jobs at once, evaluate three competitors at the same time, or be motivated by four overlapping benefits.\n\nThe data type Koji captures from a multiple_choice question is `string[]` — an array of selected option labels. That array is what powers the stacked frequency chart in your research report and feeds into any cross-question analysis you do downstream.\n\nWhat makes multiple_choice in Koji distinct from the same question in a survey tool is:\n\n- **Per-selection AI probing**: The AI can be configured to follow up on each meaningful selection (or just the most surprising one) to capture the qualitative reasoning.\n- **Free-form \"Other\" with coding**: When `allowOther` is enabled, any \"Other\" responses are automatically thematically coded and surfaced in the report as candidate new options.\n- **Voice mode without buttons**: In voice mode, the AI reads the options conversationally and the participant says which ones apply — no widget required.\n- **Quality-aware analysis**: Multi-select answers are evaluated against the study brief to detect lazy \"check all the boxes\" responses and flag low-quality data.\n\n## The Six Question Types: Where Multiple Choice Fits\n\nKoji supports six question types, each designed for a different research goal:\n\n| Question Type | Best For | Report Visualization |\n|---|---|---|\n| **Open Ended** | Discovery, narrative, \"why\" | Thematic summary + verbatim quotes |\n| **Scale** | NPS, CSAT, satisfaction ratings | Distribution chart |\n| **Single Choice** | Mutually exclusive categories | Frequency bar chart |\n| **Multiple Choice** | Multiple valid selections | Stacked frequency chart |\n| **Ranking** | Preference ordering | Ranked list with avg position |\n| **Yes/No** | Binary checkpoints | Pie/donut chart |\n\nMultiple choice is the right type when the answer is **non-exclusive** — when picking option A doesn't logically rule out option B. If the options are mutually exclusive (e.g., \"Which device did you use?\" with mobile/desktop/tablet), use `single_choice` instead.\n\n## When to Use Multiple Choice Questions\n\n### 1. Feature Adoption Research\n\"Which of these features have you used in the last 30 days? Select all that apply.\" Multiple choice gives you per-feature adoption rates across your participant base, with AI probing surfacing why participants gravitate toward some features over others.\n\n### 2. Competitor Evaluation\n\"Which of the following tools did you consider before choosing ours? (Pick all)\" tells you which competitors are showing up in your customers' shortlists. AI probing on the selected options surfaces which features they were comparing on.\n\n### 3. Jobs-to-be-Done Discovery\n\"Which of these jobs do you hire our product to do?\" with five to eight options lets you map the actual usage portfolio across customers — and identify when one participant is hiring the product for combinations no one anticipated.\n\n### 4. Channel and Source Attribution\n\"Which channels did you use to first hear about us? (Select all that apply)\" captures the realistic multi-touch attribution that single-select questions force into a misleading \"primary channel\" answer.\n\n### 5. Persona and Segment Profiling\nMulti-select demographic and behavior questions (\"Which of the following describe your role?\") let participants self-identify across overlapping categories rather than choosing one box that doesn't quite fit.\n\n### 6. Pain Point Mapping\n\"Which of these are challenges in your current workflow? Select all that apply.\" Multiple choice quickly maps the universe of pain points across your participants, and AI follow-up extracts the priority order without forcing a separate ranking question.\n\n## How Multiple Choice Works in Text Mode\n\nIn Koji's text (chat) interview mode, a multiple_choice question renders as a list of checkbox options. The participant can tap as many as apply, and submits when ready.\n\nThe sequence after submission:\n\n1. The selected array (`[\"Option A\", \"Option C\", \"Option E\"]`) is captured as the structured value immediately — no waiting for analysis.\n2. The AI reads the selections in context of the study brief.\n3. Based on the probing configuration, the AI generates a follow-up — for example, \"You picked Option A and Option C. Of those two, which one is more important to your workflow, and why?\"\n4. The participant's open-text follow-up is captured as a qualitative answer linked to the structured selections.\n\nThe result is both quantitative (clean array data for charts) and qualitative (the participant's reasoning), all from a single multi-select question.\n\n## How Multiple Choice Works in Voice Mode\n\nIn voice mode, there are no checkboxes — everything is conversational. The AI reads the question and the options conversationally: \"There are five options I'll list. Tell me which ones apply to you. The options are: [list].\"\n\nThe participant responds naturally: \"Definitely A and C. Maybe also D, but I'm not sure about that one.\" The AI parses the natural-language response into a structured array, asks for clarification on the \"maybe\" if needed, and then probes on the most important selection.\n\nThis works surprisingly well even for lists of six to eight options, especially when the option labels are short and distinct. For longer lists, consider splitting the question into two passes, or using an `open_ended` question with a structured codebook for analysis.\n\n## The \"Other\" Option and Automatic Coding\n\nFor exploratory or discovery-oriented studies, multiple choice with `allowOther` set to true is one of the most valuable patterns in Koji.\n\nHere's what happens:\n\n1. Participants see the standard options plus an \"Other\" option.\n2. Selecting \"Other\" prompts a short open-text response: \"What other option would you add?\"\n3. The \"Other\" responses are automatically thematically coded across all interviews.\n4. In the report, \"Other\" responses surface as a candidate list of options you didn't think to include — clustered into themes, with frequency counts and verbatim quotes.\n\nThis is how you avoid the classic researcher trap of forcing participants to choose between options that don't actually fit. If a meaningful share of participants selected \"Other\" and described the same missing concept, the AI surfaces it as a recommendation for your next study. Platforms like Koji turn what would otherwise be unstructured noise into structured signal.\n\n## AI Probing Behavior for Multiple Choice\n\nThe probing behavior for multi-choice questions is fully configurable in the question settings:\n\n- **maxFollowUps:** 0 (no probing — just capture the array), 1 (one follow-up, the default), or up to 3 (deep probing for critical questions).\n- **instructions:** Custom guidance, like \"Ask specifically about Options A and B — those are our priority features\" or \"If they selected more than three options, ask which is most important and why.\"\n- **anchor:** When true, probing references the specific selections the participant made.\n\nGood probing strategies for multi-choice:\n\n- **Probe the priority, not the list.** \"Of the ones you picked, which is most important?\" is a powerful follow-up that approximates a ranking answer without requiring a separate ranking question.\n- **Probe an unexpected combination.** \"I noticed you picked both A and E — those don't usually go together. What's the connection for you?\" surfaces the patterns that an aggregated chart would miss.\n- **Probe an absence.** \"You didn't pick Option C — was that a deliberate choice?\" can be more interesting than asking about what they did pick.\n\n## Multiple Choice Answers in Your Research Report\n\nIn the Koji research report, multi-choice questions are visualized as **stacked frequency charts** — showing what percentage of participants selected each option, with selections that frequently co-occur clustered visually.\n\nBelow the chart, the report includes:\n\n- A breakdown of the **most common combinations** of selected options (e.g., \"32% selected both A and C\")\n- The **\"Other\" responses** clustered into thematic groups, with verbatim quotes and frequency counts\n- A **qualitative synthesis** of the AI's follow-up exchanges, organized by selection\n- The **participant-level detail** so you can click any participant to see exactly which options they picked\n\nThis is the format that lets you answer questions like \"What percentage of our power users adopt the AI features?\" and \"Among those who picked feature A, what did they say about why they use it?\" in the same view.\n\n## Writing Strong Multiple Choice Questions\n\n**Keep the options mutually distinct.** Overlapping options (\"Easy to use\" and \"User-friendly\") will distort your frequency data because participants pick whichever they read first. Workshop your option list before deploying.\n\n**Stay in the participant's language.** Avoid jargon and product-specific terminology that some participants might not understand. Use the language they'd use, not the language your product team uses internally.\n\n**Limit the option list.** Five to eight options is the comfortable maximum. More than that and participants stop reading carefully — especially in voice mode. If you need more options, consider splitting into two questions or using `open_ended` with thematic coding.\n\n**Include \"Other\" for discovery, skip it for tracking.** When you genuinely don't know all the options, include `allowOther`. When you're tracking a known metric over time, exclude it for cleaner comparability.\n\n**Test for \"check all boxes\" behavior.** Some participants will select every option to finish faster. Koji's analysis detects this pattern and flags it; consider a follow-up that asks them to identify their top selection to validate intent.\n\n## When Not to Use Multiple Choice\n\nMultiple choice is not always the right answer. Avoid it when:\n\n- **The options are mutually exclusive.** \"Which device did you use today?\" should be `single_choice` — most participants only used one.\n- **You want a clear priority.** Multi-choice gives you selection frequency, not priority order. If you need ordering, use `ranking`.\n- **You don't know the option space.** If you're truly exploring, use `open_ended` first to discover the options, then deploy a multi-choice question in a follow-up study.\n- **The list is too long.** Anything over eight options should be broken up — long lists produce shallow engagement and unreliable data.\n\n## Multiple Choice vs. Single Choice: How to Decide\n\nThe question to ask before choosing multi vs single is: **Can a thoughtful participant honestly select more than one option?**\n\n- \"Which of these features do you use?\" → Multiple choice (they probably use several).\n- \"Which feature do you use most?\" → Single choice (only one can be the most used).\n- \"Which competitors did you evaluate?\" → Multiple choice (typically more than one).\n- \"Which competitor did you choose?\" → Single choice (mutually exclusive outcome).\n\nWhen in doubt, multi-choice is the more flexible option — but the resulting data is harder to summarize cleanly. If your stakeholders need a clear \"the winner is X\" answer, lean single_choice or ranking.\n\n## Combining Multiple Choice with Other Question Types\n\nThe most insightful Koji studies sequence multi-choice questions with other types strategically:\n\n1. **Open-ended:** \"How do you describe your role at the company?\" — to surface the participant's own framing.\n2. **Multiple choice:** \"Which of the following best match your responsibilities? (Select all)\" — to map their role across known categories.\n3. **Ranking:** \"Order these responsibilities by how much time they take.\" — to add priority structure.\n4. **Scale:** \"On a scale of 1-10, how satisfied are you with the tools you use for those responsibilities?\" — to measure sentiment.\n5. **Open-ended:** \"What would make that satisfaction a 9 or 10?\" — to capture the qualitative why.\n\nThis is the structure that yields a report with both quantitative breadth (clean charts across all participants) and qualitative depth (verbatim quotes for every theme).\n\n## Multiple Choice in Koji vs Traditional Surveys\n\nIn SurveyMonkey, Qualtrics, or Typeform, a multi-choice question captures the array and ends. Analysis is on you: you export the CSV, open it in a spreadsheet, build the pivot table, calculate co-occurrence patterns, and manually read every \"Other\" response to decide if it should become a new option.\n\nIn Koji, that workflow runs automatically:\n\n- The AI probes each interview for qualitative context on the selections.\n- \"Other\" responses are thematically clustered across the study.\n- The report renders the stacked frequency chart, co-occurrence patterns, and qualitative synthesis without manual analysis.\n- Stakeholders can chat with the report to answer custom slicing questions (\"Of those who selected A and C, what did they say about churn risk?\").\n\nThis is the shift from multi-choice as a data-collection mechanic to multi-choice as a research insight — exactly the kind of step-change that AI-native platforms like Koji enable.\n\n## Related Resources\n\n- [Structured Questions Guide: All 6 Koji Question Types](/docs/structured-questions-guide)\n- [Single Choice Questions in AI Interviews](/docs/single-choice-questions-ai-interviews)\n- [Open-Ended Questions in AI Interviews](/docs/open-ended-questions-ai-interviews)\n- [Choice and Ranking Questions: Capture Preference Data](/docs/choice-ranking-questions-guide)\n- [How Koji's AI Probing Works](/docs/ai-probing-guide)\n- [Reading Your Research Report](/docs/reading-your-research-report)\n","category":"Study Design","lastModified":"2026-06-01T03:25:01.576042+00:00","metaTitle":"Multiple Choice Questions in AI Interviews | Koji Docs","metaDescription":"Use Koji multi-select questions with automatic AI probing, \"Other\" thematic coding, stacked frequency charts, and voice-mode support. Capture multi-choice data plus the qualitative reasoning behind every selection.","keywords":["multiple choice questions","multi-select survey question","multi-select ai interview","multiple choice question type","select all that apply","allowOther multiple choice"],"aiSummary":"Koji's multiple_choice question type captures multi-select array data (string[]) in AI interviews. Renders as checkboxes in text mode and conversational option-listing in voice mode. Supports allowOther with automatic thematic coding of free-form responses. AI probes meaningful selections to capture qualitative reasoning. Reports show stacked frequency charts plus co-occurrence patterns and \"Other\" theme clusters. One of six structured question types alongside open_ended, scale, single_choice, ranking, and yes_no.","aiPrerequisites":["Basic familiarity with creating Koji studies","Understanding of the Structured Questions overview"],"aiLearningOutcomes":["Know when multi-choice is the right type vs single_choice or ranking","Design option lists that produce clean, comparable data","Use allowOther for discovery studies and disable it for tracking studies","Configure AI probing on multi-choice questions","Read stacked frequency charts and Other-cluster themes in research reports"],"aiDifficulty":"beginner","aiEstimatedTime":"10 min read"}],"pagination":{"total":1,"returned":1,"offset":0}}