{"site":{"name":"Koji","description":"AI-native customer research platform that helps teams conduct, analyze, and synthesize customer interviews at scale.","url":"https://www.koji.so","contentTypes":["blog","documentation"],"lastUpdated":"2026-05-18T14:28:40.260Z"},"content":[{"type":"blog","id":"6a5f230f-7020-42e5-a11a-a9f0e12e03c0","slug":"how-to-write-user-interview-questions","title":"How to Write User Interview Questions That Get Real Answers","url":"https://www.koji.so/blog/how-to-write-user-interview-questions","summary":"Writing effective user interview questions requires asking about past experience rather than hypothetical opinions. Use grand tour questions to open conversations, specific instance questions to drill into moments, and neutral probing questions to go deeper. Limit sessions to 5–8 questions to allow depth over breadth. AI-moderated platforms like Koji apply these principles automatically with consistent follow-up probing across all participants.","content":"\nMost interview questions are too narrow, too leading, or too hypothetical. Researchers spend weeks planning a study, recruit carefully, and then ask questions that produce polished, surface-level answers instead of the honest truth. Here is how to write questions that actually work.\n\n## Why Question Quality Matters More Than Anything Else\n\nThe quality of your interview questions determines the quality of your insights. You can recruit the perfect participants, run a flawless session, and still walk away with nothing useful if your questions were the wrong ones.\n\nAccording to **Nielsen Norman Group**, the most common failure mode in user interviews is the researcher inadvertently leading the participant — through word choice, framing, or the order of questions — toward confirming what the researcher already believes.\n\nA 2024 study from Glaut found that AI-moderated interviews produced **129% more words per response** than traditional static surveys. The difference was not the format — it was the quality of follow-up probing. Better questions, asked at the right moment, produce richer data.\n\n## The Core Principle: Ask About Experience, Not Opinion\n\nThe single most important rule in user interview question design: **ask about what people did, not what they think they would do.**\n\nOpinions and hypotheticals are unreliable. People are notoriously bad at predicting their own future behavior. But memories of past experience, while imperfect, are far more grounded in reality.\n\n**Instead of:** \"Would you pay for a feature that did X?\"\n\n**Ask:** \"Walk me through the last time you tried to do X. What did you do?\"\n\n**Instead of:** \"How important is Y to you?\"\n\n**Ask:** \"Tell me about a time when Y caused a problem for you. What happened?\"\n\nThis principle — popularized by the Jobs-to-be-Done framework and the customer discovery work of Steve Blank — consistently produces more actionable insights than opinion-based questioning.\n\n## Question Types That Work\n\n### 1. Grand Tour Questions (Start Here)\n\nGrand tour questions invite participants to walk you through their experience in their own words. They are low-pressure, open-ended, and reveal structure you didn't know to ask about.\n\n**Examples:**\n- \"Walk me through how you currently handle [problem area].\"\n- \"Tell me about the last time you had to [do the thing you're researching].\"\n- \"Describe a typical week when it comes to [topic].\"\n\nThese questions are your opening move. Let the participant talk for 3–5 minutes uninterrupted. You'll often get your most valuable insights here, before you ask anything specific.\n\n### 2. Specific Instance Questions\n\nAfter a grand tour, drill into a specific moment. Vague memories produce vague answers. Specific memories produce specific, actionable data.\n\n**Examples:**\n- \"You mentioned that happens every week — can you tell me about a specific time it happened recently?\"\n- \"Think about the last time you [did X]. What triggered it?\"\n- \"Walk me through exactly what you did step by step.\"\n\nThe more specific the episode, the more you can trust the data.\n\n### 3. Probing Questions\n\nProbing questions are your follow-up moves. They go deeper without leading the participant.\n\n**The most powerful probing questions:**\n- \"Tell me more about that.\"\n- \"What happened next?\"\n- \"How did that make you feel?\"\n- \"Why did you do it that way and not another way?\"\n- \"What were you expecting to happen instead?\"\n\nNote what these questions have in common: they're short, neutral, and create space for the participant to go wherever they need to go. Avoid suggesting the answer in your probe.\n\n### 4. Native Language Questions\n\nAsk participants what words they use, not the words you use. This matters enormously for product copy, marketing, and feature naming.\n\n**Examples:**\n- \"How would you describe this to a colleague?\"\n- \"If you were searching for a solution to this, what would you type into Google?\"\n- \"What do you call this step in your workflow?\"\n\nThe answers often reveal that your internal terminology is completely different from how customers think about the problem.\n\n## Question Types That Don't Work\n\n### Leading Questions\n\nLeading questions embed the answer in the question itself.\n\n**Avoid:** \"Don't you find it frustrating when you can't find your research notes?\"\n\n**Use instead:** \"Tell me about a time you needed to find something from a past research session.\"\n\n### Double-Barreled Questions\n\nDouble-barreled questions ask two things at once, which means participants answer only one — and you don't know which.\n\n**Avoid:** \"How do you currently handle analysis and how long does it take?\"\n\n**Use instead:** \"How do you currently handle analysis? [Wait for answer.] And how long does that typically take?\"\n\n### Hypothetical Questions\n\nHypothetical questions invite speculation, not experience.\n\n**Avoid:** \"If we added X feature, would that help you?\"\n\n**Use instead:** \"Have you ever tried to do X? What happened?\"\n\n### Yes/No Questions\n\nYes/no questions close down conversation when you need it to open up.\n\n**Avoid:** \"Do you find the current process frustrating?\"\n\n**Use instead:** \"What has your experience been with the current process?\"\n\n## How to Structure a 45-Minute Interview\n\nA well-structured interview moves from broad to specific, building psychological safety before asking hard questions.\n\n**0–5 minutes: Warm-up**\nExplain the purpose, confirm recording consent, set expectations. Ask a non-threatening opening question: \"Tell me a bit about your role and what you work on day to day.\"\n\n**5–20 minutes: Context building**\nUse grand tour and specific instance questions to understand their world. Don't ask about your product or solution yet.\n\n**20–35 minutes: Deep dive**\nProbe the specific problem area you're researching. This is your highest-value time. Ask follow-up questions relentlessly.\n\n**35–40 minutes: Direct questions**\nNow you can ask more direct questions — reactions to concepts, hypothetical comparisons. Your participant has enough context to give grounded answers.\n\n**40–45 minutes: Closing**\n\"Is there anything important about this topic that I didn't ask about?\" This question frequently produces the most valuable insight of the session.\n\n## How Many Questions to Write\n\nWrite 5–8 questions for a 45-minute session. That sounds like too few — it isn't.\n\nEach question should open a 5–10 minute conversation. If you have 15 questions, you're doing a survey, not an interview. You'll rush through topics instead of going deep on what matters.\n\nAccording to the **User Interviews State of User Research 2025**, researchers who conducted 5 or fewer interviews reported significantly lower confidence in their findings than those who conducted 10+. Interview quality compounds — better questions in each session produce better data across all sessions.\n\n## Using AI to Ask Better Questions\n\nAI-moderated interview platforms like Koji solve a persistent problem: follow-up question quality depends on who's running the session. Human moderators have bad days, get distracted, and forget to probe when something interesting comes up.\n\nKoji's AI conducts every interview with consistent quality — probing when participants go shallow, following tangents that reveal unexpected themes, and maintaining a natural conversational tone throughout. The result is more consistent, higher-quality data across all participants.\n\nAccording to the **Maze Future of User Research Report 2026**, demand for qualitative research grew **66% year-over-year** while research team headcount stayed flat. AI-moderated interviews like Koji allow teams to meet that demand without hiring more researchers.\n\nWhen designing your Koji study, the same principles apply: start with grand tour questions, focus on experience over opinion, and keep your question list to 5–8 items. The AI handles the follow-up probing automatically.\n\n## A Sample Question Set\n\nHere is an example question set for a product discovery study exploring why users churn from a B2B SaaS product:\n\n1. \"Walk me through what your team uses [product category] for on a weekly basis.\"\n2. \"Tell me about a time when the tool you were using for this really let you down. What happened?\"\n3. \"How did you decide to try [your product]? What were you hoping it would do for you?\"\n4. \"Think back to a specific moment when you almost stopped using it. What was going on?\"\n5. \"What does your workflow look like now compared to before you started using [product]?\"\n6. \"If you were recommending a solution like this to a colleague, how would you describe what it does?\"\n\nNotice: no yes/no questions, no hypotheticals, no leading language. Six questions that could sustain a rich 45-minute conversation.\n\n## Key Takeaways\n\n- Ask about past experience, not future hypotheticals\n- Start broad with grand tour questions, then drill into specific instances\n- Your best follow-up is often just \"tell me more about that\"\n- Write 5–8 questions for a 45-minute session — going deep beats going wide\n- Avoid leading language, double-barreled questions, and yes/no questions\n- Ask what words participants use to describe the problem — their language is your copy\n\n---\n\n**Want AI to ask your questions for you?** [Try Koji free](https://trykoji.com) — design your study, and Koji's AI conducts the interviews with expert follow-up probing built in.\n\n## Frequently Asked Questions\n\n**How many questions should a user interview have?**\nWrite 5–8 questions for a 45-minute session. Each question should open a 5–10 minute conversation. More questions means rushing through topics instead of going deep on what matters.\n\n**What makes a good user interview question?**\nGood questions ask about real past experiences rather than opinions or hypotheticals. They are open-ended, avoid suggesting the answer, and create space for the participant to take the conversation where they need to go.\n\n**How do you avoid leading questions in user interviews?**\nAvoid embedding assumptions in your question. Instead of \"Don't you find it frustrating when X?\" ask \"Tell me about a time X happened. What was that like?\" Review your question list and remove any word that implies a positive or negative judgment.\n\n**What is the most important question in a user interview?**\nThe closing question: \"Is there anything important about this topic that I didn't ask about?\" This question frequently produces the most valuable insight of the session because it gives participants permission to surface what mattered most to them.\n\n**Can AI conduct user interviews as effectively as a human moderator?**\nAI-moderated interviews like Koji produce consistent follow-up probing across every participant — something human moderators do variably depending on energy, focus, and experience level. For discovery research at scale, AI moderation often produces more consistent data quality. For highly sensitive topics or complex relationship-building scenarios, human moderation still has advantages.\n","category":"Tutorial","lastModified":"2026-05-13T00:21:33.326941+00:00","metaTitle":"How to Write User Interview Questions — Koji Blog","metaDescription":"A practical guide to writing user interview questions that produce real answers: question types, structures, and mistakes to avoid in qualitative research.","keywords":["how to write user interview questions","user interview questions","interview question design","qualitative research questions","customer interview questions","UX research questions","product discovery questions"],"aiSummary":"Writing effective user interview questions requires asking about past experience rather than hypothetical opinions. Use grand tour questions to open conversations, specific instance questions to drill into moments, and neutral probing questions to go deeper. Limit sessions to 5–8 questions to allow depth over breadth. AI-moderated platforms like Koji apply these principles automatically with consistent follow-up probing across all participants.","aiKeywords":["user interview questions","interview design","qualitative research","customer discovery","research methods","AI interviews","product research","UX research"],"aiContentType":"tutorial","faqItems":[{"answer":"Write 5–8 questions for a 45-minute session. Each question should open a 5–10 minute conversation. More questions means rushing through topics instead of going deep.","question":"How many questions should a user interview have?"},{"answer":"Good questions ask about real past experiences rather than opinions or hypotheticals. They are open-ended, avoid suggesting the answer, and create space for participants to take the conversation where they need to go.","question":"What makes a good user interview question?"},{"answer":"Avoid embedding assumptions in your question. Instead of asking about frustration, ask participants to walk you through what happened. Remove any word that implies a positive or negative judgment from your question list.","question":"How do you avoid leading questions in user interviews?"},{"answer":"The closing question: Is there anything important about this topic that I did not ask about? This frequently produces the most valuable insight because it gives participants permission to surface what mattered most to them.","question":"What is the most important question in a user interview?"},{"answer":"AI-moderated interviews like Koji produce consistent follow-up probing across every participant. For discovery research at scale, AI moderation often produces more consistent data quality than human moderation, which varies by session.","question":"Can AI conduct user interviews as effectively as a human moderator?"}],"relatedTopics":["user research","qualitative research","customer discovery","product discovery","interview techniques","research methods"]}],"pagination":{"total":1,"returned":1,"offset":0}}