{"site":{"name":"Koji","description":"AI-native customer research platform that helps teams conduct, analyze, and synthesize customer interviews at scale.","url":"https://www.koji.so","contentTypes":["blog","documentation"],"lastUpdated":"2026-11-21T22:45:55.229Z"},"content":[{"type":"blog","id":"54932c10-6821-4f7d-9d6b-f19ef95636f6","slug":"how-many-customer-interviews-do-you-really-need","title":"How Many Customer Interviews Does a Founder Need? Validation vs Discovery Sample Sizes","url":"https://www.koji.so/blog/how-many-customer-interviews-do-you-really-need","summary":"A founder's guide to customer interview sample sizes that separates two jobs. Discovery (understanding the problem) ends at saturation, usually 12 to 20 interviews per segment, backed by Griffin and Hauser (1993), Guest, Bunce and Johnson (2006) and Hennink and Kaiser (2022). Validation (testing a specific bet) ends when you pass or fail a bar written down before the first call, often 10 to 15 conversations to see a signal and 30 or more to quote a share, counting commitments rather than compliments. It also explains why the 5-user rule only applies to usability testing and how AI interviews make larger validation rounds practical.","content":"# How Many Customer Interviews Does a Founder Need? Validation vs Discovery Sample Sizes\n\nYou are a founder with no researcher, a short runway and a question you need answered. Before you book a single call, you want to know how many conversations it will take.\n\nThe answer depends on which of two jobs you are doing. **Discovery** (finding out what the problem really is, who has it and how they cope) is done when new interviews stop telling you anything new: usually 12 to 20 conversations with one kind of customer. **Validation** (checking whether a specific bet holds, like \"ops leads at 20-person agencies will pay to fix this\") is done when you hit or miss a pass bar you wrote down before the first call: often 10 to 15 conversations to see the signal, and 30 or more once you want a share you can quote.\n\nThis post gives a founder the numbers and the decision rules for both. For the full sample size reference across every research method, see our guide [How Many User Interviews Do You Need?](/docs/how-many-user-interviews).\n\n---\n\n## Discovery or validation? Know which number you need\n\n| | Discovery | Validation |\n|---|---|---|\n| The question | What is the problem, who has it, how do they cope today? | Does this specific bet hold for this specific customer? |\n| When you stop | When new interviews stop adding new themes (saturation) | When you clearly pass or fail a bar you set in advance |\n| Typical number | 12 to 20 per segment | 10 to 15 to see a signal, 30+ to quote a share |\n| What counts as evidence | Repeated stories, workarounds, the words people use | Commitments: a second call, a pilot, a deposit, a letter of intent |\n| Biggest risk | Too broad a segment, so answers never converge | Counting compliments as demand |\n\nMost early founders start with discovery and move to validation once the same problem keeps coming up. If you are not sure which you are doing, you are doing discovery.\n\n### How to set a validation pass bar\n\nWrite it down before the first call, so you cannot move it afterwards. For example:\n\n- \"Of 12 ops leads at agencies with 10 to 50 people, at least 6 describe losing a day or more a month to this in the last quarter.\"\n- \"At least 3 of those 6 agree to a paid pilot or a follow-up with their manager.\"\n\nThe exact bar is your call. What matters is that it is about past behavior and commitments, not about whether people liked the idea. If you hit it, widen the sample. If you miss it, change the segment or the problem, not the bar.\n\n---\n\n## The \"5 Users\" Myth: Where It Came From and Why It Doesn't Always Apply\n\nYou've probably heard the famous claim: \"Testing with 5 users uncovers 85% of usability problems.\" This insight, popularized by Jakob Nielsen of the Nielsen Norman Group, has become one of the most cited (and misapplied) guidelines in product research.\n\nHere's the thing: **Nielsen's research was specifically about usability testing**: watching users interact with an interface to find problems. It was never meant to apply to all types of customer research.\n\n### What Nielsen Actually Said\n\nNielsen's original recommendation came with important caveats that often get overlooked:\n\n1. **It applies to finding interface issues**, not understanding customer needs, motivations, or behaviors\n2. **It assumes a homogeneous user group**: if you have distinct user segments, you need 5 per segment\n3. **It's meant for iterative testing**: test 5 users, fix issues, test another 5, repeat\n\nNielsen himself noted that you would need about 15 users to find all the usability problems in a design, but that it is better to run 3 tests with 5 users each, fixing the problems you find between rounds.\n\n### Why Customer Interviews Are Different\n\nCustomer interviews aren't about finding interface bugs. They're about understanding:\n\n- What problems customers are trying to solve\n- How they currently approach those problems\n- What motivates their decisions\n- What barriers they face\n- What language they use to describe their needs\n\nThis type of discovery research requires enough conversations to identify patterns and validate that those patterns are real, not just individual opinions. And that typically requires more than 5 interviews.\n\n---\n\n## Understanding Data Saturation: When Have You Heard Enough?\n\nRather than fixating on a magic number, experienced researchers focus on **data saturation**: the point where new interviews stop revealing new insights.\n\nThink of it like panning for gold. The first few pans bring up plenty of nuggets. But eventually, each new pan yields less and less. When you're consistently coming up empty, you've likely found what there is to find.\n\n### How to Recognize Saturation\n\nYou're approaching saturation when:\n\n- **Themes repeat consistently** across interviews\n- **New interviews confirm** what you've already heard rather than adding new dimensions\n- **You can predict** how customers will respond to certain questions\n- **Your research questions feel answered** with confidence\n\n### What Research Shows About Saturation\n\nThree studies founders can lean on:\n\n- Griffin and Hauser (1993, *Marketing Science*) found that 20 to 30 interviews uncovered roughly 90 to 95% of customer needs in their product category.\n- Guest, Bunce and Johnson (2006, *Field Methods*) found that most themes in a set of 60 interviews had appeared within the first 12, with the broad themes visible after about 6.\n- Hennink and Kaiser (2022, *Social Science & Medicine*), a systematic review of saturation studies, found that 9 to 17 interviews reached saturation in most studies with a fairly similar group of people and a focused question.\n\n| Population Type | Typical Saturation Point |\n|-----------------|-------------------------|\n| Homogeneous, focused scope | 9-12 interviews |\n| Moderately diverse | 15-20 interviews |\n| Highly diverse or broad scope | 25-30+ interviews |\n\nThe key insight? **Saturation depends heavily on how diverse your customers are and how broad your research questions are.** For a founder, that means the fastest way to need fewer interviews is a narrower segment.\n\n---\n\n## Sample Size Recommendations by Research Type\n\nDifferent research goals require different sample sizes. Here's a practical framework:\n\n![Table of customer interview sample sizes by research type, from 5 to 8 for usability testing to 30 to 50 or more for market research.](/visuals/customer-interview-sample-size-by-research-type/customer-interview-sample-size-by-research-type.png \"Start from your research goal, then add interviews for each segment you need to compare.\")\n\n### Usability Testing: 5-8 Participants\n\nIf you're testing whether customers can complete specific tasks in your product, 5-8 participants per user segment will reveal most usability issues. This is where Nielsen's original guidance applies.\n\n**When this works:**\n- Testing specific features or flows\n- Identifying interface problems\n- Validating design solutions\n\n### Discovery Interviews: 12-20 Participants\n\nWhen you're trying to understand customer problems, needs, and behaviors, plan for more conversations. Discovery research requires identifying patterns that hold true across multiple customers.\n\n**When this applies:**\n- Understanding customer problems and pain points\n- Exploring how customers currently solve problems\n- Identifying unmet needs\n- Validating problem hypotheses\n\n### Segmented Research: 8-12 Per Segment\n\nIf you're researching across distinct customer segments (e.g., enterprise vs. SMB, new users vs. power users), you need enough interviews within each segment to identify segment-specific patterns.\n\n**The math:**\n- 3 segments x 10 interviews each = 30 total interviews\n- This ensures you can distinguish real segment differences from individual variation\n\n### Concept Validation: 15-25 Participants\n\nWhen testing new product concepts or value propositions, you need enough feedback to feel confident about patterns. Positive feedback from 3 people isn't validation; it could be coincidence. Set your pass bar before you start (see above), and count commitments, not compliments.\n\n### Market Research: 30-50+ Participants\n\nFor broader market understanding, like sizing opportunities or understanding competitive dynamics, you need larger samples to draw meaningful conclusions.\n\n**Consider these benchmarks:**\n- 30 minimum for directional insights\n- 50+ for more confident conclusions\n- 100+ to support quantitative analysis\n\n---\n\n## The Traditional Constraint: Why Teams Interview Too Few\n\nHere's the uncomfortable truth: most teams conduct fewer interviews than they should. Not because they don't understand the value, but because of practical constraints.\n\n### Time Investment\n\nA single 45-minute interview takes far more than 45 minutes. Count the scheduling back and forth, the call itself, writing up notes and the time to pull patterns together across calls. For a founder doing this alongside everything else, 20 interviews can easily take more than a working week.\n\n### Access Challenges\n\nFinding and recruiting the right customers takes effort:\n- Identifying qualified participants\n- Getting responses to outreach\n- Scheduling around availability\n- Managing no-shows\n\n### Cost Considerations\n\nResearcher time, participant incentives and the opportunity cost of a founder's week all add up. At those economics, teams make trade-offs. They interview fewer customers than ideal, prioritize only the highest-stakes research, or skip customer interviews altogether.\n\n---\n\n## How AI Changes the Sample Size Equation\n\nAI interview tools change the economics of customer research, because the interviewer's time is no longer the limit.\n\n### What AI Interviewers Enable\n\nWith AI handling the conversation:\n\n1. **Interviews run any time**: customers take part on their schedule, not yours\n2. **No scheduling coordination**: send a link, get responses\n3. **Automated transcription and analysis**: each interview is summarised as it comes in\n4. **Consistent interview quality**: every conversation follows your guide\n5. **Lower marginal cost**: each additional interview costs little beyond the tool and any incentive\n\nThat doesn't just mean more interviews. It means:\n\n- **Confidence in patterns**: when most of 50 customers describe the same problem, you can act on it\n- **Segment-level insights**: interview enough customers to understand each segment\n- **Continuous learning**: run ongoing research, not just periodic projects\n- **Numbers next to stories**: a structured question asked of everyone gives you a share you can report alongside the quotes\n\n### When Human Interviews Still Matter\n\nAI interviewers are powerful, but they're not always the right choice:\n\n- **Sensitive topics** requiring careful rapport-building\n- **Complex exploratory research** with unpredictable directions\n- **High-stakes stakeholder interviews** where personal connection matters\n- **Deeply technical discovery** requiring expert follow-up questions\n\nFor a founder, there is one more: your first handful of discovery calls. Do those yourself. They are how you learn the language of the problem. Then use AI interviews to reach the 20, 30 or 50 people a validation round needs.\n\n---\n\n## A Practical Framework for Determining Your Sample Size\n\nRather than memorizing numbers, use this decision framework:\n\n### Step 1: Define Your Research Type\n\n| Research Type | Minimum Sample | Recommended Sample |\n|---------------|---------------|-------------------|\n| Usability testing | 5 | 8 per segment |\n| Discovery interviews | 12 | 15-20 |\n| Concept validation | 15 | 20-25 |\n| Segment research | 8/segment | 12/segment |\n| Market research | 30 | 50+ |\n\n### Step 2: Assess Audience Diversity\n\n- **Homogeneous audience** (similar contexts, needs, behaviors): Use minimum samples\n- **Moderately diverse** (some variation in use cases): Add 25-50%\n- **Highly diverse** (distinct segments, varied needs): Double the minimum or segment your research\n\n### Step 3: Consider Your Confidence Needs\n\n- **Exploratory/directional** insights: Minimum samples acceptable\n- **Informing significant decisions**: Recommended samples\n- **High-stakes or contentious topics**: Add 20-30% buffer\n\n### Step 4: Plan for Attrition\n\nRecruit 15-20% more than your target to account for:\n- No-shows\n- Technical issues\n- Poor-quality responses\n- Participants who don't match criteria\n\nWith Koji, screening questions run before every interview, whatever route people came in by, and anyone who doesn't qualify is turned away. When you recruit from Koji's panel, interviews that were screened out or rejected for quality don't count toward your study's participant limit, and credits set aside for a recruitment that aren't used come back at the end.\n\n### Step 5: Monitor Saturation as You Go\n\nDon't commit to a rigid number upfront. Instead:\n1. Start with your minimum viable sample\n2. Analyze in batches (every 5-10 interviews)\n3. Track whether new themes are emerging\n4. Stop when you're consistently hearing familiar patterns\n\n---\n\n## Common Sample Size Mistakes (And How to Avoid Them)\n\n### Mistake 1: Stopping at 5 Because \"Nielsen Said So\"\n\n**The fix:** Recognize that 5 users is for usability testing, not discovery research. For understanding customer needs, start with 12 minimum.\n\n### Mistake 2: Moving the Validation Bar After the Calls\n\n**The fix:** Write the pass bar down before the first call. If you change it after seeing the results, you are no longer testing anything.\n\n### Mistake 3: Not Accounting for Segments\n\n**The fix:** If you're researching across segments, you need critical mass within each segment, not just total interviews. 20 interviews across 4 segments means only 5 per segment, which isn't enough.\n\n### Mistake 4: Treating Each Study in Isolation\n\n**The fix:** Build cumulative knowledge. If you interviewed 15 enterprise customers last quarter, you might only need 8 more for a focused follow-up study.\n\n### Mistake 5: Prioritizing Quantity Over Quality\n\n**The fix:** More interviews only helps if they're well-conducted. Ensure your interview guide is solid, your participants match your criteria, and your analysis is rigorous.\n\n---\n\n## Making Customer Research Sustainable\n\nThe real goal isn't to nail the \"right\" sample size for a single study. It's to build a habit where customer insights keep informing decisions.\n\n### Shift from Projects to Programs\n\nInstead of occasional deep-dive studies, consider:\n\n- **Continuous discovery**: regular small-batch interviews every week\n- **Always-on feedback channels**: interviews embedded in your product\n- **Rapid research sprints**: quick-turn studies for specific questions\n\n### Use the Right Tool for Each Job\n\n| Need | Best Approach |\n|------|---------------|\n| Broad pattern identification | AI interviews (30-50+) |\n| Deep exploration | Human interviews (8-12) |\n| Quick validation | AI interviews (15-20) |\n| Sensitive topics | Human interviews (10-15) |\n| Ongoing pulse | AI interviews (continuous) |\n\n---\n\n## Key Takeaways\n\n1. **Know which job you are doing.** Discovery stops at saturation, usually 12 to 20 per segment. Validation stops when you pass or fail a bar you set in advance.\n\n2. **The \"5 users\" rule is for usability testing, not customer interviews.**\n\n3. **Saturation matters more than arbitrary numbers.** Monitor when new interviews stop revealing new insights, and stop there.\n\n4. **A narrower segment needs fewer interviews.** Diverse populations require larger samples.\n\n5. **Count commitments, not compliments,** when you validate.\n\n6. **AI changes the economics.** When interviews cost less, you can afford the sample sizes that give you real confidence in your findings.\n\n---\n\n## Start Talking to More Customers Today\n\nRun your first discovery calls yourself. When you are ready for a validation round, put the same questions into a Koji study and send one link: the AI interviewer runs every conversation by voice or text, probes the same way each time, and the report shows the themes with the quotes behind them.\n\nKoji can recruit the participants too: describe your audience in Panel recruit and see the cost before you launch, or import your own customer list so each person gets a personal link, and the interviews land in the same study. You get 10 free credits when you sign up, enough for ten text interviews.\n\n[See how Koji works](/demo) | [Start free](/signup)\n\nFor the full reference on sample sizes by method, see [How Many User Interviews Do You Need?](/docs/how-many-user-interviews). To run the calls themselves, see [The Mom Test: How to Talk to Customers Without Being Misled](/docs/mom-test-methodology).\n\n---\n\n*Sources: Jakob Nielsen, \"Why You Only Need to Test with 5 Users\", Nielsen Norman Group (2000); Abbie Griffin and John Hauser, \"The Voice of the Customer\", Marketing Science (1993); Greg Guest, Arwen Bunce and Laura Johnson, \"How Many Interviews Are Enough?\", Field Methods (2006); Monique Hennink and Bonnie Kaiser, \"Sample sizes for saturation in qualitative research: A systematic review of empirical tests\", Social Science & Medicine (2022).*\n","category":"Research","lastModified":"2026-10-31T06:33:10.141711+00:00","metaTitle":"How Many Customer Interviews Does a Founder Need?","metaDescription":"Discovery vs validation sample sizes for founders: 12 to 20 interviews to reach saturation, a pass bar for validation, the studies behind the numbers and when to scale up.","keywords":["customer interview sample size","how many user interviews","qualitative research sample size","customer research participants","interview saturation","user research sample size","product research interviews"],"aiSummary":"A founder's guide to customer interview sample sizes that separates two jobs. Discovery (understanding the problem) ends at saturation, usually 12 to 20 interviews per segment, backed by Griffin and Hauser (1993), Guest, Bunce and Johnson (2006) and Hennink and Kaiser (2022). Validation (testing a specific bet) ends when you pass or fail a bar written down before the first call, often 10 to 15 conversations to see a signal and 30 or more to quote a share, counting commitments rather than compliments. It also explains why the 5-user rule only applies to usability testing and how AI interviews make larger validation rounds practical.","aiKeywords":["customer interview sample size","how many customer interviews","discovery vs validation","data saturation","founder customer research","problem validation","5 user rule"],"aiContentType":"guide","faqItems":[{"answer":"It depends on the job. For discovery, keep going until new interviews stop adding new themes, usually 12 to 20 with one kind of customer. For validation, set a pass bar before the first call and run 10 to 15 conversations to see whether you hit it, then 30 or more once you need a share you can quote.","question":"How many customer interviews does a founder need?"},{"answer":"Discovery interviews find out what the problem is, who has it and how they cope today. Validation interviews test a specific bet, such as whether a defined customer will pay to fix a defined problem, against a bar you set in advance, counting commitments like pilots or deposits rather than compliments.","question":"What is the difference between discovery and validation interviews?"},{"answer":"No. Jakob Nielsen's 5-user rule is about finding usability problems in an interface, run in repeated rounds. Discovery research about needs and behavior usually takes 12 to 20 interviews per segment to reach saturation.","question":"Is 5 users really enough for customer interviews?"},{"answer":"Saturation is the point where more interviews stop revealing new themes. A 2022 systematic review by Hennink and Kaiser found it is usually reached within 9 to 17 interviews for a fairly similar group and a focused question. Broader or more diverse groups need more.","question":"What is data saturation in customer research?"},{"answer":"An AI interviewer removes scheduling and runs every conversation the same way, so the interviewer's time stops being the limit. That makes a validation round of 30 to 50 interviews practical for a founder, after their own first discovery calls.","question":"How does AI change the sample size for customer interviews?"}],"relatedTopics":["customer-research-methods","interview-best-practices","qualitative-research","research-planning","AI-interviews"]}],"pagination":{"total":1,"returned":1,"offset":0}}