{"site":{"name":"Koji","description":"AI-native customer research platform that helps teams conduct, analyze, and synthesize customer interviews at scale.","url":"https://www.koji.so","contentTypes":["blog","documentation"],"lastUpdated":"2026-05-18T14:04:03.294Z"},"content":[{"type":"documentation","id":"7b3badce-c489-48de-83d0-bc0b3a7198e9","slug":"product-market-fit-survey-guide","title":"How to Measure Product-Market Fit with the Sean Ellis Test (and Go Deeper)","url":"https://www.koji.so/docs/product-market-fit-survey-guide","summary":"Comprehensive guide to product-market fit measurement. Covers the Sean Ellis 40% threshold test, how to design PMF studies with Koji that combine the quantitative metric with deep qualitative probing, segment-aware AI follow-ups, and best practices for sample size, timing, and analysis.","content":"# How to Measure Product-Market Fit with the Sean Ellis Test (and Go Deeper)\n\nProduct-market fit is the most important milestone for any startup. Before PMF, everything is a hypothesis. After PMF, you have permission to scale. But how do you know when you've reached it?\n\nThe most widely used quantitative measure is the Sean Ellis test: ask users \"How would you feel if you could no longer use [product]?\" If 40%+ say \"very disappointed,\" you have product-market fit.\n\nThe number is useful. But it's incomplete. 40% of users are very disappointed. Why? What specifically would they miss? What jobs does the product do for them that nothing else can? And what about the other 60%? Are they close to disappointed, or indifferent?\n\nKoji turns the PMF survey from a data point into a research program.\n\n## The Sean Ellis Test\n\nThe standard PMF survey has four questions:\n\n**Question 1 (Single Choice):**\n\"How would you feel if you could no longer use [product]?\"\n- Very disappointed\n- Somewhat disappointed\n- Not disappointed (it's not really that useful)\n- N/A (I no longer use it)\n\n**Question 2 (Open-ended):**\n\"What type of people do you think would benefit most from [product]?\"\n\n**Question 3 (Open-ended):**\n\"What is the main benefit you receive from [product]?\"\n\n**Question 4 (Open-ended):**\n\"How can we improve [product] for you?\"\n\n### The 40% Threshold\n\nSean Ellis analyzed hundreds of startups and found that companies where 40%+ of surveyed users would be \"very disappointed\" consistently went on to achieve strong growth. Below 25% typically indicates weak PMF. Between 25-40% is the danger zone, you have something but need to sharpen it.\n\n## Why the Standard PMF Survey Is Not Enough\n\nThe Sean Ellis test tells you whether you have PMF. It doesn't tell you:\n- **Why** specific users are very disappointed (what job does the product do for them?)\n- **What** the \"somewhat disappointed\" group needs to become \"very disappointed\"\n- **Who** your true target customer is within your user base\n- **Where** the product falls short for different segments\n- **How** to prioritize your roadmap to strengthen PMF\n\nThis is where Koji transforms the PMF survey from a metric into an actionable research program.\n\n## Building the PMF Study in Koji\n\n### Core Structure\n\n**Q1: PMF Score (Single Choice)**\n\"If you could no longer use [product], how would you feel?\"\n- Very disappointed\n- Somewhat disappointed\n- Not disappointed\n- I no longer use it\n- Configure: Single choice with probing enabled\n\n**Q2: Core Value (Open-ended, high probing)**\n\"What's the main benefit you get from [product]?\"\n- Probing depth: 3\n- AI instruction: \"Dig into specific workflows and outcomes. Get concrete examples of what the product enables them to do.\"\n\n**Q3: Alternatives (Open-ended)**\n\"What would you use instead if [product] didn't exist?\"\n- Probing depth: 2\n- AI instruction: \"Understand the competitive landscape from the user's perspective. What specific alternatives have they tried?\"\n\n**Q4: Ideal Customer (Open-ended)**\n\"Who do you think would benefit most from [product]?\"\n- Probing depth: 1\n- AI instruction: \"This reveals how users perceive the product's target audience.\"\n\n**Q5: Improvement (Open-ended, high probing)**\n\"If you could change one thing about [product], what would it be?\"\n- Probing depth: 2\n- AI instruction: \"Separate nice-to-haves from critical improvements. Ask about impact on their workflow.\"\n\n**Q6: Usage Context (Single Choice)**\n\"How often do you use [product]?\"\n- Daily / Several times a week / Weekly / Monthly / Rarely\n- No probing needed, this is segmentation data\n\n### Advanced: Segment-Aware Probing\n\nKoji's AI adapts its follow-up questions based on the PMF answer:\n\n**For \"Very Disappointed\" users:**\nThe AI probes for what makes the product indispensable. \"You said you'd be very disappointed. Can you tell me about a specific moment when [product] was critical for you?\" This captures your product's competitive moat in the user's own words.\n\n**For \"Somewhat Disappointed\" users:**\nThe AI explores the gap. \"What would need to change for this to be something you absolutely couldn't live without?\" This reveals your PMF roadmap.\n\n**For \"Not Disappointed\" users:**\nThe AI investigates why. \"What's preventing [product] from being more useful for you? Is it missing something, or is it just not the right fit?\" This distinguishes between fixable problems and wrong-segment users.\n\n## Sample Sizes and Timing\n\n- **Minimum sample:** 40 responses from active users (used product in last 2 weeks)\n- **Ideal sample:** 100-200 for segment-level analysis\n- **Timing:** After users have had enough time to experience core value (typically 2-4 weeks of active use)\n- **Frequency:** Quarterly for early-stage. Semi-annually post-PMF.\n- **Exclude:** Churned users, free trial users who never activated, internal team members\n\n## Analyzing PMF Results in Koji\n\nKoji's report automatically generates:\n\n### Quantitative\n- **PMF score:** % \"Very Disappointed\" with confidence interval\n- **Distribution chart:** Breakdown across all four categories\n- **Segment analysis:** PMF score by user cohort, plan, tenure, use case\n- **Trend tracking:** How PMF score changes over time\n\n### Qualitative\n- **Core value themes:** What do \"very disappointed\" users value most? Koji clusters their responses into actionable themes.\n- **Gap analysis:** What do \"somewhat disappointed\" users need? These are your highest-ROI product investments.\n- **Alternative mapping:** What would users switch to? This reveals your real competitive landscape.\n- **Improvement priority:** Which requested improvements correlate most with higher PMF scores?\n\n## Best Practices\n\n### Survey the right people\nOnly survey users who have activated and used the product recently. New signups who haven't experienced core value will skew results downward. Users who churned 6 months ago have stale opinions.\n\n### Don't chase the number\nThe goal isn't to get to 40%. The goal is to understand who finds your product indispensable and why, then find more of those people and deepen the value for everyone else.\n\n### Segment ruthlessly\nYour overall PMF score might be 30%, but your PMF among product managers who use the feature X workflow might be 65%. Find the segment with strongest PMF and double down.\n\n### Combine quant and qual\nThis is Koji's superpower. The PMF number tells you where you stand. The conversation tells you what to do about it. No other tool gives you both in a single, natural interaction.\n\n## Why Koji Is Ideal for PMF Research\n\n- **Conversational depth** that traditional PMF survey tools can't match\n- **AI-driven segment analysis** connecting PMF scores to user characteristics\n- **Probing that adapts** based on the PMF answer, automatically exploring what matters most\n- **Scale without sacrifice** since you can run 500 PMF conversations in the time it takes to schedule 5 user interviews\n- **Quote extraction** that gives you the exact customer language to use in marketing\n- **Mixed methods in one flow** combining the quantitative PMF metric with qualitative understanding\n\n---\n\n## Related Survey Guides\n\n- [Feature Prioritization Guide](/docs/feature-prioritization-survey-guide) — Decide what to build next\n- [Concept Testing Guide](/docs/concept-testing-survey-guide) — Validate ideas before building\n- [Pricing Research Guide](/docs/pricing-research-survey-guide) — Find your optimal price point\n- [Beta Testing Feedback Guide](/docs/beta-testing-feedback-survey-guide) — Collect pre-launch feedback\n- [Market Segmentation Guide](/docs/market-segmentation-survey-guide) — Find your best customer segment\n\n*Use [structured questions](/docs/structured-questions-guide) to combine the Sean Ellis test with AI-powered conversational follow-up.*\n\n## Further reading on the blog\n\n- [Product-Market Fit Research: How to Go Beyond the 40% Survey (2026)](/blog/product-market-fit-research-guide-2026) — The Sean Ellis 40% survey tells you if you have product-market fit. AI-powered customer interviews tell you why — and what to do about it. H\n\n<!-- further-reading:blog -->\n","category":"Survey & Study Templates","lastModified":"2026-05-13T00:25:38.788654+00:00","metaTitle":"Product-Market Fit Survey Guide: Measure PMF with the Sean Ellis Test | Koji","metaDescription":"Complete guide to measuring product-market fit. Run the Sean Ellis \"very disappointed\" test with Koji and go deeper with AI-driven conversational follow-up to understand why you have (or don't have) PMF.","keywords":["product market fit survey","Sean Ellis test","PMF survey","product market fit template","how to measure PMF","very disappointed test","startup survey"],"aiSummary":"Comprehensive guide to product-market fit measurement. Covers the Sean Ellis 40% threshold test, how to design PMF studies with Koji that combine the quantitative metric with deep qualitative probing, segment-aware AI follow-ups, and best practices for sample size, timing, and analysis."}],"pagination":{"total":1,"returned":1,"offset":0}}