{"site":{"name":"Koji","description":"AI-native customer research platform that helps teams conduct, analyze, and synthesize customer interviews at scale.","url":"https://www.koji.so","contentTypes":["blog","documentation"],"lastUpdated":"2026-05-21T02:12:37.823Z"},"content":[{"type":"documentation","id":"dfd2070d-0dc7-456e-b43a-7954a2c2979a","slug":"sean-ellis-test-product-market-fit","title":"Sean Ellis Test: The 40% Rule for Product-Market Fit (Complete 2026 Guide)","url":"https://www.koji.so/docs/sean-ellis-test-product-market-fit","summary":"The Sean Ellis Test is a 4-question survey that measures product-market fit by asking active users how they would feel without the product. If 40% or more say 'very disappointed', you have PMF and can scale growth. Below 40%, keep iterating. AI interview platforms like Koji automate the survey with conversational follow-up probing, voice or text modes, and auto-analysis — turning a 3-week manual process into 2 to 3 days.","content":"# Sean Ellis Test: The 40% Rule for Product-Market Fit (Complete 2026 Guide)\n\n**TL;DR:** The Sean Ellis Test (also called the PMF Survey or \"40% rule\") asks existing users a single question: *\"How would you feel if you could no longer use this product?\"* If 40% or more answer **\"very disappointed,\"** you have product-market fit. Below 40% means you need to keep iterating before scaling growth. The test is cheap, fast, and predictive — and AI interview platforms like Koji let you run it conversationally so you also capture the *why* behind each rating.\n\n## What is the Sean Ellis Test?\n\nThe Sean Ellis Test is a survey-based methodology for measuring product-market fit (PMF), created by growth expert Sean Ellis — the first marketer at Dropbox, LogMeIn, Eventbrite, and Lookout. Sean discovered a pattern: companies that struggled to scale always had fewer than 40% of users saying they'd be \"very disappointed\" without their product. Companies that scaled effortlessly always exceeded that threshold.\n\nInstead of measuring PMF through proxy metrics like retention curves or NPS, the Sean Ellis Test asks one direct question that captures *emotional dependence*. It is the closest thing to a single-number \"do we have PMF?\" gauge that exists in the product world.\n\nThe test has four core questions:\n\n1. **How would you feel if you could no longer use [product]?** — Options: *Very disappointed / Somewhat disappointed / Not disappointed / N/A I no longer use it*\n2. **What type of people do you think would most benefit from [product]?**\n3. **What is the main benefit you receive from [product]?**\n4. **How can we improve [product] for you?**\n\nThe first question is your PMF score. The next three tell you *who* loves the product, *why* they love it, and *what's blocking* even more love.\n\n## Why the 40% Threshold Matters\n\nSean Ellis benchmarked the \"very disappointed\" rate against ~100 startups. The pattern was unambiguous:\n\n- **Below 25%:** The product has not found a market. Major repositioning, audience pivot, or feature overhaul is needed.\n- **25% to 40%:** You are close but not there. Focus on the things your high-intent users tell you — usually a tightening of audience or a sharper value prop.\n- **40% or higher:** You have product-market fit. It is now safe to invest aggressively in growth.\n\nThis threshold is not arbitrary. Below 40%, paid acquisition typically leaks faster than referral can fill it. Above 40%, your product begins to compound — happy users tell other users, and growth becomes cheaper over time.\n\n## When to Run the Sean Ellis Test\n\nRun the test when:\n\n- You have **at least 30 to 40 active users** who have used the product more than twice in the last two weeks (this is the minimum sample for the question to be meaningful)\n- You're **deciding whether to invest in growth** (paid ads, SDR team, content engine) or keep iterating on product\n- You want to **track PMF over time** as a north-star metric on your product dashboard\n- You're **preparing for fundraising** and need a credible PMF signal investors trust\n\nDo *not* run it when users haven't experienced the product enough to know whether they'd miss it. Set a minimum usage threshold — for example, \"used at least 3 times in the past 14 days\" — before sending the survey.\n\n## How to Run the Sean Ellis Test in 6 Steps\n\n### 1. Define Your \"Active User\" Segment\nPick the cohort that has experienced enough of the product to answer honestly. For most B2B SaaS, this is users who completed onboarding *and* returned at least twice. For consumer apps, it's users who hit a key activation event (sent first message, completed first transaction, etc.).\n\n### 2. Recruit at Least 40 Respondents\nStatistical reliability for the 40% threshold requires roughly 40 to 100 responses. Send the survey to a broader cohort — typical response rates are 10% to 20% for in-app prompts and 5% to 10% for email.\n\n### 3. Use a Conversational Format, Not a Static Survey\nTraditional survey tools collect single-word answers. The real insight is in the *open-ended* responses — what people would miss, why, who they'd recommend it to. AI-moderated interview platforms like Koji ask the four core questions and then automatically follow up: *\"You said you'd be 'very disappointed.' Can you tell me about the last time the product saved you time or solved a problem?\"* This unlocks 5x richer qualitative data than a static survey form.\n\n### 4. Segment the \"Very Disappointed\" Group\nThe most valuable data comes from segmenting *who* says \"very disappointed.\" Look at:\n\n- **What roles or job titles** are over-represented in this group?\n- **What use cases or features** do they describe in the open-ended questions?\n- **How did they find the product?**\n\nThese segments are your ICP. Marketing, sales, and product should be ruthlessly aligned around them.\n\n### 5. Mine the Open-Ended Responses\nThe \"what is the main benefit\" and \"how can we improve\" answers are gold — they're the *exact words* your future website headlines, ad copy, and roadmap should reflect. Koji's auto-analysis surfaces these themes and quotes automatically, so you don't have to read 100 transcripts manually.\n\n### 6. Track the Score Over Time\nPMF is not a static state. As you change the product, audience, or positioning, the score drifts. Run the test quarterly and compare cohorts. A rising score means your changes are working; a falling score means something just broke.\n\n## Sean Ellis Test in Practice: How Koji Automates It\n\nSean Ellis originally distributed the test via static survey tools (SurveyMonkey, Typeform, Google Forms). The mechanics were clunky: send a link, wait, manually code open-ended responses, and hope respondents answered the follow-ups.\n\nWith platforms like Koji, the entire workflow is faster and richer:\n\n- **Structured PMF question types:** Use Koji's six structured question types (open_ended, scale, single_choice, multiple_choice, ranking, yes_no) to capture the \"very disappointed\" rating as a `single_choice` question and the rest as `open_ended` with AI follow-up probing.\n- **AI follow-up probing:** When a user says \"very disappointed,\" Koji's AI moderator asks *why* in their own words — surfacing the language of love that becomes your marketing copy.\n- **Voice or text:** Run the same PMF survey via voice for higher response quality and emotional nuance, or text for speed and asynchronicity.\n- **Real-time analysis:** Auto-extracted themes, quality scores, and quote tags appear as soon as interviews complete. No manual coding required.\n- **Cohort segmentation:** Pipe responses to your CRM via webhook or the Koji API to segment \"very disappointed\" users for ICP refinement and lookalike targeting.\n\nA typical workflow that used to take 3 weeks (build survey, recruit, manually analyze) now takes 2 to 3 days end-to-end.\n\n## How to Interpret Your Sean Ellis Score\n\n| Score | Interpretation | Recommended Next Step |\n|---|---|---|\n| **< 25%** | No PMF yet | Pivot positioning or audience. Re-run customer discovery interviews. |\n| **25–39%** | Approaching PMF | Tighten ICP. Double down on the use case that resonates with \"very disappointed\" users. |\n| **40–49%** | PMF achieved | Begin scaling growth investment. Continue tracking quarterly. |\n| **50%+** | Strong PMF | Focus on retention, expansion, and category leadership. |\n\nFamous PMF scores at scale:\n\n- **Slack** reportedly hit 51% in early days\n- **Superhuman** famously rebuilt the product over 18 months to climb from 22% to 58%\n- **Hubspot** ran the test as part of their early growth motion\n\n## Common Mistakes That Skew the Score\n\n1. **Surveying users who haven't activated.** Their answer to \"would you be disappointed\" is \"no\" because they never got value. Filter ruthlessly.\n2. **Treating \"somewhat disappointed\" as a win.** It isn't. Only \"very disappointed\" counts in the 40% calculation.\n3. **Sampling power users only.** Running the survey to your top 10 customers will inflate the score. Use a representative cohort.\n4. **Ignoring open-ended responses.** The score is the headline; the qualitative data is the actual playbook.\n5. **Treating the score as static.** PMF is a moving target. Pricing changes, competitor launches, and audience shifts all move the number.\n\n## Sean Ellis Test vs. NPS vs. Other PMF Metrics\n\n| Metric | What It Measures | When to Use |\n|---|---|---|\n| **Sean Ellis Test** | Emotional dependence on product | PMF check, especially pre-scaling |\n| **NPS** | Willingness to recommend | Ongoing loyalty tracking |\n| **Retention curve** | Behavioral stickiness | Long-term PMF validation |\n| **CES (Customer Effort Score)** | Friction in specific tasks | UX-level optimization |\n| **DAU/MAU stickiness ratio** | Usage frequency | Engagement health |\n\nThe Sean Ellis Test is the best *leading indicator* — it tells you whether your retention curve and growth metrics *will* be healthy. NPS and retention are *trailing indicators* — they confirm what your PMF score already showed.\n\n## Frequently Asked Questions\n\n### How many users do I need for a valid Sean Ellis Test?\nA minimum of 40 responses is needed for the 40% threshold to be statistically meaningful. Below 40 responses, treat the result as directional only. Aim for 100+ responses for confident decisions.\n\n### Should I include inactive users in the survey?\nNo. Only survey users who have used the product enough to form an opinion. A typical filter is \"used the product 2 or more times in the past 14 days.\" Sending the survey to inactive users will deflate your score with non-engaged opinions.\n\n### Is the 40% threshold universal across industries?\nThe 40% rule is a general benchmark, not an industry-specific number. For high-frequency consumer products (messaging, social), strong PMF often shows up at 50%+. For B2B enterprise tools, 40% from the right ICP is a strong signal. The trend over time matters more than hitting a specific number.\n\n### Can I use the Sean Ellis Test on a free product?\nYes — in fact, it's especially useful for free-tier products where willingness-to-pay isn't a useful signal yet. Filter for users who have hit your activation milestone, then run the test on that cohort.\n\n### How does the Sean Ellis Test compare to a PMF survey?\nThe Sean Ellis Test *is* a PMF survey — specifically, it's the most widely-adopted version. Other PMF surveys exist (Superhuman PMF Engine, Pirate Metrics retention proxies), but the Sean Ellis question remains the gold standard for its simplicity.\n\n### Does AI moderation change the validity of the Sean Ellis Test?\nNo — if anything, it improves it. Static surveys are subject to respondent fatigue and shallow answers. AI moderators (like Koji's) ask follow-up questions in plain language, capture richer \"why\" responses, and reduce survey abandonment by 30 to 50%.\n\n## Related Resources\n\n- [Product Market Fit Interviews](/docs/product-market-fit-interviews) — Deeper qualitative methodology that pairs with the Sean Ellis Test\n- [Structured Questions Guide](/docs/structured-questions-guide) — Use the six question types to design your PMF survey\n- [Customer Validation Guide](/docs/customer-validation-guide) — End-to-end framework for validating product-market fit\n- [Mom Test User Interviews](/docs/mom-test-user-interviews) — How to ask better follow-up questions during PMF research\n- [NPS Survey Guide](/docs/nps-survey-guide) — Trailing-indicator metric to track once PMF is achieved\n- [Customer Discovery Interviews](/docs/customer-discovery-interviews) — Pre-PMF research methodology for finding the right audience\n\nRun a Sean Ellis Test in under an hour with [Koji's AI interview platform](/) — structured PMF questions, AI follow-up probing, and auto-analysis included.\n","category":"Research Methods","lastModified":"2026-05-19T03:17:52.707237+00:00","metaTitle":"Sean Ellis Test: The 40% Rule for Product-Market Fit (2026 Guide)","metaDescription":"Run the Sean Ellis Test to measure product-market fit. Learn the 40% threshold, the 4 core questions, how to interpret scores, and run conversational PMF surveys with AI moderation.","keywords":["sean ellis test","product market fit test","40% rule product market fit","pmf survey","pmf score","how to measure product market fit","sean ellis pmf survey","product market fit questions","pmf interviews","product market fit measurement"],"aiSummary":"The Sean Ellis Test is a 4-question survey that measures product-market fit by asking active users how they would feel without the product. If 40% or more say 'very disappointed', you have PMF and can scale growth. Below 40%, keep iterating. AI interview platforms like Koji automate the survey with conversational follow-up probing, voice or text modes, and auto-analysis — turning a 3-week manual process into 2 to 3 days.","aiPrerequisites":["Basic understanding of product-market fit concept","At least 30-40 active product users to survey","Defined activation event or usage threshold for filtering respondents"],"aiLearningOutcomes":["Understand the 40% threshold and why it matters","Run a Sean Ellis Test in 6 steps from sample selection to score interpretation","Interpret Sean Ellis scores against industry benchmarks","Avoid the 5 most common mistakes that skew PMF scores","Compare the Sean Ellis Test with NPS, retention, and other PMF metrics","Automate the test with AI-moderated interviews for richer qualitative data"],"aiDifficulty":"intermediate","aiEstimatedTime":"14 min read"}],"pagination":{"total":1,"returned":1,"offset":0}}