Sean Ellis Test: The 40% Rule for Product-Market Fit (Complete 2026 Guide)

TL;DR: The Sean Ellis Test (also called the PMF Survey or "40% rule") asks existing users a single question: "How would you feel if you could no longer use this product?" If 40% or more answer "very disappointed," you have product-market fit. Below 40% means you need to keep iterating before scaling growth. The test is cheap, fast, and predictive — and AI interview platforms like Koji let you run it conversationally so you also capture the why behind each rating.

What is the Sean Ellis Test?

The Sean Ellis Test is a survey-based methodology for measuring product-market fit (PMF), created by growth expert Sean Ellis — the first marketer at Dropbox, LogMeIn, Eventbrite, and Lookout. Sean discovered a pattern: companies that struggled to scale always had fewer than 40% of users saying they'd be "very disappointed" without their product. Companies that scaled effortlessly always exceeded that threshold.

Instead of measuring PMF through proxy metrics like retention curves or NPS, the Sean Ellis Test asks one direct question that captures emotional dependence. It is the closest thing to a single-number "do we have PMF?" gauge that exists in the product world.

The test has four core questions:

1. How would you feel if you could no longer use [product]? — Options: Very disappointed / Somewhat disappointed / Not disappointed / N/A I no longer use it
2. What type of people do you think would most benefit from [product]?
3. What is the main benefit you receive from [product]?
4. How can we improve [product] for you?

The first question is your PMF score. The next three tell you who loves the product, why they love it, and what's blocking even more love.

Why the 40% Threshold Matters

Sean Ellis benchmarked the "very disappointed" rate against ~100 startups. The pattern was unambiguous:

• Below 25%: The product has not found a market. Major repositioning, audience pivot, or feature overhaul is needed.
• 25% to 40%: You are close but not there. Focus on the things your high-intent users tell you — usually a tightening of audience or a sharper value prop.
• 40% or higher: You have product-market fit. It is now safe to invest aggressively in growth.

This threshold is not arbitrary. Below 40%, paid acquisition typically leaks faster than referral can fill it. Above 40%, your product begins to compound — happy users tell other users, and growth becomes cheaper over time.

When to Run the Sean Ellis Test

Run the test when:

• You have at least 30 to 40 active users who have used the product more than twice in the last two weeks (this is the minimum sample for the question to be meaningful)
• You're deciding whether to invest in growth (paid ads, SDR team, content engine) or keep iterating on product
• You want to track PMF over time as a north-star metric on your product dashboard
• You're preparing for fundraising and need a credible PMF signal investors trust

Do not run it when users haven't experienced the product enough to know whether they'd miss it. Set a minimum usage threshold — for example, "used at least 3 times in the past 14 days" — before sending the survey.

How to Run the Sean Ellis Test in 6 Steps

1. Define Your "Active User" Segment

Pick the cohort that has experienced enough of the product to answer honestly. For most B2B SaaS, this is users who completed onboarding and returned at least twice. For consumer apps, it's users who hit a key activation event (sent first message, completed first transaction, etc.).

2. Recruit at Least 40 Respondents

Statistical reliability for the 40% threshold requires roughly 40 to 100 responses. Send the survey to a broader cohort — typical response rates are 10% to 20% for in-app prompts and 5% to 10% for email.

3. Use a Conversational Format, Not a Static Survey

Traditional survey tools collect single-word answers. The real insight is in the open-ended responses — what people would miss, why, who they'd recommend it to. AI-moderated interview platforms like Koji ask the four core questions and then automatically follow up: "You said you'd be 'very disappointed.' Can you tell me about the last time the product saved you time or solved a problem?" This unlocks 5x richer qualitative data than a static survey form.

4. Segment the "Very Disappointed" Group

The most valuable data comes from segmenting who says "very disappointed." Look at:

• What roles or job titles are over-represented in this group?
• What use cases or features do they describe in the open-ended questions?
• How did they find the product?

These segments are your ICP. Marketing, sales, and product should be ruthlessly aligned around them.

5. Mine the Open-Ended Responses

The "what is the main benefit" and "how can we improve" answers are gold — they're the exact words your future website headlines, ad copy, and roadmap should reflect. Koji's auto-analysis surfaces these themes and quotes automatically, so you don't have to read 100 transcripts manually.

6. Track the Score Over Time

PMF is not a static state. As you change the product, audience, or positioning, the score drifts. Run the test quarterly and compare cohorts. A rising score means your changes are working; a falling score means something just broke.

Sean Ellis Test in Practice: How Koji Automates It

Sean Ellis originally distributed the test via static survey tools (SurveyMonkey, Typeform, Google Forms). The mechanics were clunky: send a link, wait, manually code open-ended responses, and hope respondents answered the follow-ups.

With platforms like Koji, the entire workflow is faster and richer:

• Structured PMF question types: Use Koji's six structured question types (open_ended, scale, single_choice, multiple_choice, ranking, yes_no) to capture the "very disappointed" rating as a single_choice question and the rest as open_ended with AI follow-up probing.
• AI follow-up probing: When a user says "very disappointed," Koji's AI moderator asks why in their own words — surfacing the language of love that becomes your marketing copy.
• Voice or text: Run the same PMF survey via voice for higher response quality and emotional nuance, or text for speed and asynchronicity.
• Real-time analysis: Auto-extracted themes, quality scores, and quote tags appear as soon as interviews complete. No manual coding required.
• Cohort segmentation: Pipe responses to your CRM via webhook or the Koji API to segment "very disappointed" users for ICP refinement and lookalike targeting.

A typical workflow that used to take 3 weeks (build survey, recruit, manually analyze) now takes 2 to 3 days end-to-end.

How to Interpret Your Sean Ellis Score

Famous PMF scores at scale:

• Slack reportedly hit 51% in early days
• Superhuman famously rebuilt the product over 18 months to climb from 22% to 58%
• Hubspot ran the test as part of their early growth motion

Common Mistakes That Skew the Score

1. Surveying users who haven't activated. Their answer to "would you be disappointed" is "no" because they never got value. Filter ruthlessly.
2. Treating "somewhat disappointed" as a win. It isn't. Only "very disappointed" counts in the 40% calculation.
3. Sampling power users only. Running the survey to your top 10 customers will inflate the score. Use a representative cohort.
4. Ignoring open-ended responses. The score is the headline; the qualitative data is the actual playbook.
5. Treating the score as static. PMF is a moving target. Pricing changes, competitor launches, and audience shifts all move the number.

Sean Ellis Test vs. NPS vs. Other PMF Metrics

The Sean Ellis Test is the best leading indicator — it tells you whether your retention curve and growth metrics will be healthy. NPS and retention are trailing indicators — they confirm what your PMF score already showed.

Frequently Asked Questions

How many users do I need for a valid Sean Ellis Test?

A minimum of 40 responses is needed for the 40% threshold to be statistically meaningful. Below 40 responses, treat the result as directional only. Aim for 100+ responses for confident decisions.

Should I include inactive users in the survey?

No. Only survey users who have used the product enough to form an opinion. A typical filter is "used the product 2 or more times in the past 14 days." Sending the survey to inactive users will deflate your score with non-engaged opinions.

Is the 40% threshold universal across industries?

The 40% rule is a general benchmark, not an industry-specific number. For high-frequency consumer products (messaging, social), strong PMF often shows up at 50%+. For B2B enterprise tools, 40% from the right ICP is a strong signal. The trend over time matters more than hitting a specific number.

Can I use the Sean Ellis Test on a free product?

Yes — in fact, it's especially useful for free-tier products where willingness-to-pay isn't a useful signal yet. Filter for users who have hit your activation milestone, then run the test on that cohort.

How does the Sean Ellis Test compare to a PMF survey?

The Sean Ellis Test is a PMF survey — specifically, it's the most widely-adopted version. Other PMF surveys exist (Superhuman PMF Engine, Pirate Metrics retention proxies), but the Sean Ellis question remains the gold standard for its simplicity.

Does AI moderation change the validity of the Sean Ellis Test?

No — if anything, it improves it. Static surveys are subject to respondent fatigue and shallow answers. AI moderators (like Koji's) ask follow-up questions in plain language, capture richer "why" responses, and reduce survey abandonment by 30 to 50%.

Related Resources

• Product Market Fit Interviews — Deeper qualitative methodology that pairs with the Sean Ellis Test
• Structured Questions Guide — Use the six question types to design your PMF survey
• Customer Validation Guide — End-to-end framework for validating product-market fit
• Mom Test User Interviews — How to ask better follow-up questions during PMF research
• NPS Survey Guide — Trailing-indicator metric to track once PMF is achieved
• Customer Discovery Interviews — Pre-PMF research methodology for finding the right audience

Run a Sean Ellis Test in under an hour with Koji's AI interview platform — structured PMF questions, AI follow-up probing, and auto-analysis included.