{"site":{"name":"Koji","description":"AI-native customer research platform that helps teams conduct, analyze, and synthesize customer interviews at scale.","url":"https://www.koji.so","contentTypes":["blog","documentation"],"lastUpdated":"2026-10-13T11:49:38.296Z"},"content":[{"type":"documentation","id":"937322de-58a1-46e1-ba04-53988e9d2833","slug":"negative-case-analysis","title":"Negative Case Analysis: How to Use the Participants Who Don't Fit","url":"https://www.koji.so/docs/negative-case-analysis","summary":"Negative case analysis is a qualitative research technique in which the researcher deliberately searches for participants or data that contradict an emerging finding, examines each one, and revises the finding until it accounts for the exceptions or the exceptions are explained. It grew out of analytic induction (Znaniecki, 1934; Lindesmith, 1947; Cressey, 1953) and was named by Lincoln and Guba (Naturalistic Inquiry, 1985) as a credibility technique. Each negative case sets a boundary, suggests a better explanation, is a genuine outlier, or reveals an analysis problem. In Koji, report findings show how many participants support them, which shows where to look for exceptions.","content":"Negative case analysis is the practice of deliberately looking for participants, or moments in the data, that don't fit your emerging findings, and then using them to test and refine those findings. Each exception either reveals a limit on a pattern (\"this holds for new customers, not long-standing ones\"), points to a better explanation, or turns out to be a genuine outlier you can account for. Lincoln and Guba named it as one of the main techniques for establishing credibility in qualitative research, and it's one of the simplest ways to stop a study from only finding what you expected.\n\nThis guide explains what negative case analysis is, where it comes from, how to do it step by step, and how to fit it into fast-moving product and customer research.\n\n## What is negative case analysis?\n\nEvery qualitative study produces patterns: most participants churned because of setup effort, most trial users never reached the reporting feature, most managers distrusted the dashboard. Patterns are useful, but \"most\" is doing a lot of work in those sentences. Negative case analysis asks: **what about everyone else?**\n\nA negative case (sometimes called a deviant or disconfirming case) is any participant, response or episode that contradicts or doesn't fit a pattern you've identified. Negative case analysis means:\n\n1. Actively searching for those cases rather than waiting to stumble on them.\n2. Examining each one closely.\n3. Revising your finding until it accounts for the exceptions, or explaining clearly why an exception doesn't change it.\n\nThe goal isn't to make every finding universal. It's to make each finding precise: true for whom, under what conditions and why.\n\n## Where the method comes from\n\nThe idea has deep roots in sociology.\n\n- **Analytic induction.** Florian Znaniecki proposed in 1934 that social scientists should develop explanations that hold for every case studied, revising the explanation whenever a case contradicts it. Alfred Lindesmith's study of opiate addiction (1947) and Donald Cressey's study of embezzlement (1953) became classic examples, each refining a hypothesis case by case until no exceptions remained.\n- **Naturalistic inquiry.** In _Naturalistic Inquiry_ (1985), Yvonna Lincoln and Egon Guba set out criteria for the trustworthiness of qualitative research. Under credibility, the qualitative counterpart of internal validity, they listed negative case analysis alongside techniques such as prolonged engagement, triangulation, peer debriefing and member checking.\n\nToday few researchers insist that a finding must fit every single case. Most use negative case analysis in a softer form: as a disciplined search for disconfirming evidence that sharpens findings and shows readers the analysis was tested, not just assembled.\n\n## Why it matters\n\n**It counters confirmation bias.** Once you have a hypothesis, it's easy to notice supporting quotes and skim past the rest. Searching for exceptions on purpose balances that.\n\n![A researcher at a desk going back through interview notes to find the participants who don't fit the pattern](https://images.unsplash.com/photo-1669146894279-509f5de45390?crop=entropy&cs=tinysrgb&fit=max&fm=jpg&ixid=M3w5NDUzMDN8MHwxfHNlYXJjaHw0fHxyZXNlYXJjaGVyJTIwcmVhZGluZyUyMG5vdGVzJTIwZGVza3xlbnwxfDB8fHwxNzkxODY3MDExfDA&ixlib=rb-4.1.0&q=80&w=1080)\n\n_Photo by [Denise Jans](https://unsplash.com/@dmjdenise?utm_source=koji&utm_medium=referral) on [Unsplash](https://unsplash.com/?utm_source=koji&utm_medium=referral)_\n\n**It sharpens findings.** \"Customers churn because setup is hard\" is weaker than \"Customers who set up without a teammate churn because setup is hard; those who set up with one rarely mention it.\" The second version came from looking at the people the first version didn't fit.\n\n**It finds segments.** A cluster of negative cases is often a segment you didn't know you had. That's frequently the most valuable output of a study.\n\n**It earns trust.** Stakeholders who have been burned by research that told them what they wanted to hear will trust findings that show their limits.\n\n**It catches analysis errors.** Sometimes a negative case reveals a theme was coded too broadly, or that two different things were lumped together.\n\n## How to do negative case analysis, step by step\n\n![Checklist of eight steps for negative case analysis in qualitative research, from stating each finding precisely to reporting the exceptions](/visuals/negative-case-analysis-checklist/negative-case-analysis-checklist.png \"Run through this before you present findings · Source: Lincoln and Guba, Naturalistic Inquiry, 1985\")\n\n### 1. State each finding precisely\n\nWrite the finding as a clear claim you could be wrong about: \"Participants who abandoned onboarding did so at the data import step.\" Vague findings (\"onboarding is a pain point\") can't have negative cases.\n\n### 2. Count who supports it, and who doesn't\n\nFor each finding, list the participants whose data supports it. Everyone else is a potential negative case, including people who never mentioned the topic. Silence isn't contradiction, but it's worth checking.\n\n### 3. Search on purpose\n\nGo back to the transcripts of the participants outside the supporting group. Look for direct contradictions (\"import was the easy part\"), different explanations for the same outcome, and the same conditions with a different outcome.\n\n### 4. Examine each negative case\n\nRead the whole transcript, not just the passage. Ask what is different about this person: their role, tenure, plan, context, timing or the way the question was asked.\n\n### 5. Decide what it means\n\nEach negative case usually lands in one of four places:\n\n- **It sets a boundary.** The finding holds, but only for a defined group. Narrow the claim.\n- **It suggests a better explanation.** The exception fits a different, more general explanation that also covers the original cases. Replace the finding.\n- **It's a genuine outlier.** Something unusual explains it, and the pattern still holds. Note it and say why.\n- **It reveals an analysis problem.** The theme was too broad, or the question was leading. Fix the coding or flag the limitation.\n\n### 6. Revise and repeat\n\nRewrite the finding and check it again against all the data. Repeat until the remaining exceptions are explained.\n\n### 7. Collect more data if you need to\n\nIf negative cases point to a segment you only have two or three people from, recruit more of them. This is where negative case analysis becomes part of theoretical sampling: you deliberately seek the cases most likely to challenge your current understanding, a form of [purposive sampling](/docs/purposive-sampling-guide).\n\n### 8. Report the exceptions\n\nSay how many participants supported each finding, describe the negative cases and explain how they shaped the final claim. A sentence like \"Three participants described the opposite experience; all had set up with a dedicated admin\" adds credibility, not doubt.\n\n## A worked example\n\nA team runs 30 interviews about why customers downgrade. The first pass suggests a clear theme: **price**. Twenty participants mention cost.\n\nNegative case analysis starts with the other ten. Reading their transcripts, the team finds that seven downgraded after a champion left the company, and price never came up. Going back to the twenty \"price\" cases, they notice that twelve of them also mention a champion leaving, and that price only became an issue once nobody internally could explain the value.\n\nThe revised finding: **customers downgrade when they lose an internal champion; price is the reason given, not the cause.** That changes the response from a discount to a champion-replacement playbook, and it came entirely from looking at the people the first finding didn't fit.\n\n## Common mistakes\n\n- **Treating silence as support.** A participant who didn't mention a theme isn't evidence for it.\n- **Explaining away every exception.** If each negative case gets its own special story, the finding may simply be wrong.\n- **Dropping exceptions from the report.** Hiding them makes findings look stronger and less trustworthy at once.\n- **Waiting until the end.** Negative cases are most useful while you can still change your interview guide or recruit more participants.\n- **Confusing rare with wrong.** A theme mentioned by few people isn't a negative case. A negative case contradicts a pattern.\n\n## Negative case analysis with Koji\n\nKoji runs AI-moderated voice and text interviews and builds a report across them, which makes the search for exceptions much faster.\n\n- **See who supports a finding, and who doesn't.** Each finding in a Koji report shows how many participants back it, such as 11 of 42, with a button to view the supporting responses. Everyone outside that group is where you start looking for negative cases. See [tracing report findings to evidence](/docs/tracing-report-findings-to-evidence).\n- **Read the whole interview.** Open any participant's interview to see their summary, key findings and full transcript, so you judge an exception in context, not from one quote.\n- **Spot outliers in structured answers.** When a study includes [structured questions](/docs/structured-questions-guide), sort the responses table by an answer to find the people whose rating or choice cuts against the pattern, then read what they said in the follow-ups.\n- **Check segments.** The report's personas tab groups participants into types. A negative case that matches a persona is a boundary, not noise.\n- **Ask about the exceptions next.** If negative cases point to a group you're short of, add a follow-up question or a screening question and run a second round. You can [duplicate a study](/docs/duplicating-a-study) to keep the original brief.\n\n![Koji report summary with a side panel of supporting participant quotes behind one finding](/email/shots/shot-evidence-panel.jpg \"Start with the supporting responses, then read the participants who are not in them\")\n\n## Related Resources\n\n- [Structured questions in AI interviews](/docs/structured-questions-guide): find outliers in ratings and choices quickly\n- [Qualitative research validity and reliability](/docs/qualitative-research-validity): the wider set of credibility techniques\n- [Tracing report findings to evidence](/docs/tracing-report-findings-to-evidence): see exactly who supports each finding\n- [Member checking in qualitative research](/docs/member-checking-qualitative-research): test findings with participants\n- [Template analysis](/docs/template-analysis-qualitative): building and revising a coding template\n- [Writing insight statements](/docs/writing-insight-statements): phrase findings precisely enough to test\n","category":"Research Methods","lastModified":"2026-10-13T04:50:11.428905+00:00","metaTitle":"Negative Case Analysis in Qualitative Research: A Guide | Koji","metaDescription":"What negative case analysis is, where it comes from, and eight steps to test your findings against the participants who don't fit, with a worked example.","keywords":["negative case analysis","deviant case analysis","disconfirming evidence qualitative research","analytic induction","qualitative research credibility","negative case analysis example"],"aiSummary":"Negative case analysis is a qualitative research technique in which the researcher deliberately searches for participants or data that contradict an emerging finding, examines each one, and revises the finding until it accounts for the exceptions or the exceptions are explained. It grew out of analytic induction (Znaniecki, 1934; Lindesmith, 1947; Cressey, 1953) and was named by Lincoln and Guba (Naturalistic Inquiry, 1985) as a credibility technique. Each negative case sets a boundary, suggests a better explanation, is a genuine outlier, or reveals an analysis problem. In Koji, report findings show how many participants support them, which shows where to look for exceptions.","aiPrerequisites":["A set of interview findings or emerging themes","Access to the underlying transcripts"],"aiLearningOutcomes":["Define negative case analysis and its origins in analytic induction","Search systematically for disconfirming cases","Decide what each negative case means for a finding","Report exceptions in a way that builds credibility","Use Koji reports and structured answers to find exceptions quickly"],"aiDifficulty":"intermediate","aiEstimatedTime":"10 minutes"}],"pagination":{"total":1,"returned":1,"offset":0}}