{"site":{"name":"Koji","description":"AI-native customer research platform that helps teams conduct, analyze, and synthesize customer interviews at scale.","url":"https://www.koji.so","contentTypes":["blog","documentation"],"lastUpdated":"2026-09-21T16:50:02.772Z"},"content":[{"type":"documentation","id":"ebb30ced-56a1-45af-9e14-d6b1791ea7c1","slug":"extreme-case-formulations-interview-analysis","title":"Always, Never, Everyone: What Extreme Wording Actually Signals (2026)","url":"https://www.koji.so/docs/extreme-case-formulations-interview-analysis","summary":"An extreme case formulation names a maximum case (always, never, everybody). Pomerantz (1986, Human Studies) identified three uses: asserting the strongest case in anticipation of a non-sympathetic hearing, proposing a cause, and speaking for the rightness of a practice. None is a frequency report. Edwards (2000, RLSI) calls ECFs factually brittle because a single counterexample refutes them, and notes that softened versions (mostly, almost) are logically weaker but rhetorically more robust. The inversion for analysts: the punchy absolute quote is the least defensible sentence in the transcript, and an unprompted softening deserves more weight, not less. ECFs are overwhelmingly unsoftened and unchallenged, showing participants treat them as rhetoric. Probe with when did that last happen to convert rhetoric into a datable incident. Koji runs that probe automatically during the interview.","content":"*It never works.* *Everybody on my team complains about it.* *I spend my entire day in this tool.*\n\nThese are the quotes that end up on the slide, because they are vivid and they sound decisive. They are also, taken literally, almost always false -- and the speakers know it. **The extremity is not a claim about frequency. It is a claim about how much resistance the speaker expects to meet.**\n\nAnita Pomerantz named this pattern in a 1986 paper in Human Studies: the **extreme case formulation**, an expression that names a maximum case of the matter at hand. *All the time*, *everybody*, *no one*. Once you can see them, you will find them clustered in exactly one place in your transcripts -- around complaints and justifications -- and you will stop reading them as measurements.\n\n## What an extreme case formulation is\n\n### The vocabulary\n\nDerek Edwards, in a 2000 paper in Research on Language and Social Interaction, lists the working set: *all*, *none*, *most*, *every*, *least*, *absolutely*, *completely*, and their relatives. The function is to defend or justify a description or an assessment, particularly where the speaker anticipates a challenge.\n\nThat last clause is the whole finding. An ECF is deployed against an imagined objection. Its presence in a transcript is evidence that the participant expected to be doubted.\n\n### Pomerantz's three uses\n\nHer account identifies three jobs these formulations do:\n\n- **Asserting the strongest case in anticipation of a non-sympathetic hearing.** The speaker braces for disagreement and overshoots to leave room to be argued down.\n- **Proposing the cause of a phenomenon.** Extremity is used to make a causal claim sound inevitable rather than contingent.\n- **Speaking for the rightness or wrongness of a practice.** The formulation carries a moral position, not a count.\n\nTo legitimize a complaint and portray a situation as worth complaining about, a speaker may describe the offence or the suffering in extreme terms. None of these three uses is a frequency report. All three are routinely coded as one.\n\n## The inversion: the softened claim is the stronger one\n\nHere is where analytic instinct gets it backwards.\n\n### Extreme claims are factually brittle\n\nEdwards describes ECFs as **factually brittle**, for a precise reason: a single counterexample refutes them. *It never works* is defeated the moment anyone produces one occasion where it worked. The claim is maximally vivid and minimally defensible.\n\nSpeakers can manage that brittleness by **softening** -- *mostly*, *almost*, *nearly always*, *hardly anyone*. A softened formulation is a logically weaker claim, and it is for that very reason more robust: there is no cheap counterexample that kills it.\n\nSo rank the two on the dimension that matters for your report. The punchy absolute quote is the fragile one. The hedged version is the one that survives scrutiny. An analyst who reaches for *it never works* over *it almost never works* has systematically selected the least defensible sentence in the transcript, because it was the most quotable.\n\n### What you can actually bank\n\nThe practical consequence is a reversal of the usual weighting. When a participant softens a claim unprompted, treat that as a signal of care rather than of weakness -- they have made a statement you can defend. When a participant produces an unsoftened extreme, treat it as a strong signal about **stance and investment** and a weak signal about **magnitude**.\n\nEdwards also observes that ECFs are overwhelmingly left unsoftened and overwhelmingly go unchallenged by recipients, which is itself evidence that everyone in the conversation is treating them as rhetoric rather than as arithmetic. Everyone, that is, except the analysis pipeline downstream.\n\n## What to do when you hear one\n\n### Probe for the incident, not the number\n\nDo not argue with an ECF and do not accept it. Convert it. The move that works is to ask for a specific occasion: *when did that last happen?* or *tell me about the most recent time.*\n\nThis is productive for two reasons. It replaces an unfalsifiable formulation with a datable event you can count and compare across participants. And it does so without challenging the participant, because you are treating their claim as true and asking for detail -- which is the only way to probe a defensive formulation without triggering more defence.\n\n### Do not tally extremes as frequencies\n\nIf your analysis counts *always* and *never* as literal quantifiers, extreme wording will distort severity rankings in a specific direction: issues that participants feel defensive about will outrank issues that are merely frequent. The fix is to record the ECF as a marker of stance, and to source magnitude from a question designed to measure it.\n\nThere is a second finding hiding in the pattern, and it is often the better one. A cluster of extreme formulations around a topic means participants expect not to be believed about it. That usually means they have raised it before and been dismissed. That is a genuine, reportable insight about the relationship -- just not the one you were about to write down.\n\n## Where this stops and the hedging article starts\n\nThree boundaries.\n\nThis article is about the **participant's** wording inside an answer. The analyst's own hedging, when writing a finding they cannot fully support, is a different discipline covered in [the graded hedge](/docs/research-modified-conclusions).\n\nIt is also the opposite case from [conversational implicature](/docs/conversational-implicature-interview-answers), which covers what an answer conveys by saying **too little**. An ECF says too much. Both are places where the literal text and the intended meaning diverge, and they diverge in opposite directions.\n\nFinally, an ECF produced because your question invited it is a question-design problem; see [avoiding leading questions](/docs/avoiding-leading-questions).\n\n## How Koji handles this\n\nExtreme formulations are best dealt with during the interview, while the participant is still available to be asked *when did that last happen?* -- which is exactly the moment a survey tool has already lost.\n\n- **AI follow-ups convert rhetoric into incidents.** Koji's AI interviewer probes vague and absolute answers automatically, asking for the specific recent occasion behind a sweeping claim. A traditional form -- SurveyMonkey, Typeform, Qualtrics -- records *it never works* and stops there. Koji comes back with the follow-up a good moderator would have asked, on every interview, without scheduling anyone.\n- **Structured questions measure magnitude properly.** Never source a frequency from an open-ended answer if the frequency matters. Koji supports six question types -- open_ended, scale, single_choice, multiple_choice, ranking, and yes_no. Use open_ended for the story and the stance, and a scale or single_choice question for how often it actually happens. The [structured questions guide](/docs/structured-questions-guide) covers combining them in a single study.\n- **Counting stays honest.** Koji reports themes with the underlying evidence attached, so a theme that looks severe can be traced back to whether it was severe or merely emphatic. How you count themes changes the ranking more than most teams expect, which is the subject of [counting themes by mention or by participant](/docs/correct-output-wrong-configuration-research).\n- **Quotes keep their context.** Because every quote in a Koji report links to its passage, a reviewer can see whether an extreme statement was softened two sentences later -- the softening that gets stripped when a quote is lifted.\n\n## Frequently asked questions\n\n### What is an extreme case formulation?\n\nIt is a description that names a maximum case -- *always*, *never*, *everybody*, *nobody*, *completely*. Pomerantz identified it in 1986. Its function is to defend or legitimize a claim the speaker expects to be challenged, which makes it evidence about anticipated resistance rather than about frequency.\n\n### Does never really mean never?\n\nAlmost never, and the speaker does not intend it to. Extreme formulations are treated as rhetoric by everyone in the conversation: recipients rarely challenge them, and speakers rarely soften them. Treat one as a strong statement of stance and a weak statement of magnitude.\n\n### Should I quote the extreme version or the softened one?\n\nThe softened one, if you want a finding that survives review. An unsoftened extreme is factually brittle -- one counterexample defeats it -- while *almost never* has no cheap refutation. The most quotable sentence in a transcript is frequently the least defensible one in it.\n\n### How do I probe an extreme claim without arguing?\n\nAsk for the most recent instance: *when did that last happen?* You are accepting the claim and requesting detail, which avoids triggering further defensiveness, and you get back a datable event you can actually count. Koji's AI interviewer runs this probe automatically.\n\n### What does a cluster of extreme wording tell me?\n\nThat participants expect not to be believed about that topic, which usually means they have raised it before and been dismissed. That is a real finding about the customer relationship, and it is separate from whatever the literal complaint was about.\n\n### How does Koji stop this from skewing my results?\n\nBy probing absolute answers during the interview instead of leaving them for the analyst, and by giving you structured question types for anything where magnitude matters. Koji also keeps every quote linked to its surrounding passage, so a stripped-out extreme can be checked against what the participant said next.\n\n## Related Resources\n\n- [Structured questions in AI interviews](/docs/structured-questions-guide) -- the six question types, and why frequency should never come from an open-ended answer.\n- [What participants mean but never say](/docs/conversational-implicature-interview-answers) -- the opposite failure, where the answer says too little.\n- [The graded hedge](/docs/research-modified-conclusions) -- hedging on your side of the report rather than the participant's.\n- [Probing questions in user interviews](/docs/probing-questions-user-interviews) -- turning a sweeping claim into a specific incident.\n- [Counting themes by mention or by participant](/docs/correct-output-wrong-configuration-research) -- how a counting choice reorders your severity ranking.\n- [Avoiding leading questions](/docs/avoiding-leading-questions) -- making sure the extremity did not come from your own wording.\n","category":"Research Methods","lastModified":"2026-09-21T03:24:06.640404+00:00","metaTitle":"Extreme Case Formulations in Interview Analysis","metaDescription":"When a participant says it never works, the extremity signals expected resistance, not frequency. How to analyse it.","keywords":["extreme case formulations","always never everyone","interview analysis","participant hedging","pomerantz","qualitative coding","severity ranking"],"aiSummary":"An extreme case formulation names a maximum case (always, never, everybody). Pomerantz (1986, Human Studies) identified three uses: asserting the strongest case in anticipation of a non-sympathetic hearing, proposing a cause, and speaking for the rightness of a practice. None is a frequency report. Edwards (2000, RLSI) calls ECFs factually brittle because a single counterexample refutes them, and notes that softened versions (mostly, almost) are logically weaker but rhetorically more robust. The inversion for analysts: the punchy absolute quote is the least defensible sentence in the transcript, and an unprompted softening deserves more weight, not less. ECFs are overwhelmingly unsoftened and unchallenged, showing participants treat them as rhetoric. Probe with when did that last happen to convert rhetoric into a datable incident. Koji runs that probe automatically during the interview.","aiPrerequisites":["Experience coding qualitative interview transcripts","Familiarity with building severity or priority rankings from research"],"aiLearningOutcomes":["Identify extreme case formulations in a transcript","Explain why softened claims are more defensible than absolute ones","Probe an absolute claim without triggering defensiveness","Avoid tallying extreme wording as frequency data"],"aiDifficulty":"intermediate","aiEstimatedTime":"12 min"}],"pagination":{"total":1,"returned":1,"offset":0}}