{"site":{"name":"Koji","description":"AI-native customer research platform that helps teams conduct, analyze, and synthesize customer interviews at scale.","url":"https://www.koji.so","contentTypes":["blog","documentation"],"lastUpdated":"2026-06-28T01:28:28.992Z"},"content":[{"type":"documentation","id":"4503aa38-5e2e-476a-b473-156bd204d043","slug":"nps-comment-analysis","title":"NPS Comment Analysis: Turn Open-Text Verbatims into Driver Themes","url":"https://www.koji.so/docs/nps-comment-analysis","summary":"A practical guide to analyzing NPS open-text comments. Covers standardizing a segment-aware follow-up question after the 0-10 scale (with anchor follow-ups that adapt to detractors, passives, and promoters), coding verbatims into driver themes via open and axial coding, linking drivers to score bands to find the promoter-vs-detractor delta, and trending driver frequency and sentiment over time. Explains how Koji treats the NPS comment as an open_ended question that the AI probes in the moment, then auto-codes into a canonical cross-response codebook with counts and verbatim quotes, replacing manual spreadsheet tagging.","content":"## The Bottom Line\n\nThe NPS number tells you *that* customers feel a way; the comments tell you *why*. NPS comment analysis is the process of coding those open-text verbatims into a small set of **driver themes**, then linking each theme to the scores it appears in so you can rank what actually moves your number. Done by hand, this means reading hundreds of comments and tagging them in a spreadsheet. Done with a platform like Koji, the open-text follow-up is treated as a real `open_ended` question — the AI probes \"what would move that to a 9?\", then themes every answer automatically and ties each theme back to promoters, passives, and detractors.\n\n## Why the NPS Number Alone Is a Dead End\n\nA single NPS score — say, 32 — is a thermometer, not a diagnosis. It moved from 28 last quarter; great, but *why*? Without the comments coded into drivers, you are guessing. The open-text \"What is the main reason for your score?\" question is where the real signal lives, and it is almost always the most under-analyzed field in the whole program because reading and tagging it is tedious.\n\nThe goal of comment analysis is to convert that free text into three usable things:\n\n1. **A ranked list of drivers** — the themes that show up most often\n2. **Sentiment by driver** — is \"onboarding\" praised by promoters or blamed by detractors?\n3. **Driver-to-score linkage** — which themes cluster in 9–10 vs 0–6\n\n## Step 1 — Standardize the Follow-Up Question\n\nMost weak NPS analysis starts with a weak question. After the 0–10 rating (a `scale` question), always ask an open follow-up. The best wording is segment-aware:\n\n- **Detractors (0–6):** \"What is the main reason for your score, and what would have to change?\"\n- **Passives (7–8):** \"What would it take to make this a 9 or 10?\"\n- **Promoters (9–10):** \"What do you value most — and who else would benefit?\"\n\nIn Koji you do not have to send three separate forms. Set the NPS scale with an **anchor** follow-up and the AI asks the right version automatically based on the score the participant just gave. This is the single highest-leverage upgrade to any NPS program.\n\n## Step 2 — Code Verbatims into Themes (Open + Axial Coding)\n\nManual NPS coding follows the classic two-cycle method: first **open coding** (label each comment with a short descriptive code like \"slow performance\" or \"responsive support\"), then **axial coding** (cluster near-duplicate codes into a canonical driver). The hard part at scale is consistency — two analysts code the same comment differently, and the codebook drifts.\n\nKoji performs this automatically. Each `open_ended` answer is coded into themes grounded in the participant's exact words, then near-duplicate themes are clustered into a canonical codebook *across all responses* during report aggregation. Every theme carries the count of how many people raised it and the verbatim quotes that justify it — so the analysis is both fast and auditable. (For the manual technique, see [open, axial, and selective coding](/docs/open-axial-selective-coding).)\n\n## Step 3 — Link Drivers to Score Bands\n\nA theme list is useful; a theme list *split by promoter / passive / detractor* is decisive. The question is not \"what do people mention?\" but \"what do my **detractors** mention that my **promoters** do not?\" That delta is your roadmap. Because Koji keeps each NPS answer linked to its score via stable question IDs, you can see that, for example, \"confusing setup\" appears in 41% of detractor comments and 4% of promoter comments — a clear, prioritized fix.\n\n## Step 4 — Quantify Sentiment and Trend It\n\nFor each driver, track two numbers over time: **frequency** (how often it is mentioned) and **sentiment** (positive vs negative). A driver that is rising in frequency *and* negative in sentiment is an early warning the score has not caught up to yet. Koji's sentiment and theme tracking lets you trend drivers release over release, so you catch a deteriorating driver before it drags the headline number down.\n\n## Step 5 — Close the Loop\n\nThe payoff of comment analysis is action. Use the ranked driver list to brief product and CS, fix the top detractor driver, and re-survey to confirm the theme's frequency dropped. Because the AI already captured the *specific* friction (not just \"support\" but \"support took three days to reply to billing tickets\"), the fix is concrete instead of vague.\n\n## Why AI Interviews Beat Spreadsheet Tagging\n\nTraditional NPS tools (the SurveyMonkeys and Qualtrics of the world) collect the comment and stop — the analysis is on you. The shift with an AI-native approach is twofold: the AI **probes** the comment in the moment (so the verbatim is richer), and it **codes** the comment automatically (so the analysis is instant and consistent). You get the why behind the number without a single hour of manual tagging.\n\n## A Worked Example: From 200 Comments to 5 Drivers\n\nImagine a quarter's NPS run with 200 scored responses, each with a comment. Manually, you would read all 200, invent codes as you go, re-read the first 50 because your codebook drifted, and produce a rough tally by Friday. With AI coding the flow is different:\n\n1. The 200 comments are coded into ~30 raw descriptive codes (\"slow sync\", \"great support rep\", \"confusing billing\", and so on).\n2. Near-duplicates collapse into ~5 canonical drivers: **Performance**, **Support quality**, **Billing clarity**, **Onboarding**, **Pricing**.\n3. Each driver shows its frequency and a sentiment split, plus the verbatim quotes behind it.\n4. Split by band, \"Performance\" appears in 38% of detractor comments and 6% of promoter comments — your number-one fix.\n\nWhat took a weekend now takes minutes, and the codebook is applied uniformly across all 200 instead of drifting between the first and last comment you read.\n\n## Common NPS Comment Analysis Mistakes\n\n- **Analyzing only detractors.** Promoter comments tell you what to protect and what to amplify in marketing — do not throw them away.\n- **Counting mentions without sentiment.** \"Pricing\" mentioned 40 times could be 40 complaints or 40 compliments. Always pair frequency with sentiment.\n- **Letting the codebook drift.** Manual coders invent new labels for the same idea over a long session. A consistent, auto-merged codebook fixes this.\n- **Stopping at the theme list.** A ranked driver list is not the deliverable — the fix is. Tie each top driver to an owner and re-survey to confirm the theme shrank.\n- **Ignoring the silent middle.** Passives rarely comment, so probe them deliberately (\"what would make this a 9?\") — their answers are the cheapest points to win.\n\n## From Number to Roadmap\n\nThe end state of good NPS comment analysis is a one-page picture: your score, its movement, and the three to five drivers behind it — each with a frequency, a sentiment, a band breakdown, and the verbatim quotes that make it undeniable in a stakeholder review. That artifact turns NPS from a vanity metric the leadership team glances at into a prioritized backlog the product team can act on. An AI-native platform like Koji produces it continuously, so the picture is always current rather than reconstructed once a quarter from a spreadsheet.\n\n## Related Resources\n\n- [Structured Questions Guide](/docs/structured-questions-guide) — scale and open_ended question types behind NPS\n- [NPS Survey Guide](/docs/nps-survey-guide) — running and scoring NPS end to end\n- [NPS Follow-Up Interviews](/docs/nps-follow-up-interviews) — probing detractors and promoters\n- [Verbatim Analysis Guide](/docs/verbatim-analysis-guide) — working with open-text at scale\n- [Open, Axial & Selective Coding](/docs/open-axial-selective-coding) — the manual coding method\n- [Thematic Analysis Guide](/docs/thematic-analysis-guide) — clustering codes into themes","category":"analysis","lastModified":"2026-06-27T03:20:47.692024+00:00","metaTitle":"NPS Comment Analysis: Code Verbatims into Driver Themes | Koji","metaDescription":"Analyze NPS open-text comments at scale: code verbatims into driver themes, link them to promoter/passive/detractor bands, and use AI follow-up to capture the why behind every score.","keywords":["nps comment analysis","nps verbatim analysis","analyze nps comments","nps open text analysis","nps driver analysis","nps feedback themes"],"aiSummary":"A practical guide to analyzing NPS open-text comments. Covers standardizing a segment-aware follow-up question after the 0-10 scale (with anchor follow-ups that adapt to detractors, passives, and promoters), coding verbatims into driver themes via open and axial coding, linking drivers to score bands to find the promoter-vs-detractor delta, and trending driver frequency and sentiment over time. Explains how Koji treats the NPS comment as an open_ended question that the AI probes in the moment, then auto-codes into a canonical cross-response codebook with counts and verbatim quotes, replacing manual spreadsheet tagging.","aiPrerequisites":["An NPS program collecting 0-10 scores","At least one open-text follow-up question"],"aiLearningOutcomes":["Standardize a segment-aware NPS follow-up question","Code NPS verbatims into driver themes","Link drivers to promoter, passive, and detractor bands","Trend driver frequency and sentiment over time","Replace manual comment tagging with AI auto-coding"],"aiDifficulty":"intermediate","aiEstimatedTime":"10 min read"}],"pagination":{"total":1,"returned":1,"offset":0}}