{"site":{"name":"Koji","description":"AI-native customer research platform that helps teams conduct, analyze, and synthesize customer interviews at scale.","url":"https://www.koji.so","contentTypes":["blog","documentation"],"lastUpdated":"2026-10-13T11:50:29.360Z"},"content":[{"type":"documentation","id":"4a0cdcee-3c42-430e-8a1f-f53ed8dd4d16","slug":"nominal-group-technique","title":"Nominal Group Technique: Steps, Examples and When to Use It","url":"https://www.koji.so/docs/nominal-group-technique","summary":"The nominal group technique (NGT) is a structured meeting for generating ideas and agreeing priorities, developed by Andre Delbecq and Andrew Van de Ven in 1971. It has four stages: silent generation, round robin, clarification and private voting or ranking. It works because people think and vote alone, which avoids the productivity loss of open brainstorming: Diehl and Stroebe (1987) found nominal groups outperformed real groups in 18 of 22 experiments they reviewed. Groups of five to nine are typical, and the output is a ranked list of priorities.","content":"# Nominal Group Technique: Steps, Examples and When to Use It\n\n**The short answer:** the nominal group technique (NGT) is a structured meeting for generating ideas and agreeing priorities. A small group answers one question in four stages: everyone writes ideas **silently**, the facilitator collects them **round-robin**, the group **clarifies** each one, and then everyone **votes or ranks** privately. Andre Delbecq and Andrew Van de Ven developed it in 1971 to get the benefits of a group without the usual problems of open discussion, where the loudest or most senior person sets the agenda. Use it when you need a ranked list a group actually agrees on, such as the top problems in onboarding or the features customers care about most.\n\nThe name explains the idea. The group is a group in name only (nominal) for the most important parts of the session: people think and vote alone, and only come together to share and clarify.\n\n## Where NGT comes from\n\nDelbecq and Van de Ven introduced the method in \"A Group Process Model for Problem Identification and Program Planning\" (_Journal of Applied Behavioral Science_, 1971). They developed it from social-psychology research on group decision-making, and later wrote it up as a practical guide with David Gustafson in _Group Techniques for Program Planning: A Guide to Nominal Group and Delphi Processes_ (1975).\n\nIt spread fastest in health care, education and public services, where planners needed to get doctors, patients, managers and community members to agree on priorities without one group drowning out another. The CDC still publishes an evaluation brief, \"Gaining Consensus Among Stakeholders Through the Nominal Group Technique\", which describes it as \"a structured variation of a small-group discussion to reach consensus.\"\n\nFor product and research teams it fills a useful gap. It is faster than a [Delphi study](/docs/delphi-method-guide), more rigorous than a whiteboard session, and it produces a ranked output instead of a pile of sticky notes.\n\n## Why structure beats open brainstorming\n\nThe case for NGT rests on decades of evidence that unstructured group brainstorming produces fewer ideas than the same number of people working alone.\n\n- **Nominal groups out-produce real groups.** Michael Diehl and Wolfgang Stroebe reviewed the research in \"Productivity Loss in Brainstorming Groups: Toward the Solution of a Riddle\" (_Journal of Personality and Social Psychology_, 1987). Of the 22 experiments they tabulated, 18 found nominal groups (people working alone, with their ideas pooled) superior to real groups.\n- **The main cause is waiting your turn.** In their own four experiments, Diehl and Stroebe tested free riding, fear of evaluation and production blocking. Production blocking, where people forget or drop ideas while others are talking, accounted for most of the productivity loss.\n- **The loss grows with group size.** Brian Mullen, Craig Johnson and Eduardo Salas's meta-analysis (_Basic and Applied Social Psychology_, 1991) found brainstorming groups produced less than nominal groups in both quantity and quality, with bigger losses in larger groups.\n- **NGT itself was tested early.** Van de Ven and Delbecq compared 20 nominal groups, 20 Delphi groups and 20 conventional discussion groups of seven people each (_Academy of Management Journal_, 1974). Both NGT and Delphi were more effective than conventional group discussion.\n\nNGT's silent generation step removes production blocking: everyone writes at once. The private vote removes the pressure to agree with the most senior person in the room. The round-robin makes sure quiet participants' ideas get the same airtime as everyone else's.\n\n## The four steps of the nominal group technique\n\nSinead McMillan, Michelle King and Mary Tully summarise the method in \"How to use the nominal group and Delphi techniques\" (_International Journal of Clinical Pharmacy_, 2016): it \"comprises four key stages: silent generation, round robin, clarification and voting (ranking or rating).\"\n\n![Process showing the four steps of the nominal group technique: silent generation, round robin, clarification and private voting](/visuals/nominal-group-technique-four-steps/nominal-group-technique-four-steps.png \"Each step fixes a known weakness of open group discussion · Source: Andre Delbecq and Andrew Van de Ven\")\n\n### Step 1: Silent generation\n\nThe facilitator presents one clear question, in writing, and each participant writes as many answers as they can without talking. McMillan and colleagues note that participants are typically given up to twenty minutes. Ten is usually enough for a focused question.\n\nThe question carries the whole session, so test it beforehand. Good NGT questions are specific and open: \"What makes it hard to get your team using a new tool in its first month?\" works. \"What do you think of our product?\" does not.\n\n### Step 2: Round robin\n\nGoing around the table, each person reads out one idea at a time, and the facilitator writes it up exactly as said, numbered. Nobody debates at this stage. The round continues until every idea is on the board. Participants can pass and come back in, and can add new ideas that someone else's sparked.\n\n### Step 3: Clarification\n\nThe group goes through the list, item by item. The goal is shared understanding, not persuasion: anyone can ask what an item means, and the author explains. Duplicates are merged with the agreement of the people who wrote them. Keep the facilitator strict here; this is where open discussion tends to creep back.\n\n### Step 4: Voting and ranking\n\nEach person privately chooses their top items and ranks them. A common rule, used in the CDC's guidance, is to rank the top five, giving 5 points to the most important and 1 to the least. The facilitator adds up the scores. Items with the highest totals, and the number of people who picked them, show the group's priorities.\n\nSome teams run a short discussion of the results and a second vote, especially when the scores are close. That is fine, as long as the second vote is also private.\n\n## Planning a session\n\n**Group size.** The CDC brief suggests a room for five to nine participants. McMillan and colleagues note that NGT studies have used groups of between two and fourteen people, but that a maximum of seven has been recommended. If you have more people, run several groups on the same question and combine the votes.\n\n**Who to invite.** Mix the perspectives you need to agree, such as customers from different segments, or sales, support and product. Avoid putting someone's manager in the same group if you can; the private vote helps, but the clarification step still feels different with the boss in the room.\n\n**Time.** Plan for 60 to 90 minutes for one question: roughly ten minutes of silent writing, 20 to 30 minutes of round robin, 20 minutes of clarification and ten minutes for the vote and results.\n\n**Materials.** One written question, cards or forms for silent writing, a board everyone can see and a ranking sheet. For remote sessions, a shared document and a private form for the vote work well.\n\n![Table comparing the nominal group technique, Delphi method, focus groups and open brainstorming by format, anonymity, output and best use](/visuals/nominal-group-technique-vs-delphi-focus-groups/nominal-group-technique-vs-delphi-focus-groups.png \"Pick the format by the output you need: a ranked list, expert consensus or rich discussion\")\n\n## Running the session\n\nThe facilitator's job is mostly to protect the structure. A few habits help:\n\n![A small group sitting around a table with sticky notes, sharing ideas one at a time while a facilitator writes them up](https://images.unsplash.com/photo-1632835254999-b0041c859303?crop=entropy&cs=tinysrgb&fit=max&fm=jpg&ixid=M3w5NDUzMDN8MHwxfHNlYXJjaHwzfHxzbWFsbCUyMHRlYW0lMjBtZWV0aW5nJTIwdGFibGUlMjBzdGlja3klMjBub3Rlc3xlbnwxfDB8fHwxNzkxODcwNjExfDA&ixlib=rb-4.1.0&q=80&w=1080)\n\n_Photo by [Redmind Studio](https://unsplash.com/@redmind_studio?utm_source=koji&utm_medium=referral) on [Unsplash](https://unsplash.com/?utm_source=koji&utm_medium=referral)_\n\n- **Read the question aloud and leave it visible** for the whole session.\n- **Write ideas in the participant's words.** Rewording them in the round robin quietly shifts ownership to the facilitator.\n- **Keep the round robin moving.** One idea per person per turn stops one prolific person from filling the board.\n- **Stop arguments in clarification.** \"Let's note that you disagree; the vote will show us where the group lands.\"\n- **Show the scores straight away.** People trust the result more when they watch it being counted.\n\n## Examples for product and research teams\n\n- **Prioritising onboarding problems.** Six recently onboarded customers answer \"What slowed you down in your first two weeks?\" and rank the top five. The ranked list goes straight into the next quarter's onboarding work.\n- **Aligning internal teams on churn reasons.** Sales, support and product each run one NGT session on \"Why do customers leave in their first year?\" Comparing the three ranked lists shows where the teams' pictures of churn differ, which is useful input for a round of [churned customer interviews](/docs/churned-customer-interviews).\n- **Choosing research questions.** A research team and its stakeholders use NGT to agree which three questions next quarter's studies should answer.\n- **Feature priorities with a customer advisory board.** Board members silently list the problems they most want solved and rank them, so the loudest customer does not set the roadmap.\n\n## Strengths and limitations\n\n**Strengths.** Every participant contributes equally. It produces a ranked, numeric output in one session. It is cheap and easy to learn. Results are easy to explain to stakeholders because the counting is transparent.\n\n**Limitations.** It handles one question at a time. The ranked list tells you _what_ the group values, not _why_, so it needs follow-up research to explain the top items. A small group can only represent so much, so treat results as the view of that group, not your whole market. And the structure can feel rigid to people used to free discussion.\n\nNGT is related to [dot voting](/docs/dot-voting-prioritization-guide), which shares the private-priority idea but usually skips silent generation and clarification. Compared with [focus groups](/docs/focus-group-research-guide), it gives up depth of discussion in exchange for equal voice and a clear ranking.\n\n## How Koji helps\n\nKoji does not replace a live NGT meeting, but it can run the parts of the method that work better one person at a time, and do it with far more people than fit in a room.\n\n- **Silent generation at scale.** An AI-moderated interview asks every participant the same open question, by voice or text, alone and in their own time, which is the same condition that makes NGT's first step work. The interviewer follows up on vague answers so each idea is clear, which covers much of what the clarification step does.\n- **Private ranking.** Add a ranking question to the study and participants drag the items into order. The report shows each item's average position, so you get the same kind of ranked output as an NGT vote. Multiple choice and scale questions work for top-five picks and importance ratings. See the [structured questions guide](/docs/structured-questions-guide).\n- **A two-round design.** Run an open study first to collect ideas, then [duplicate the study](/docs/duplicating-a-study) and add the merged list as a ranking question for a second round with the same or a wider group.\n- **Automatic themes.** Koji's analysis groups open answers into themes across interviews, with the quotes behind each one, which gives you a first draft of the merged idea list.\n- **Screening questions** keep each round to the people whose priorities you need.\n\n![Koji research report with participant, duration, themes and quality stats above a summary of findings](/email/shots/shot-report.jpg \"Themes from the open round arrive grouped, with the quotes behind each one\")\n\nThe trade-off is fair to state: a live NGT session builds shared ownership in the room, which a remote study does not. Many teams use both, running Koji to gather and rank ideas from dozens of customers, then a short live NGT session with internal stakeholders to agree what to do about the top items.\n\n## Related Resources\n\n- [The Delphi method](/docs/delphi-method-guide)\n- [Dot voting for prioritisation](/docs/dot-voting-prioritization-guide)\n- [Focus group research](/docs/focus-group-research-guide)\n- [Ranking vs rating questions](/docs/ranking-vs-rating-questions)\n- [Choice and ranking questions](/docs/choice-ranking-questions-guide)\n- [Structured questions guide](/docs/structured-questions-guide)\n\n## Sources\n\n- Andre L. Delbecq and Andrew H. Van de Ven, \"A Group Process Model for Problem Identification and Program Planning\", _Journal of Applied Behavioral Science_ 7(4), 1971.\n- Andre L. Delbecq, Andrew H. Van de Ven and David H. Gustafson, _Group Techniques for Program Planning: A Guide to Nominal Group and Delphi Processes_, Scott, Foresman, 1975.\n- Andrew H. Van de Ven and Andre L. Delbecq, \"The Effectiveness of Nominal, Delphi, and Interacting Group Decision Making Processes\", _Academy of Management Journal_ 17(4), 1974.\n- Michael Diehl and Wolfgang Stroebe, \"Productivity Loss in Brainstorming Groups: Toward the Solution of a Riddle\", _Journal of Personality and Social Psychology_ 53(3), 1987.\n- Brian Mullen, Craig Johnson and Eduardo Salas, \"Productivity Loss in Brainstorming Groups: A Meta-Analytic Integration\", _Basic and Applied Social Psychology_ 12(1), 1991.\n- Sinead S. McMillan, Michelle King and Mary P. Tully, \"How to use the nominal group and Delphi techniques\", _International Journal of Clinical Pharmacy_ 38, 2016.\n- Centers for Disease Control and Prevention, \"Gaining Consensus Among Stakeholders Through the Nominal Group Technique\", Evaluation Brief No. 7.\n","category":"Research Methods","lastModified":"2026-10-13T05:50:11.499324+00:00","metaTitle":"Nominal Group Technique: 4 Steps, Examples and Tips | Koji","metaDescription":"Learn the four steps of the nominal group technique (silent generation, round robin, clarification, voting), how to run a session and when to use it.","keywords":["nominal group technique","nominal group technique steps","ngt method","nominal group technique vs delphi","nominal group technique example","group prioritization method","consensus method"],"aiSummary":"The nominal group technique (NGT) is a structured meeting for generating ideas and agreeing priorities, developed by Andre Delbecq and Andrew Van de Ven in 1971. It has four stages: silent generation, round robin, clarification and private voting or ranking. It works because people think and vote alone, which avoids the productivity loss of open brainstorming: Diehl and Stroebe (1987) found nominal groups outperformed real groups in 18 of 22 experiments they reviewed. Groups of five to nine are typical, and the output is a ranked list of priorities.","aiPrerequisites":["None; basic facilitation experience helps"],"aiLearningOutcomes":["Describe the four steps of the nominal group technique","Explain why silent generation beats open brainstorming","Plan group size, timing and materials for a session","Facilitate a session that keeps every voice equal","Choose between NGT, Delphi, focus groups and dot voting"],"aiDifficulty":"beginner","aiEstimatedTime":"10 min read"}],"pagination":{"total":1,"returned":1,"offset":0}}