Bar chart
How 100 Delphi studies handled consensus
A bar chart from a 2014 systematic review by Diamond and colleagues of 100 Delphi studies. 98 said they assessed consensus, but only 72 defined it, and the most common definition was percent agreement with a median threshold of 75%. Use it as a reminder to write down your consensus threshold and stopping rule before the first round. Koji can run each round as AI-moderated voice or text interviews with scale and ranking questions.
Where this appears
What's in this bar chart
| Delphi studies | |
|---|---|
| Studies reviewed | 100 |
| Said they assessed consensus | 98 |
| Defined what consensus meant | 72 |
The most common measure was percent agreement, with a median threshold of 75%.
Use this image
Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:
html
<a href="https://www.koji.so/visuals/delphi-studies-defining-consensus-diamond-2014"><img src="https://www.koji.so/visuals/delphi-studies-defining-consensus-diamond-2014/delphi-studies-defining-consensus-diamond-2014.png" alt="Bar chart of a review of 100 Delphi studies: 98 said they assessed consensus, but only 72 defined what consensus meant." width="1200" height="630" /></a>
<p>Source: <a href="https://www.koji.so/visuals/delphi-studies-defining-consensus-diamond-2014">How 100 Delphi studies handled consensus</a>, Koji</p>
