Checklist
Before round one of an employer Delphi panel
Nine decisions that make an employer Delphi study defensible in programme review
A checklist for programme directors and quality leads planning a Delphi study with employers as part of a programme review. It covers the question, who counts as an expert, the consensus and stopping rules, response rates, dissent and what happens with the result. It follows the reporting points in the CREDES guidance. Koji can run the open first round as interviews and later rounds as rating studies.
What's in this checklist
- Tie the panel question to the programme's intended learning outcomes
- Write down who counts as an expert before you recruit
- Recruit across sectors and organisation sizes
- Include line managers of recent graduates, not only senior leaders
- Set the consensus threshold before round one
- Set a stopping rule: a fixed number of rounds or consensus reached
- Plan to record response rates in every round
- Decide how items where the panel stays split will be reported
- Agree what the programme team will do with the result, and tell the panel
Use this image
Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:
html
<a href="https://www.koji.so/visuals/employer-delphi-panel-checklist-programme-review"><img src="https://www.koji.so/visuals/employer-delphi-panel-checklist-programme-review/employer-delphi-panel-checklist-programme-review.png" alt="Checklist of nine decisions to make before round one of an employer Delphi panel, from the question and consensus rule to dissent and follow-up." width="1200" height="706" /></a>
<p>Source: <a href="https://www.koji.so/visuals/employer-delphi-panel-checklist-programme-review">Before round one of an employer Delphi panel</a>, Koji</p>
