Checklist
Pre-analysis plan checklist for a teaching change
A one-page checklist for programme leads and educational developers who want to judge a teaching change on course evaluation data without fooling themselves. Fill it in before the evaluation window closes, date it and share it, then report any analysis you add later as exploratory. It adapts the logic of pre-registration from research practice to everyday quality work. Koji's fixed structured questions and consistent quality screening make the same measures repeatable across cohorts.
What's in this checklist
- The question: what changed, for which students, compared with what
- The primary outcome, and the single measure that decides it
- Secondary outcomes, labelled as secondary
- The comparison cohort or baseline you will use
- Which responses you will exclude, and why
- The subgroups you will check, named in advance
- The size of change that would count as meaningful
- What you will do if the result is null or negative
- The date, and where colleagues can read the plan
Use this image
Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:
html
<a href="https://www.koji.so/visuals/teaching-change-evaluation-pre-analysis-plan-checklist"><img src="https://www.koji.so/visuals/teaching-change-evaluation-pre-analysis-plan-checklist/teaching-change-evaluation-pre-analysis-plan-checklist.png" alt="Checklist of nine things to write down before you look at course evaluation data for a teaching change, from the primary outcome to exclusion rules." width="1080" height="1080" /></a>
<p>Source: <a href="https://www.koji.so/visuals/teaching-change-evaluation-pre-analysis-plan-checklist">Pre-analysis plan checklist for a teaching change</a>, Koji</p>
