Checklist
Checklist: filter questions in course evaluations
Seven checks for skip logic that students can learn to use as a shortcut
A checklist for quality and institutional research staff who run course evaluations with skip logic. It turns survey experiments on motivated misreporting, where respondents answer no to filter questions to shorten the survey, into seven checks you can apply to an existing form. Use it when reviewing a questionnaire or reading a sudden drop in yes answers. Koji avoids filter-and-skip branching by asking every student the same key questions in a short conversation.
What's in this checklist
- List every filter question that opens extra items when a student answers yes
- Count how many filters come before the last follow-up block
- Compare yes rates for similar filters early and late in the form
- Check filter answers against records you already hold, such as lab enrolment
- Keep follow-up items short, since harder follow-ups widen the gap
- If you ask all filters first, watch for missing answers to the follow-ups
- Report how many students saw each follow-up, not only the average
Use this image
Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:
html
<a href="https://www.koji.so/visuals/filter-question-misreporting-checklist-course-evaluation"><img src="https://www.koji.so/visuals/filter-question-misreporting-checklist-course-evaluation/filter-question-misreporting-checklist-course-evaluation.png" alt="Checklist of seven checks for filter questions in course evaluations, from listing filters and comparing yes rates to reporting follow-up counts." width="1200" height="632" /></a>
<p>Source: <a href="https://www.koji.so/visuals/filter-question-misreporting-checklist-course-evaluation">Checklist: filter questions in course evaluations</a>, Koji</p>
