Checklist
Screening low-effort student feedback fairly
A checklist for quality teams who filter course evaluation responses
A seven-point checklist for quality assurance staff and institutional researchers who remove careless or low-effort answers from course evaluations. Survey research shows that people who fail quality checks are not a random group, so filtering can make results less representative. The checklist keeps screening strict but transparent. Koji shows how many responses its quality score filtered out, which makes the last steps easier to do.
What's in this checklist
- Fix the screening rule before the evaluation window closes
- Screen on effort, never on opinion or criticism
- Don't use answer length as the only test
- Report how many responses were removed, per course
- Check whether removed responses come from particular groups
- For high-stakes decisions, show results with and without them
- Fix thin answers at collection: clearer prompts and follow-ups
Use this image
Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:
html
<a href="https://www.koji.so/visuals/student-feedback-quality-screening-checklist"><img src="https://www.koji.so/visuals/student-feedback-quality-screening-checklist/student-feedback-quality-screening-checklist.png" alt="Checklist for screening low-effort student feedback fairly: fix the rule in advance, screen on effort not opinion, report removals and compare groups." width="1080" height="1080" /></a>
<p>Source: <a href="https://www.koji.so/visuals/student-feedback-quality-screening-checklist">Screening low-effort student feedback fairly</a>, Koji</p>
