Comparison
Rating vs ranking questions in course evaluation
What each format shows, and what it hides
A side by side comparison of rating and ranking questions for course evaluation, based on the values measurement studies by Alwin and Krosnick and by Maio and colleagues. It is for quality teams deciding how to ask students about course components. Use ratings for evidence that a standard was met and a short ranking to set improvement priorities. Koji supports both question types in one study.
What's in this comparison
Rating questions
- Show how good each part was on its own
- Answer whether a standard was met
- Let students give everything the same score
- Work with averages and correlations
Ranking questions
- Show which part students would change first
- Force a choice when ratings hit the ceiling
- Hide absolute level: all good and all poor can match
- Need rank methods, not rating-style correlations
- Work best with short lists of about six items
Use this image
Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:
html
<a href="https://www.koji.so/visuals/rating-vs-ranking-questions-course-evaluation"><img src="https://www.koji.so/visuals/rating-vs-ranking-questions-course-evaluation/rating-vs-ranking-questions-course-evaluation.png" alt="Comparison of rating and ranking questions in course evaluation, listing what each format shows about a course and what each one hides." width="1200" height="709" /></a>
<p>Source: <a href="https://www.koji.so/visuals/rating-vs-ranking-questions-course-evaluation">Rating vs ranking questions in course evaluation</a>, Koji</p>
