All frameworks and cheat sheets

Reference table

What each evaluation score is fit for

Table comparing a single global rating with a dimension profile across five evaluation decisions, from screening courses to promotion reviews
A global item can flag a course. Only a profile with comments tells a teacher what to change. Source: Based on Marsh and Roche 1997, d'Apollonia and Abrami 1997, Cashin and Downey 1992

This table maps five common uses of student evaluation data to the score that suits each one. It is meant for quality assurance leads and committees revising how evaluation results are reported. Use it to check whether your reporting template puts the right score in front of each decision. Koji can help collect the profile and probed comments half through conversational interviews with structured scale items.

What's in this reference table

DecisionSingle global ratingProfile with comments
Screening many courses for a closer lookFit for purpose, show response count and spreadPossible, but more than the job needs
Telling a teacher what to changeNot fit, it has no directionFit for purpose, points at a specific dimension
Mid-semester formative checkToo blunt to act onFit for purpose, comments explain low scores
Spotting where bias may have enteredHidden inside one numberPartly visible across dimensions
Contract or promotion decisionsNot fit on its ownOne input among several, never alone

Use this image

Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:

html
<a href="https://www.koji.so/visuals/global-rating-vs-dimension-profile-what-each-score-is-fit-for"><img src="https://www.koji.so/visuals/global-rating-vs-dimension-profile-what-each-score-is-fit-for/global-rating-vs-dimension-profile-what-each-score-is-fit-for.png" alt="Table comparing a single global rating with a dimension profile across five evaluation decisions, from screening courses to promotion reviews" width="1200" height="745" /></a>
<p>Source: <a href="https://www.koji.so/visuals/global-rating-vs-dimension-profile-what-each-score-is-fit-for">What each evaluation score is fit for</a>, Koji</p>