All frameworks and cheat sheets

Comparison

Rating feedback vs evaluating feedback

Comparison of rating assessment feedback with a satisfaction item versus evaluating it by use, timing, consistent source labels and students' reasons.
When AI helps write feedback, a satisfaction score partly measures the label, so check what students did with it

A side by side view of two ways to judge assessment feedback. A satisfaction item tells you how useful students believe feedback was, which research shows shifts when they learn AI wrote it. Evaluating feedback by whether students used it, asked soon after it is returned and with the source described the same way to everyone, gives a fairer picture. Koji's short follow-up interviews can collect the reasons and examples behind the score.

What's in this comparison

Rating the feedback

  • How useful students think it was
  • Shaped by who they believe wrote it
  • Asked once, at the end of the module
  • One number per item, with no reasons

Evaluating the feedback

  • Whether students used it on the next task
  • Source shown the same way to every student
  • Asked soon after the feedback is returned
  • Reasons and examples in students' own words

Use this image

Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:

html
<a href="https://www.koji.so/visuals/rating-vs-evaluating-assessment-feedback-ai-source"><img src="https://www.koji.so/visuals/rating-vs-evaluating-assessment-feedback-ai-source/rating-vs-evaluating-assessment-feedback-ai-source.png" alt="Comparison of rating assessment feedback with a satisfaction item versus evaluating it by use, timing, consistent source labels and students' reasons." width="1200" height="630" /></a>
<p>Source: <a href="https://www.koji.so/visuals/rating-vs-evaluating-assessment-feedback-ai-source">Rating feedback vs evaluating feedback</a>, Koji</p>