All frameworks and cheat sheets

Comparison

Marking criteria on paper vs in practice

What two studies of UK assessors found

Comparison of how marking criteria are presented to students with how UK assessors used them in practice, in studies by Bloxham and colleagues.
The gap students notice when marks do not match the rubric Source: Bloxham, Boyd and Orr 2011, and Bloxham et al. 2016, studies of UK assessors

A side-by-side comparison of how marking criteria are usually presented to students and how experienced UK assessors used them in two studies by Sue Bloxham and colleagues: holistic first judgements, criteria used to check a mark afterwards, different choices and weights between markers, and comparison with other work. It helps programme teams and quality officers explain why a clear rubric does not guarantee consistent marks, and what course evaluations can and cannot show about it.

What's in this comparison

How criteria are presented

  • Markers apply each written criterion in turn
  • The criteria mean the same thing to every marker
  • Each piece is judged against the standard alone
  • The rubric explains the mark

How markers used them

  • Most judged the work as a whole first
  • Criteria often used afterwards to check or justify a mark
  • Markers chose, ranked and scored criteria differently
  • Work was also compared with other work in the pile

Use this image

Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:

html
<a href="https://www.koji.so/visuals/marking-criteria-written-vs-in-use-comparison"><img src="https://www.koji.so/visuals/marking-criteria-written-vs-in-use-comparison/marking-criteria-written-vs-in-use-comparison.png" alt="Comparison of how marking criteria are presented to students with how UK assessors used them in practice, in studies by Bloxham and colleagues." width="1200" height="642" /></a>
<p>Source: <a href="https://www.koji.so/visuals/marking-criteria-written-vs-in-use-comparison">Marking criteria on paper vs in practice</a>, Koji</p>