All frameworks and cheat sheets

Comparison

Voluntary vs required ratings of the same product

Comparison of ratings for one music CD: voluntary Amazon ratings are J-shaped with over 60% extreme and a 3.54 mean, required ratings normal with a 3.12 mean.
Same product, same question. Only who chose to answer changed. Source: Hu, Pavlou and Zhang, MIS Quarterly 41(2), 2017

Results from a study by Nan Hu, Paul Pavlou and Jennifer Zhang that rated one music CD two ways: the voluntary ratings on Amazon, and ratings from an experiment where everyone had to answer. Voluntary ratings came out J-shaped, with more than 60% at 1 or 5 stars and a mean of 3.54. Required ratings were roughly normal, with over 90% moderate and a mean of 3.12. It shows self-selection inflating and polarising feedback.

Where this appears

What's in this comparison

Voluntary ratings (Amazon)

  • J-shaped, bimodal distribution
  • More than 60% of ratings at 1 or 5 stars
  • Under 40% moderate (2, 3 or 4 stars)
  • Mean score of 3.54

Required ratings (experiment)

  • Roughly normal distribution
  • Under 10% of ratings at 1 or 5 stars
  • Over 90% moderate (2, 3 or 4 stars)
  • Mean score of 3.12

Use this image

Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:

html
<a href="https://www.koji.so/visuals/voluntary-vs-required-ratings-same-product"><img src="https://www.koji.so/visuals/voluntary-vs-required-ratings-same-product/voluntary-vs-required-ratings-same-product.png" alt="Comparison of ratings for one music CD: voluntary Amazon ratings are J-shaped with over 60% extreme and a 3.54 mean, required ratings normal with a 3.12 mean." width="1200" height="630" /></a>
<p>Source: <a href="https://www.koji.so/visuals/voluntary-vs-required-ratings-same-product">Voluntary vs required ratings of the same product</a>, Koji</p>