Checklist
Auditing course comments for gendered language
A checklist for quality and evaluation leads who want to check open-text course evaluation comments for gendered language before they reach appraisal or promotion files. It follows patterns found in studies from Iceland, Denmark and Australia: women judged on care and men on expertise, title differences and remarks on appearance. Koji groups interview answers into themes with the quotes behind them, which makes the comparison quicker to run.
What's in this checklist
- Code comments by topic before you score how positive they are
- Compare theme mix across lecturers on similar modules and class sizes
- Count first names versus titles in how lecturers are named
- Flag remarks on appearance or personality and keep them out of appraisal files
- Check whether gaps come mainly from one group of students
- Remove abusive comments before reports go out, and log that you did
- Test any sentiment tool on swapped he and she sentences before trusting it
Use this image
Free to use in your docs, decks and posts under CC BY 4.0, as long as you credit Koji with a link to this page. To embed it, paste this into your page:
html
<a href="https://www.koji.so/visuals/gendered-language-course-comments-audit-checklist"><img src="https://www.koji.so/visuals/gendered-language-course-comments-audit-checklist/gendered-language-course-comments-audit-checklist.png" alt="Checklist for auditing course evaluation comments for gendered language, from comparing themes by lecturer to removing abusive comments before reports go out." width="1200" height="632" /></a>
<p>Source: <a href="https://www.koji.so/visuals/gendered-language-course-comments-audit-checklist">Auditing course comments for gendered language</a>, Koji</p>
