Beyond Average: Contemporary statistical techniques for analysing student evaluations of teaching
- Publication Type:
- Journal Article
- Citation:
- Assessment and Evaluation in Higher Education, 2019, 44 (3), pp. 338 - 360
- Issue Date:
- 2019-04-03
Open Access
Copyright Clearance Process
- Recently Added
- In Progress
- Open Access
This item is open access.
© 2018, © 2018 Informa UK Limited, trading as Taylor & Francis Group. Student evaluations of teaching (SETs) have been used to evaluate higher education teaching performance for decades. Reporting SET results often involves the extraction of an average for some set of course metrics, which facilitates the comparison of teaching teams across different organisational units. Here, we draw attention to ongoing problems with the naive application of this approach. Firstly, a specific average value may arise from data that demonstrates very different patterns of student satisfaction. Furthermore, the use of distance measures (e.g. an average) for ordinal data can be contested, and finally, issues of multiplicity increasingly plague approaches using hypothesis testing. It is time to advance the methodology of the field. We demonstrate how multinomial distributions and hierarchical Bayesian methods can be used to contextualise the SET scores of a course to different organisational units and student cohorts, and then show how this approach can be used to extract sensible information about how a distribution is changing.
Please use this identifier to cite or link to this item: