TY - JOUR
T1 - Correlating peer and tutor assessment on a low-stakes engineering assignment
AU - Montalvão, Diogo
AU - Baker, Thomas
PY - 2015/7
Y1 - 2015/7
N2 - Peer-assessment has been a subject of great debate in recent years. The way students perceive assessment and what motivates them when assessing, may differ significantly from the tutor. This paper discusses a study designed to correlate student’s marking with the marks awarded by their tutors when peer-assessing one another from in-class oral presentations. A new and alternative approach to correlate results is presented, which is based on the normalisation of the quantitative judgements based on determined criteria. The methodology was blind and holistic, as described in previous works: some guidelines were provided to the students on what is considered acceptable without getting into detail (holistic marking) and peer-assessment marks were made confidential (blind approach). It was observed that students have a tendency to overrate fellow students - especially where lower marks might be awarded. There is, however, direct agreement with the tutor’s marking in terms of qualitative judgements, which is highlighted by the presented correlation method used to adjust students marks. The presented methodology to correlate marks between the students and tutor showed to be a promising one. After processing the data with this simple and straightforward algorithm, peer- and tutor assessment practically showed a perfect match.
AB - Peer-assessment has been a subject of great debate in recent years. The way students perceive assessment and what motivates them when assessing, may differ significantly from the tutor. This paper discusses a study designed to correlate student’s marking with the marks awarded by their tutors when peer-assessing one another from in-class oral presentations. A new and alternative approach to correlate results is presented, which is based on the normalisation of the quantitative judgements based on determined criteria. The methodology was blind and holistic, as described in previous works: some guidelines were provided to the students on what is considered acceptable without getting into detail (holistic marking) and peer-assessment marks were made confidential (blind approach). It was observed that students have a tendency to overrate fellow students - especially where lower marks might be awarded. There is, however, direct agreement with the tutor’s marking in terms of qualitative judgements, which is highlighted by the presented correlation method used to adjust students marks. The presented methodology to correlate marks between the students and tutor showed to be a promising one. After processing the data with this simple and straightforward algorithm, peer- and tutor assessment practically showed a perfect match.
U2 - 10.1177/0306419015603008
DO - 10.1177/0306419015603008
M3 - Article
SN - 0306-4190
VL - 43
SP - 168
EP - 179
JO - International Journal of Mechanical Engineering Education
JF - International Journal of Mechanical Engineering Education
ER -