TY - GEN
T1 - Interactive and Iterative Peer Assessment
AU - Dery, Lihi
N1 - Publisher Copyright:
© 2024 The Authors.
PY - 2024/10/16
Y1 - 2024/10/16
N2 - Iterative peer grading activities may keep students engaged during in-class project presentations.Effective methods for collecting and aggregating peer assessment data are essential.Students tend to grade projects favorably.So, while asking students for numeric grades is a common approach, it often leads to inflated grades across all projects, resulting in numerous ties for the top grades.Additionally, students may strategically assign lower grades to others' projects so that their projects will shine.Alternatively, requesting students to rank all projects from best to worst presents challenges due to limitations in human cognitive capacity.To address these issues, we propose a novel peer grading model consisting of (a) an algorithm designed to elicit student evaluations and (b) a median-based voting protocol for aggregating grades to a single ranked order that reduces ties.An application based on our model was deployed and tested in a university course, demonstrating fewer ties between alternatives and a significant decrease in students' cognitive and communication burdens.
AB - Iterative peer grading activities may keep students engaged during in-class project presentations.Effective methods for collecting and aggregating peer assessment data are essential.Students tend to grade projects favorably.So, while asking students for numeric grades is a common approach, it often leads to inflated grades across all projects, resulting in numerous ties for the top grades.Additionally, students may strategically assign lower grades to others' projects so that their projects will shine.Alternatively, requesting students to rank all projects from best to worst presents challenges due to limitations in human cognitive capacity.To address these issues, we propose a novel peer grading model consisting of (a) an algorithm designed to elicit student evaluations and (b) a median-based voting protocol for aggregating grades to a single ranked order that reduces ties.An application based on our model was deployed and tested in a university course, demonstrating fewer ties between alternatives and a significant decrease in students' cognitive and communication burdens.
UR - http://www.scopus.com/inward/record.url?scp=85213332572&partnerID=8YFLogxK
U2 - 10.3233/FAIA240656
DO - 10.3233/FAIA240656
M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???
AN - SCOPUS:85213332572
T3 - Frontiers in Artificial Intelligence and Applications
SP - 1519
EP - 1526
BT - ECAI 2024 - 27th European Conference on Artificial Intelligence, Including 13th Conference on Prestigious Applications of Intelligent Systems, PAIS 2024, Proceedings
A2 - Endriss, Ulle
A2 - Melo, Francisco S.
A2 - Bach, Kerstin
A2 - Bugarin-Diz, Alberto
A2 - Alonso-Moral, Jose M.
A2 - Barro, Senen
A2 - Heintz, Fredrik
PB - IOS Press BV
T2 - 27th European Conference on Artificial Intelligence, ECAI 2024
Y2 - 19 October 2024 through 24 October 2024
ER -