Interactive and Iterative Peer Assessment

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Iterative peer grading activities may keep students engaged during in-class project presentations.Effective methods for collecting and aggregating peer assessment data are essential.Students tend to grade projects favorably.So, while asking students for numeric grades is a common approach, it often leads to inflated grades across all projects, resulting in numerous ties for the top grades.Additionally, students may strategically assign lower grades to others' projects so that their projects will shine.Alternatively, requesting students to rank all projects from best to worst presents challenges due to limitations in human cognitive capacity.To address these issues, we propose a novel peer grading model consisting of (a) an algorithm designed to elicit student evaluations and (b) a median-based voting protocol for aggregating grades to a single ranked order that reduces ties.An application based on our model was deployed and tested in a university course, demonstrating fewer ties between alternatives and a significant decrease in students' cognitive and communication burdens.

Original languageEnglish
Title of host publicationECAI 2024 - 27th European Conference on Artificial Intelligence, Including 13th Conference on Prestigious Applications of Intelligent Systems, PAIS 2024, Proceedings
EditorsUlle Endriss, Francisco S. Melo, Kerstin Bach, Alberto Bugarin-Diz, Jose M. Alonso-Moral, Senen Barro, Fredrik Heintz
PublisherIOS Press BV
Pages1519-1526
Number of pages8
ISBN (Electronic)9781643685489
DOIs
StatePublished - 16 Oct 2024
Event27th European Conference on Artificial Intelligence, ECAI 2024 - Santiago de Compostela, Spain
Duration: 19 Oct 202424 Oct 2024

Publication series

NameFrontiers in Artificial Intelligence and Applications
Volume392
ISSN (Print)0922-6389
ISSN (Electronic)1879-8314

Conference

Conference27th European Conference on Artificial Intelligence, ECAI 2024
Country/TerritorySpain
CitySantiago de Compostela
Period19/10/2424/10/24

Fingerprint

Dive into the research topics of 'Interactive and Iterative Peer Assessment'. Together they form a unique fingerprint.

Cite this