Peer assessment encourages self-assessment, critical thinking, and collaboration. Retrofeedback involves evaluating the quality of received peer assessment for improvement purposes. Solely positive assessment lacking improvement suggestions is less useful than assessment balancing positive and negative comments with constructive suggestions.
On Moodle, two separate workshops are required for peer assessment with retrofeedback (PAWR), one for assessment and one for retrofeedback, while on ChallengeMe, these two activities are integrated into a single “Challenge”. The Moodle workshop allows the use of rubrics for evaluation. On ChallengeMe, each line of the rubric needs to be simulated on a 10-star scale, where each cluster of stars corresponds to a level ABCD of the rubric.
This study (Feb 28-May 15, 2024) compares student user experience (UX) between Moodle and ChallengeMe for PAWR. UX includes system usability (utility, perspicuity, efficiency, dependability) and user perception (quality/trustworthiness of content, clarity, trust). N=34 students submitted two assignments T1 and T2, alternating between platforms. After each assignment, UX was measured using the standardized UEQ+ questionnaire and their perception of PAWR captured using a custom questionnaire. At semester end, their platform preferences were collected via a custom questionnaire.
The data show no significant difference between Moodle and ChallengeMe in terms of UX or skills acquired. However, preferences are clear: half of the students prefer ChallengeMe for its speed and smoothness, while the other half prefers Moodle for the clarity, precision, and efficiency of the rubric. Activity setup and session moderation are easier for the instructor on ChallengeMe.
This presentation makes the following contributions:
- Comparing UX and features between Moodle and ChallengeMe for PAWR
- Discussing the integration of retrofeedback into the Moodle workshop to promote collaborative learning and enhance students’ critical skills
- Sharing an adaptable and replicable UX evaluation methodology, emphasizing the importance of UX for user acceptance.