An Articulated Approach to the Development and Evaluation of Automated Feedack for Online MCQ Quizzes in Human Biology
Document Type
Conference Proceeding
Publisher
University of Sydney
Faculty
Faculty of Computing, Health and Science
School
School of Exercise, Biomedical and Health Science
RAS ID
4928
Abstract
This paper describes an articulated programme of development and evaluation of automatically-presented explanatory feedback comments for online, enriched-multiple choice style quizzes in Human Biology for first year university courses. The degree of articulation of the separate components of the programme arose almost unintentionally from the inclusion of common sets of demographic questions in several of the components of the work, and from continuity of logon identities, but proved to be a powerful means of reaching an understanding of the dynamics of student engagement with the online learning process and of the effectiveness of the product we were testing. In particular, links were established between expectations of academic performance and the amount of paid employment in which students were engaged, and between expected and achieved levels of performance. Students who expected lower levels of performance at the outset were also less convinced of the potential of feedback to help them with their studies. Analysis of the patterns of use of the online test revealed a serious disadvantage to working students of current accessibility to online summative assessments, and that the standard duration of the summative tests was approximately three times the preferred online work span of the younger students. ‘Dose’ and ‘decay’-graded selective improvements in end of semester assessments in the topics covered by the feedback comments could be demonstrated.
Access Rights
Free_to_read
Comments
Meyer, J., Fyfe, S., Fyfe, G., Ziman, M. R., Plastow, K., Sanders, K., & Hill, J. (2007). An articulated approach to the development and evaluation of automated feedack for online MCQ quizzes in Human Biology. Proceedings of 2007 National Uniserve Conference. (pp. 52-57). Sydney. University of Sydney. Available here