Title

Designing Online Information Systems for Portfolio-Based Assessment: Design Criteria and Heuristics

Document Type

Conference Proceeding

Publisher

Informing Science Institute

Faculty

Computing, Health and Science

School

Engineering

RAS ID

1647

Comments

This article was originally published as: Love, T. , & Cooper, T. (2003). Designing Online Information Systems for Portfolio-Based Assessment: Design Criteria and Heuristics. Proceedings of Informing Science + IT Education (INSITE) Conference. Pori, Finland. Informing Science Institute. Original article available here

Abstract

This paper reports the main findings of an exploratory investigation into the key factors necessary to designing information systems for online portfolio-based assessment in tertiary, professional, secondary and primary education that maximize benefits for all stakeholders. A review of contemporary practice in designing online portfolio assessment systems showed a widespread neglect of several key factors necessary to formulating designs that maximize benefits for all stakeholders. In addition, it was found that design processes were marked by an over-emphasis on technical issues to facilitate implementation rather than addressing the primary educational goals. The result is online portfolio systems that fall significantly short of their potential, and, in many cases, are inferior to conventional portfolio assessment and other more traditional assessment approaches. The paper identifies key design factors necessary for successful conceptual design of online portfolio information systems that maximize benefits for all stakeholders. Initial design heuristics are outlined for designing online portfolio assessment information systems that provide improvements on conventional portfolio assessment and other assessment modalities for all stakeholders.