Aligning objectives with assessment in online courses: Integrating learning analytics and measurement theory

Barthakur, A (通讯作者),Univ South Australia, Adelaide, SA 5001, Australia.
2022-12
Well-designed online courses enhance learning experiences and allow effective development of learners' skills and knowledge. A critical factor contributing to the design of online courses in the higher education settings are well-defined learning objectives that align with course assessments and learning activities. While there are several introspective instruments to evaluate course designs, with the broader adoption of educational technologies and digital tools, there is a wealth of data that offers insights on the alignment of learning objectives to assessments. Such data has paved the way for evidence-based methods of investigating course effectiveness within higher education. This study outlines a methodology for designing and evaluating the alignment between course learning objectives and assessment activities at scale, utilising a combination of learning analytics and measurement theory approaches, more specificially exploratory multidimensional item response theory (MIRT) models. We demonstrate the proposed methodology within a professional development MOOC on leadership skills development, where we evaluate the alignemnt between course objectives and reflective writing assessments activities. Our results suggested that the alignment of the existing course objectives to assessment activities can be improved, showing the practical value of the proposed approach. The theoretical and practical implications of this research are further illustrated.
COMPUTERS & EDUCATION
卷号:190
ISSN:0360-1315|收录类别:SCIE
语种
英语
来源机构
University of South Australia; Boeing
被引频次(WOS)
0
被引频次(其他)
0
180天使用计数
9
2013以来使用计数
9
EISSN
1873-782X
出版年
2022-12
DOI
10.1016/j.compedu.2022.104603
学科领域
循证教育学
关键词
Educational assessment Learning objectives Learning analytics Multi-dimensional item response theory
WOS学科分类
Computer Science, Interdisciplinary Applications Education & Educational Research