Is there order in the mess? A single paper meta-analysis approach to identification of predictors of success in learning analytics

Saqr, M (通讯作者),Univ Eastern Finland, Sch Comp, Joensuu Campus,Yliopistokatu 2, FI-80100 Joensuu, Finland.
2022-12-2
Predictors of student academic success do not always replicate well across different learning designs, subject areas, or educational institutions. This suggests that characteristics of a particular discipline and learning design have to be carefully considered when creating predictive models in order to scale up learning analytics. This study aimed to examine if and to what extent frequently used predictors of study success are portable across a homogenous set of courses. The research was conducted in an integrated blended problem-based curriculum with trace data (n = 2,385 students) from 50 different course offerings across four academic years. We applied the statistical method of single paper meta-analysis to combine correlations of several indicators with students' success. Total activity and the forum indicators exhibited the highest prediction intervals, where the former represented proxies of the overall engagement with online tasks, and the latter with online collaborative learning activities. Indicators of lecture reading (frequency of lecture view) showed statistically insignificant prediction intervals and, therefore, are less likely to be portable across course offerings. The findings show moderate amounts of variability both within iterations of the same course and across courses. The results suggest that the use of the meta-analytic statistical method for the examination of study success indicators across courses with similar learning design and subject area can offer valuable quantitative means for the identification of predictors that reasonably well replicate and consequently can be reliably portable in the future.
STUDIES IN HIGHER EDUCATION
卷号:47|期号:12|页码:2370-2391
ISSN:0307-5079|收录类别:SSCI
语种
英语
来源机构
University of Eastern Finland; University of Belgrade; Royal Institute of Technology; Monash University; University of Edinburgh
被引频次(WOS)
1
被引频次(其他)
1
180天使用计数
4
2013以来使用计数
10
EISSN
1470-174X
出版年
2022-12-2
DOI
10.1080/03075079.2022.2061450
WOS学科分类
Education & Educational Research
学科领域
循证教育学
关键词
Learning analytics meta-analysis reproducibility portability student success