Issues and solutions in meta-analysis of single-case design with multiple dependent variables using multilevel modeling

Baek, E (通讯作者),Texas A&M Univ, Dept Educ Psychol, 718E Harrington Tower,4225 TAMU, College Stn, TX 77843 USA.
It is common to include multiple dependent variables (DVs) in single-case experimental design (SCED) meta-analyses. However, statistical issues associated with multiple DVs in the multilevel modeling approach (i.e., possible dependency of error, heterogeneous treatment effects, and heterogeneous error structures) have not been fully investigated. In this study, we first addressed various issues caused by multiple DVs and examined current modeling practice, then proposed several modeling options for handling multiple DVs and compared their impact on parameter estimates and statistical inferences by conducting both empirical and simulation studies. The results indicated that different modeling options can lead to very different conclusions about the treatment effects, variance components, and model fit. Among the presented modeling options, modeling heterogeneity in the level-1 error structure and adding DV type as moderators had a noticeably large and consistent impact on both fixed and random effects as well as model fit. Although including DV types as an additional level had a relatively small impact compared to the other options, it was still able to alter the conclusion of the statistical inferences on the treatment effects.
JOURNAL OF EXPERIMENTAL EDUCATION
卷号:90|期号:4|页码:934-961
ISSN:0022-0973|收录类别:SSCI
语种
英语
来源机构
Texas A&M University System; Texas A&M University College Station
被引频次(WOS)
3
被引频次(其他)
3
180天使用计数
1
2013以来使用计数
7
EISSN
1940-0683
出版年
2022-7-13
DOI
10.1080/00220973.2020.1821342
学科领域
循证教育学
关键词
Autocorrelation heterogeneous error structure heterogeneous treatment effects meta-analysis of single-case experimental design multilevel modeling multiple outcomes
WOS学科分类
Education & Educational Research Psychology, Educational