Estimating individual-level interaction effects in multilevel models: a Monte Carlo simulation study with application

2018
Moderated multiple regression provides a useful framework for understanding moderator variables. These variables can also be examined within multilevel datasets, although the literature is not clear on the best way to assess data for significant moderating effects, particularly within a multilevel modeling framework. This study explores potential ways to test moderation at the individual level (level one) within a 2-level multilevel modeling framework, with varying effect sizes, cluster sizes, and numbers of clusters. The study examines five potential methods for testing interaction effects: the Wald test, F-test, likelihood ratio test, Bayesian information criterion (BIC), and Akaike information criterion (AIC). For each method, the simulation study examines Type I error rates and power. Following the simulation study, an applied study uses real data to assess interaction effects using the same five methods. Results indicate that the Wald test, F-test, and likelihood ratio test all perform similarly in terms of Type I error rates and power. Type I error rates for the AIC are more liberal, and for the BIC typically more conservative. A four-step procedure for applied researchers interested in examining interaction effects in multi-level models is provided.
JOURNAL OF APPLIED STATISTICS
页码:2238-2255|卷号:45|期号:12
ISSN:0266-4763
收录类型
SSCI
发表日期
2018
学科领域
循证社会科学-方法
国家
美国
语种
英语
DOI
10.1080/02664763.2017.1414163
其他关键词
REGRESSION-ANALYSIS; DIFFERENTIAL PREDICTION; VARIANCE HETEROGENEITY; MULTIPLE-REGRESSION; POWER; HOMOGENEITY; SELECTION
EISSN
1360-0532
被引频次(WOS)
3
被引更新日期
2022-01
来源机构
Indiana University System Indiana University Bloomington
关键词
Multilevel modeling moderation Monte Carlo study model fit interactions hierarchical linear modeling