Optimizing Measurement Reliability in Within-Person Research: Guidelines for Research Design and R Shiny Web Application Tools

Yang, LQ (通讯作者),Portland State Univ, Dept Psychol, POB 751, Portland, OR 97207 USA.;Wang, W (通讯作者),CUNY, Psychol Program, Grad Ctr, 365 5th Ave, New York, NY 10016 USA.
2022-12
Within-person research has become increasingly popular over recent years in the field of organizational studies for its unique theoretical and methodological advantages for studying dynamic intrapersonal processes (e.g., Dalal et al., Journal of Management 40:1396-1436, 2014; McCormick et al., Journal of Management 46:321-350, 2020). Despite the advancements, there remain serious challenges for many organizational researchers to fully appreciate and appropriately implement within-person research-more specifically, to correctly conceptualize and compute the within-person measurement reliability, as well as navigate key within-person research design factors (e.g., number of measurement occasions, T; number of participants, N; and scale length, I) to optimize within-person reliability. By conducting a comprehensive Monte Carlo simulation with 3240 data conditions, we offer a practical guideline table showing the expected within-person reliability as a function of key design factors. In addition, we provide three easy-to-use, free R Shiny web applications for within-person researchers to conveniently (a) compute expected within-person reliability based on their customized research design, (b) compute observed validity based on the expected reliability and hypothesized within-person validity, and (c) compute observed within-person (as well as between-person) reliability from collected within-person research datasets. We hope these much-needed evidence-based guidelines and practical tools will help enhance within-person research in organizational studies.
JOURNAL OF BUSINESS AND PSYCHOLOGY
卷号:37|期号:6|页码:1141-1156
ISSN:0889-3268|收录类别:SSCI
语种
英语
来源机构
Portland State University; City University of New York (CUNY) System; National Chengchi University
资助信息
This research was supported by the grant T03OH008435 awarded to Portland State University, funded by the Centers for Disease Control and Prevention, National Institute for Occupational Safety and Health. Its contents are solely the responsibility of the authors and do not necessarily represent the official views of NIOSH, CDC, or HHS. This research is also supported by the National Science Foundation under Grant awarded to Wei Wang (No. 16406229). Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do notnecessarily reflect the views of the National Science Foundation.
被引频次(WOS)
1
被引频次(其他)
1
180天使用计数
0
2013以来使用计数
1
EISSN
1573-353X
出版年
2022-12
DOI
10.1007/s10869-022-09803-5
学科领域
循证经济学
关键词
Within-person research Level-specific alpha Reliability R shiny web application Validity
资助机构
Centers for Disease Control and Prevention, National Institute for Occupational Safety and Health(United States Department of Health & Human ServicesCenters for Disease Control & Prevention - USANational Institute for Occupational Safety & Health (NIOSH)) National Science Foundation(National Science Foundation (NSF))
WOS学科分类
Business Psychology, Applied