Do coefficients of variation of response propensities approximate non-response biases during survey data collection?

2021
We evaluate the utility of coefficients of variation of response propensities (CVs) as measures of risks of survey variable non-response biases when monitoring survey data collection. CVs quantify variation in sample response propensities estimated given a set of auxiliary attribute covariates observed for all subjects. If auxiliary covariates and survey variables are correlated, low levels of propensity variation imply low bias risk. CVs can also be decomposed to measure associations between auxiliary covariates and propensity variation, informing collection method modifications and post-collection adjustments to improve dataset quality. Practitioners are interested in such approaches to managing bias risks, but risk indicator performance has received little attention. We describe relationships between CVs and expected biases and how they inform quality improvements during and post-data collection, expanding on previous work. Next, given auxiliary information from the concurrent 2011 UK census and details of interview attempts, we use CVs to quantify the representativeness of the UK Labour Force Survey dataset during data collection. Following this, we use survey data to evaluate inference based on CVs concerning survey variables with analogues measuring the same quantities among the auxiliary covariate set. Given our findings, we then offer advice on using CVs to monitor survey data collection.
JOURNAL OF THE ROYAL STATISTICAL SOCIETY SERIES A-STATISTICS IN SOCIETY
页码:301-323|卷号:184|期号:1
ISSN:0964-1998
收录类型
SSCI
发表日期
2021
学科领域
循证社会科学-方法
国家
英国
语种
英语
DOI
10.1111/rssa.12624
其他关键词
IMPROVING REPRESENTATIVENESS; HOUSEHOLD SURVEYS; INDICATORS; DESIGN; NONCONTACT; REFUSAL; MODELS; RATES
EISSN
1467-985X
资助机构
ESRC National Centre for Research MethodsUK Research & Innovation (UKRI)Economic & Social Research Council (ESRC) [ES/L008351/1]; ESRC Administrative Research Centre for England (ADRCE) [ES/L007517/1]; ESRCUK Research & Innovation (UKRI)Economic & Social Research Council (ESRC) [ES/S007253/1, ES/L007517/1, ES/R009139/1] Funding Source: UKRI
资助信息
ESRC National Centre for Research Methods, Grant/Award Number: ES/L008351/1; ESRC Administrative Research Centre for England (ADRCE), Grant/Award Number: ES/L007517/1
被引频次(WOS)
0
被引更新日期
2022-01
来源机构
University of Essex University of Southampton
关键词
non‐ response bias representativeness indicators adaptive survey designs phase capacity data collection efficiency savings