Simulating the consequences of adaptive survey design in two household panel studies

Publication type

Journal Article

Authors

Publication date

September 15, 2023

Summary:

Adaptive survey design has been proposed as a solution to the decreasing response rates and higher costs associated with surveys. Much of the adaptive survey design research to date focuses on cross-sectional surveys, yet it seems there is greater potential for this approach within longitudinal surveys as data on the respondent and their survey experience builds each wave. We consider the short- to medium-term impacts of modifications to fieldwork processes in the context of two household panels. We use waves 11–16 of the Household, Income and Labour Dynamics in Australia (HILDA) Survey and waves 1–6 of the UK Household Longitudinal Study (also known as Understanding Society) to simulate eight alternative follow-up strategies. Cases are targeted based on their likelihood to improve sample balance (representativeness), as measured by the R-indicator, or to provide a response, or a combination of these components. Both individual- and household-level targeting are considered. We assess the extent to which these adjustments to fieldwork efforts impact the response rates, sample representativity, and cost. We find that if the follow-up fieldwork effort were reduced by 25 percent the least detrimental strategy is where the best households in terms of improving the R-indicator or the response rates are issued to field for follow-up. This approach resulted in the same sample balance as obtained with full follow-up practice, saved between 17 and 25 percent of follow-up calls but dropped the full balanced panel response rate over four years by 8–12 percentage points.

Published in

Journal of Survey Statistics and Methodology

Volume and page numbers

Volume: 11 , p.806 -828

DOI

https://doi.org/10.1093/jssam/smab050

ISSN

23250984

Subjects

#567922

News

Latest findings, new research

Publications search

Search all research by subject and author

Podcasts

Researchers discuss their findings and what they mean for society

Projects

Background and context, methods and data, aims and outputs

Events

Conferences, seminars and workshops

Survey methodology

Specialist research, practice and study

Taking the long view

ISER's annual report

Themes

Key research themes and areas of interest