Can targeted cover letters improve participation in health surveys? Results from a randomized controlled trial

Publication type

Journal Article

Authors

Publication date

July 17, 2019

Summary:

Background:

Improving response rates in epidemiologic studies is important for the generalizability of the outcome. The aim of this study was to examine whether it can be advantageous for participation to target different versions of the cover letters to different sample subgroups.
Methods:

A randomized trial was incorporated in a cross-sectional health survey in Denmark (n = 25,000) where a motivational sentence in the cover letter intended to heighten perceptions of relevance of the survey was varied among 11 sample subgroups (treatment groups). Ten different versions of a sentence outlining questionnaire themes were tested: each mentioned three out of five themes: stress, alcohol, sex, sleep problems, and contact with family and friends. An eleventh group, the control group, omitted this sentence.
Results:

On average, the additional motivational sentence resulted in a significantly lower response rate overall compared to the control group. However, the additional motivational sentence was found to have heterogeneous effects on survey response. Furthermore, the nature of the heterogeneity differed between the versions of the sentence. Specifically, the additional sentence tended to produce a higher response rate among the youngest age group and a lower response rate in the oldest age group compared to the generic letter. The use of alcohol in the motivational sentence tended to have a positive effect on response in the age group 16–24 years, and stress tended to have a positive effect in the age group ≥65 years. On the contrary, sex tended to have a negative effect in the age groups 45–64 years and ≥ 65 years. However, a significant interaction was only found between the use of stress and age group (p = < 0.0001).
Conclusion:

The findings of significant and heterogeneous effects suggest that there is potential for a targeted approach to improve both response rates and sample composition. The uneven effect of the separate themes across age groups suggests that the selection of themes to be included in the motivational sentence is important for the use of targeted appeals to be successful and warrants further research to better identify which themes works in which contexts, in which subgroups and under which circumstances.

Published in

BMC Medical Research Methodology

Volume

Volume: 19:151

DOI

https://doi.org/10.1186/s12874-019-0799-4

ISSN

14712288

Subjects

Notes

Open Access

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

#525852

News

Latest findings, new research

Publications search

Search all research by subject and author

Podcasts

Researchers discuss their findings and what they mean for society

Projects

Background and context, methods and data, aims and outputs

Events

Conferences, seminars and workshops

Survey methodology

Specialist research, practice and study

Taking the long view

ISER's annual report

Themes

Key research themes and areas of interest