Assessing the Effect of Data Collection Mode on Measurement

Publication type

Conference Paper

Series

International Statistical Institute Session

Authors

Publication date

August 22, 2007

Abstract:

In order to make informed decisions about suitable data collection designs, survey practitioners need to evaluate and quantify the potential impact of mode on data quality. Generating this type of information is however a difficult task. We review the methods typically used to assess the effects of mode on measurement and data comparability and then discuss some of the challenges, including 1) the need to avoid confounding effects, 2) the sensitivity of conclusions to methods of analysing experimental mode comparison data, 3) the difficulty of assessing whether measurement differences matter in practice, and 4) the assessment of which mode provides better measurement. We illustrate the challenges and implications of mixed modes research for survey design with examples from mode experiments conducted in the context of the European Social Survey (ESS). The paper concludes with implications for mixed mode research.


Related Publications

#518222

News

Latest findings, new research

Publications search

Search all research by subject and author

Podcasts

Researchers discuss their findings and what they mean for society

Projects

Background and context, methods and data, aims and outputs

Events

Conferences, seminars and workshops

Survey methodology

Specialist research, practice and study

Taking the long view

ISER's annual report

Themes

Key research themes and areas of interest