Evaluating relative mode effects on data quality in mixed-mode surveys

Publication type

Journal Article

Authors

Publication date

June 1, 2013

Summary:

In order to compare data-quality of different data-collection modes, multitrait-multimethod (MTMM) experiments have been implemented in a mixed-mode experiment parallel to the European Social Survey (ESS) fourth round (2008/2009). Special interest lies in measurement effects between the modes which refer to the pure impact of a data-collection mode on the quality. Nevertheless, mere comparison between quality estimates of the different modes does not allow drawing conclusions about measurement effects. Indeed, measurement effects may be completely confounded with selection effects which refer to differences in respondents’ compositions across the modes. However, by comparing the mixed-mode data with the main ESS data and treating the dataset of origin as an instrumental variable, some conditional measurement effects and selection effects can be disentangled. This paper provides a preliminary exploratory analysis of this approach. The results generally yield low to fair measurement effects while the selection effects on some items are rather large.

Published in

Survey Research Methods

Volume and page numbers

Volume: 7 , p.157 -168

ISSN

18643361

Subject

Link

https://ojs.ub.uni-konstanz.de/srm/article/view/5137

Notes

Open Access journal

#522081

News

Latest findings, new research

Publications search

Search all research by subject and author

Podcasts

Researchers discuss their findings and what they mean for society

Projects

Background and context, methods and data, aims and outputs

Events

Conferences, seminars and workshops

Survey methodology

Specialist research, practice and study

Taking the long view

ISER's annual report

Themes

Key research themes and areas of interest