Survey-based cross-country comparisons where countries vary in sample design: issues and solutions

Publication type

Journal Article

Authors

Publication date

March 15, 2017

Summary:

In multi-national surveys different countries usually implement different sample designs. The sample designs affect the variance of estimates of differences between countries. When making such estimates, analysts often fail to take sample design appropriately into account. This failure is sometimes because variables indicating stratification, clustering or weighting are unavailable, partially available, or in a form unsuitable for cross-national analysis. In this article we demonstrate how complex sample design should be taken into account when estimating differences between countries and we provide practical guidance to analysts and to data producers on how to deal with partial or inappropriately-coded sample design indicator variables. Using EU-SILC as a case study, we evaluate the inverse mis-specification effect (imeff) that results from ignoring clustering or stratification or both in a between-country comparison where countries’ sample designs differ. We present imeff for estimates of between-country differences in a number of demographic and economic variables for 19 European Union member states. We assess the magnitude of imeff and the associated impact on standard error estimates. Our empirical findings illustrate that it is important for data producers to supply appropriate sample design indicators and for analysts to use them.

Published in

Journal of Official Statistics

Volume and page numbers

Volume: 33 , p.123 -136

DOI

http://doi.org/10.1515/jos-2017-0007

ISSN

20017367

Subject

Link

- http://repository.essex.ac.uk/18601/

#524086

News

Latest findings, new research

Publications search

Search all research by subject and author

Podcasts

Researchers discuss their findings and what they mean for society

Projects

Background and context, methods and data, aims and outputs

Events

Conferences, seminars and workshops

Survey methodology

Specialist research, practice and study

Taking the long view

ISER's annual report

Themes

Key research themes and areas of interest