Skip to content

Journal Article

Cross-validating administrative and survey datasets through microsimulation

Authors

Publication date

2011

Summary

In this paper we cross-validate two sources of data, administrative and sample survey, addressing an issue commonly faced by analysts regarding the relative reliability and comparability of these two data sources. By way of case study, the paper uses data presently available in the Grand-Duchy of Luxembourg. While administrative data extracted from the recently implemented Social Security Data Warehouse contains information about the whole population of Luxembourg (449,000 observations) in 2003, survey data, extracted from the Luxembourg household panel PSELL3/EU-SILC for 2004 (incomes from 2003), provides a representative sample of only around 3,600 private households (9,800 individuals) living in Luxembourg. The attraction of the survey is the more detailed information it provides on incomes, family relationships and other socio-economic dimensions. Our paper first analyzes the advantages and limitations of each dataset, before outlining and addressing methodological difficulties relating to their cross-validation. Through the cross-validation that follows we conclude that the survey database performs reasonably well in capturing the relevant characteristics of the resident population and allows analyses with respect to characteristics not found in the administrative database, and vice versa. Importantly we find that even if, on average, some monetary variables are different in the two datasets, the shapes of the equivalised income distributions broadly coincide. Even so, we observe a few important discrepancies at the extremes of the curves. Finally, through use of the EUROMOD microsimulation platform, we are able to show that the discrepancies observed between these income data sources are insufficient to significantly affect the conclusions drawn from analysis of policy alternatives.

Published in

International Journal of Microsimulation

Volume and page numbers

4 , 54 -71

ISSN

16

Subjects

Welfare Benefits and Microsimulation

Links

http://www.microsimulation.org/ijm/issues/volume-41-spring-2011/


Related publications

  1. Cross-validating administrative and survey datasets through microsimulation and the assessment of a tax reform in Luxembourg

    Philippe LiƩgeois, Frederic Berger, Nizamul Islam, et al.

    1. Welfare Benefits
    2. Microsimulation

#520773


Research home

Research home

News

Latest findings, new research

Publications search

Search all research by subject and author

Podcasts

Researchers discuss their findings and what they mean for society

Projects

Background and context, methods and data, aims and outputs

Events

Conferences, seminars and workshops

Survey methodology

Specialist research, practice and study

Taking the long view

ISER's annual report

Themes

Key research themes and areas of interest