Detecting and understanding interviewer effects on survey data by using a cross-classified mixed effects location–scale model

Publication type

Journal Article

Authors

Publication date

February 15, 2017

Summary:

We propose a cross-classified mixed-effects location scale model for the analysis of interviewer effects in survey data. The model extends the standard two-way cross-classified random-intercept model (respondents nested in interviewers crossed with areas) by specifying the residual variance to be a function of covariates and an additional interviewer random effect. This extension provides a way to study interviewers’ effects on not just the ‘location’ (mean) of respondents’ responses, but additionally on their ‘scale’ (variability). It therefore allows researchers to address new questions such as: Do interviewers influence the variability of their respondents’ responses in addition to their average, and if so why? In doing so, the model facilitates a more complete and flexible assessment of the factors associated with interviewer error. We illustrate this model using data from wave 3 of the UK Household Longitudinal Survey (UKHLS), which we link to a range of interviewer characteristics measured in an independent survey of interviewers. By identifying both interviewer characteristics in general, but also specific interviewers who are associated with unusually high or low or homogeneous or heterogeneous responses, the model provides a way to inform improvements to survey quality.

Published in

Journal of the Royal Statistical Society Series A (Statistics in Society)

Volume and page numbers

Volume: 180 , p.551 -568

DOI

http://dx.doi.org/10.1111/rssa.12205

ISSN

9641998

Subject

Notes

Open Access article

Published by John Wiley & Sons Ltd on behalf of the Royal Statistical Society.

© 2016 The Authors Journal of the Royal Statistical Society: Series A (Statistics in Society) 0964–1998/17/180000

This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided that the original work is properly cited.


Related Publications

#523633

News

Latest findings, new research

Publications search

Search all research by subject and author

Podcasts

Researchers discuss their findings and what they mean for society

Projects

Background and context, methods and data, aims and outputs

Events

Conferences, seminars and workshops

Survey methodology

Specialist research, practice and study

Taking the long view

ISER's annual report

Themes

Key research themes and areas of interest