Assessing the mechanisms of misreporting to filter questions in surveys

Publication type

Research Paper

Series Number

1

Series

Survey Research And Methodology Program: Faculty Publications

Authors

Publication date

October 15, 2014

Summary:

To avoid asking respondents questions that do not apply to them, surveys often use filter questions that determine routing into follow-up items. Filter questions can be asked in an interleafed format, in which follow-up questions are asked immediately after each relevant filter, or in a grouped format, in which follow-up questions are asked only after multiple filters have been administered. Most previous investigations of filter questions have found that the grouped format collects more affirmative answers than the interleafed format. This result has been taken to mean that respondents in the interleafed format learn to shorten the questionnaire by answering the filter questions negatively. However, this is only one mechanism that could produce the observed differences between the two formats. Acquiescence, the tendency to answer yes to yes/no questions, could also explain the results. We conducted a telephone survey that linked filter question responses to high-quality administrative data to test two hypotheses about the mechanism of the format effect. We find strong support for motivated underreporting and less support for the acquiescence hypothesis. This is the first clear evidence that the grouped format results in more accurate answers to filter questions. However, we also find that the underreporting phenomenon does not always occur. These findings are relevant to all surveys that use multiple filter questions.

Published in

Public Opinion Quarterly

Subject

Link

http://digitalcommons.unl.edu/sramfacpub/1/

Notes

This Article is brought to you for free and open access by the Survey Research And Methodology Program at DigitalCommons@University of Nebraska - Lincoln. It has been accepted for inclusion in Survey Research And Methodology Program: Faculty Publications by an authorized administrator of DigitalCommons@University of Nebraska - Lincoln.

Published in Public Opinion Quarterly (2014); doi: 10.1093/poq/nfu030

Copyright © 2014 Stephanie Eckman, Frauke Kreuter, Antje Kirchner, Annette Jäckle, Roger Tourangeau, and Stanley Presser; published by Oxford University Press on behalf of the American Association for Public Opinion Research. Used by permission.


Related Publications

#522779

News

Latest findings, new research

Publications search

Search all research by subject and author

Podcasts

Researchers discuss their findings and what they mean for society

Projects

Background and context, methods and data, aims and outputs

Events

Conferences, seminars and workshops

Survey methodology

Specialist research, practice and study

Taking the long view

ISER's annual report

Themes

Key research themes and areas of interest