Mode effects on self-reported health across web-based, interviewer-administered, and nurse-administered modes: population-based study

Publication type

Journal Article

Authors

Publication date

October 16, 2026

Summary:

Background:
Probability-based surveys remain essential to epidemiology, but expanding mixed-mode data collection, which combines web self-completion and interviewer-administered surveys, raises concerns that administration mode and interviewer presence may influence health reporting. These concerns warrant further investigation of interviewer-related biases and mode differences in health reporting.

Objective:
This study assessed whether responses to the 12-item General Health Questionnaire (GHQ-12) and 12-item Short Form Health Survey (SF-12), both self-completed, differed by interviewer presence and role: online without an interviewer, during a social interviewer visit, or during a nurse visit. It also assessed mode effects on doctor-diagnosed conditions recorded by interviewers in computer-assisted personal interviewing (CAPI) and when self-completed online. We further examined possible variation by sex and age.

Methods:
The analysis used randomized mode allocation embedded within wave 12 (2019) of the UK Household Longitudinal Study Innovation Panel. After applying relevant exclusions, the final analytic sample comprised 1111 households (1779 participants) across the 3 randomly assigned survey modes: web-based self-completion, interviewer-administered CAPI, or nurse-administered CAPI. The sample was predominantly White British, with a broadly balanced sex distribution and participants from diverse age, employment, education, and household income groups. Participants did not always complete the survey in their randomly assigned mode. Effects were estimated using a two-stage residual inclusion instrumental variable approach, with randomized mode as an instrument for actual mode, to address confounding arising from nonrandom selection into actual mode.

Results:
No statistically significant differences were observed across self-completion contexts for the GHQ-12 or the SF-12 mental and physical component scores. We found no statistically significant evidence of mode effects on doctor-diagnosed conditions. For example, no statistically significant mode effects in psychiatric conditions were identified across the comparisons: nurse relative to social interviewer (odds ratio [OR] 0.72, 95% CI 0.40‐1.29; P=.53), web relative to social interviewer (OR 0.45, 95% CI 0.17‐1.18; P=.14), and web relative to nurse (OR 0.63, 95% CI 0.27‐1.49; P=.59). There was little evidence overall that mode-related differences varied by age or sex.

Conclusions:
Our findings may support embedding self-completion modules within interviewer-administered surveys for the collection of SF-12 and GHQ-12. Meanwhile, potential mode-related differences should be considered when designing mixed-mode surveys and interpreting self-reported health data.

Published in

JMIR Human Factors

Volume

Volume: 13:e89896

DOI

https://doi.org/10.2196/89896

ISSN

22929495

Subjects

Notes

© Yunlong Liang, Tarek Al Baghal, Jonathan Burton, Meena Kumari. Originally published in JMIR Human Factors (https://humanfactors.jmir.org), 16.Oct.2026.

Open Access

This is an open-access article distributed under the terms of the Creative Commons Attribution License (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work, first published in JMIR Human Factors, is properly cited. The complete bibliographic information, a link to the original publication on https://humanfactors.jmir.org, as well as this copyright and license information must be included.

Code: R code supporting the main analyses is available on GitHub - Researchhealth6/modeeffects_health. GitHub. URL: https://github.com/researchhealth6/Modeeffects_health

#589284

News

Latest findings, new research

Publications search

Search all research by subject and author

Podcasts

Researchers discuss their findings and what they mean for society

Projects

Background and context, methods and data, aims and outputs

Events

Conferences, seminars and workshops

Survey methodology

Specialist research, practice and study

Themes

Key research themes and areas of interest