City Research Online

Surely Shorter is Better? A Questionnaire Length Experiment in a Self-Completion Survey

Hanson, T., Aizpurua, E., Fitzgerald, R. ORCID: 0000-0002-2126-5564 & Vukovic, M. (2025). Surely Shorter is Better? A Questionnaire Length Experiment in a Self-Completion Survey. Survey Research Methods, 19(2), pp. 139-152. doi: 10.18148/srm/2025.v19i2.8348

Abstract

As surveys increasingly transition to self-completion approaches, understanding the impact of design decisions on survey outcomes becomes paramount. This includes assessing the effects of different questionnaire lengths on survey quality and considering what length of questionnaire can reasonably be fielded in a self-completion environment. This paper presents findings from a self-completion experiment conducted in Austria in 2021, which compared the full European Social Survey Round 10 questionnaire (estimated 50-minute completion time) with a shorter version (anticipated 35-minute completion time). The analysis includes a comparison between the longer and shorter versions based on response rates, sample composition, and data quality indicators. Except for response rates, which were significantly but only slightly higher in the shorter condition, results for both versions were generally comparable. Fielding a shorter questionnaire did not produce clear benefits in terms of sample composition or data quality. These results suggest that a questionnaire that would traditionally be regarded as lengthy for self-completion can yield acceptable outcomes.

Publication Type: Article
Additional Information: Copyright (c) 2025 Tim Hanson, Eva Aizpurua, Rory Fitzgerald, Marta Vukovic. This work is licensed under a Creative Commons Attribution 4.0 International License.
Publisher Keywords: Interview length, Self-administered Questionnaires, European Social Survey, Response Rate, Data Quality
Subjects: H Social Sciences > H Social Sciences (General)
H Social Sciences > HA Statistics
H Social Sciences > HM Sociology
Departments: School of Policy & Global Affairs
SWORD Depositor:
[thumbnail of srm_8348_OnlinePDF.pdf]
Preview
Text - Published Version
Available under License Creative Commons Attribution.

Download (442kB) | Preview

Export

Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email

Downloads

Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login