Comparing the use of open and closed questions for web-based measures of the continued influence effect

Connor Desai, S. & Reimers, S. (2018). Comparing the use of open and closed questions for web-based measures of the continued influence effect. Behavior Research Methods,

[img] Text - Accepted Version
Restricted to Repository staff only

Download (1MB) | Request a copy

Abstract

Open-ended questions, in which participants write or type their responses, are used in many areas of the behavioral sciences. Although effective in the lab, they are relatively untested in online experiments, and the quality of responses is largely unexplored. Closed-ended questions are easier to use online because they generally require only single key- or mouse-press responses and are less cognitively demanding, but can bias responses. We compared data quality obtained using open and closed response formats using the continued influence effect, in which participants read a series of statements about an unfolding event, one of which is unambiguously corrected later. Participants typically continue to refer to the corrected misinformation when making inferential statements about the event. We implemented this basic procedure online (Experiment 1A, n = 78), comparing standard open-ended responses to an alternative procedure using closed-ended responses (Experiment 1B, n = 75). Finally, we replicated these findings in a larger preregistered study (Experiments 2A and 2B, n = 323). We observed the CIE in all conditions: Participants continued to refer to the misinformation following a correction, and references to target misinformation were broadly similar in number across open- and closed-ended questions. We found that participants’ open-ended responses were relatively detailed (writing an average of 75 characters for inference questions), and almost all responses attempted to address the question. Responses for closed-ended questions were, however, faster. Overall, we suggest that with caution it may be possible to use either method for gathering CIE data.

Publication Type: Article
Additional Information: This is a post-peer-review, pre-copyedit version of an article to be published in Behavior Research Methods. The final authenticated version is available online at: https://www.springer.com/psychology/cognitive+psychology/journal/13428
Publisher Keywords: Open-ended, Closed-ended, Response formats, Web-Based, Misinformation, Continued influence effect
Departments: School of Social Sciences > Department of Psychology
URI: http://openaccess.city.ac.uk/id/eprint/19831

Actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics