City Research Online

Abstract

Background
Online studies offer an efficient method of recruiting participants and collecting data. Whilst delivering an online randomised trial, we detected unusual recruitment activity. We describe our approach to detecting and managing suspected fraud and share lessons for researchers.

Methods
Our trial investigated the single and combined effects of different ways of presenting clinical audit and feedback. Clinicians and managers who received feedback from one of five United Kingdom national clinical audit programmes were emailed invitations that contained a link to the trial website. After providing consent and selecting their relevant audit, participants were randomised automatically to different feedback versions. Immediately after viewing their assigned feedback, participants completed a questionnaire and could request a financial voucher by entering an email address. Email addresses were not linked to trial data to preserve participant anonymity. We actively monitored participant numbers, questionnaire completions, and voucher claims.

Results
Following a rapid increase in trial participation, we identified 268 new voucher claims from three email addresses that we had reason to believe were linked. Further scrutiny revealed duplicate trial completions and voucher requests from 24 email addresses. We immediately suspended the trial, improved security measures, and went on to successfully complete the study.

We found a peak in questionnaires completed in less than 20 seconds during a likely contamination period. Given that study and personal data were not linked, we could not directly identify the trial data from the 268 duplicate entries within the 603 randomisations occurring during the same period. We therefore excluded all 603 randomisations from the primary analysis, which was consequently based on 638 randomisations. A sensitivity analysis, including all 961 randomisations over the entire study except for questionnaire completions of less than 20 seconds, found only minor differences from the primary analysis.

Conclusion
Online studies offering incentives for participation are at risk of attempted fraud. Systematic monitoring and analysis can help detect such activity. Measures to protect study integrity include linking participant identifiers to study data, balancing study security and ease of participation, and safeguarding the allocation of participant incentives.

Trial registration
International Standard Randomised Controlled Trial Number: ISRCTN41584028. Registration date is August 17, 2017.

Publication Type:	Article
Additional Information:	This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
Publisher Keywords:	Audit and feedback, Randomised fractional factorial experiment, Behaviour change, Trial misconduct, Online trial
Subjects:	H Social Sciences > HD Industries. Land use. Labor H Social Sciences > HN Social history and conditions. Social problems. Social reform Q Science > QA Mathematics R Medicine > RA Public aspects of medicine > RA0421 Public health. Hygiene. Preventive Medicine
Departments:	School of Science & Technology > Computer Science > Human Computer Interaction Design
SWORD Depositor:	Symplectic Administrator

Export

Downloads