City Research Online

Measuring communication as a core outcome in aphasia trials: Results of the ROMA-2 international core outcome set development meeting

Wallace, S. J., Worrall, L., Rose, T. A. , Alyahya, R. S. W., Babbitt, E., Beeke, S., de Beer, C., Bose, A., Bowen, A., Brady, M. C., Breitenstein, C., Bruehl, S., Bryant, L., Cheng, B. B. Y., Cherney, L. R., Conroy, P., Copland, D. A., Croteau, C., Cruice, M. ORCID: 0000-0001-7344-2262, Dipper, L. ORCID: 0000-0002-5918-3898, Hilari, K. ORCID: 0000-0003-2091-4849, Howe, T., Kelly, H., Kiran, S., Laska, A-C., Marshall, J., Murray, L. L., Patterson, J., Pearl, G., Quinting, J., Rochon, E., Rose, M. L., Rubi-Fessen, I., Sage, K., Simmons-Mackie, N., Visch-Brink, E., Volkmer, A., Webster, J., Whitworth, A. & Dorze, G. L. (2022). Measuring communication as a core outcome in aphasia trials: Results of the ROMA-2 international core outcome set development meeting. International Journal of Language & Communication Disorders, 58(4), pp. 1017-1028. doi: 10.1111/1460-6984.12840


BACKGROUND: Evidence-based recommendations for a core outcome set (COS; minimum set of outcomes) for aphasia treatment research have been developed (the Research Outcome Measurement in Aphasia-ROMA, COS). Five recommended core outcome constructs: communication, language, quality of life, emotional well-being and patient-reported satisfaction/impact of treatment, were identified through three international consensus studies. Constructs were paired with outcome measurement instruments (OMIs) during an international consensus meeting (ROMA-1). Before the current study (ROMA-2), agreement had not been reached on OMIs for the constructs of communication or patient-reported satisfaction/impact of treatment.

AIM: To establish consensus on a communication OMI for inclusion in the ROMA COS.

METHODS & PROCEDURES: Research methods were based on recommendations from the Core Outcome Measures in Effectiveness Trials (COMET) Initiative. Participants with expertise in design and conduct of aphasia trials, measurement instrument development/testing and/or communication outcome measurement were recruited through an open call. Before the consensus meeting, participants agreed on a definition of communication, identified appropriate OMIs, extracted their measurement properties and established criteria for their quality assessment. During the consensus meeting they short-listed OMIs and participants without conflicts of interest voted on the two most highly ranked instruments. Consensus was defined a priori as agreement by ≥ 70% of participants.

OUTCOMES & RESULTS: In total, 40 researchers from nine countries participated in ROMA-2 (including four facilitators and three-panel members who participated in pre-meeting activities only). A total of 20 OMIs were identified and evaluated. Eight short-listed communication measures were further evaluated for their measurement properties and ranked. Participants in the consensus meeting (n = 33) who did not have conflicts of interest (n = 29) voted on the top two ranked OMIs: The Scenario Test (TST) and the Communication Activities of Daily Living-3 (CADL-3). TST received 72% (n = 21) of 'yes' votes and the CADL-3 received 28% (n = 8) of 'yes' votes.

CONCLUSIONS & IMPLICATIONS: Consensus was achieved that TST was the preferred communication OMI for inclusion in the ROMA COS. It is currently available in the original Dutch version and has been adapted into English, German and Greek. Further consideration must be given to the best way to measure communication in people with mild aphasia. Development of a patient-reported measure for satisfaction with/impact of treatment and multilingual versions of all OMIs of the COS is still required. Implementation of the ROMA COS would improve research outcome measurement and the quality, relevance, transparency, replicability and efficiency of aphasia treatment research. WHAT THIS PAPER ADDS: What is already known on this subject International consensus has been reached on five core constructs to be routinely measured in aphasia treatment studies. International consensus has also been established for OMIs for the three constructs of language, quality of life and emotional well-being. Before this study, OMIs for the constructs of communication and patient-reported satisfaction/impact of treatment were not established. What this paper adds to existing knowledge We gained international consensus on an OMI for the construct of communication. TST is recommended for inclusion in the ROMA COS for routine use in aphasia treatment research. What are the potential or actual clinical implications of this work? The ROMA COS recommends OMIs for a minimum set of outcomes for adults with post-stroke aphasia within phases I-IV aphasia treatment research. Although not intended for clinical use, clinicians may employ the instruments of the ROMA COS, considering the quality of their measurement properties. The systematic inclusion of a measure of communication, such as TST, in clinical practice could ultimately support the implementation of research evidence and best practices.

Publication Type: Article
Additional Information: © 2022 The Authors. International Journal of Language & Communication Disorders published by John Wiley & Sons Ltd on behalf of Royal College of Speech and Language Therapists. This is an open access article under the terms of the Creative Commons Attribution-NonCommercial-NoDerivs License, which permits use and distribution in any medium, provided the original work is properly cited, the use is non-commercial and no modifications or adaptations are made.
Publisher Keywords: aphasia, consensus, core outcome set, recommendations, stroke
Subjects: R Medicine > RC Internal medicine > RC0321 Neuroscience. Biological psychiatry. Neuropsychiatry
Departments: School of Health & Psychological Sciences > Language & Communication Science
SWORD Depositor:
[thumbnail of Intl J Lang Comm Disor - 2022 - Wallace - Measuring communication as a core outcome in aphasia trials Results of the.pdf]
Text - Published Version
Available under License Creative Commons Attribution Non-commercial No Derivatives.

Download (301kB) | Preview


Add to AnyAdd to TwitterAdd to FacebookAdd to LinkedinAdd to PinterestAdd to Email


Downloads per month over past year

View more statistics

Actions (login required)

Admin Login Admin Login