Measuring communication as a core outcome in aphasia trials: Results of the ROMA-2 international core outcome set development meeting.

Wallace, SJ; Worrall, L; Rose, TA; Alyahya, RSW; Babbitt, E; Beeke, S; de Beer, C; Bose, A; Bowen, A; Brady, MC; Breitenstein, C; Bruehl, S; Bryant, L; Cheng, BBY; Cherney, LR; Conroy, P; Copland, DA; Croteau, C; Cruice, M; Dipper, L; Hilari, K; Howe, T; Kelly, H; Kiran, S; Laska, A-C; Marshall, J; Murray, LL; Patterson, J; Pearl, G; Quinting, J; Rochon, E; Rose, ML; Rubi-Fessen, I; Sage, K; Simmons-Mackie, N; Visch-Brink, E; Volkmer, A; Webster, J; Whitworth, A; Dorze, GL

Measuring communication as a core outcome in aphasia trials: Results of the ROMA-2 international core outcome set development meeting.

Wallace, SJ Worrall, L Rose, TA Alyahya, RSW Babbitt, E Beeke, S de Beer, C Bose, A Bowen, A Brady, MC Breitenstein, C Bruehl, S Bryant, L

Cheng, BBY Cherney, LR Conroy, P Copland, DA Croteau, C Cruice, M Dipper, L Hilari, K Howe, T Kelly, H Kiran, S Laska, A-C Marshall, J Murray, LL Patterson, J Pearl, G Quinting, J Rochon, E Rose, ML Rubi-Fessen, I Sage, K Simmons-Mackie, N Visch-Brink, E Volkmer, A Webster, J Whitworth, A Dorze, GL

Permalink

Publisher:: Wiley
Publication Type:: Journal Article
Citation:: Int J Lang Commun Disord, 2022
Issue Date:: 2022-12-30

Open Access

Copyright Clearance Process

Recently Added
In Progress
Open Access

This item is open access.

Adobe PDF

Download Published versionAdobe PDF (294.24 kB)

View on publisher's site

View statistics

Full metadata record

Field	Value	Language
dc.contributor.author	Wallace, SJ
dc.contributor.author	Worrall, L
dc.contributor.author	Rose, TA
dc.contributor.author	Alyahya, RSW
dc.contributor.author	Babbitt, E
dc.contributor.author	Beeke, S
dc.contributor.author	de Beer, C
dc.contributor.author	Bose, A
dc.contributor.author	Bowen, A
dc.contributor.author	Brady, MC
dc.contributor.author	Breitenstein, C
dc.contributor.author	Bruehl, S
dc.contributor.author	Bryant, L https://orcid.org/0000-0001-8497-7406
dc.contributor.author	Cheng, BBY
dc.contributor.author	Cherney, LR
dc.contributor.author	Conroy, P
dc.contributor.author	Copland, DA
dc.contributor.author	Croteau, C
dc.contributor.author	Cruice, M
dc.contributor.author	Dipper, L
dc.contributor.author	Hilari, K
dc.contributor.author	Howe, T
dc.contributor.author	Kelly, H
dc.contributor.author	Kiran, S
dc.contributor.author	Laska, A-C
dc.contributor.author	Marshall, J
dc.contributor.author	Murray, LL
dc.contributor.author	Patterson, J
dc.contributor.author	Pearl, G
dc.contributor.author	Quinting, J
dc.contributor.author	Rochon, E
dc.contributor.author	Rose, ML
dc.contributor.author	Rubi-Fessen, I
dc.contributor.author	Sage, K
dc.contributor.author	Simmons-Mackie, N
dc.contributor.author	Visch-Brink, E
dc.contributor.author	Volkmer, A
dc.contributor.author	Webster, J
dc.contributor.author	Whitworth, A
dc.contributor.author	Dorze, GL
dc.date.accessioned	2023-01-19T04:48:59Z
dc.date.available	2022-12-08
dc.date.available	2023-01-19T04:48:59Z
dc.date.issued	2022-12-30
dc.identifier.citation	Int J Lang Commun Disord, 2022
dc.identifier.issn	1368-2822
dc.identifier.issn	1460-6984
dc.identifier.uri	http://hdl.handle.net/10453/165221
dc.description.abstract	BACKGROUND: Evidence-based recommendations for a core outcome set (COS; minimum set of outcomes) for aphasia treatment research have been developed (the Research Outcome Measurement in Aphasia-ROMA, COS). Five recommended core outcome constructs: communication, language, quality of life, emotional well-being and patient-reported satisfaction/impact of treatment, were identified through three international consensus studies. Constructs were paired with outcome measurement instruments (OMIs) during an international consensus meeting (ROMA-1). Before the current study (ROMA-2), agreement had not been reached on OMIs for the constructs of communication or patient-reported satisfaction/impact of treatment. AIM: To establish consensus on a communication OMI for inclusion in the ROMA COS. METHODS & PROCEDURES: Research methods were based on recommendations from the Core Outcome Measures in Effectiveness Trials (COMET) Initiative. Participants with expertise in design and conduct of aphasia trials, measurement instrument development/testing and/or communication outcome measurement were recruited through an open call. Before the consensus meeting, participants agreed on a definition of communication, identified appropriate OMIs, extracted their measurement properties and established criteria for their quality assessment. During the consensus meeting they short-listed OMIs and participants without conflicts of interest voted on the two most highly ranked instruments. Consensus was defined a priori as agreement by ≥ 70% of participants. OUTCOMES & RESULTS: In total, 40 researchers from nine countries participated in ROMA-2 (including four facilitators and three-panel members who participated in pre-meeting activities only). A total of 20 OMIs were identified and evaluated. Eight short-listed communication measures were further evaluated for their measurement properties and ranked. Participants in the consensus meeting (n = 33) who did not have conflicts of interest (n = 29) voted on the top two ranked OMIs: The Scenario Test (TST) and the Communication Activities of Daily Living-3 (CADL-3). TST received 72% (n = 21) of 'yes' votes and the CADL-3 received 28% (n = 8) of 'yes' votes. CONCLUSIONS & IMPLICATIONS: Consensus was achieved that TST was the preferred communication OMI for inclusion in the ROMA COS. It is currently available in the original Dutch version and has been adapted into English, German and Greek. Further consideration must be given to the best way to measure communication in people with mild aphasia. Development of a patient-reported measure for satisfaction with/impact of treatment and multilingual versions of all OMIs of the COS is still required. Implementation of the ROMA COS would improve research outcome measurement and the quality, relevance, transparency, replicability and efficiency of aphasia treatment research. WHAT THIS PAPER ADDS: What is already known on this subject International consensus has been reached on five core constructs to be routinely measured in aphasia treatment studies. International consensus has also been established for OMIs for the three constructs of language, quality of life and emotional well-being. Before this study, OMIs for the constructs of communication and patient-reported satisfaction/impact of treatment were not established. What this paper adds to existing knowledge We gained international consensus on an OMI for the construct of communication. TST is recommended for inclusion in the ROMA COS for routine use in aphasia treatment research. What are the potential or actual clinical implications of this work? The ROMA COS recommends OMIs for a minimum set of outcomes for adults with post-stroke aphasia within phases I-IV aphasia treatment research. Although not intended for clinical use, clinicians may employ the instruments of the ROMA COS, considering the quality of their measurement properties. The systematic inclusion of a measure of communication, such as TST, in clinical practice could ultimately support the implementation of research evidence and best practices.
dc.format	Print-Electronic
dc.language	eng
dc.publisher	Wiley
dc.relation.ispartof	Int J Lang Commun Disord
dc.relation.isbasedon	10.1111/1460-6984.12840
dc.rights	info:eu-repo/semantics/openAccess
dc.subject	1103 Clinical Sciences, 1702 Cognitive Sciences, 2004 Linguistics
dc.subject.classification	Speech-Language Pathology & Audiology
dc.title	Measuring communication as a core outcome in aphasia trials: Results of the ROMA-2 international core outcome set development meeting.
dc.type	Journal Article
utslib.location.activity	United States
utslib.for	1103 Clinical Sciences
utslib.for	1702 Cognitive Sciences
utslib.for	2004 Linguistics
pubs.organisational-group	/University of Technology Sydney
pubs.organisational-group	/University of Technology Sydney/Faculty of Health
pubs.organisational-group	/University of Technology Sydney/Faculty of Health/Graduate School of Health
pubs.organisational-group	/University of Technology Sydney/Faculty of Health/Graduate School of Health/GSH.Speech Pathology
utslib.copyright.status	open_access	*
dc.date.updated	2023-01-19T04:48:57Z
pubs.publication-status	Published online

Abstract:

BACKGROUND: Evidence-based recommendations for a core outcome set (COS; minimum set of outcomes) for aphasia treatment research have been developed (the Research Outcome Measurement in Aphasia-ROMA, COS). Five recommended core outcome constructs: communication, language, quality of life, emotional well-being and patient-reported satisfaction/impact of treatment, were identified through three international consensus studies. Constructs were paired with outcome measurement instruments (OMIs) during an international consensus meeting (ROMA-1). Before the current study (ROMA-2), agreement had not been reached on OMIs for the constructs of communication or patient-reported satisfaction/impact of treatment. AIM: To establish consensus on a communication OMI for inclusion in the ROMA COS. METHODS & PROCEDURES: Research methods were based on recommendations from the Core Outcome Measures in Effectiveness Trials (COMET) Initiative. Participants with expertise in design and conduct of aphasia trials, measurement instrument development/testing and/or communication outcome measurement were recruited through an open call. Before the consensus meeting, participants agreed on a definition of communication, identified appropriate OMIs, extracted their measurement properties and established criteria for their quality assessment. During the consensus meeting they short-listed OMIs and participants without conflicts of interest voted on the two most highly ranked instruments. Consensus was defined a priori as agreement by ≥ 70% of participants. OUTCOMES & RESULTS: In total, 40 researchers from nine countries participated in ROMA-2 (including four facilitators and three-panel members who participated in pre-meeting activities only). A total of 20 OMIs were identified and evaluated. Eight short-listed communication measures were further evaluated for their measurement properties and ranked. Participants in the consensus meeting (n = 33) who did not have conflicts of interest (n = 29) voted on the top two ranked OMIs: The Scenario Test (TST) and the Communication Activities of Daily Living-3 (CADL-3). TST received 72% (n = 21) of 'yes' votes and the CADL-3 received 28% (n = 8) of 'yes' votes. CONCLUSIONS & IMPLICATIONS: Consensus was achieved that TST was the preferred communication OMI for inclusion in the ROMA COS. It is currently available in the original Dutch version and has been adapted into English, German and Greek. Further consideration must be given to the best way to measure communication in people with mild aphasia. Development of a patient-reported measure for satisfaction with/impact of treatment and multilingual versions of all OMIs of the COS is still required. Implementation of the ROMA COS would improve research outcome measurement and the quality, relevance, transparency, replicability and efficiency of aphasia treatment research. WHAT THIS PAPER ADDS: What is already known on this subject International consensus has been reached on five core constructs to be routinely measured in aphasia treatment studies. International consensus has also been established for OMIs for the three constructs of language, quality of life and emotional well-being. Before this study, OMIs for the constructs of communication and patient-reported satisfaction/impact of treatment were not established. What this paper adds to existing knowledge We gained international consensus on an OMI for the construct of communication. TST is recommended for inclusion in the ROMA COS for routine use in aphasia treatment research. What are the potential or actual clinical implications of this work? The ROMA COS recommends OMIs for a minimum set of outcomes for adults with post-stroke aphasia within phases I-IV aphasia treatment research. Although not intended for clinical use, clinicians may employ the instruments of the ROMA COS, considering the quality of their measurement properties. The systematic inclusion of a measure of communication, such as TST, in clinical practice could ultimately support the implementation of research evidence and best practices.

Please use this identifier to cite or link to this item:

http://hdl.handle.net/10453/165221