Departing from the essential features of a high quality systematic review of psychotherapy : A response to ÖST (2014) and recommendations for improvement
Journal article
Atkins, Paul W. B., Ciarrochi, Joseph, Gaudiano, Brandon A., Bricker, Jonathan B., James, Donald, Rovner, Graciela, Smout, Matthew, Livheim, Fredrik, Lundgren, Tobias and Hayes, Steven C.. (2017). Departing from the essential features of a high quality systematic review of psychotherapy : A response to ÖST (2014) and recommendations for improvement. Behaviour Research and Therapy. 97, pp. 259-272. https://doi.org/10.1016/j.brat.2017.05.016
Authors | Atkins, Paul W. B., Ciarrochi, Joseph, Gaudiano, Brandon A., Bricker, Jonathan B., James, Donald, Rovner, Graciela, Smout, Matthew, Livheim, Fredrik, Lundgren, Tobias and Hayes, Steven C. |
---|---|
Abstract | Ost's (2014) systematic review and meta-analysis of Acceptance and Commitment Therapy (ACT) has received wide attention. On the basis of his review, Ost argued that ACT research was not increasing in its quality and that, in contradiction to the views of Division 12 of the American Psychological Association(APA), ACT is “not yet well-established for any disorder”(2014, p. 105). We conducted a careful examination of the methods, approach, and data used in the meta-analysis. Based in part on examinations by the authors of the studies involved, which were then independently checked, 91 factual or interpretive errors were documented, touching upon 80% of the studies reviewed. Comparisons of Ost's quality ratings with independent teams rating the same studies with the same scale suggest that Ost's ratings were unreliable. In all of these areas (factual errors; interpretive errors; quality ratings) mistakes and differences were not random: Ost's data were dominantly more negative toward ACT. The seriousness, range, and distribution of errors, and a wider pattern of misinterpreting the purpose of studies and ignoring positive results, suggest that Ost's review should be set aside in future considerations of the evidence base for ACT. We argue that future published reviews and meta-analyses should rely upon diverse groups of scholars rather than a single individual; that resulting raw data should be made available for inspection and independent analysis; that well-crafted committees rather than individuals should design, apply and interpret quality criteria; that the intent of transdiagnostic studies need to be more seriously considered as the field shifts away from a purely syndromal approach; and that data that demonstrate theoretically consistent mediating processes should be given greater weight in evaluating specific interventions. Finally, in order to examine substantive progress since Ost's review, recent outcome and process evidence was briefly examined. |
Keywords | treatment efficacy; randomized clinical trials; acceptance and commitment therapy; cognitive behavior therapy; research methodology; empirically based treatments |
Year | 2017 |
Journal | Behaviour Research and Therapy |
Journal citation | 97, pp. 259-272 |
Publisher | Elsevier Ltd |
ISSN | 0005-7967 |
Digital Object Identifier (DOI) | https://doi.org/10.1016/j.brat.2017.05.016 |
Scopus EID | 2-s2.0-85021239544 |
Open access | Published as green open access |
Page range | 259-272 |
Research Group | Institute for Positive Psychology and Education |
Author's accepted manuscript | License File Access Level Open |
Publisher's version | License All rights reserved File Access Level Controlled |
Output status | Published |
Publication dates | |
Online | 29 May 2017 |
Publication process dates | |
Accepted | 24 May 2017 |
https://acuresearchbank.acu.edu.au/item/8800v/departing-from-the-essential-features-of-a-high-quality-systematic-review-of-psychotherapy-a-response-to-st-2014-and-recommendations-for-improvement
Download files
Author's accepted manuscript
AM_Atkins_2017_Departing_from_the_essential_features_of.pdf | |
License: CC BY-NC-ND 4.0 | |
File access level: Open |
Restricted files
Publisher's version
133
total views167
total downloads1
views this month1
downloads this month