Quality of life and symptom burden improve in patients attending a multidisciplinary clinical service for cancer cachexia : A retrospective observational review

Journal article


Bland, Kelcey A., Harrison, Meg, Harrison, Meg, Zopf, Eva M., Sousa, Mariana S., Currow, David C., Ely, Matthew, Agar, Meera, Butcher, Belinda E., Vaughan, Vanessa, Dowd, Anna and Martin, Peter. (2021). Quality of life and symptom burden improve in patients attending a multidisciplinary clinical service for cancer cachexia : A retrospective observational review. Journal of Pain and Symptom Management. 62(3), pp. e164-e176. https://doi.org/10.1016/j.jpainsymman.2021.02.034
AuthorsBland, Kelcey A., Harrison, Meg, Harrison, Meg, Zopf, Eva M., Sousa, Mariana S., Currow, David C., Ely, Matthew, Agar, Meera, Butcher, Belinda E., Vaughan, Vanessa, Dowd, Anna and Martin, Peter
Abstract

Background
Cancer cachexia negatively affects quality of life (QoL) and increases symptom burden. A multimodal treatment approach may optimize cachexia outcomes, including QoL. We evaluated QoL and symptoms over time among patients attending a multidisciplinary clinical service for cancer cachexia.

Methods
Adults with cancer who attended the clinical service three times between 2017 and 2020 were included. Quality of life and symptoms were assessed using the European Organization for Research and Treatment of Cancer Quality of life Questionnaire Core 15 Palliative Care (EORTC QLQ-C15-PAL) and the Functional Assessment Anorexia/Cachexia Therapy (FAACT) questionnaires. Physical function was assessed using the 30s sit-to-stand test and handgrip strength.

Results
Overall, 162 patients (age = 67.2 ± 12.0 years) were included. Mean six-month weight loss at baseline was 10.4% ± 9.4%. Mean body weight was stable between clinic visits (P = 0.904) and no change in sit-to-stand repetitions (P = 0.133) or handgrip strength (P = 0.734) occurred over time. Improvements in EORTC QLQ-C15-PAL overall QoL (Δ10.7 ± 2.5, P < 0.001), physical function (Δ8.0 ± 2.4, P = 0.003) and emotional function (Δ11.4 ± 2.9, P < 0.001) occurred by the second visit. EORTC QLQ-C15-PAL fatigue (Δ13.8 ± 2.9, P < 0.001), pain (Δ10.3 ± 3.3, P = 0.007), nausea/vomiting (Δ16.1 ± 3.0, P < 0.001) and appetite symptoms (Δ25.9 ± 3.8, P < 0.001) also improved by the second visit. FAACT total score (Δ14.6 ± 2.7, P < 0.001), anorexia-cachexia symptoms (Δ6.6 ± 1.1, P< 0.001), and physical (Δ3.7 ± 0.70, P < 0.001), emotional (Δ1.9 ± 0.60, P = 0.005) and functional wellbeing (Δ2.7 ± 0.71, P = 0.001) improved by the second visit. All improvements in EORTC QLQ-C15-PAL and FAACT outcomes were maintained at the third visit.

Conclusion
Significant improvements in QoL and symptoms were associated with attending a cancer cachexia clinical service. Our findings support using multidisciplinary, multimodal cancer cachexia treatment approaches to improve patient wellbeing.

Keywordspalliative care; cachexia; quality of life; multidisciplinary; multimodal treatment
Year2021
JournalJournal of Pain and Symptom Management
Journal citation62 (3), pp. e164-e176
PublisherElsevier Inc.
ISSN0885-3924
Digital Object Identifier (DOI)https://doi.org/10.1016/j.jpainsymman.2021.02.034
Scopus EID2-s2.0-85104345461
Research or scholarlyResearch
Page rangee164-e176
Publisher's version
License
All rights reserved
File Access Level
Controlled
Output statusPublished
Publication dates
Online27 Feb 2021
Publication process dates
Deposited22 Nov 2021
Permalink -

https://acuresearchbank.acu.edu.au/item/8x1w5/quality-of-life-and-symptom-burden-improve-in-patients-attending-a-multidisciplinary-clinical-service-for-cancer-cachexia-a-retrospective-observational-review

Restricted files

Publisher's version

  • 96
    total views
  • 0
    total downloads
  • 0
    views this month
  • 0
    downloads this month
These values are for the period from 19th October 2020, when this repository was created.

Export as

Related outputs

Early detection of brain metastases in a supervised exercise program for patients with advanced breast cancer : A case report
Pelaez, Mireia, Stuiver, Martijn M., Broekman, Marike, Schmitz, Kathryn H., Zopf, Eva M., Clauss, Dorothea, Wengström, Yvonne, Rosenberger, Friederike, Steindorf, Karen, Urruticoechea, Ander and May, Anne M.. (2023). Early detection of brain metastases in a supervised exercise program for patients with advanced breast cancer : A case report. Medicine and Science in Sports and Exercise. 55(10), pp. 1745-1749. https://doi.org/10.1249/MSS.0000000000003213
Implementation of physical activity interventions in a community-based youth mental healthcare service : A case study of context, strategies, and outcomes
Czosnek, Louise, Rosenbaum, Simon, Rankin, Nicole M., Zopf, Eva M., Cormie, Prue, Herbert, Brittany and Richards, Justin. (2023). Implementation of physical activity interventions in a community-based youth mental healthcare service : A case study of context, strategies, and outcomes. Early Intervention in Psychiatry. 17(2), pp. 212-222. https://doi.org/10.1111/eip.13324
Developing an implementation research logic model : Using a multiple case study design to establish a worked exemplar
Czosnek, Louise, Zopf, Eva M., Cormie, Prue, Rosenbaum, Simon, Richards, Justin and Rankin, Nicole M.. (2022). Developing an implementation research logic model : Using a multiple case study design to establish a worked exemplar. Implementation Science Communications. 3, p. Article 90. https://doi.org/10.1186/s43058-022-00337-8
"I want to get myself as fit as I can and not die just yet" - Perceptions of exercise in people with advanced cancer and cachexia : A qualitative study
Bland, Kelcey A., Krishnasamy, Meinir, Parr, Evelyn B., Mulder, Stella, Martin, Peter, van Loon, Luc, Cormie, Prue, Michael, Natasha and Zopf, Eva M.. (2022). "I want to get myself as fit as I can and not die just yet" - Perceptions of exercise in people with advanced cancer and cachexia : A qualitative study. BMC Palliative Care. 21(1), p. Article 75. https://doi.org/10.1186/s12904-022-00948-x
Effect and feasibility of wearable physical activity trackers and pedometers for increasing physical activity and improving health outcomes in cancer survivors : A systematic review and meta-analysis
Singh, Benjamin, Zopf, Eva M. and Howden, Erin J.. (2022). Effect and feasibility of wearable physical activity trackers and pedometers for increasing physical activity and improving health outcomes in cancer survivors : A systematic review and meta-analysis. Journal of Sport and Health Science. 11(2), pp. 184-193. https://doi.org/10.1016/j.jshs.2021.07.008
Effects of supervised aerobic exercise on cardiorespiratory fitness and patient-reported health outcomes in colorectal cancer patients undergoing adjuvant chemotherapy — A pilot study
Zopf, Eva M., Schulz, Holger, Poeschko, Jonas, Aschenbroich, Kerstin, Wilhelm, Thomas, Eypasch, Ernst, Kleimann, Elmar, Severin, Kai, Benz, Jutta, Liu, Enwu, Bloch, Wilhelm and Baumann, Freerk T.. (2022). Effects of supervised aerobic exercise on cardiorespiratory fitness and patient-reported health outcomes in colorectal cancer patients undergoing adjuvant chemotherapy — A pilot study. Supportive Care in Cancer. 30(3), pp. 1945-1955. https://doi.org/10.1007/s00520-021-06608-9
Exercise-based interventions to counteract skeletal muscle mass loss in people with cancer : Can we overcome the odds?
Bland, Kelcey A., Kouw, Imre W. K., van Loon, Luc J. C., Zopf, Eva M. and Fairman, Ciaran M.. (2022). Exercise-based interventions to counteract skeletal muscle mass loss in people with cancer : Can we overcome the odds? Sports Medicine. 52(5), pp. 1009-1027. https://doi.org/10.1007/s40279-021-01638-z
Exercise-based multimodal programming : A treatment gap for older adults with advanced cancer [Commentary]
Small, Stephanie, Bland, Kelcey, Rickard, Julia and Kirkham, Amy. (2022). Exercise-based multimodal programming : A treatment gap for older adults with advanced cancer [Commentary] Oxford University Press. https://doi.org/10.1093/oncolo/oyab009
Taking advantage of the teachable moment at initial diagnosis of prostate cancer—Results of a pilot randomized controlled trial of supervised exercise training
Schulz, Gerald B., Locke, Jennifer A., Campbell, Kristin L., Bland, Kelcey A., Van Patten, Cheri L., Black, Peter C., Goldenberg, S. Larry and Flannigan, Ryan. (2022). Taking advantage of the teachable moment at initial diagnosis of prostate cancer—Results of a pilot randomized controlled trial of supervised exercise training. Cancer Nursing. 45(3), pp. E680-E688. https://doi.org/10.1097/NCC.0000000000001013
Supervised pelvic floor muscle exercise is more effective than unsupervised pelvic floor muscle exercise at improving urinary incontinence in prostate cancer patients following radical prostatectomy – a systematic review and meta-analysis
Baumann, Freerk T., Reimer, Nadine, Gockeln, Theresa, Reike, Alexandra, Hallek, Michael, Ricci, Christian, Zopf, Eva M., Schmid, Daniela, Taaffe, Dennis, Newton, Robert U., Galvao, Daniel A. and Leitzmann, Michael. (2022). Supervised pelvic floor muscle exercise is more effective than unsupervised pelvic floor muscle exercise at improving urinary incontinence in prostate cancer patients following radical prostatectomy – a systematic review and meta-analysis. Disability and Rehabilitation. 44(9), p. 5374–5385. https://doi.org/10.1080/09638288.2021.1937717
Attention to principles of exercise training : An updated systematic review of randomized controlled trials in cancers other than breast and prostate
Bland, Kelcey A., Neil-Sztramko, Sarah E., Zadravec, Kendra, Medysky, Mary E., Kong, Jeffrey, Winters-Stone, Kerri M. and Campbell, Kristin L.. (2021). Attention to principles of exercise training : An updated systematic review of randomized controlled trials in cancers other than breast and prostate. BMC Cancer. 21(1), p. Article 1179. https://doi.org/10.1186/s12885-021-08701-y
Effects of exercise on sexual dysfunction in patients with prostate cancer - A systematic review
Reimer, Nadine, Zopf, Eva Maria, Böwe, Rebecca and Baumann, Freerk Theeagnus. (2021). Effects of exercise on sexual dysfunction in patients with prostate cancer - A systematic review. Journal of Sexual Medicine. 18(11), pp. 1899-1914. https://doi.org/10.1016/j.jsxm.2021.09.001
Exercise interventions for people diagnosed with cancer : A systematic review of implementation outcomes
Czosnek, Louise, Richards, Justin, Zopf, Eva, Cormie, Prue, Rosenbaum, Simon and Rankin, Nicole M.. (2021). Exercise interventions for people diagnosed with cancer : A systematic review of implementation outcomes. BMC Cancer. 21, p. Article 643. https://doi.org/10.1186/s12885-021-08196-7
Patients and carers' perspectives of participating in a pilot tailored exercise program during chemoradiotherapy for high grade glioma : A qualitative study
Halkett, Georgia K. B., Cormie, Prue, McGough, Shirley, Zopf, Eva M., Galvao, Daniel A., Newton, Robert U. and Nowak, Anna K.. (2021). Patients and carers' perspectives of participating in a pilot tailored exercise program during chemoradiotherapy for high grade glioma : A qualitative study. European Journal of Cancer Care. 30(5), p. Article: e13453. https://doi.org/10.1111/ecc.13453
The effect of exercise training on cardiometabolic health in men with prostate cancer receiving androgen deprivation therapy : A systematic review and meta-analysis
Bigaran, Ashley, Zopf, Eva, Gardner, Jason, La Gerche, Andre, Murphy, Declan G., Howden, Erin J., Baker, Michael K. and Cormie, Prue. (2021). The effect of exercise training on cardiometabolic health in men with prostate cancer receiving androgen deprivation therapy : A systematic review and meta-analysis. Prostate Cancer and Prostatic Diseases. 24(1), pp. 35-48. https://doi.org/10.1038/s41391-020-00273-5
Exercising in isolation? The role of telehealth in exercise oncology during the COVID-19 pandemic and beyond
Bland, Kelcey A., Bigaran, Ashley, Campbell, Kristin L., Trevaskis, Mark and Zopf, Eva M.. (2020). Exercising in isolation? The role of telehealth in exercise oncology during the COVID-19 pandemic and beyond. Physical Therapy. 100(10), pp. 1713-1716. https://doi.org/10.1093/ptj/pzaa141
Aerobic exercise-induced changes in cardiorespiratory fitness in breast cancer patients receiving chemotherapy : A systematic review and meta-analysis
Maginador, Guilherme, Lixandrão, Manoel E., Bortolozo, Henrique I., Vechin, Felipe C., Sarian, Luís O., Derchain, Sophie, Telles, Guilherme D., Zopf, Eva, Ugrinowitsch, Carlos and Conceição, Miguel S.. (2020). Aerobic exercise-induced changes in cardiorespiratory fitness in breast cancer patients receiving chemotherapy : A systematic review and meta-analysis. Cancers. 12(8), p. 2240. https://doi.org/10.3390/cancers12082240
Prognostic markers of overall survival in cancer patients attending a cachexia support service : An evaluation of clinically assessed physical function, malnutrition and inflammatory status
Bland, Kelcey A., Zopf, Eva M., Harrison, Meg, Ely, Matthew, Cormie, Prue, Liu, E., Dowd, Anna and Martin, Peter. (2020). Prognostic markers of overall survival in cancer patients attending a cachexia support service : An evaluation of clinically assessed physical function, malnutrition and inflammatory status. Nutrition and Cancer. 73(8), pp. 1400-1410. https://doi.org/10.1080/01635581.2020.1800765
Impact of exercise on chemotherapy tolerance and survival in early-stage breast cancer : A nonrandomized controlled trial
Kirkham, Amy A., Gelmon, Karen A., Van Patten, Cheri L., Bland, Kelcey A., Wollmann, Holly, McKenzie, Donald C., Landry, Taryne and Campbell, Kristin L.. (2020). Impact of exercise on chemotherapy tolerance and survival in early-stage breast cancer : A nonrandomized controlled trial. Journal of the National Comprehensive Cancer Network. 18(12), pp. 1670-1677. https://doi.org/10.6004/jnccn.2020.7603
PUB0201081895
Kirkham, Amy A., Virani, Sean A., Bland, Kelcey A., McKenzie, Donald C., Gelmon, Karen A., Warburton, Darren E. R. and Campbell, Kristin L.. (2020). PUB0201081895. Breast Cancer Research and Treatment. 184, pp. 75-85. https://doi.org/10.1007/s10549-020-05824-x
The effect of exercise on cancer-related cognitive impairment and applications for physical therapy : Systematic review of randomized controlled trials
Campbell, Kristin L., Zadravec, Kendra, Bland, Kelcey A., Chesley, Elizabeth, Wolf, Florian and Janelsins, Michelle C.. (2020). The effect of exercise on cancer-related cognitive impairment and applications for physical therapy : Systematic review of randomized controlled trials. Physical Therapy. 100(3), pp. 523-542. https://doi.org/10.1093/ptj/pzz090
Study protocol of the Aerobic exercise and CogniTIVe functioning in women with breAsT cancEr (ACTIVATE) trial: a two-arm, two-centre randomized controlled trial
Jennifer Brunet, Meagan Barrett-Bernstein, Kendra Zadravec, Monica Taljaard, Nathalie Levasseur, Amirrtha Srikanthan, Kelcey Bland, Barbara Collins, Julia W. Y. Kam, Todd C. Handy, Sherri Hayden, Christine Simmons, Andra M. Smith, Naznin Virji-Babul and Kristin L. Campbell. (2020). Study protocol of the Aerobic exercise and CogniTIVe functioning in women with breAsT cancEr (ACTIVATE) trial: a two-arm, two-centre randomized controlled trial. BMC Cancer. 20(1), pp. 1-14. https://doi.org/10.1186/s12885-020-07196-3
Implementing Exercise in Healthcare Settings: The Potential of Implementation Science
Louise Czosnek, Nicole Rankin, Eva Zopf, Justin Richards, Simon Rosenbaum and Prue Cormie. (2020). Implementing Exercise in Healthcare Settings: The Potential of Implementation Science. Sports Medicine. 50, pp. 1-14. https://doi.org/10.1007/s40279-019-01228-0
Exercise medicine for the management of androgen deprivation therapy-related side effects in prostate cancer
Cormie, Prue and Zopf, Eva M.. (2020). Exercise medicine for the management of androgen deprivation therapy-related side effects in prostate cancer. Urologic Oncology. 38(2), pp. 62 - 70. https://doi.org/10.1016/j.urolonc.2018.10.008
Updated systematic review of exercise studies in breast cancer survivors : Attention to the principles of exercise training
Neil-Sztramko, Sarah E., Winters-Stone, Kerri M., Bland, Kelcey A. and Campbell, Kristin L.. (2019). Updated systematic review of exercise studies in breast cancer survivors : Attention to the principles of exercise training. British Journal of Sports Medicine. 53(8), pp. 504-512. https://doi.org/10.1136/bjsports-2017-098389
Health benefits, safety and cost of physical activity interventions for mental health conditions: A meta-review to inform translation efforts
Czosnek, Louise, Lederman, Oscar, Cormie, Prue, Zopf, Eva M., Stubbs, Brendon and Rosenbaum, Simon. (2019). Health benefits, safety and cost of physical activity interventions for mental health conditions: A meta-review to inform translation efforts. Mental Health and Physical Activity. 16, pp. 140 - 151. https://doi.org/10.1016/j.mhpa.2018.11.001
Impact of exercise on chemotherapy completion rate: A systematic review of the evidence and recommendations for future exercise oncology research
Bland, Kelcey, Zadravec, Kendra, Landry, Taryne, Weller, Sarah, Meyers, Logan and Campbell, Kristin L.. (2019). Impact of exercise on chemotherapy completion rate: A systematic review of the evidence and recommendations for future exercise oncology research. Critical Reviews in Oncology Hematology. 136, pp. 79 - 85. https://doi.org/10.1016/j.critrevonc.2019.02.005
Effects of KYUSHO JITSU on physical activity-levels and quality of life in breast cancer patients
Strunk, Maximilian A., Zopf, Eva, Steck, Jule, Hamacher, Stefanie, Hallek, Michael and Baumann, Freerk T.. (2018). Effects of KYUSHO JITSU on physical activity-levels and quality of life in breast cancer patients. In Vivo: international journal of experimental and clinical pathophysiology and drug research. 32(4), pp. 819 - 824. https://doi.org/10.21873/invivo.11313
Sustainable impact of an individualized exercise program on physical activity level and fatigue syndrome on breast cancer patients in two German rehabilitation centers
Baumann, Freerk T., Bieck, Oliver, Oberste, Max, Kuhn, Rafaela, Schmitt, Joachim, Wentrock, Steffen, Zopf, Eva, Bloch, Wilhelm, Schüle, Klaus and Reuss-Borst, Monika. (2017). Sustainable impact of an individualized exercise program on physical activity level and fatigue syndrome on breast cancer patients in two German rehabilitation centers. Supportive Care in Cancer. 25(4), pp. 1047 - 1054. https://doi.org/10.1007/s00520-016-3490-x
The impact of exercise on cancer mortality, recurrence, and treatment-related adverse effects
Cormie, Prue, Zopf, Eva, Zhang, Xiaochen and Schmitz, Kathryn H.. (2017). The impact of exercise on cancer mortality, recurrence, and treatment-related adverse effects. Epidemiologic Reviews. 39(1), pp. 71 - 92. https://doi.org/10.1093/epirev/mxx007
Associations between aerobic exercise levels and physical and mental health outcomes in men with bone metastatic prostate cancer: A cross-sectional investigation
Zopf, Eva M., Newton, Robert, Taaffe, Dennis R., Spry, Nigel A., Cormie, Prue, Joseph, David, Chambers, Suzanne, Baumann, Freerk T., Bloch, W. and Galvao, Daniel. (2017). Associations between aerobic exercise levels and physical and mental health outcomes in men with bone metastatic prostate cancer: A cross-sectional investigation. European Journal of Cancer Care. 26(6), pp. 1 - 7. https://doi.org/10.1111/ecc.12575
Clinically relevant physical benefits of exercise interventions in breast cancer survivors
Kirkham, Amy A., Bland, Kelcey A., Sayyari, Sarah, Campbell, Kristin L. and Davis, Margot K.. (2016). Clinically relevant physical benefits of exercise interventions in breast cancer survivors. Current Oncology Reports. 19(12), p. Article: 12. https://doi.org/10.1007/s11912-015-0496-3
Impact of physical inactivity on the multifactorial process of developing cancer-related cognitive impairments
Pesendorfer, L. M., Zimmer, Philipp, Galvao, Daniel, Zopf, Eva M., Bloch, Wilhelm and Baumann, Freerk T.. (2016). Impact of physical inactivity on the multifactorial process of developing cancer-related cognitive impairments. Journal of Cancer Science and Therapy (online). 8(8), pp. 222 - 227. https://doi.org/10.4172/1948-5956.1000417
Exercise-induced natural killer cell activation is driven by epigenetic modifications
Zimmer, Philipp, Bloch, Wilhelm, Schenk, Alexander, Zopf, Eva M., Hildebrandt, U., Streckmann, F., Beulertz, J., Koliamitra, C., Schollmayer, Friederike and Baumann, F.. (2015). Exercise-induced natural killer cell activation is driven by epigenetic modifications. International Journal of Sports Medicine. 36(6), pp. 510 - 515. https://doi.org/10.1055/s-0034-1398531
Recommendations for assessment methods for exercise trials with cancer patients
Scharhag-Rosenberger, F., Becker, T., Streckmann, F., Schmidt, K., Berling, A., Bernardi, A., Engeroff, T., Exner, A. K., Gutekunst, K., Hofmeister, D., Jensen, W., Kähnert, H., Kneis, S., Limbach, M., Mau-Möller, A., Röcker, K., Schmidt, M. E., Schmidt, T., Stöckel, T., ... Karen, Steindorf. (2014). Recommendations for assessment methods for exercise trials with cancer patients. Deutsche Zeitschrift fur Sportmedizin. 65(11), pp. 304 - 313. https://doi.org/10.5960/dzsm.2014.148
Physical activity and exercise recommendations for cancer patients during rehabilitation
Zopf, Eva M., Baumann, Freerk T. and Pfeifer, K.. (2014). Physical activity and exercise recommendations for cancer patients during rehabilitation. Rehabilitation (Germany). 53(1), pp. 2 - 7. https://doi.org/10.1055/s-0033-1334916
Feasibility of an isometric maximal voluntary contraction test in hematological cancer patients during thrombocytopenia
Zimmer, Philipp, Baumann, Freerk T., Ebel, Janis, Zopf, Eva Maria, Bloch, Wilhelm and Elter, Thomas. (2013). Feasibility of an isometric maximal voluntary contraction test in hematological cancer patients during thrombocytopenia. Journal of Sports Medicine. 2013(Article ID 470489), pp. 1-6. https://doi.org/10.1155/2013/470489
Clinical exercise interventions in prostate cancer patients-a systematic review of randomized controlled trials
Baumann, Freerk T., Zopf, Eva M. and Bloch, Wilhelm. (2012). Clinical exercise interventions in prostate cancer patients-a systematic review of randomized controlled trials. Supportive Care in Cancer. 20(2), pp. 221 - 233. https://doi.org/10.1007/s00520-011-1271-0
Implementation and scientific evaluation of rehabilitative sports groups for prostate cancer patients: Study protocol of the ProRehab Study
Zopf, Eva M., Braun, Moritz, Machtens, Stefan, Zumbé, Jürgen, Bloch, Wilhelm and Baumann, Freerk T.. (2012). Implementation and scientific evaluation of rehabilitative sports groups for prostate cancer patients: Study protocol of the ProRehab Study. BMC Cancer. 12(312), pp. 1 - 7. https://doi.org/10.1186/1471-2407-12-312
Physical activity for patients undergoing an allogeneic hematopoietic stem cell transplantation: Benefits of a moderate exercise intervention
Baumann, Freerk T., Zopf, Eva M., Nykamp, Eike, Kraut, Ludwig, Schüle, Klaus, Elter, Thomas, Fauser, Axel A. and Bloch, Wilhelm. (2011). Physical activity for patients undergoing an allogeneic hematopoietic stem cell transplantation: Benefits of a moderate exercise intervention. European Journal of Haematology. 87(2), pp. 148 - 156. https://doi.org/10.1111/j.1600-0609.2011.01640.x