Differentiating experience from cue utilization in radiological assessments

Journal article


Carrigan, Ann J., Magnussen, John, Georgiou, Andrew, Curby, Kim M., Palmeri, Thomas J. and Wiggins, Mark W.. (2021). Differentiating experience from cue utilization in radiological assessments. Human Factors. 63(4), pp. 635-646. https://doi.org/10.1177/0018720820902576
AuthorsCarrigan, Ann J., Magnussen, John, Georgiou, Andrew, Curby, Kim M., Palmeri, Thomas J. and Wiggins, Mark W.
Abstract

Objective: this research was designed to examine the contribution of self-reported experience and cue utilization to diagnostic accuracy in the context of radiology.

Background: within radiology, it is unclear how task related experience contributes to the acquisition of associations between features with events in memory, or cues, and how they contribute to diagnostic performance.

Method: data were collected from 18 trainees and 41 radiologists. the participants completed a radiology edition of the established cue utilization assessment tool expertise 2.0, which provides a measure of cue utilization based on performance on a number of domain-specific tasks. The participants also completed a separate image interpretation task as an independent measure of diagnostic performance.

Results: consistent with previous research, a k-means cluster analysis using the data from expertise 2.0 delineated two groups, the pattern of centroids of which reflected higher and lower cue utilization. Controlling for years of experience, participants with higher cue utilization were more accurate on the image interpretation task compared to participants who demonstrated relatively lower cue utilization (p = .01).

Conclusion: this study provides support for the role of cue utilization in assessments of radiology images among qualified radiologists. Importantly, it also demonstrates that cue utilization and self-reported years of experience as a radiologist make independent contributions to performance on the radiological diagnostic task.

Application: task-related experience, including training, needs to be structured to ensure that learners have the opportunity to acquire feature–event relationships and internalize these associations in the form of cues in memory.

Keywordsnaturalistic decision making; radiology and medical imaging; organizational psychology
Year01 Jan 2021
JournalHuman Factors
Journal citation63 (4), pp. 635-646
PublisherSage Publications, Inc. (US)
ISSN0018-7208
Digital Object Identifier (DOI)https://doi.org/10.1177/0018720820902576
Web address (URL)https://journals.sagepub.com/doi/10.1177/0018720820902576
Open accessPublished as non-open access
Research or scholarlyResearch
Page range635-646
Publisher's version
License
All rights reserved
File Access Level
Controlled
Output statusPublished
Publication dates
Online09 Mar 2020
Publication process dates
Accepted06 Jan 2020
Deposited03 Dec 2024
ARC Funded ResearchThis output has been funded, wholly or partially, under the Australian Research Council Act 2001
Grant IDDP180100425
Additional information

Copyright © 2020, Human Factors and Ergonomics Society.

This work is funded by an Australian Research Council Discovery Project Grant (DP180100425).

Place of publicationUnited States
Permalink -

https://acuresearchbank.acu.edu.au/item/911v8/differentiating-experience-from-cue-utilization-in-radiological-assessments

Restricted files

Publisher's version

  • 4
    total views
  • 0
    total downloads
  • 4
    views this month
  • 0
    downloads this month
These values are for the period from 19th October 2020, when this repository was created.

Export as

Related outputs

Strategies to improve care for older adults who present to the emergency department : A systematic review
Testa, Luke, Richardson, Lieke, Cheek, Colleen, Hensel, Theresa, Austin, Elizabeth E., Safi, Mariam, Ransolin, Natália, Carrigan, Ann, Long, Janet, Hutchinson, Karen, Goirand, Magali, Bierbaum, Mia, Bleckley, Felicity, Hibbert, Peter, Churruca, Kate and Clay-Williams, Robyn. (2024). Strategies to improve care for older adults who present to the emergency department : A systematic review. BMC Health Services Research. 24(1), pp. 1-35. https://doi.org/10.1186/s12913-024-10576-1
Consumer and provider perceptions of the specialist unit model of care : A qualitative study
Long, Janet C., Carrigan, Ann, Roberts, Natalie, Clay-Williams, Robyn, Hibbert, D, Zurynski, Yvonne, Maka, Katherine, Loy, Graeme and Braithwaite, Jeffrey. (2024). Consumer and provider perceptions of the specialist unit model of care : A qualitative study. PLoS One. 19, pp. 1-16. https://doi.org/10.1371/journal.pone.0293025
Birang Daruganora : what do Aboriginal and Torres Strait Islander communities need in a new hospital? A qualitative study
Austin, Elizabeth E., Carrigan, Ann, Holden, Narelle, Grigg, Shai, Maka, Katherine, Clay-Williams, Robyn, Hibbert, Peter, Loy, Graeme and Braithwaite, Jeffrey. (2024). Birang Daruganora : what do Aboriginal and Torres Strait Islander communities need in a new hospital? A qualitative study. BMJ Open. 14(5), pp. 1-11. https://doi.org/10.1136/bmjopen-2023-078658
Improving emergency department care for adults presenting with mental illness : a systematic review of strategies and their impact on outcomes, experience, and performance
Austin, Elizabeth E., Cheek, Colleen, Richardson, Lieke, Testa, Luke, Dominello, Amanda, Long, Janet C., Carrigan, Ann, Ellis, Louise A., Norman, Alicia, Murphy, Margaret, Smith, Kylie, Gillies, Donna and Clay-Williams, Robyn. (2024). Improving emergency department care for adults presenting with mental illness : a systematic review of strategies and their impact on outcomes, experience, and performance. Frontiers in Psychiatry. 15, pp. 1-14. https://doi.org/10.3389/fpsyt.2024.1368129
Experience-based codesign approach to improve care in Australian emergency departments for complex consumer cohorts : the MyED project protocol, Stages 1.1-1.3
Cheek, Colleen, Hayba, Nema, Richardson, Lieke, Austin, Elizabeth E., Francis-Auton, Emilie, Safi, Mariam, Ransolin, Natália, Vukasovic, Matthew, De Los Santos, Aaron, Murphy, Margaret, Harrison, Reema, Churruca, Kate, Long, Janet C., Hibbert, Peter, Carrigan, Ann, Newman, Bronwyn, Hutchinson, Karen, Mitchell, Rebecca, Cutler, Henry, ... Clay-Williams, Robyn. (2023). Experience-based codesign approach to improve care in Australian emergency departments for complex consumer cohorts : the MyED project protocol, Stages 1.1-1.3. BMJ Open. 13(7), pp. 1-8. https://doi.org/10.1136/bmjopen-2023-072908
Innovative models of healthcare delivery : an umbrella review of reviews
Roberts, Natalie, Carrigan, Ann, Clay-Williams, Robyn, Hibbert, Peter, Mahmoud, Zeyad, Pomare, Chiara, Pulido, Diana Fajardo, Meulenbroeks, Isabelle, Knaggs, Gilbert Thomas, Austin, Elizabeth E., Churruca, Kate, Ellis, Louise A., Long, Janet C., Hutchinson, Karen and et. al.. (2023). Innovative models of healthcare delivery : an umbrella review of reviews. BMJ Open. 13(2), pp. 1-11. https://doi.org/10.1136/bmjopen-2022-066270
Strategies to Improve Care in the Emergency Department for Culturally and Linguistically Diverse Adults : a Systematic Review
Hayba, Nematullah, Cheek, Colleen, Austin, Elizabeth E., Testa, Luke, Richardson, Lieke, Safi, Mariam, Ransolin, Natália, Carrigan, Ann, Harrison, Reema, Francis-Auton, Emilie and Clay-Williams, Robyn. (2023). Strategies to Improve Care in the Emergency Department for Culturally and Linguistically Diverse Adults : a Systematic Review. Journal of Racial and Ethnic Health Disparities. pp. 1-21. https://doi.org/10.1007/s40615-023-01876-z
Transition models of care for type 1 diabetes : a systematic review
Zurynski, Yvonne, Carrigan, Ann, Meulenbroeks, Isabelle, Sarkies, Mitchell N., Dammery, Genevieve, Halim, Nicole, Lake, Rebecca, Davis, Elizabeth, Jones, Timothy W. and Braithwaite, Jeffrey. (2023). Transition models of care for type 1 diabetes : a systematic review. BMC Health Services Research. 23(1), pp. 1-15. https://doi.org/10.1186/s12913-023-09644-9
The journey to a learning health system in primary care : a qualitative case study utilising an embedded research approach
Dammery, Genevieve, Ellis, Louise A., Churruca, Kate, Mahadeva, Janani, Lopez, Francisco, Carrigan, Ann, Halim, Nicole, Willcock, Simon and Braithwaite, Jeffrey. (2023). The journey to a learning health system in primary care : a qualitative case study utilising an embedded research approach. BMC Primary Care. 24(22), pp. 1-10. https://doi.org/10.1186/s12875-022-01955-w
The diversity of providers’ and consumers’ views of virtual versus inpatient care provision : a qualitative study
Clay-Williams, Robyn, Hibbert, Peter, Carrigan, Ann, Roberts, Natalie, Austin, Elizabeth E., Pulido, Diana Fajardo, Meulenbroeks, Isabelle, Nguyen, Hoa Mi, Sarkies, Mitchell N., Hatem, Sarah, Maka, Katherine, Loy, Graeme and Braithwaite, Jeffrey. (2023). The diversity of providers’ and consumers’ views of virtual versus inpatient care provision : a qualitative study. BMC Health Services Research. 23(1), pp. 1-12. https://doi.org/10.1186/s12913-023-09715-x
Consumer and Provider Perspectives on Hospital in the Home : A Qualitative Study
Roberts, Natalie, Carrigan, Ann, Hibbert, Peter, Williams, Robyn-Clay, Austin, Elizabeth E., Pulido, Diana Fajardo, Meulenbroeks, Isabelle, Nguyen, Hoa Mi, Hatem, Sarah, Maka, Katherine, Loy, Graeme and Braithwaite, Jeffrey. (2023). Consumer and Provider Perspectives on Hospital in the Home : A Qualitative Study. Health & Social Care in the Community. 2023, pp. 1-11. https://doi.org/10.1155/2023/7105751
What do consumer and providers view as important for integrated care? A qualitative study
Carrigan, Ann, Roberts, Natalie, Clay-Williams, Robyn, Hibbert, Peter, Austin, Elizabeth E., Pulido, Diana Fajardo, Meulenbroeks, Isabelle, Nguyen, Hoa Mi, Sarkies, Mitchell N., Hatem, Sarah, Maka, Katherine, Loy, Graeme and Braithwaite, Jeffrey. (2023). What do consumer and providers view as important for integrated care? A qualitative study. BMC Health Services Research. 23(1), pp. 1-11. https://doi.org/10.1186/s12913-022-08997-x
Built to last? Barriers and facilitators of healthcare program sustainability : a systematic integrative review
Zurynski, Yvonne, Ludlow, Kristiana, Testa, Luke, Augustsson, Hanna, Herkes-Deane, Jessica, Hutchinson, Karen, Lamprell, Gina, McPherson, Elise, Carrigan, Ann, Ellis, Louise A., Dharmayani, Putu Novi Arfirsta, Smith, Carolynn L., Richardson, Lieke, Dammery, Genevieve, Singh, Nehal and Braithwaite, Jeffrey. (2023). Built to last? Barriers and facilitators of healthcare program sustainability : a systematic integrative review. Implementation Science. 18(1), pp. 1-21. https://doi.org/10.1186/s13012-023-01315-x
Birang Daruganora : A protocol for a qualitative study to elicit Aboriginal and Torres Strait Islander community views about cultural needs and experiences for a new Australian health facility
Carrigan, Ann, Austin, Elizabeth E., Clay-Williams, Robyn, Hibbert, Peter, Maka, Katherine, Holden, Narelle, Grigg, Shai, Loy, Graeme and Braithwaite, Jeffrey. (2023). Birang Daruganora : A protocol for a qualitative study to elicit Aboriginal and Torres Strait Islander community views about cultural needs and experiences for a new Australian health facility. BMJ Open. 13(4), pp. 1-6. https://doi.org/10.1136/bmjopen-2022-069951
Predictors of response rates of safety culture questionnaires in healthcare : a systematic review and analysis
Ellis, Louise A., Pomare, Chiara, Churruca, Kate, Carrigan, Ann, Meulenbroeks, Isabelle, Saba, Maree and Braithwaite, Jeffrey. (2022). Predictors of response rates of safety culture questionnaires in healthcare : a systematic review and analysis. BMJ Open. 12(9), pp. 1-7. https://doi.org/10.1136/bmjopen-2022-065320
The role of cue-based strategies in skilled diagnosis among pathologists
Carrigan, Ann J., Charlton, Amanda, Foucar, Elliott, Wiggins, Mark W., Georgiou, Andrew, Palmeri, Thomas J. and Curby, Kim M.. (2022). The role of cue-based strategies in skilled diagnosis among pathologists. Human Factors. 64(7), pp. 1154-1167. https://doi.org/10.1177/0018720821990160
Cue utilisation reduces the impact of response bias in histopathology
Carrigan, A. J., Charlton, A., Wiggins, M. W., Georgiou, A, Palmeri, T and Curby, K. M.. (2022). Cue utilisation reduces the impact of response bias in histopathology. Applied Ergonomics : Human factors in technology and society. 98, pp. 1-10. https://doi.org/10.1016/j.apergo.2021.103590
Innovative models of care for the health facility of the future : a protocol for a mixed-methods study to elicit consumer and provider views
Carrigan, Ann, Roberts, Natalie, Clay-Williams, Robyn, Hibbert, Peter, Pomare, Chiara, Mahmoud, Zeyad, Maka, Katherine, Mitchell, Rebecca, Zurynski, Yvonne, Long, Janet C., Rapport, Frances, Arnolda, Gaston, Loy, Graeme and Braithwaite, Jeffrey. (2022). Innovative models of care for the health facility of the future : a protocol for a mixed-methods study to elicit consumer and provider views. BMJ Open. 12(11), pp. 1-8. https://doi.org/10.1136/bmjopen-2021-059330
Mapping care provision for type 1 diabetes throughout Australia : A protocol for a mixed-method study
Carrigan, Ann, Lake, Rebecca, Zoungas, Sophia, Huynh, Tony, Couper, Jennifer, Davis, Elizabeth, Jones, Timothy W., Bloom, David, Braithwaite, Jeffrey and Zurynski, Yvonne. (2022). Mapping care provision for type 1 diabetes throughout Australia : A protocol for a mixed-method study. BMJ Open. 12(12), pp. 1-6. https://doi.org/10.1136/bmjopen-2022-067209
The invisible breast cancer : Experience does not protect against inattentional blindness to clinically relevant findings in radiology
Williams, Lauren, Carrigan, Ann, Auffermann, William, Mills, Megan, Rich, Anina, Elmore, Joann and Drew, Trafton. (2021). The invisible breast cancer : Experience does not protect against inattentional blindness to clinically relevant findings in radiology. Psychonomic Bulletin and Review. 28(2), pp. 503-511. https://doi.org/10.3758/s13423-020-01826-4
Spatial and time domain analysis of eye-tracking data during screening of brain magnetic resonance images
Suman, Abdulla Al, Russo, Carlo, Carrigan, Ann, Nalepka, Patrick, Liquet-Weiland, Benoit, Newport, Robert Ahadizad, Kumari, Poonam and Ieva, Antonio Di. (2021). Spatial and time domain analysis of eye-tracking data during screening of brain magnetic resonance images. PLoS One. 16, pp. 1-19. https://doi.org/10.1371/journal.pone.0260717
Static versus dynamic medical images : The role of cue utilization in diagnostic performance
Carrigan, Ann J., Stoodley, Paul, Ng, Kenny, Moerel, Denise and Wiggins, Mark W.. (2021). Static versus dynamic medical images : The role of cue utilization in diagnostic performance. Applied Cognitive Psychology. 35(5), pp. 1284-1296. https://doi.org/10.1002/acp.3861
What can an echocardiographer see in briefly presented stimuli? Perceptual expertise in dynamic search
Carrigan, A. J., Stoodley, P., Fernandez, F. and Wiggins, M. W.. (2020). What can an echocardiographer see in briefly presented stimuli? Perceptual expertise in dynamic search. Cognitive Research: Principles and Implications. 5(1), pp. 1-14. https://doi.org/10.1186/s41235-020-00232-7
Individual differences in echocardiography : Visual object recognition ability predicts cue utilization
Carrigan, Ann J., Stoodley, Paul, Fernandez, Fernando, Sunday, Mackenzie A. and Wiggins, Mark W.. (2020). Individual differences in echocardiography : Visual object recognition ability predicts cue utilization. Applied Cognitive Psychology. 34(6), pp. 1369-1378. https://doi.org/10.1002/acp.3711
Optimising the future of technology in organisations : A human factors perspective
Wiggins, Mark W., Auton, Jaime, Bayl-Smith, Piers and Carrigan, Ann. (2020). Optimising the future of technology in organisations : A human factors perspective. Australian Journal of Management. 45(3), pp. 449-467. https://doi.org/10.1177/0312896220918915
Exploring the effect of context and expertise on attention : is attention shifted by information in medical images?
Carrigan, Ann, Curby, Kim, Moerel, Denise and Rich, Anina N.. (2019). Exploring the effect of context and expertise on attention : is attention shifted by information in medical images? Attention, Perception and Psychophysics. 81(5), pp. 1283-1296. https://doi.org/10.3758/s13414-019-01695-7
Do target detection and target localization always go together? Extracting information from briefly presented displays
Carrigan, Ann, Wardle, Susan G. and Rich, Anina N.. (2019). Do target detection and target localization always go together? Extracting information from briefly presented displays. Attention, Perception and Psychophysics. 81(8), pp. 2685-2699. https://doi.org/10.3758/s13414-019-01782-9
Finding cancer in mammograms : if you know it’s there, do you know where?
Carrigan, Ann, Wardle, Susan G. and Rich, Anina N.. (2018). Finding cancer in mammograms : if you know it’s there, do you know where? Cognitive Research: Principles and Implications. 3(10), pp. 1-14. https://doi.org/10.1186/s41235-018-0096-5