Using eye-tracking measures to predict reading comprehension

Journal article


Mézière, Diane C., Yu, Lili, Reichle, Erik D., von der Malsburg, Titus and McArthur, Genevieve. (2023). Using eye-tracking measures to predict reading comprehension. Reading Research Quarterly. 58(3), pp. 425-449. https://doi.org/10.1002/rrq.498
AuthorsMézière, Diane C., Yu, Lili, Reichle, Erik D., von der Malsburg, Titus and McArthur, Genevieve
Abstract

This study examined the potential of eye-tracking as a tool for assessing reading comprehension. We administered three widely used reading comprehension tests with varying task demands to 79 typical adult readers while monitoring their eye movements. In the York Assessment of Reading for Comprehension (YARC), participants were given passages of text to read silently, followed by comprehension questions. In the Gray Oral Reading Test (GORT-5), participants were given passages of text to read aloud, followed by comprehension questions. In the sentence comprehension subtest of the Wide Range Achievement Test (WRAT-4), participants were asked to provide a missing word in sentences that they read silently (i.e., a cloze task). Linear models predicting comprehension scores from eye-tracking measures yielded different results for the three tests. Eye-tracking measures explained significantly more variance than reading-speed data for the YARC (four times better), GORT (three times better), and the WRAT (1.3 time better). Importantly, there was no common strong predictor for all three tests. These results support growing recognition that reading comprehension tests do not measure the same cognitive processes, and that participants adapt their reading strategies to the tests' varying task demands. This study also suggests that eye-tracking may provide a useful alternative for measuring reading comprehension

Keywordsreading comprehension; eye-tracking ; eye movements; reading comprehension tests
Year01 Jan 2023
JournalReading Research Quarterly
Journal citation58 (3), pp. 425-449
PublisherJohn Wiley & Sons, Inc. (US)
ISSN0034-0553
Digital Object Identifier (DOI)https://doi.org/10.1002/rrq.498
Web address (URL)https://ila.onlinelibrary.wiley.com/doi/10.1002/rrq.498
Open accessOpen access
Research or scholarlyResearch
Page range425-449
Publisher's version
License
File Access Level
Open
Output statusPublished
Publication dates
Online04 Apr 2023
Publication process dates
Accepted06 Mar 2023
Deposited26 Jul 2024
Supplemental file
License
File Access Level
Open
ARC Funded ResearchThis output has been funded, wholly or partially, under the Australian Research Council Act 2001
Grant IDDP190100719
DP200100311
Additional information

© 2023 The Authors.

Reading Research Quarterly published by Wiley Periodicals LLC on behalf of International Literacy Association. This is an open access article under the terms of the Creative Commons Attribution License, which permits use, distribution and reproduction in any medium, provided the original work is properly cited.

Research funding: Australian Research Council,
Macquarie University

This research was supported by an International Macquarie University Research Excellence Scholarship (iMQRES) and two Australian Research Council grants (DP190100719 & DP200100311).

Place of publicationUnited States
Permalink -

https://acuresearchbank.acu.edu.au/item/90v75/using-eye-tracking-measures-to-predict-reading-comprehension

Download files

Publisher's version
OA_McArthur_2023_Using_eye_tracking_measures_to_predict.pdf
License: CC BY 4.0
File access level: Open

Supplemental file
SM_McArthur_2023_Using_eye_tracking_measures_to_predict.pdf
License: CC BY 4.0
File access level: Open

  • 23
    total views
  • 24
    total downloads
  • 1
    views this month
  • 2
    downloads this month
These values are for the period from 19th October 2020, when this repository was created.

Export as

Related outputs

Reading and emotional-behavioural development in Finnish children : a longitudinal study of associations
Robidoux, Serje, Eklund, Kenneth, McArthur, Genevieve, Francis, Deanna A., Aro, Tuija and Torppa, Minna. (2024). Reading and emotional-behavioural development in Finnish children : a longitudinal study of associations. Reading and Writing. pp. 1-24. https://doi.org/10.1007/s11145-024-10559-y
A scoping review on the use of consumer-grade EEG devices for research
Sabio, Joshua, Williams, Nikolas S., McArthur, Genevieve and Badcock, N. A.. (2024). A scoping review on the use of consumer-grade EEG devices for research. PLoS One. 19(3), pp. 1-22. https://doi.org/10.1371/journal.pone.0291186
Are comorbidities of poor reading related to elevated anxiety in children?
McArthur, Genevieve, Doust, Amy, Banales, Erin, Robidoux, Serje and Kohnen, Saskia Regina. (2024). Are comorbidities of poor reading related to elevated anxiety in children? Annals of Dyslexia. 74(1), pp. 47-65. https://doi.org/10.1007/s11881-023-00292-6
The Impact of Shared Book Reading on Children and Families : A Study of Dolly Parton’s Imagination Library in Tamworth, Australia
Galea, Claire, Robidoux, Serje, Salins, Andrea, Noble, Clayton and McArthur, Genevieve. (2024). The Impact of Shared Book Reading on Children and Families : A Study of Dolly Parton’s Imagination Library in Tamworth, Australia. Journal of Research in Childhood Education: an international journal of research on the education of children. pp. 1-30. https://doi.org/10.1080/02568543.2024.2322731
An interdisciplinary approach to enhance children’s listening, learning, and wellbeing in the classroom : The Listen to Learn for Life (L3) Assessment Framework
Mealings, Kiri, Miles, Kelly, Parrila, Rauno, Holt, Rebecca, Cox, Felicity, Dillon, Harvey, Sharma, Mridula, Demuth, Katherine, Leigh, Greg, McMahon, Catherine, McArthur, Genevieve and Buchholz, Joerg M.. (2023). An interdisciplinary approach to enhance children’s listening, learning, and wellbeing in the classroom : The Listen to Learn for Life (L3) Assessment Framework. Frontiers in Education. 8, p. Article 1185167. https://doi.org/10.3389/feduc.2023.1185167
Scanpath regularity as an index of reading comprehension
Mézière, Diane C., Yu, Lili, McArthur, Genevieve, Reichle, Erik D. and von der Malsburg, Titus. (2023). Scanpath regularity as an index of reading comprehension. Scientific Studies of Reading. pp. 1-22. https://doi.org/10.1080/10888438.2023.2232063
Poor reading and anxiety (PRAX) : Building a theory and practice
McArthur, Genevieve. (2022). Poor reading and anxiety (PRAX) : Building a theory and practice. Australian Journal of Learning Difficulties. 27(1), pp. 169-180. https://doi.org/10.1080/19404158.2022.2054834
Are different reading problems associated with different anxiety types?
Francis, Deanna A., Hudson, Jennifer L., Robidoux, Serje and McArthur, Genevieve M.. (2022). Are different reading problems associated with different anxiety types? Applied Cognitive Psychology. 36(4), pp. 793-804. https://doi.org/10.1002/acp.3970
Tracking the relations between children’s reading and emotional health across time : Evidence from four large longitudinal studies
McArthur, Genevieve, Badcock, Nicholas, Castles, Anne and Robidoux, Serje. (2022). Tracking the relations between children’s reading and emotional health across time : Evidence from four large longitudinal studies. Reading Research Quarterly. 57(2), pp. 555-585. https://doi.org/10.1002/rrq.426
It’s all about time : Precision and accuracy of Emotiv event-marking for ERPD research
Williams, Nikolas S., McArthur, Genevieve M. and Badcock, Nicholas A.. (2021). It’s all about time : Precision and accuracy of Emotiv event-marking for ERPD research. PeerJ. 9, p. Article e10700. https://doi.org/10.7717/peerj.10700
The effect of an integrated reading and anxiety intervention for poor readers with anxiety
Francis, Deanna, Hudson, Jennifer L., Kohnen, Saskia, Mobach, Lynn and McArthur, Genevieve M.. (2021). The effect of an integrated reading and anxiety intervention for poor readers with anxiety. PeerJ. 9, p. Article e10987. https://doi.org/10.7717/peerj.10987
Videoconferencing interventions for children with reading and spelling difficulties : A pilot study
Kohnen, Saskia, Banales, Erin and McArthur, Genevieve. (2021). Videoconferencing interventions for children with reading and spelling difficulties : A pilot study. Telemedicine and e-health. 27(5), pp. 537-543. https://doi.org/10.1089/tmj.2020.0061
Profiling the word reading abilities of school-age children with neurofibromatosis type 1
Arnold, Shelley, Payne, Jonathan, McArthur, Genevieve, North, Kathryn and Barton, Belinda. (2021). Profiling the word reading abilities of school-age children with neurofibromatosis type 1. Journal of the International Neuropsychological Society. 27(5), pp. 484-496. https://doi.org/10.1017/S135561772000106X
A validation of Emotiv EPOC Flex saline for EEG and ERP research
Williams, Nikolas S., McArthur, Genevieve, de Wit, Bianca, Ibrahim, George and Badcock, N. A.. (2020). A validation of Emotiv EPOC Flex saline for EEG and ERP research. PeerJ. 8, p. Article e9713. https://doi.org/10.7717/peerj.9713
Self-concept in poor readers : A systematic review and meta-analysis
McArthur, Genevieve M., Filardi, Nicola, Francis, Deanna A., Boyes, Mark E. and Badcock, Nicholas A.. (2020). Self-concept in poor readers : A systematic review and meta-analysis. PeerJ. 8, p. Article e8772. https://doi.org/10.7717/peerj.8772
Children's knowledge of single- and multiple-letter grapheme-phoneme correspondences : An exploratory study
Larsen, Linda, Schauber, Stefan Kilian, Kohnen, Saskia, Nickels, Lyndsey and McArthur, Genevieve. (2020). Children's knowledge of single- and multiple-letter grapheme-phoneme correspondences : An exploratory study. Early Childhood Research Quarterly. 51, pp. 379-391. https://doi.org/10.1016/j.ecresq.2019.12.001
The effect of non-communicative eye movements on joint attention
Caruana, Nathan, Alhasan, Ayeh, Wagner, Kirilee, Kaplan, David M., Woolgar, Alexandra and McArthur, Genevieve. (2020). The effect of non-communicative eye movements on joint attention. Quarterly Journal of Experimental Psychology. 73(12), pp. 2389-2402. https://doi.org/10.1177/1747021820945604
The mind minds minds : The effect of intentional stance on the neural encoding of joint attention
Caruana, Nathan and McArthur, Genevieve. (2019). The mind minds minds : The effect of intentional stance on the neural encoding of joint attention. Cognitive, Affective and Behavioral Neuroscience. 19(6), pp. 1479-1491. https://doi.org/10.3758/s13415-019-00734-y
Peripheral preview abolishes N170 face-sensitivity at fixation : Using fixation-related potentials to investigate dynamic face processing
de Lissa, Peter, McArthur, Genevieve, Hawelka, Stefan, Palermo, Romina, Mahajan, Yatin, Degno, Federica and Hutzler, Florian. (2019). Peripheral preview abolishes N170 face-sensitivity at fixation : Using fixation-related potentials to investigate dynamic face processing. Visual Cognition. 27(9-10), pp. 740-759. https://doi.org/10.1080/13506285.2019.1676855
The association between poor reading and internalising problems : A systematic review and meta-analysis
Francis, Deanna A., Caruana, Nathan, Hudson, Jennifer L. and McArthur, Genevieve M.. (2019). The association between poor reading and internalising problems : A systematic review and meta-analysis. Clinical Psychology Review. 67, pp. 45-60. https://doi.org/10.1016/j.cpr.2018.09.002
Syntactic processing in music and language : Effects of interrupting auditory streams with alternating timbres
Fiveash, Anna, Thompson, William Forde, Badcock, Nicholas A. and McArthur, Genevieve. (2018). Syntactic processing in music and language : Effects of interrupting auditory streams with alternating timbres. International Journal of Psychophysiology. 129, pp. 31-40. https://doi.org/10.1016/j.ijpsycho.2018.05.003
Syntactic and non-syntactic sources of interference by music on language processing
Fiveash, Anna, McArthur, Genevieve and Thompson, William Forde. (2018). Syntactic and non-syntactic sources of interference by music on language processing. Scientific Reports. 8(1), p. Article 17918. https://doi.org/10.1038/s41598-018-36076-x
Joint attention difficulties in autistic adults : An interactive eye-tracking study
Caruana, Nathan, Stieglitz Ham, Heidi, Brock, Jon, Woolgar, Alexandra, Kloth, Nadine, Palermo, Romina and McArthur, Genevieve. (2018). Joint attention difficulties in autistic adults : An interactive eye-tracking study. Autism. 22(4), pp. 502-512. https://doi.org/10.1177/1362361316676204
Phonics training for English-speaking poor readers (Review)
McArthur, Genevieve, Eve, Phillipa, Jones, Kristy, Banales, Erin, Kohnen, Saskia, Anandakumar, Thushara, Larsen, Linda, Marinus, Eva, Wang, Hua-Chen and Castles, Anne. (2018). Phonics training for English-speaking poor readers (Review). Cochrane Database of Systematic Reviews. 2018(11), p. Article CD009115. https://doi.org/10.1002/14651858.CD009115.pub3
Variations within a subtype : Developmental surface dyslexias in English
Kohnen, Saskia, Nickels, Lyndsey, Geigis, Leonie, Coltheart, Max, McArthur, Genevieve and Castles, Anne. (2018). Variations within a subtype : Developmental surface dyslexias in English. Cortex. 106, pp. 151-163. https://doi.org/10.1016/j.cortex.2018.04.008
An investigation of grapheme parsing and grapheme-phoneme knowledge in two children with dyslexia
Larsen, Linda, Kohnen, Saskia, McArthur, Genevieve and Nickels, Lyndsey. (2018). An investigation of grapheme parsing and grapheme-phoneme knowledge in two children with dyslexia. Reading and Writing. 31(4), pp. 991-1015. https://doi.org/10.1007/s11145-018-9823-z
No meditation-related changes in the auditory N1 during first-time meditation
Barnes, L. J., McArthur, G. M., Biedermann, B. A., de Lissa, P., Polito, V. and Badcock, N. A.. (2018). No meditation-related changes in the auditory N1 during first-time meditation. International Journal of Psychophysiology. 127, pp. 26-37. https://doi.org/10.1016/j.ijpsycho.2018.03.003
Detecting communicative intent in a computerised test of joint attention
Caruana, Nathan, McArthur, Genevieve, Woolgar, Alexandra and Brock, Jon. (2017). Detecting communicative intent in a computerised test of joint attention. PeerJ. 2017(1), pp. 1-16. https://doi.org/10.7717/peerj.2899
Helping children with reading difficulties : Some things we have learned so far
McArthur, Genevieve and Castles, Anne. (2017). Helping children with reading difficulties : Some things we have learned so far. npj Science of Learning. 2(1), p. Article 7. https://doi.org/10.1038/s41539-017-0008-3
Beliefs about human agency influence the neural processing of gaze during joint attention
Caruana, Nathan, de Lissa, Peter and McArthur, Genevieve. (2017). Beliefs about human agency influence the neural processing of gaze during joint attention. Social Neuroscience. 12(2), pp. 194-206. https://doi.org/10.1080/17470919.2016.1160953
Simulating social interactions for the experimental investigation of joint attention
Caruana, Nathan, McArthur, Genevieve, Woolgar, Alexandra and Brock, Jon. (2017). Simulating social interactions for the experimental investigation of joint attention. Neuroscience and Biobehavioral Reviews. 74, pp. 115-125. https://doi.org/10.1016/j.neubiorev.2016.12.022
Low self-concept in poor readers : Prevalence, heterogeneity, and risk
McArthur, Genevieve, Castles, Anne, Kohnen, Saskia and Banales, Erin. (2016). Low self-concept in poor readers : Prevalence, heterogeneity, and risk. PeerJ. 2016(11), p. Article e2669. https://doi.org/10.7717/peerj.2669
Phonics training improves reading in children with neurofibromatosis type 1 : A prospective intervention trial
Arnold, Shelley S., Barton, Belinda, McArthur, Genevieve, North, Kathryn N. and Payne, Jonathan M.. (2016). Phonics training improves reading in children with neurofibromatosis type 1 : A prospective intervention trial. Journal of Pediatrics. 177, pp. 219-226. https://doi.org/10.1016/j.jpeds.2016.06.037
Meditation and auditory attention : An ERP study of meditators and non-meditators
Biedermann, Britta, de Lissa, Peter, Mahajan, Yatin, Polito, Vince, Badcock, Nicolas, Connors, Michael H., Quinto, Lena, Larsen, Linda and McArthur, Genevieve. (2016). Meditation and auditory attention : An ERP study of meditators and non-meditators. International Journal of Psychophysiology. 109, pp. 63-70. https://doi.org/10.1016/j.ijpsycho.2016.09.016
The relationship between spoken language and speech and nonspeech processing in children with autism : A magnetic event-related field study
Yau, Shu Hui, Brock, Jon and McArthur, Genevieve. (2016). The relationship between spoken language and speech and nonspeech processing in children with autism : A magnetic event-related field study. Developmental Science. 19(5), pp. 834-852. https://doi.org/10.1111/desc.12328