Tracking Adults’ Eye Movements to Study Text Comprehension: A Review Article
Abstract
:1. Introduction
1.1. Reading Processing and Comprehension
1.2. Eye Tracking Technology in Reading Comprehension Research
Q: How can eye tracking technology contribute to the understanding of the processes involved in adult text comprehension?
2. Method
2.1. Eligibility Criteria
2.2. Information Sources and Search Strategy
2.3. Selection Process
2.4. Data Collection Process and Items
3. Results
3.1. Study Selection
3.2. Study Characteristics
3.2.1. Eye Movements During Reading in Print and Digital Media
3.2.2. Tracking the Eyes in Text Comprehension with Perspectives Effects
3.2.3. Tracking the Eyes in Text Comprehension with Effects of Instructional Strategies
3.3. Results of Individual Studies
3.4. Results of Syntheses
4. Discussion
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
References
- Ackerman, Rakefet, and Morris Goldsmith. 2011. Metacognitive regulation of text learning: On screen versus on paper. Journal of Experimental Psychology: Applied 17: 18–32. [Google Scholar] [CrossRef] [PubMed]
- Anderson, John R. 2009. Cognitive Psychology and Its Implication. New York: Worth Publishers. [Google Scholar]
- Angele, Bernhard, and Jon Andoni Duñabeitia. 2024. Closing the eye-tracking gap in reading research. Frontiers in Psychology 15: 1425219. [Google Scholar] [CrossRef] [PubMed]
- Ariasi, Nicola, and Lucia Mason. 2011. Uncovering the effect of text structure in learning from a science text: An eye-tracking study. Instructional Science 39: 581–601. [Google Scholar] [CrossRef]
- Ariasi, Nicola, Jukka Hyönä, Johanna K. Kaakinen, and Lucia Mason. 2017. An eye-movement analysis of the refutation effect in reading science text. Journal of Computer Assisted Learning 33: 202–21. [Google Scholar] [CrossRef]
- Bell, Charles. 1823. On the motions of the eye, in illustration of the uses of the muscles and nerves of the orbit. Philosophical Transaction of the Royal Society of London 113: 166–86. [Google Scholar] [CrossRef]
- Carter, Benjamin T., and Steven G. Luke. 2020. Best practices in eye tracking research. International Journal of Psychophysiology 155: 49–62. [Google Scholar] [CrossRef]
- Chen, Minglei, and Chia Hsing Chen. 2020. Do readers adjust their lower- and higher-level language skills according to text structures? Evidence from eye movements in Chinese text reading. Journal of Research in Reading 43: 180–200. [Google Scholar] [CrossRef]
- Daneman, Meredyth, and Patricia A. Carpenter. 1980. Individual differences in working memory and reading. Journal of Verbal Learning & Verbal Behavior 19: 450–66. [Google Scholar] [CrossRef]
- Delgado, Pablo, and Ladislao Salmerón. 2022. Cognitive effort in text processing and reading comprehension in print and on tablet: An eye-tracking study. Discourse Processes 59: 237–74. [Google Scholar] [CrossRef]
- Destefano, Diana, and Jo-Anne Lefevre. 2007. Cognitive load in hypertext reading: A review. Computers in Human Behavior 23: 1616–41. [Google Scholar] [CrossRef]
- D’Mello, Sidney K., Rosy Southwell, and Julie Gregg. 2020. Machine-learned computational models can enhance the study of text and discourse: A case study using eye tracking to model reading comprehension. Discourse Processes 57: 420–40. [Google Scholar] [CrossRef]
- Fraenkel, Jack R., Norman E. Wallen, and Helen Hyun. 2012. How to Design and Evaluate Research in Education, 8th ed. New York: The McGraw-Hill Companies, Inc. [Google Scholar]
- Gough, Philip B., and William E. Tunmer. 1986. Decoding, reading, and reading disability. Remedial and Special Education 7: 6–10. [Google Scholar] [CrossRef]
- Hyönä, Jukka. 2010. The use of eye movements in the study of multimedia learning. Learning and Instruction 20: 172–76. [Google Scholar] [CrossRef]
- Hyönä, Jukka, and Robert F. Lorch. 2004. Effects of topic headings on text processing: Evidence from adult reader’s eye fixation patterns. Learning and Instruction 14: 131–52. [Google Scholar] [CrossRef]
- Hyönä, Jukka, Robert F. Lorch, and Mike Rinck. 2003. Eye movement measures to study global text processing. In The Mind’s Eye: Cognitive and Applied Aspects of Eye Movement Research. Edited by Jukka Hyönä, Ralph Radach and Heiner Deubel. Amsterdam: Elsevier Science, pp. 313–34. [Google Scholar] [CrossRef]
- Inhoff, Albrecht W., Julie Gregg, and Ralph Radach. 2018. Eye movement programming and reading accuracy. Quarterly Journal of Experimental Psychology 71: 3–10. [Google Scholar] [CrossRef]
- Jeong, Yin Jeong, and Gahgene Gweon. 2021. Advantages of print reading over screen reading: A comparison of visual patterns, reading performance, and reading attitudes across paper, computers, and tablets. International Journal of Human Computer Interaction 37: 1674–84. [Google Scholar] [CrossRef]
- Jian, Yu-Cin. 2018. Reading instructions influence cognitive processes of illustrated text reading not subject perception: An eye-tracking study. Frontiers in Psychology 9: 2263. [Google Scholar] [CrossRef]
- Jian, Yu-Cin. 2019. Reading instructions facilitate signaling effect on science text for young readers: An eye-movement study. International Journal of Science and Mathematics Education 17: 503–22. [Google Scholar] [CrossRef]
- Jian, Yu-Cin. 2021. Influence of science text reading difficulty and hands-on manipulation on science learning: An eye-tracking study. Journal of Research in Science Teaching 59: 358–82. [Google Scholar] [CrossRef]
- Jian, Yu-Cin. 2022. Reading in print versus digital media uses different cognitive strategies: Evidence from eye movements during science-text reading. Reading and Writing 35: 1549–68. [Google Scholar] [CrossRef]
- Just, Marcel A., and Patricia A. Carpenter. 1980. A theory of reading: From eye fixations to comprehension. Psychological Review 87: 329–54. [Google Scholar] [CrossRef] [PubMed]
- Just, Marcel. A., and Patricia A. Carpenter. 2018. Using eye fixations to study reading comprehension. In New Methods in Reading Comprehension Research. Edited by Marcel A. Just and Patricia A. Carpenter. London: Routledge, pp. 151–82. [Google Scholar] [CrossRef]
- Kaakinen, Johanna K., and Jukka Hyönä. 2005. Perspective effects on expository text comprehension: Evidence from think-aloud protocols, eye tracking, and recall. Discourse Processes 40: 239–57. [Google Scholar] [CrossRef]
- Kaakinen, Johanna K., and Jukka Hyönä. 2007. Perspective effects in repeated reading: An eye movement study. Memory & Cognition 35: 1323–36. [Google Scholar] [CrossRef]
- Kaakinen, Johanna K., and Jukka Hyönä. 2008. Perspective-driven text comprehension. Applied Cognitive Psychology 22: 319–34. [Google Scholar] [CrossRef]
- Kaakinen, Johanna K., Jukka Hyönä, and Janice M. Keenan. 2002. Perspective effects on online text processing. Discourse Processes 33: 159–73. [Google Scholar] [CrossRef]
- Keller, Alice. 2012. In print or on screen? Investigating the reading habits of undergraduate students using photo-diaries and photo-interviews. Libri 62: 1–18. [Google Scholar] [CrossRef]
- Kendeou, Panayiota, Emily R. Smith, and Edward J. O’Brien. 2013. Updating during reading comprehension: Why causality matters. Journal of Experimental Psychology: Learning, Memory, and Cognition 39: 854–65. [Google Scholar] [CrossRef]
- Kim, Young-Suk Grace. 2017. Why the simple view of reading is not simplistic: Unpacking component skills of reading using a direct and indirect effect model of reading (DIER). Scientific Studies of Reading 21: 310–33. [Google Scholar] [CrossRef]
- Kim, Young-Suk Grace. 2020. Hierarchical and dynamic relations of language and cognitive skills to reading comprehension: Testing the direct and indirect effects model of reading (DIER). Journal of Educational Psychology 112: 667–84. [Google Scholar] [CrossRef]
- Kim, Young-Suk Grace, Christian Vorstius, and Ralph Radach. 2018. Does online comprehension monitoring make a unique contribution to reading comprehension in beginning readers? Evidence from eye movements. Scientific Studies of Reading 22: 367–83. [Google Scholar] [CrossRef]
- Kim, Young-Suk Grace, Yaacov Petscher, and Christian Vorstius. 2019. Unpacking eye movements during oral and silent reading and their relations to reading proficiency in beginning readers. Contemporary Educational Psychology 58: 102–20. [Google Scholar] [CrossRef]
- Kintsch, Walter. 1988. The role of knowledge in discourse comprehension: A construction-integration model. Psychological Review 95: 163–82. [Google Scholar] [CrossRef] [PubMed]
- Kintsch, Walter, and Teun A. van Dijk. 1978. Toward a model of text comprehension and production. Psychological Review 85: 363–94. [Google Scholar] [CrossRef]
- Kuperberg, Gina R., and T Florian Jaeger. 2016. What do we mean by prediction in language comprehension? Language, Cognition and Neuroscience 31: 32–59. [Google Scholar] [CrossRef] [PubMed]
- Lai, Meng-Lung, Meng-Jung Tsai, Fang-Ying Yang, Chung-Yuan Hsu, Tzu-Chien Liu, Silvia Wen-Yu Lee, Min-Hsien Lee, Guo-Li Chiou, Jyh-Chong Liang, and Chin-Chung Tsai. 2013. A review of using eye-tracking technology in exploring learning from 2000 to 2012. Educational Research Review 10: 90–115. [Google Scholar] [CrossRef]
- Latini, Natalia, Ivar Braten, and Ladislao Salmerón. 2020. Does reading medium affect processing and integration of textual and pictorial information? A multimedia eye-tracking study. Contemporary Educational Psychology 62: 101870. [Google Scholar] [CrossRef]
- Liao, Chia-Ning, Kuo EN Chang, Yu-Ching Huang, and Yao-Ting Sung. 2020. Electronic storybook design, kindergartners’ visual attention, and print awareness: An eye-tracking investigation. Computers & Education 144: 103703. [Google Scholar] [CrossRef]
- Mangen, Anne, Bente R. Walgermo, and Kolbjørn Brønnick. 2013. Reading linear texts on paper versus computer screen: Effects on reading comprehension. International Journal of Educational Research 58: 61–68. [Google Scholar] [CrossRef]
- Mason, Lucia, Maria Caterina Tornatora, and Patrik Pluchino. 2013. Do fourth graders integrate text and picture in processing and learning from an illustrated science text? Evidence from eye-movement patterns. Computers & Education 60: 95–109. [Google Scholar] [CrossRef]
- Mayer, Richard E. 2020. Multimedia Learning, 3rd ed. Cambridge: Cambridge University Press. [Google Scholar] [CrossRef]
- McLaughlin, Maureen. 2012. Reading comprehension: What every teacher needs to know. The Reading Teacher 65: 432–40. [Google Scholar] [CrossRef]
- McNamara, Danielle S., Arthur C. Graesser, Philip M. McCarthy, and Zhiqiang Cai. 2014. Automated Evaluation of Text and Discourse with Coh-Metrix. Cambridge: Cambridge University Press. [Google Scholar]
- McNamara, Danielle S., and Joe Magliano. 2009. Chapter 9 toward a comprehensive model of comprehension. Psychology of Learning and Motivation 51: 297–384. [Google Scholar] [CrossRef]
- Moher, David, Alessandro Liberati, Jennifer Tetzlaff, Douglas G. Altman, and PRISMA Group. 2009. Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement. PLoS Medicine 6: e1000097. [Google Scholar] [CrossRef] [PubMed]
- Parshina, Olga, Irina A Sekerina, Anastasiya Lopukhina, and Titus von der Malsburg. 2021. Monolingual and bilingual reading strategies in Russian: An exploratory scanpath analysis. Reading Research Quarterly 57: 469–92. [Google Scholar] [CrossRef]
- Penttinen, Marjaana, Erkki Anto, and Mirjamaija Mikkilä-Erdmann. 2013. Conceptual change, text comprehension and eye movements during reading. Research in Science Education 43: 1407–34. [Google Scholar] [CrossRef]
- Perfetti, Charles. 2007. Reading ability: Lexical quality to comprehension. Scientific Studies of Reading 11: 357–83. [Google Scholar] [CrossRef]
- Perfetti, Charles, and Joe Stafura. 2014. Work knowledge in a theory of reading comprehension. Scientific Studies of Reading 18: 22–37. [Google Scholar] [CrossRef]
- Rayner, Keith. 1998. Eye movement in reading and information processing: 20 years of research. Psychological Bulletins 124: 372–422. [Google Scholar] [CrossRef]
- Rayner, Keith. 2009. Eye movements and attention in reading, scene perception, and visual search. Quarterly Journal of Experimental Psychology 62: 1457–506. [Google Scholar] [CrossRef]
- Rayner, Keith, Kathryn H. Chace, Timothy J. Slattery, and Jane Ashby. 2006. Eye movements as reflections of comprehension processes in reading. Scientific Studies of Reading 10: 241–55. [Google Scholar] [CrossRef]
- Reichle, Erik D. 2021. Computational Models of Reading: A Handbook. Oxford: Oxford University Press. [Google Scholar]
- Reichle, Erik D., Keith Rayner, and Alexander Pollatsek. 2003. The E-Z reader model of eye-movement control in reading: Comparisons to other models. Behavioral and Brain Sciences 26: 445–526. [Google Scholar] [CrossRef]
- Sabatini, John, Tenaha O’Reilly, and Paul Deane. 2013. Preliminary reading literacy assessment framework: Foundation and rationale for assessment and system design. ETS Research Report Series 2013: i-50. [Google Scholar] [CrossRef]
- Sabatini, John, Tenaha O’Reilly, Jonathan Weeks, and Zuowei Wang. 2020. Engineering a twenty-first century reading comprehension assessment system utilizing scenario-based assessment techniques. International Journal of Testing 20: 1–23. [Google Scholar] [CrossRef]
- Sabatini, John, Zuowei Wang, and Tenaha O’Reilly. 2019. Relating reading comprehension to oral reading performance in the NAEP fourth-grade special study of oral reading. Reading Research Quarterly 54: 253–71. [Google Scholar] [CrossRef]
- Schotter, Elizabeth R., Randy Tran, and Keith Rayner. 2014. Don’t believe what you read (Only Once): Comprehension is supported by regressions during reading. Psychological Science 25: 1218–26. [Google Scholar] [CrossRef] [PubMed]
- Schuster, Sarah, Stefan Hawelka, Nicole Alexandra Himmelstoss, Fabio Richlan, and Florian Hutzler. 2020. The neural correlates of word position and lexical predictability during sentence reading: Evidence from fixation-related fMRI. Language, Cognition and Neuroscience 35: 613–24. [Google Scholar] [CrossRef]
- Shojaeizadeh, Mina, Soussan Djamasbi, and Andrew C. Trapp. 2016. Density of gaze points within a fixation and information processing behavior. Paper presented at the International Conference on Universal Access in Human-Computer Interaction, Toronto, ON, Canada, July 17–22; Cham: Springer, pp. 465–71. [Google Scholar] [CrossRef]
- Southwell, Rosy, Julie Gregg, Robert Bixler, and Sidney K. D’Mello. 2020. What eye movements reveal about later comprehension of long connected texts. Cognitive Science 44: e12905. [Google Scholar] [CrossRef]
- Suckow, Katja, and Roger P. G. van Gompel. 2018. Number attraction affects reanalysis in sentence processing. Language, Cognition and Neuroscience 33: 1–11. [Google Scholar] [CrossRef]
- Sweller, John, Paul Ayres, and Slava Kalyuga. 2011. Measuring Cognitive Load. In Cognitive Load Theory. Explorations in the Learning Sciences, Instructional Systems and Performance Technologies. New York: Springer, pp. 71–85. [Google Scholar] [CrossRef]
- Torres, Débora, Wagner R. Sena, Humberto A. Carmona, André A. Moreira, Hernán A. Makse, and José S Andrade, Jr. 2021. Eye-tracking as a proxy for coherence and complexity of texts. PLoS ONE 16: e0260236. [Google Scholar] [CrossRef]
- Wonnacott, Elizabeth, Holly S. S. L. Joseph, James S. Adelman, and Kate Nation. 2016. Is children’s reading “good enough”? Links between online processing and comprehension as children read syntactically ambiguous sentences. Quarterly Journal of Experimental Psychology 69: 855–79. [Google Scholar] [CrossRef]
ID Author | Research Purposes | Participants | Eye Movements Measures | Performance Measures | Focus of the Study | |
---|---|---|---|---|---|---|
1 | Ariasi and Mason (2011) | This study examined whether reading a refutational or non- refutational text would induce different cognitive processing, as revealed by eye movement analyses. | 40 | First-pass duration, total fixation duration, second-pass fixation, total reading time | Pretest and post-test, knowledge test | Text comprehension with effects of instructional strategies |
2 | Ariasi et al. (2017) | This study used an eye tracking methodology for a deeper understanding of the refutation text effect on online text comprehension. | 40 | First-pass progressive fixation time, first-pass reinspection time, look-back fixation time (second-pass fixation) | Pretest and post-test knowledge questions | Text comprehension with effects of instructional strategies |
3 | Delgado and Salmerón (2022) | This study examined the effect of the reading medium and the reading time-frame on text processing, metacognitive monitoring of comprehension, and comprehension outcomes. | 116 | Fixation time, number of fixations, number of regressive fixations | Prior knowledge and topic interest questionnaire, comprehension questions | Text comprehension in print and digital media |
4 | Hyönä and Lorch (2004) | This study investigated the effects of topic headings on the processing of multiple-topic expository texts with the help of readers’ eye fixation patterns. | 66 | First-pass fixation time, first-pass forward fixation time, first-pass rereading time, look-back fixation time, look-from-fixation time | Text summary | Text comprehension with effects of instructional strategies |
5 | Jeong and Gweon (2021) | This study examined the effects of the reading medium (print vs. digital) on readers’ visual patterns, reading performance, and reading attitudes. | 74 | Fixation duration, fixation count | Reading comprehension level test, pre-survey questionnaire, reading time, reading comprehension test, reading attitudes questionnaire | Text comprehension in print and digital media |
6 | Jian (2022) | This study involved an eye tracking experiment to investigate the differences in reading processes in print and digital media. | 50 | Total fixation duration, first-pass fixation duration, rereading (or second-pass) fixation duration, number of rereading instances across pages | Demographic survey, test of prior knowledge, reading comprehension test | Text comprehension in print and digital media |
7 | Kaakinen et al. (2002) | This study examined the effect of a reading perspective on online text processing, studied by recording readers’ eye movements during reading. | 64 | Total fixation time, first-pass fixation time, look-back fixation time | Reading span test, recall test | Text comprehension with perspective effects |
8 | Kaakinen and Hyönä (2005) | This study investigated the recording of participants’ eye movements while reading an expository text from a given perspective, and think-alouds were probed after 10 relevant and 10 irrelevant sentences. | 36 | First-pass progressive fixation time, first-pass rereading time, look-back fixation time | Recognition of target items, think aloud, recall performance | Text comprehension with perspective effects |
9 | Kaakinen and Hyönä (2007) | This study examined the influence of perspective instructions on the online processing of expository text during repeated reading. | 62 | Gaze duration (first-pass processing measures, second-pass reading of words), probability of skipping word, regression | Recall performance | Text comprehension with perspective effects |
10 | Kaakinen and Hyönä (2008) | This study examined whether the perspective-driven text comprehension framework applies to comprehension of narrative text. | 64 | Progressive fixation time (duration of fixations), first-pass rereading time (total fixation time), look-back fixation time (second-pass fixations) | Recall performance | Text comprehension with perspective effects |
11 | Latini et al. (2020) | This study investigated effects of reading medium (print vs. digital) on integrative processing and integrated understanding of an illustrated text, as well as whether reading medium indirectly affected integrated understanding via integrative processing. | 100 | Number of gazes | Demographic survey, writing report, inventory, reading comprehension measure, diagram comprehension score | Text comprehension in print and digital media |
12 | Penttinen et al. (2013) | This study examined the interplay of conceptual change, text comprehension, and eye movements during reading, and developed and tested methods suitable for such explorations. | 15 + 23 | Fixations | Pretest (open-ended questions) and post-test (open-ended questions and two interviews) questionnaires, average reading time | Text comprehension with effects of instructional strategies |
13 | Rayner et al. (2006) | This study examined the results of two experiments about the eye movement data to assess moment-to-moment comprehension processes: (a) global text passage difficulty and (b) inconsistencies in text. | 16 + 18 | Average fixation duration, number of fixations, total fixation time | Comprehension test, total reading time | Text comprehension with effects of instructional strategies |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Andreou, G.; Gkantaki, M. Tracking Adults’ Eye Movements to Study Text Comprehension: A Review Article. Languages 2024, 9, 360. https://doi.org/10.3390/languages9120360
Andreou G, Gkantaki M. Tracking Adults’ Eye Movements to Study Text Comprehension: A Review Article. Languages. 2024; 9(12):360. https://doi.org/10.3390/languages9120360
Chicago/Turabian StyleAndreou, Georgia, and Maria Gkantaki. 2024. "Tracking Adults’ Eye Movements to Study Text Comprehension: A Review Article" Languages 9, no. 12: 360. https://doi.org/10.3390/languages9120360
APA StyleAndreou, G., & Gkantaki, M. (2024). Tracking Adults’ Eye Movements to Study Text Comprehension: A Review Article. Languages, 9(12), 360. https://doi.org/10.3390/languages9120360