Reading Comics: The Effect of Expertise on Eye Movements
Abstract
Introduction
Eye tracking research on visual expertise
Eye tracking on comic reading
Aim and research questions
Methods
Participants
Equipment
Materials
Procedure
Variables
Expertise Level
Content Type of AOIs
Covariates
observed variable
Data Analysis
The viewing patterns between experts and non-experts
Experts (M ± SD) (n = 14) | Non-experts (M ± SD) (n = 17) | Overall (M ± SD) | |
Number of whole fixations | 21.32 ± 12.20 | 22.58 ± 14.99 | 22.08 ± 13.96 |
Average duration of whole fixations (ms) | 219.21 ± 41.15 | 205.90 ± 43.57 | 211.16 ± 43.09 |
Number of saccades | 19.45 ± 12.03 | 18.75 ± 13.60 | 19.03 ± 13 |
Average amplitude of saccades (°) | 4.69 ± 1.47 | 4.40 ± 1.72 | 4.52 ± 1.63 |
The viewing patterns between experts and non-experts in AOIs
Discussion
Main Findings
Theoretical Significance
Contrasting Findings
Future Work
Acknowledgements
Ethics and Conflict of Interest
References
- Antes, J. R., and A. F. Kristjanson. 1991. Discriminating artists from nonartists by their eye-fixation patterns. Percept. Mot. Skills 73: 893–894. [Google Scholar] [CrossRef] [PubMed]
- Bisson, M.-J., W. J. B. Van Heuven, K. Conklin, and R. J. Tunney. 2014. Processing of native and foreign language subtitles in films: An eye tracking study. Applied Psycholinguistics 35, 2: 399–418. [Google Scholar] [CrossRef]
- Brumberger, E. 2022. Ways of looking: an eye-tracking study of visual literacy expertise. Journal of Visual Literacy 41: 65–89. [Google Scholar] [CrossRef]
- Brumberger, E. 2023. Generational differences in viewing behaviors: an eye-tracking study. Visual Communication 22, 1: 128–151. [Google Scholar] [CrossRef]
- Buswell, G. T. 1935. How people look at pictures: A study of the psychology of perception in art. University Chicago Press. [Google Scholar]
- Cherry, D., D. Brickler, and C. University. 2015. Analysis of gaze on comic book panel structure. Psychology. [Google Scholar]
- Cohn, N., and H. Campbell. 2014. Navigating Comics II: Constraints on the Reading Order of Comic Page Layouts. Applied Cognitive Psychology 29, 2: 193–199. [Google Scholar] [CrossRef]
- d'Ydewalle, G., and W. De Bruycker. 2007. Eye movements of children and adults while reading television subtitles. European Psychologist 12, 3: 196–205. [Google Scholar] [CrossRef]
- Ericsson, K. A., and N. Charness. 1994. Expert performance: Its structure and acquisition. American Psychologist 49, 8: 725–747. [Google Scholar] [CrossRef]
- Foulsham, T., D. P. Wybrow, and N. Cohn. 2016. Reading Without Words: Eye Movements in the Comprehension of Comic Strips. Applied Cognitive Psychology 30: 566–579. [Google Scholar] [CrossRef]
- Francuz, P., I. Zaniewski, P. Augustynowicz, N. Kopi’S, and T. Jankowski. 2018. Eye movement correlates of expertise in visual arts. Frontiers in Human Neuroscience 12: 1–13. [Google Scholar] [CrossRef]
- Fudali-Czyż, A., P. Francuz, and P. Augustynowicz. 2018. The Effect of Art Expertise on Eye Fixation-Related Potentials During Aesthetic Judgment Task in Focal and Ambient Modes. Frontiers in Psychology 9. [Google Scholar] [CrossRef]
- Groner, R., F. Walder, and M. Groner. 1984. Looking at Faces: Local and Global Aspects of Scanpaths. Advances in Psychology, 523–533. [Google Scholar] [CrossRef]
- Hershler, O., and S. Hochstein. 2009. The importance of being expert: Top-down attentional control in visual search with photographs. Attention, Perception, & Psychophysics 71: 1478–1486. [Google Scholar] [CrossRef]
- Ikuta, H., L. Wöhler, and K. Aizawa. 2023. Statistical characteristics of comic panel viewing times. Scientific Reports 13: 20291. [Google Scholar] [CrossRef] [PubMed]
- Just, M. A., and P. A. Carpenter. 1976. Eye fixations and cognitive processes. Cognitive Psychology 8, 4: 441–480. [Google Scholar] [CrossRef]
- Kirtley, C., C. Murray, P. B. Vaughan, and B. W. Tatler. 2018. Reading Words and Images: Factors Influencing Eye Movements in Comic Reading. In Empirical Comics Research, 1st ed. Routledge: p. 20. [Google Scholar] [CrossRef]
- Kirtley, C., C. Murray, P. B. Vaughan, and B. W. Tatler. 2023. Navigating the narrative: An eye-tracking study of readers' strategies when Reading comic page layouts. Applied Cognitive Psychology 37, 1: 52–70. [Google Scholar] [CrossRef]
- Koide, N., T. Kubo, S. Nishida, T. Shibata, and K. Ikeda. 2015. Art expertise reduces the influence of visual salience on fixation in viewing abstract paintings. PLOS ONE 10, 2: e0117696. [Google Scholar] [CrossRef]
- Kolodziej, M., A. Majkowski, P. Francuz, R. J. Rak, and P. Augustynowicz. 2018. Identifying experts in the field of visual arts using oculomotor signals. Journal of Eye Movement Research 11, 3. [Google Scholar] [CrossRef]
- Kristjanson, A. F., and J. R. Antes. 1989. Eye movement analysis of artists and nonartists viewing paintings. Visual Arts Research 15, 2: 21–30. http://www.jstor.org/stable/20715702.
- Laubrock, J., S. Hohenstein, and M. Kümmerer. 2018. Edited by A. Dunst, J. Laubrock and J. Wildfeuer. Attention to comics: Cognitive processing during the reading of graphic literature. In Empirical comics research: Digital, multimodal, and cognitive methods. Routledge: pp. 239–263. [Google Scholar]
- Laubrock, J., A. Krutz, J. Nübel, and S. Spethmann. 2023. Gaze patterns reflect and predict expertise in dynamic echocardiographic imaging. Journal of Medical Imaging (Bellingham, Wash.) 10 Suppl 1: S11906. [Google Scholar] [CrossRef]
- Lesgold, A., H. Rubinson, P. Feltovich, R. Glaser, D. Klopfer, and Y. Wang. 1988. Expertise in a complex skill: Diagnosing x-ray pictures. In The nature of expertise. Edited by M. Chi, R. Glaser and M. Farr. Hillsdale, NJ: Erlbaum, pp. 311–342. [Google Scholar]
- Maturi, K. S., and H. Sheridan. 2020. Expertise effects on attention and eye-movement control during visual search: Evidence from the domain of music reading. Atten Percept Psychophys 82, 5: 2201–2208. [Google Scholar] [CrossRef]
- Meixner, J. M., J. S. Nixon, and J. Laubrock. 2022. The perceptual span is dynamically adjusted in response to foveal load by beginning readers. Journal of Experimental Psychology: General 151, 6: 1219–1232. [Google Scholar] [CrossRef] [PubMed]
- Mesmoudi, S., S. Hommet, and D. Peschanski. 2020. Eye-tracking and learning experience: gaze trajectories to better understand the behavior of memorial visitors. Journal of Eye Movement Research 13, 2. [Google Scholar] [CrossRef] [PubMed]
- Meteyard, L., and R. A. I. Davies. 2020. Best practice guidance for linear mixed-effects models in psychological science. Journal of Memory and Language 112: 104092. [Google Scholar] [CrossRef]
- Mikkonen, K. H., and O. P. Lautenbacher. 2019. Global attention in reading comics: Eye movement indications of interplay between narrative content and layout. ImageTexT 10, 2. https://imagetextjournal.com/global-attention-in-reading-comics/.
- Miyata, H, Y Minagawa-Kawai, S Watanabe, T Sasaki, and K. Ueda. 2012. Reading Speed, Comprehension and Eye Movements While Reading Japanese Novels: Evidence from Untrained Readers and Cases of Speed-Reading Trainees. PLoS One 7, 5. [Google Scholar] [CrossRef]
- Cohn, Neil. 2014. The Visual Language Fluency Index. https://www.visuallanguagelab.com/2014/04/the-visual-language-fluency-index.html.
- Omori, T., T. Ishii, and K. Kurata. 2004. Eye catchers in comics: Controlling eye movements in reading pictorial and textual media. Paper presented at the 28th International Congress of Psychology. [Google Scholar]
- Perra, J., A. Latimier, B. Poulin-Charronnat, T. Baccino, and V. Drai-Zerbib. 2022. A meta-analysis on the effect of expertise on eye movements during music reading. Journal of Eye Movement Research 15, 4. [Google Scholar] [CrossRef]
- Postema, B. 2013. Narrative Structure in Comics: Making Sense of Fragments. Rochester: RIT Press. https://muse.jhu.edu/book/31439.
- Rabe-Hesketh, S., and A. Skrondal. 2010. International Encyclopedia of Education, 3rd ed. [Google Scholar]
- Rayner, K. 1986. Eye movements and the perceptual span in beginning and skilled readers. Journal of experimental child psychology 41, 2: 211–236. [Google Scholar] [CrossRef]
- Reingold, E. M., N. Charness, M. Pomplun, and D. M. Stampe. 2001. Visual Span in Expert Chess Players: Evidence From Eye Movements. Psychological Science 12, 1: 48–55. [Google Scholar] [CrossRef]
- Reingold, E. M., and H. Sheridan. 2011. Eye movements and visual expertise in chess and medicine. In The Oxford handbook of eye movements. Edited by S. P. Liversedge, I. D. Gilchrist and S. Everling. Oxford University Press: pp. 523–550. [Google Scholar]
- Rohan, O., R. Sasamoto, and S. O'Brien. 2021. Onomatopoeia: A relevance-based eye-tracking study of digital manga. Journal of Pragmatics 176: 1–9. [Google Scholar] [CrossRef]
- Sperlich, A., J. Meixner, and J. Laubrock. 2016. Development of the perceptual span in reading: A longitudinal study. Journal of experimental child psychology 146: 181–201. [Google Scholar] [CrossRef]
- Stein, I., H. Jossberger, and H. Gruber. 2022. Investigating visual expertise in sculpture: A methodological approach using eye tracking. Journal of Eye Movement Research 15, 2: Article 5. [Google Scholar] [CrossRef]
- Vogt, S., and S. Magnussen. 2007. Expertise in Pictorial Perception: Eye-Movement Patterns and Visual Memory in Artists and Laymen. Perception 36, 1: 91–100. [Google Scholar] [CrossRef]
- Von Wartburg, R., P. Wurtz, T. Pflugshaupt, T. Nyffeler, M. Lüthi, and R. M. Müri. 2007. Size matters: Saccades during scene perception. Perception 36, 3: 355–365. [Google Scholar] [CrossRef] [PubMed]
- Wang, T. N., and Y. C. Jian. 2022. A Systematic Review of Eye-Tracking Studies on Text-Diagram Science Reading. Bulletin of Educational Psychology 53, 4: 773–800. [Google Scholar] [CrossRef]
- Wildfeuer, J. 2019. The Inferential Semantics of Comics. Poetics Today 40, 2: 265–292. [Google Scholar]
- Zhao, F., and N. Mahrt. 2018. Influences of comics expertise and comics types in comics reading. International Journal of Innovation and Research in Educational Sciences (IJIRES) 5, 2: 218–224. https://creativecommons.org/licenses/by-nc-sa/4.0/.
Comic | Panel Count | Textless Panel Count | Is Vertical Layout | Speech BubbleCount | Word Count | Has Blockage | |
Comic1-p1 | 5 | 0 | Z-path | 8 | 42 | No | |
Comic1-p2 | 5 | 0 | Z-path | 7 | 46 | No | |
Comic1-p3 | 6 | 0 | Z-path | 8 | 69 | No | |
Comic1-p4 | 4 | 0 | Z-path | 5 | 43 | Yes | |
Comic2-p1 | 6 | 3 | Z-path | 4 | 20 | Yes | |
Comic2-p2 | 5 | 1 | Z-path | 4 | 23 | No | |
Comic2-p3 | 3 | 2 | Z-path | 1 | 11 | No | |
Comic2-p4 | 3 | 2 | Vertical | 1 | 8 | No | |
Comic2-p5 | 6 | 1 | Z-path | 7 | 81 | No | |
Comic3-p1 | 3 | 2 | Z-path | 2 | 2 | No | |
Comic3-p2 | 4 | 0 | Z-path | 4 | 24 | No | |
Comic3-p3 | 3 | 0 | Z-path | 0 | 0 | No | |
Comic3-p4 | 5 | 4 | Z-path | 1 | 9 | Yes | |
Comic3-p5 | 5 | 4 | Z-path | 5 | 9 | Yes | |
Comic3-p6 | 5 | 2 | Z-path | 3 | 13 | Yes | |
Comic3-p7 | 2 | 1 | Vertical | 3 | 16 | No | |
Comic4-p1 | 4 | 2 | Vertical | 5 | 50 | No | |
Comic4-p2 | 4 | 2 | Vertical | 3 | 19 | No | |
Comic4-p3 | 4 | 1 | Vertical | 4 | 12 | No | |
Comic4-p4 | 4 | 3 | Vertical | 3 | 15 | No | |
Comic4-p5 | 3 | 0 | Vertical | 5 | 39 | No | |
Comic4-p6 | 4 | 0 | Vertical | 6 | 23 | No | |
Comic4-p7 | 3 | 0 | Vertical | 5 | 22 | No |
Mean | SD | t | p | |
Non-experts (n = 17) | 5.85 | 3.99 | -5.67 | < 0.001 |
Experts (n = 14) | 23.5 | 9.18 |
Metric name | Description |
Average duration of whole fixations | The Average duration of the fixations inside an AOI or a page. |
Number of whole fixations | The number of fixations occurring in an AOI or a page. |
Average amplitude of saccades | The total amplitude of all saccades in an AOI or a page. |
Number of saccades | The number of saccades occurring in an AOI or a page. |
Number of saccades in AOI a | |||
B | SE | z value | |
(Intercept) | -0.52 | 0.18 | -2.85** |
Expertise Level | -0.34 | 0.22 | -1.52 |
Content Type | -0.02 | 0.04 | -0.48 |
Expertise Level * Content Type | 0.60 | 0.07 | 8.39*** |
Random parts | Variance | SD | |
Intercept: comic | 0.054 | 0.233 | |
Intercept: participant | 0.342 | 0.585 | |
N comic | 4 | ||
N participant | 31 | ||
Observations | 5236 | ||
AIC | 13425 | ||
BIC | 13464.38 | ||
logLik | -6706.499 | ||
Marginal R2 | 0.023 | ||
Conditional R2 | 0.332 |
Copyright © 2024. This article is licensed under a Creative Commons Attribution 4.0 International License.
Share and Cite
Yang, H. Reading Comics: The Effect of Expertise on Eye Movements. J. Eye Mov. Res. 2024, 17, 1-17. https://doi.org/10.16910/jemr.17.4.5
Yang H. Reading Comics: The Effect of Expertise on Eye Movements. Journal of Eye Movement Research. 2024; 17(4):1-17. https://doi.org/10.16910/jemr.17.4.5
Chicago/Turabian StyleYang, Hong. 2024. "Reading Comics: The Effect of Expertise on Eye Movements" Journal of Eye Movement Research 17, no. 4: 1-17. https://doi.org/10.16910/jemr.17.4.5
APA StyleYang, H. (2024). Reading Comics: The Effect of Expertise on Eye Movements. Journal of Eye Movement Research, 17(4), 1-17. https://doi.org/10.16910/jemr.17.4.5