Reading Music or Reading Notes? Rethinking Musical Stimuli in Eye-Movement Research
Highlights
- In eye-tracking studies of music reading, some musical stimuli lack authentic syntax, reducing research validity.
- Definitions of complexity in stimuli are inconsistent.
- Motor planning and instrument-specific factors are underexplored.
- This work advocates the use of syntactically meaningful stimuli in future research.
Abstract
1. Introduction
2. Text and Music Reading
3. Eye Movements
Understanding the effects of the most basic features of music notation on the targeting and timing of eye movements seems essential before combining these observations with the effects of expertise, added visual elements, violation of musical expectations in complex settings, or even the distribution of attention between two staves.
4. Method and Materials
5. Results
5.1. Study 1 [42]
5.2. Study 2 [47]
5.3. Study 3 [23], Experiment 2
5.4. Study 4 [21]
5.5. Study 5 [48]
5.6. Study 6 [49]
5.7. Study 7 [18]
5.8. Study 8 [50], Experiment 2
5.9. Complexity of Musical Stimuli
Twenty “Tonally Simple, Visually Simple” stimuli were composed with four notes preceded by a treble clef, forming simple scale or arpeggio structures. All notes fit within a single major diatonic scale, each containing two or fewer accidentals and one or no contour changes. Twenty “Tonally Simple, Visually Complex” stimuli retained the same musical structures but were arranged to include two contour changes. Twenty “Tonally Complex, Visually Simple” stimuli were created by altering one or two notes so they no longer fit within a single diatonic scale, or by repositioning accidentals. Finally, twenty “Tonally Complex, Visually Complex” stimuli combined these tonal alterations with two contour changes.
5.10. Unexpected Findings
Sometimes a subject may fixate each of a pair of quavers individually, sometimes only one of them, or neither. (…) Comparison of the number of saccades made when performing musically identical bars with quavers notated either as isolated or beamed showed, for two subjects, a significant (p = 0.05) decrease with beaming, but for the other subject (RHSC), an equally significant increase—demonstrating again the idiosyncratic nature of the responses.
However, on the first stimulus presentation, it is interesting that there was no evidence that the tonal complexity of the material had any effect on the fixation durations of the experts, as might be predicted from Kinsler and Carpenter’s model. This is a curious finding since we would have expected the experts’ drop in accuracy on the more difficult material to have been due to encoding difficulties on the first stimulus presentation. Furthermore, there was no suggestion from the spatial data that the experts used larger saccade sizes for the tonally simple material. In other words, there was no evidence for any differences in eye movement behaviour between tonally simple and tonally complex material for the expert group.
6. Discussion
6.1. Melodic and Harmonic Patterns
6.2. Rhythm Patterns
6.3. Complexity
- Does the use of accidentals contribute to tonal complexity, visual complexity, or both? In a musical context, accidentals increase harmonic complexity, but they also make the score visually more complex.
- Do scales and triads affect tonal or visual complexity? These are basic and high-frequency musical structures.
- Can we meaningfully discuss musical structure, tonal progression, and complexity when the stimulus consists of only four notes, as in Waters and Underwood [21]?
- Notational complexity: all graphical features, including density, clefs, accidentals, rhythmic patterns.
- Cognitive complexity: the mental effort required to process the notation, including tonal ambiguity, unfamiliar patterns, or non-standard structures.
- Performance complexity: the demands placed on the performer, including motor planning, fingering, and instrument-specific challenges.
6.4. Music Instrument and Motor Planning
6.5. Interpretation of the Unexpected Findings
6.6. Comparison to Linguistic Stimuli
7. Conclusions
Funding
Data Availability Statement
Conflicts of Interest
References
- Rayner, K. Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 1998, 124, 372. [Google Scholar] [CrossRef] [PubMed]
- Gudmundsdottir, H.R. Advances in music-reading research. Music Educ. Res. 2010, 12, 331–338. [Google Scholar] [CrossRef]
- Hodges, D.A.; Nolker, D.B. The acquisition of music reading skills. MENC Handb. Res. Music Learn. 2011, 2, 61–91. [Google Scholar]
- Madell, J.; Hébert, S. Eye Movements and Music Reading: Where Do We Look Next? Music Percept. Interdiscip. J. 2008, 26, 157–170. [Google Scholar] [CrossRef]
- Puurtinen, M. Eye on Music Reading: A Methodological Review of Studies from 1994 to 2017. J. Eye Mov. Res. 2018, 11, 1–16. [Google Scholar] [CrossRef]
- Lerdahl, F.; Jackendoff, R. A Generative Theory of Tonal Music; MIT Press: Cambridge, MA, USA, 1996. [Google Scholar]
- Patel, A.D. Music, Language, and the Brain; Oxford University Press: Oxford, UK, 2008; Available online: http://site.ebrary.com/lib/hisbib/docDetail.action?docID=10211997 (accessed on 21 December 2025).
- Clifton, C.; Staub, A.; Rayner, K. Eye movements in reading words and sentences. In Eye Movements; Van Gompel, R.P.G., Fischer, M.H., Murray, W.S., Hill, R.L., Eds.; Elsevier: Amsterdam, The Netherlands, 2007; pp. 341–371. [Google Scholar] [CrossRef]
- Fink, L.K.; Lange, E.B.; Groner, R. The application of eye-tracking in music research. J. Eye Mov. Res. 2019, 11, 1–4. [Google Scholar] [CrossRef] [PubMed]
- Perra, J.; Latimier, A.; Poulin-Charronnat, B.; Baccino, T.; Drai-Zerbib, V. A Meta-analysis on the Effect of Expertise on Eye Movements during Music Reading. J. Eye Mov. Res. 2022, 15, 1–33. [Google Scholar] [CrossRef]
- Radach, R.; Kennedy, A. Eye movements in reading: Some theoretical context. Q. J. Exp. Psychol. 2013, 66, 429–452. [Google Scholar] [CrossRef]
- Clifton, C.; Ferreira, F.; Henderson, J.M.; Inhoff, A.W.; Liversedge, S.P.; Reichle, E.D.; Schotter, E.R. Eye movements in reading and information processing: Keith Rayner’s 40 year legacy. J. Mem. Lang. 2016, 86, 618. [Google Scholar] [CrossRef]
- Dambacher, M.; Slattery, T.J.; Yang, J.; Kliegl, R.; Rayner, K. Evidence for direct control of eye movements during reading. J. Exp. Psychol. Hum. Percept. Perform. 2013, 39, 1468–1484. [Google Scholar] [CrossRef]
- Goolsby, T.W. Profiles of Processing: Eye Movements During Sightreading. Music Percept. 1994, 12, 97–123. [Google Scholar] [CrossRef]
- Kopiez, R.; Lee, J.I. Towards a General Model of Skills Involved in Sight Reading Music. Music Educ. Res. 2008, 10, 41–62. [Google Scholar] [CrossRef]
- Lehmann, A.C.; Sloboda, J.A.; Woody, R.H. Psychology for Musicians: Understanding and Acquiring the Skills; Oxford University Press: Oxford, UK, 2007. [Google Scholar]
- Mishra, J. Improving sightreading accuracy: A meta-analysis. Psychol. Music 2014, 42, 131–156. [Google Scholar] [CrossRef]
- Arthur, P.; Khuu, S.; Blom, D. Music sight-reading expertise, visually disrupted score and eye movements. J. Eye Mov. Res. 2016, 9, 35. [Google Scholar] [CrossRef]
- Lörch, L. The association of eye movements and performance accuracy in a novel sight-reading task. J. Eye Mov. Res. 2021, 14, 1–30. [Google Scholar] [CrossRef]
- Waters, A.; Townsend, E.; Underwood, G. Expertise in musical sight reading: A study of pianists. Br. J. Psychol. 1998, 89, 123–149. [Google Scholar] [CrossRef]
- Waters, A.J.; Underwood, G. Eye Movements in a Simple Music Reading Task: A Study of Expert and Novice Musicians. Psychol. Music 1998, 26, 46–60. [Google Scholar] [CrossRef]
- Schad, D.J.; Nuthmann, A.; Engbert, R. Eye movements during reading of randomly shuffled text. Vis. Res. 2010, 50, 2600–2616. [Google Scholar] [CrossRef]
- Waters, A.J.; Underwood, G.; Findlay, J.M. Studying expertise in music reading: Use of a pattern-matching paradigm. Percept. Psychophys. 1997, 59, 477–488. [Google Scholar] [CrossRef] [PubMed]
- Aiello, R. Music and Language: Parallels and Contrasts. In Musical Perceptions; Aiello, R., Sloboda, J.A., Eds.; Oxford University Press: Oxford, UK, 1994; pp. 40–63. [Google Scholar]
- Hansen, D.; Bernstorf, E.; Stuber, G.M. The Music and Literacy Connection; Rowman & Littlefield: Lanham, MD, USA, 2014. [Google Scholar]
- Patel, A.D. Advancing the comparative study of linguistic and musical syntactic processing. In Language and Music as Cognitive Systems; Rebuschat, P., Rohrmeier, M., Hawkins, J.A., Cross, I., Eds.; Oxford University Press: Oxford, UK, 2012; pp. 248–253. [Google Scholar]
- Rebuschat, P.; Rohrmeier, M.; Hawkins, J.A.; Cross, I. (Eds.) Language and Music as Cognitive Systems; Oxford University Press: Oxford, UK, 2012. [Google Scholar]
- Sloboda, J.A. Exploring the Musical Mind: Cognition, Emotion, Ability, Function; Oxford University Press: Oxford, UK, 2005. [Google Scholar]
- Waller, D. Language literacy and music literacy: A pedagogical asymmetry. Philos. Music Educ. Rev. 2010, 18, 26–44. [Google Scholar] [CrossRef]
- Drake, C.; Palmer, C. Skill acquisition in music performance: Relations between planning and temporal control. Cognition 2000, 74, 1–32. [Google Scholar] [CrossRef]
- Gobet, F.; Lloyd-Kelly, M.; Lane, P.C. What’s in a name? The multiple meanings of “Chunk” and “Chunking”. Front. Psychol. 2016, 7, 102. [Google Scholar] [CrossRef]
- Miller, G.A. The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychol. Rev. 1956, 63, 81. [Google Scholar] [CrossRef]
- Cowan, N. The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behav. Brain Sci. 2001, 24, 87–185. [Google Scholar] [CrossRef]
- Hambrick, D.Z.; Oswald, F.L.; Altmann, E.M.; Meinz, E.J.; Gobet, F.; Campitelli, G. Deliberate practice: Is that all it takes to become an expert? Intelligence 2014, 45, 34–45. [Google Scholar] [CrossRef]
- Lim, Y.; Park, J.M.; Rhyu, S.-Y.; Chung, C.K.; Kim, Y.; Yi, S.W. Eye-hand span is not an indicator of but a strategy for proficient sight-reading in piano performance. Sci. Rep. 2019, 9, 17906. [Google Scholar] [CrossRef]
- Rosemann, S.; Altenmüller, E.; Fahle, M. The art of sight-reading: Influence of practice, playing tempo, complexity and cognitive skills on the eye–hand span in pianists. Psychol. Music 2016, 44, 658–673. [Google Scholar] [CrossRef]
- Pike, P.D.; Carter, R. Employing Cognitive Chunking Techniques to Enhance Sight-Reading Performance of Undergraduate Group-Piano Students. Int. J. Music Educ. 2010, 28, 231–246. [Google Scholar] [CrossRef]
- Ehri, L.C. Learning to Read Words: Theory, Findings, and Issues. Sci. Stud. Read. 2005, 9, 167–188. [Google Scholar] [CrossRef]
- Koelsch, S.; Kasper, E.; Sammler, D.; Schulze, K.; Gunter, T.; Friederici, A.D. Music, language and meaning: Brain signatures of semantic processing. Nat. Neurosci. 2004, 7, 302–307. [Google Scholar] [CrossRef]
- Huron, D. Sweet Anticipation: Music and the Psychology of Expectation; MIT press: Cambridge, MA, USA, 2008. [Google Scholar]
- Holmqvist, K.; Nyström, M.; Andersson, R.; Dewhurst, R.; Jarodzka, H.; Van de Weijer, J. Eye Tracking: A Comprehensive Guide to Methods and Measures; Oxford University Press: Oxford, UK, 2011. [Google Scholar]
- Kinsler, V.; Carpenter, R.H.S. Saccadic eye movements while reading music. Vis. Res. 1995, 35, 1447–1458. [Google Scholar] [CrossRef][Green Version]
- Honing, H. Structure and interpretation of rhythm in music. In The Psychology of Music; Deutsch, D., Ed.; Academic Press: Cambridge, MA, USA, 2013; Volume 3, pp. 369–404. [Google Scholar]
- Feist, J. Berklee Contemporary Music Notation; Hal Leonard Corporation: Milwaukee, WI, USA, 2017. [Google Scholar]
- Halsband, U.; Binkofski, F.; Camp, M. The role of the perception of rhythmic grouping in musical performance: Evidence from motor-skill development in piano playing. Music Percept. 1994, 11, 265–288. [Google Scholar] [CrossRef]
- Bar-Niv, R. The Art of Piano Fingering: Traditional, Advanced, and Innovative; AndreA: Salinas, CA, USA, 2013. [Google Scholar]
- Polanka, M. Research Note: Factors Affecting Eye Movements During the Reading of Short Melodies. Psychol. Music 1995, 23, 177–183. [Google Scholar] [CrossRef]
- Penttinen, M.; Huovinen, E. The Early Development of Sight-Reading Skills in Adulthood: A Study of Eye Movements. J. Res. Music Educ. 2011, 59, 196–220. [Google Scholar] [CrossRef]
- Ahken, S.; Comeau, G.; Hébert, S.; Balasubramaniam, R. Eye movement patterns during the processing of musical and linguistic syntactic incongruities. Psychomusicol. Music Mind Brain 2012, 22, 18–25. [Google Scholar] [CrossRef]
- Huovinen, E.; Ylitalo, A.K.; Puurtinen, M. Early Attraction in Temporally Controlled Sight Reading of Music. J. Eye Mov. Res. 2018, 11, 1–30. [Google Scholar] [CrossRef]
- Zhukov, K.; McPherson, G.E. Sight-reading. In The Oxford Handbook of Music Performance; McPherson, G.E., Ed.; Oxford University Press: Oxford, UK, 2022; Volume 1, pp. 192–213. [Google Scholar]
- Babayigit, Ö. The Reading Speed of Elementary School Students on the All Text Written with Capital and Lowercase Letters. Univers. J. Educ. Res. 2019, 7, 371–380. [Google Scholar] [CrossRef]
- Chase, W.G.; Simon, H.A. The mind’s eyes in chess. In Visual Information Processing; Chase, W.G., Ed.; Academic Press: Cambridge, MA, USA, 1975; pp. 215–281. [Google Scholar]








| Study | Aim (Related to Syntactic Processing) | Participants | Stimuli | Procedure | Conclusion |
|---|---|---|---|---|---|
| (1) Kinsler & Carpenter, 1995 [42] | To examine saccades while reading music: to be able to dissociate the contributions of factors associated with the input (the printed music) and with the output (the rate of execution). | No data. | Short rhythmic phrases presented as a single line of notes with bar lines. | Participants were suddenly presented with a line of notes on a computer screen and asked to tap the corresponding rhythm on a microphone. | At slow speeds with complex sequences there may be considerably more saccades than notes; with a fast speed and simple pattern—shown here as more notes than eye movements. |
| (2) Polanka, 1995 [47] | To determine whether musicians read in higher order structures (patterns) or notes by monitoring their eye movements as they sight-read. | 18 undergraduate music majors (11 females, 7 males), divided into three skill groups based on a sight-singing pretest. | Six melodies—three composed of three-note pitch patterns and three of four-note patterns, each with varying complexity (low, medium, high). | Subjects read each melody twice, once silently and once humming and their vocal responses were recorded on audio tape. | Better readers tended to process larger units than poorer readers. Pattern size influenced eye movement behavior. Stepwise patterns were processed in smaller units than triadic patterns. |
| (3) Waters et al., 1997 [23] exp.2 | To test whether skilled sight-reading is associated with rapid processing of note groups and to examine the relationship between expertise and eye-movement parameters (e.g., fixation duration). | Three groups of 8 subjects each: two “expert” groups (full time music students playing a monophonic instrument) and a novice group (familiar with the names of the notes). | Sixty 10-note melodies in 3/4 or 4/4 time, each consisting of two bars of five notes each. No key signature or accidentals. Each melody had a randomized counterpart. | Silent reading, matching pairs of stimuli as same or different by pressing a button as quickly as possible. | Experienced musicians used larger units and processed them with fewer and shorter fixations. Musicians made more errors on duration-different trials, while nonmusicians made more errors on pitch-different trials. |
| (4) Waters & Underwood, 1998 [21] | To determine the effect of the tonal complexity of the stimuli on task performance and eye movement behaviour. To determine whether there was any difference in task performance and eye movement behaviour for expert and novice musicians. | Twenty-two subjects divided into two groups: “expert” group, experienced musicians playing at least one musical instrument associated with the treble clef register. The “novice” group, familiar with musical notation. | Twenty “Tonally Simple, Visually Simple” stimuli: four notes encompassed within one major diatonic scale, preceded by the treble clef, consisting of simple scale or arpeggio structures. Other stimuli with various complexity level were created by shifting some of the notes. | Silent reading. Each subject made a “same” response with their preferred hand, and a “different” response with their non-preferred hand. | Experts outperformed novices in speed and accuracy. Experts showed reduced performance on tonally complex material, while novices showed no difference. There was no evidence for any differences in eye movement behavior between tonally simple and tonally complex material for the expert group. |
| (5) Penttinen & Huovinen, 2011 [48] | To elucidate the early stages of learning to read music in adulthood by examining the various measures of fixation time in elementary sight-reading tasks and comparing novices with experienced music amateurs. | 49 s-year teacher education students in Finland, all enrolled in a year-long compulsory music course. | Twelve five-bar melodies in C major, using quarter notes and a whole note in the final bar. Melodic range: C4–G4. Fingering marked for the first note. The melodic movement in each melody was primarily stepwise, with the exceptions of two larger intervals at the temporal distance from one another. | Participants sight-read four melodies on piano with a metronome (60 bpm) at three time points: start, mid-point (16 weeks), and end of the course. | Sight-reading skills improved significantly. Fixation times decreased for central notes in large intervals, but not for surrounding notes. |
| (6) Ahken et al., 2012 [49] | Investigating the eye movements of readers during the visual processing of music and linguistic syntactic incongruities. To examine the role of key signature and accidentals to establish tonality. | Eighteen experienced pianists. | Sixteen short musical phrases (5–7 bars), grouped in fours. Half were syntactically congruent; the rest ended with a non-tonic chord or note. | Participants were instructed to play each musical sequence at the piano with hands together and no preview time, at any speed they liked. | Incongruent stimuli elicited more fixations, longer fixation durations, and longer trial durations. Effects were less pronounced for stimuli with accidentals than for those with key signatures. |
| (7) Arthur et al., 2016 [18] | To explore how visual expectations influence sight-reading expertise, focusing on working memory, cross-modal integration, and visual crowding. The study examined eye movement responses to unexpected changes in notation observed in expert and non-expert music sightreaders. | 9 participants were assigned to the expert sight-reader group and 13 to the non-expert sightreader group. No data about their main instrument. | Ten four-bar melodies in treble clef, right-hand only, using white notes. Notational features were altered (e.g., bar line removal, stem direction, spacing). | Participants sight-read the 9 specifically composed musical excerpts of 4 bars duration on the piano. | Score disruption had no effect on total task time. Saccadic latency increased significantly for experts only when encountering disrupted notation. |
| (8) Huovinen et al., 2018 [50], exp 2 | To examine the hypothesis stating that local increases in music-structural complexity (and thus visual salience) of the score may bring about local, stimulus-driven lengthening of the ETS [eye-time span]. | 14 professional piano students from three Finnish universities. | Eight mostly stepwise melodies in 4/4 time, each six bars long and composed entirely of quarter notes. The melodies were divided into two sets in the keys of G, C, F, and B♭. In each melody, one larger intervallic skip (a minor sixth) was inserted in one of bars 3–5. | The participants were instructed to sight-read the melodies on the piano in time with a metronome. | Experienced musicians appeared to react sensitively to upcoming deviant elements. Target notes triggered longer-than-average eye-time spans for notes occurring several beats before the target itself. Sight-readers often responded to the target element as early as six beats in advance. |
| Study | Syntactic Units of Information Possible to Chunk | Could Be a Part of an Authentic Piece | |||
|---|---|---|---|---|---|
| Melodic | Rhythmic | Harmonic | Phrases/Repetitions | ||
| 1 [42] | Not applicable | limited | Not applicable | limited | no |
| 2 [47] | limited | no | no | no | no |
| 3 [23] exp 2 | no | no | no | limited | no |
| 4 [21] | no | no | limited | no | limited |
| 5 [48] | no | no | no | no | no |
| 6 [49] | yes | yes | yes | yes | yes |
| 7 [18] | no | no | no | no | no |
| 8 [50] exp 2 | no | no | no | no | no |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the author. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.
Share and Cite
Leikvoll, K.J. Reading Music or Reading Notes? Rethinking Musical Stimuli in Eye-Movement Research. J. Eye Mov. Res. 2026, 19, 3. https://doi.org/10.3390/jemr19010003
Leikvoll KJ. Reading Music or Reading Notes? Rethinking Musical Stimuli in Eye-Movement Research. Journal of Eye Movement Research. 2026; 19(1):3. https://doi.org/10.3390/jemr19010003
Chicago/Turabian StyleLeikvoll, Katarzyna Julia. 2026. "Reading Music or Reading Notes? Rethinking Musical Stimuli in Eye-Movement Research" Journal of Eye Movement Research 19, no. 1: 3. https://doi.org/10.3390/jemr19010003
APA StyleLeikvoll, K. J. (2026). Reading Music or Reading Notes? Rethinking Musical Stimuli in Eye-Movement Research. Journal of Eye Movement Research, 19(1), 3. https://doi.org/10.3390/jemr19010003
