Next Article in Journal
Analytical Solutions for a Charged Particle with White, Thermal, and Active Noises in the Presence of a Uniform Magnetic Field
Previous Article in Journal
HeteroEdge: Latency-Aware Adaptive Protocol Parsing with Digital Twin Intelligence for Heterogeneous 5G IoT Edge Networks
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Saccade Amplitude and Pupil Diameter Information Channels: Extending the Gaze Information Channel Framework and Assessing Cross-Channel Association in Eye Tracking of Van Gogh Paintings

1
Institute of Informatics and Applications, University of Girona, 17003 Girona, Spain
2
College of Intelligent Engineering, Henan Institute of Technology, Xinxiang 453003, China
3
Institute of New Image Technologies, Universitat Jaume I, 12071 Castelló de la Plana, Spain
*
Authors to whom correspondence should be addressed.
Entropy 2026, 28(7), 767; https://doi.org/10.3390/e28070767
Submission received: 3 June 2026 / Revised: 27 June 2026 / Accepted: 1 July 2026 / Published: 4 July 2026
(This article belongs to the Section Multidisciplinary Applications)

Abstract

The gaze information channel paradigm models fixation sequences as a first-order Markov chain and quantifies gaze behaviour through Shannon entropy and mutual information (MI), where I ( X ; Y ) measures the reduction in uncertainty about the next fixation state given the current one. This paper extends the framework by introducing two new channels: the saccade amplitude channel, which discretises saccade angular distance into three categories (short, medium, long) with a four-category variant also analysed, and the pupil diameter channel, which discretises fixation-period pupil size into three categories. Both are applied to 10 observers viewing 12 Van Gogh paintings. The amplitude channel shows that observer-driven variation exceeds stimulus-driven variation. The pupil channel yields the highest I ( X ; Y ) among the two new channels ( 0.489 ± 0.209 bits per participant), consistent with the slow dynamics of pupil responses. Goodness-of-fit tests confirm significantly non-random sequential structure in both channels ( p < 0.01 ) for all pooled matrices. A simultaneous cross-channel association analysis across all five channels finds that 19 of 20 pairwise Spearman correlations are non-significant; the single nominally significant result (pupil–duration, ρ = + 0.697 , p = 0.025 ) does not survive Bonferroni correction and is not robust to outlier removal. Two theoretical observations are presented: an upper bound on conditional entropy in terms of transition persistence (Proposition 1), and a refinement monotonicity result showing that finer discretisation cannot decrease channel MI (Remark 2). An exploratory comparison with five computational aesthetics measures finds a nominally significant negative correlation between pupil I ( X ; Y ) and Bense’s palette redundancy ( ρ = 0.692 , p = 0.013 , uncorrected), suggesting that diverse colour palettes are associated with stronger sequential pupil dynamics; permutation entropy and statistical complexity show no association with any channel.

1. Introduction

Eye tracking is one of the most direct windows into human visual cognition. The gaze information channel paradigm [1] models eye-tracking fixation sequences between Areas of Interest (AOIs) as a first-order Markov chain and derives a discrete information channel from the transition matrix. The stationary entropy H ( X ) quantifies how uniformly the observer distributes gaze across regions; the conditional entropy H ( Y | X ) quantifies the randomness of gaze transitions; and the mutual information I ( X ; Y ) = H ( X ) H ( Y | X ) measures sequential dependence.
A fixation-to-fixation trajectory carries information along several complementary dimensions simultaneously: which spatial region the gaze lands in (AOI), how long the fixation lasts (duration), how large the subsequent saccade is (amplitude), and in which direction the saccade travels (direction). Hao et al. introduced both the fixation duration channel [2] and the saccade direction channel [3].
This paper makes two methodological contributions: it introduces the saccade amplitude channel and the pupil diameter channel. These two channels were selected on complementary grounds. Saccade amplitude complements the previously introduced direction channel and represents the magnitude component of the saccadic displacement vector, constituting a natural next step in the same geometric decomposition. Pupil diameter, by contrast, is the only channel that is not purely spatial or temporal in nature: it is often associated with arousal and cognitive load [4] and therefore introduces a qualitatively new physiological dimension into the multi-channel framework, complementing the four purely oculomotor channels. Prior work on saccade amplitude has focused on its marginal distribution [5,6] or on high-order Markovian patterns of short and long saccade lengths (pixel displacement) without computing H ( X ) , H ( Y | X ) , or I ( X ; Y ) [7], and prior work on pupil diameter has treated it as a scalar physiological signal [4] or used a temporally quantised marginal distribution [8], rather than modelling the sequence of fixation-period pupil states as a communication channel. With all five channels computed on the same dataset, we perform a simultaneous assessment of cross-channel association among their I ( X ; Y ) summary statistics, using Spearman rank correlations computed both across participants and across paintings, with Bonferroni correction for multiple comparisons.
We also derive two theoretical observations (Proposition 1 and Remark 2): a simple upper bound on the conditional entropy in terms of the expected self-transition probability, and a refinement monotonicity result showing that state-space refinement cannot decrease channel mutual information.
The paper is organised as follows. Section 2 reviews related work. Section 3 describes the methodology. Section 4 presents results. Section 5 discusses the findings, Section 6 discusses limitations, and Section 7 concludes.

2. Related Work

  • Notation note. Throughout this paper the notation H ( X ) H s (stationary entropy) and H ( Y | X ) H t (transition entropy) are used interchangeably following the conventions established in the literature reviewed below; the former follows Cover and Thomas [9], the latter follows Krejtz et al. [10].

2.1. Gaze Entropy and Markov Chain Models

Ellis and Stark [11] were among the first to model fixation sequences as a Markov chain, computing conditional entropy from the transition matrix. Ponsoda et al. [12] constructed transition matrices over saccade direction categories. Krejtz et al. [10] formalised the stationary entropy H s and transition entropy H t as measures of attention dispersion and transition randomness. Shiferaw et al. [4] provide a comprehensive review of gaze entropy as a measure of visual scanning efficiency.

2.2. The Gaze Information Channel

Hao et al. [13] proposed extending the Markov chain model to a full information channel X Y for Area of Interest (AOI) sequences, enabling computation of H ( X , Y ) and I ( X ; Y ) in addition to H s and H t . The AOI channel was developed fully by Hao et al. [1], who compared channel measures with computational aesthetics quantities and observed a visual correspondence between the curve of normalised AOI MI across Van Gogh’s chronological periods and the compressibility measure M k (defined in Section 2.4)—a relationship we revisit formally in Section 4.11. Hao et al. [13] applied the same AOI framework to scientific poster reading, demonstrating that MI correlates with cognitive comprehension.

2.3. Duration and Direction Channels

The fixation duration channel was introduced by Hao et al. [2], who classified fixations as short-duration (SD, <150 ms), medium-duration (MD, 150–900 ms), or long-duration (LD, ≥900 ms). They found that observer variation is more pronounced than image variation for the duration channel—in contrast to the pattern observed in the AOI channel.
The saccade direction channel was introduced by Hao et al. [3], using eight 45° directional bins. They found that the direction channel also discriminates better between observers than between paintings, and that mutual information is higher for horizontal/vertical saccades than for diagonal ones, with the exception of paintings with strong diagonal composition such as b5 (The Starry Night; see Figure 1).
These three published channels—AOI, fixation duration, and saccade direction—form the established background against which the present paper introduces the amplitude and pupil diameter channels.
To position these contributions, it is useful to compare three strands of prior work. Classical gaze entropy work (Ellis and Stark [11]; Krejtz et al. [10]; Shiferaw et al. [4]) characterises transition structure between spatial regions or directions using H s and H t , but does not compute mutual information and does not treat the transition matrix as a full communication channel. Marginal amplitude studies (Foulsham and Kingstone [5]; Tatler and Vincent [6]; Bonev et al. [7]) have analysed the distribution and Markovian patterns of saccade lengths (pixel displacement) in relation to image content and task demands, but have not computed H ( X ) , H ( Y | X ) , or I ( X ; Y ) for amplitude sequences. Prior pupillometry work (Mathôt [14]; Shiferaw et al. [4]) has analysed pupil diameter either as a scalar psychophysiological signal [15] or marginal distributions [8], without modelling the sequential transition structure between fixation-period pupil states as a Markov information channel. To the best of our knowledge, no prior work has modelled saccade amplitude or fixation-period pupil diameter sequences as a discrete information channel—constructing the transition matrix between consecutive fixation states, estimating the stationary distribution, and computing H ( X ) , H ( Y | X ) , and I ( X ; Y ) .

2.4. Computational Aesthetics and Van Gogh

Rigau et al. [16,17] proposed a suite of information-theoretic aesthetics measures grounded in Birkhoff’s order/complexity framework and applied them to Van Gogh’s chronological evolution. Three measures are relevant here. Bense’s palette redundancy M B = ( H max H ( C ) ) / H max measures the reduction in uncertainty achieved by the palette relative to the maximum possible entropy, where H ( C ) is the Shannon entropy of the colour histogram and H max = log 2 | C | is the maximum possible entropy for that colour space; high M B indicates a limited, homogeneous colour selection, while low M B indicates a heterogeneous, diverse palette. Kolmogorov compressibility M k = ( N H max K ( I ) ) / ( N H max ) approximates the degree of order in the pixel arrangement via lossless compression, where N is the number of pixels and K ( I ) is the compressed file size in bits; higher M k means greater structural regularity. Compositional complexity M s 1 ( 0.25 ) is defined as the number of colour-homogeneous spatial regions required to account for 25% of the mutual information between the colour histogram and a spatial partition of the image; it quantifies how many distinct compositional elements a painting contains, with larger values indicating richer structural organisation. Across Van Gogh’s six chronological periods—Earliest Paintings (1881–1883), Nuenen/Antwerp (1883–1886), Paris (1886–1888), Arles (1888–1889), Saint-Rémy (1889–1890), and Auvers-sur-Oise (1890)— M B and M k decrease monotonically from Nuenen to Auvers (reflecting increasing colour diversity and structural complexity), while M s 1 increases (reflecting richer compositions) [17].
Sigaki et al. [18] computed two further pixel-level measures for nearly 140,000 paintings spanning a millennium of art history. The normalised permutation entropy H PE is estimated from the ordinal probability distribution of 2 × 2 pixel patches: values near 1 indicate that local pixel arrangements are nearly random, while values near 0 indicate high local regularity. The statistical complexity C PE = H PE · Q JS (where Q JS is the normalised Jensen–Shannon divergence between the ordinal pattern distribution and the uniform distribution) is maximised for processes that are neither fully ordered nor fully disordered, and equals zero at both extremes. The Van Gogh dataset was chosen because AOI-based channel measures have already been computed for it [1], enabling direct cross-channel comparison.

3. Method

3.1. Gaze Information Channel

Let the gaze sequence be represented as X 1 , X 2 , , X n , where each state belongs to a finite alphabet S = { 1 , , s } . The sequence is modelled as a first-order Markov chain with transition matrix P = [ p i j ] , estimated by normalising transition counts row-wise. Under mild conditions the chain has a unique stationary distribution π satisfying π P = π .
Each signal dimension (amplitude, duration, direction, pupil) is modelled as an independent first-order Markov chain. This per-channel design follows the established gaze information channel framework [1,2,3] and is motivated by tractability: a joint model over all five channels would require a state space of size O ( s 1 × s 2 × × s 5 ) , rendering transition-count estimation infeasible at the available sample sizes ( N 1000 –3000 fixations per observer). Inter-channel statistical dependencies are instead examined explicitly through the cross-channel Spearman correlation analysis in Section 4.10. This two-stage approach—independent characterisation followed by pairwise association testing—is consistent with prior work on sequential eye-movement analysis [11,12,19].

3.2. Channel Measures

Following [1], with the convention 0 log 0 = 0 :
H s = H ( X ) = H ( Y ) = i π i log 2 π i
H t = H ( Y | X ) = i j π i p i j log 2 p i j
H ( X , Y ) = H ( X ) + H ( Y | X )
I ( X ; Y ) = H ( X ) H ( Y | X )
The normalised mutual information I ( X ; Y ) / H ( X ) is scale-free, allowing comparison across channels with different state-space sizes. All logarithms are base 2 (bits). Unless otherwise stated, amplitude channel results refer to the 3-category scheme (Short/Medium/Long), and values are pooled across participants (for per-painting results) or across paintings (for per-participant results).
We derive a simple upper bound on the conditional entropy in terms of the expected self-transition probability. While the ingredients are standard, this formulation provides a direct link between transition persistence and mutual information in gaze channels.
Proposition 1 
(Persistence and conditional entropy). Let ( X t ) be a stationary first-order Markov chain on a finite state space S with | S | = m , stationary distribution π, and transition matrix P = [ p i j ] . Define the expected self-transition probability
α = i S π i p i i .
Then, we denote by H b ( p ) = p log 2 p ( 1 p ) log 2 ( 1 p ) the binary entropy function,
H ( Y | X ) H b ( α ) + ( 1 α ) log 2 ( m 1 ) .
That is, the conditional entropy of the channel output is bounded above by a function of persistence α and state-space size m alone, regardless of the off-diagonal transition structure.
Proof. 
For each state i, among all distributions over m states with fixed self-probability p i i , the conditional entropy H ( Y | X = i ) is maximised when the remaining probability mass 1 p i i is spread uniformly over the other m 1 states [9]. Hence
H ( Y | X = i ) H b ( p i i ) + ( 1 p i i ) log 2 ( m 1 ) .
Averaging with respect to π gives
H ( Y | X ) i π i H b ( p i i ) + ( 1 α ) log 2 ( m 1 ) .
Since H b is concave, Jensen’s inequality yields i π i H b ( p i i ) H b ( α ) , so H ( Y | X ) H b ( α ) + ( 1 α ) log 2 ( m 1 ) . □
Remark 1. 
The proposition shows that the conditional entropy H ( Y | X ) of a gaze channel is controlled by two factors: the persistence α (which sets the upper bound) and the off-diagonal transition structure (which determines how far below the bound the actual H ( Y | X ) falls). Since I ( X ; Y ) = H ( X ) H ( Y | X ) , a lower upper bound on H ( Y | X ) increases the maximum attainable mutual information for a fixed H ( X ) : channels with strong persistence can achieve higher MI, though they are not guaranteed to. The empirical tightness of this bound—how much slack remains between the bound and the actual H ( Y | X ) for each channel—is examined in Section 5.
Remark 2. 
Since the 3-category amplitude scheme is obtained from the 4-category scheme by deterministic merging of states, the data-processing inequality [9] implies
I 3 - cat ( X ; Y ) I 4 - cat ( X ; Y ) .
Therefore the increase in MI observed in Table 1 (participants 0.029 0.040 bits; paintings 0.026 0.037 bits) is expected theoretically whenever one categorisation is a refinement of the other.
  • Practical interpretation. Proposition 1 connects the persistence parameter α to an upper bound on H ( Y | X ) and hence to I ( X ; Y ) . A high α (strongly persistent gaze, e.g., long fixations within a single AOI or slow, large-amplitude saccades) implies a tight bound on conditional entropy, predicting high sequential predictability and high MI. This allows researchers to rank channels or observers by their degree of gaze “stickiness” using a single observable statistic ( α ) before computing the full channel; the slack values reported in Section 5 confirm that the bound is informative rather than vacuous. Remark 2 provides a principled basis for calibrating discretisation: since adding categories can only increase MI, a researcher can systematically refine the binning and monitor diminishing returns. For the amplitude channel, moving from 3 to 4 categories increases mean participant MI by 0.011 bits ( 0.029 0.040 bits)—a small gain that confirms the 3-category scheme already captures most of the sequential structure and is adequate for cross-channel comparisons.

3.3. Categorisation Schemes and Validation

  • Saccade amplitude channel. The visual angle θ of each saccade is computed from pixel displacement d using a screen-to-eye distance of 700 mm and 0.2745 mm/px:
θ = 2 · arctan d × 0.2745 2 × 700 × 180 π ( degrees )
The 3-category scheme partitions saccades into short ( θ < 1 ), medium ( 1 θ 5 ), and long ( θ > 5 ). The 4-category scheme further splits at 3 : very-short ( θ < 1 ), short ( 1 3 ), medium ( 3 5 ), long ( > 5 ). The 1° and 5° boundaries follow established functional distinctions in the scene-viewing literature: saccades below 1° are typically classified as microsaccades or very short corrective movements; the 1°–5° range encompasses the ambient-to-focal transition zone typical of art and scene viewing [5,6,20]; and saccades exceeding 5° constitute large exploratory re-orientations. The 3° split in the 4-category scheme further separates within-region (1°–3°) from between-region (3°–5°) ambient saccades. The robustness of the choice is confirmed empirically by Remark 2: the 3-category and 4-category schemes yield nearly identical normalised MI (see Section 4.6), demonstrating that the key information content is captured by the 3-category scheme and that the results are not sensitive to the precise location of the boundary within the medium range. In 18 of the 120 participant–painting pairs (15%), the long category is empty; in these cases measures are computed over non-empty categories only.
  • Pupil diameter channel. Mean pupil diameter during each fixation period is classified as small (S, <3.5 mm), medium (M, 3.5 4.3 mm), or large (L, >4.3 mm). Pupil size is influenced by cognitive arousal and mental effort via the psychosensory pupil response [14], in addition to luminance-driven mechanisms. During free viewing of paintings, pupil dilation has been shown to track high-level perceptual processing: observers show larger pupils when judging the quality of abstract art, suggesting that pupil size indexes cognitive engagement with the stimulus [15]. These thresholds were chosen to separate qualitatively distinct pupil-diameter ranges (small, medium, and large); the observed empirical proportions (Small 9.9 %, Medium 32.7 %, Large 57.4 %) reflect the raw frequency of each category across all fixations, while the stationary distribution π derived from the transition matrix gives a somewhat different picture (see Figure 2, bottom row). A total of 132 fixations with diameter 0.5 mm were excluded as tracking artefacts (0.95% of 13,897 total fixations); these affect only the transition matrix construction. Unlike the amplitude channel, we do not introduce a 4-category pupil scheme. One methodological limitation of the pupil channel in painting-viewing studies is the luminance confound: as the eye moves between bright and dark regions of a painting, the pupil light response modulates diameter independently of cognitive arousal [14]. We do not apply luminance correction in this study because luminance values per fixation are not available in the dataset; the sequential structure captured by the channel therefore reflects a mixture of psychosensory and luminance-driven dynamics. A luminance-corrected replication is noted as future work. For amplitude, the split at 3 within the medium band has a clear physiological motivation, refining the ambient/focal distinction. For pupil diameter, no equivalent physiological boundary motivates a fourth category; the three bins reflect the empirical distribution of pupil sizes, and finer bins would produce smaller counts in the extreme categories where data are already sparse.
  • Validation. To confirm that the observed sequential structure is non-random, we apply the Besag and Mondal [21] exact goodness-of-fit test for Markov chains to the pooled transition matrices (all 12 paintings per participant; all 10 participants per painting). The null hypothesis is p i j = π j for all i (independence). For both new channels, all 10 matrices averaged across participants and all 12 matrices averaged across paintings reject H 0 at p < 0.01 , confirming that the sequential structure is significantly non-random.

3.4. Statistical Analysis

Distributional properties of I ( X ; Y ) were assessed using the Shapiro–Wilk test applied to all N = 120 individual observations (10 participants × 12 paintings). I Dir was the only channel consistent with approximate normality (Shapiro–Wilk W = 0.984 , p = 0.174), where I Ch denotes I ( X ; Y ) for channel Ch; all remaining channels departed significantly ( p < 0.001 in each case, with W ranging from 0.672 for I Amp to 0.927 for I Pup ). All subsequent inferential analyses therefore use nonparametric procedures. Differences in I ( X ; Y ) across the five channels were assessed with the Friedman test applied to participant-level data ( N = 10 ). Associations among I ( X ; Y ) values and between I ( X ; Y ) and image-complexity measures were examined with Spearman’s ρ . All tests are two-tailed with a nominal significance level of 0.05.

4. Results

4.1. Dataset

The dataset consists of eye-tracking recordings from 10 observers (five female, mean age 24.3 ± 3.1 years) viewing 12 Van Gogh paintings under free-viewing conditions (45 s per painting, SMI iViewETG2w eye tracker). Observers were recruited from the student and staff community of Tianjin University through posted notices; all had normal or corrected-to-normal vision and reported no history of colour deficiency. Ethical approval and informed consent procedures for the original data collection are described in [1]; the present study performs a secondary analysis of these previously collected, de-identified recordings and did not involve any new data collection. Observers were instructed to view each painting freely for 45 seconds, with no prescribed task, no mention of subsequent testing, and no instruction to memorise or evaluate the works. This free-viewing paradigm is standard in aesthetic eye-tracking research and stands in contrast to task-directed viewing, in which instructions are known to profoundly redirect gaze [22,23]. The 12 paintings span six chronological periods—Earliest Paintings (1881–1883), Nuenen/Antwerp (1883–1886), Paris (1886–1888), Arles (1888–1889), Saint-Rémy (1889–1890), and Auvers-sur-Oise (1890)—with two representative paintings selected per period. Following [1], the two paintings within each period are labelled group a and group b (an arbitrary distinction inherited from that work); see Figure 1. Full experimental details are given in [1].

4.2. Participant-Level Amplitude Analysis

Table 1 (left panel) shows H ( X ) and I ( X ; Y ) per participant for both amplitude schemes (Figure 3). H ( X ) is stable across participants (3-cat: mean 1.127, SD 0.059 bits), suggesting a broadly similar marginal distribution of saccade amplitudes across observers, although equal entropy values do not uniquely imply identical distributions. I ( X ; Y ) shows more variability (3-cat: mean 0.029, SD 0.026 bits). The stationary distributions π for both amplitude schemes are shown in Figure 2 (top and middle rows): medium saccades ( 1 5 ) dominate the 3-category amplitude channel ( π medium 0.58 ), while the 4-category scheme reveals that this mass splits roughly equally between the short ( 1 3 ) and medium ( 3 5 ) bands.

4.3. Stimulus-Level Amplitude Analysis

Table 1 (right panel) shows channel measures per painting for both amplitude schemes (Figure 4). Inter-painting variation in I ( X ; Y ) (3-cat: mean 0.026, SD 0.015 bits) is lower than inter-participant variation (3-cat: mean 0.029, SD 0.026 bits), suggesting that, in this dataset, observer-driven variation exceeds stimulus-driven variation for the amplitude channel.

4.4. MI by Chronological Period

Figure 5 shows the mean I ( X ; Y ) per Van Gogh chronological period for all five channels. The AOI channel shows a significant positive trend ( ρ = + 0.763 , p = 0.004 ; see [1]), reflecting the growing compositional complexity of Van Gogh’s later work. In contrast, amplitude MI shows no monotonic trend ( ρ = 0.050 , p = 0.878 ), confirming that while amplitude MI discriminates observers slightly better than paintings overall (results derived from Table 2 and summarized in Table 3, ratio 0.58), it is insensitive to the chronological evolution of Van Gogh’s style. Duration ( ρ = 0.234 , p = 0.465 ) and pupil ( ρ = + 0.014 , p = 0.965 ) channels show no significant chronological trend. The direction channel shows a marginal negative trend ( ρ = 0.565 , p = 0.055 ), suggesting that later Van Gogh periods may elicit slightly less predictable saccade direction sequences, though this does not survive correction for multiple comparisons. Overall, the AOI channel remains the only one to show a statistically significant association with Van Gogh’s stylistic evolution.

4.5. Five-Channel Summary

Table 2 (left panel: participants; right panel: paintings) summarises I ( X ; Y ) from all five channels simultaneously. The most immediately striking feature is the scale separation between channels: AOI I ( X ; Y ) (participant mean 1.324 bits; painting mean 1.367 bits) substantially exceeds all other channels, reflecting the large state space and rich spatial structure of the AOI representation. The pupil channel is the second highest contributor (participant mean 0.489 bits; painting mean 0.746 bits), attributable to the slow physiological dynamics of pupil dilation discussed in Section 5. The amplitude channel has the smallest I ( X ; Y ) values (participant mean 0.029 bits; painting mean 0.026 bits), followed by the duration channel (participant mean 0.046 bits) and the direction channel (participant mean 0.189 bits). A Friedman test on participant-level data ( N = 10 ) confirmed that the five channels differ significantly in I ( X ; Y ) ( χ 2 ( 4 ) = 38.69 , p < 0.001 ), with mean ranks r ¯ AOI = 5.00 > r ¯ Pup = 4.00 > r ¯ Dir = 3.00 > r ¯ Dur = 1.75 > r ¯ Amp = 1.25 , confirming the scale separation visible in Table 2 and Figure 6. Within the participant panel, P01 is a notable outlier: it records zero MI for the duration channel and the lowest MI for the pupil channel (0.144 bits), suggesting an atypically uniform fixation-period pupil-diameter transition pattern. Within the painting panel, b1 (Two Women in the Woods) elicits the highest pupil MI (0.995 bits), while the amplitude channel is comparatively stable across all twelve paintings (range 0.010–0.051 bits). Table 3 shows that inter-participant variation in amplitude MI ( σ obs = 0.026 bits) exceeds inter-painting variation ( σ stim = 0.015 bits, ratio 0.58), indicating that amplitude sequential structure is more observer-specific than stimulus-driven—in contrast to the AOI channel (ratio 1.82).
Table 3 summarises the discrimination profile of each channel. Only the AOI channel (ratio 1.82) shows greater inter-painting variability than inter-participant variability, indicating that its sequential structure is tightly linked to stimulus content. All remaining channels—amplitude (0.58), duration (0.79), direction (0.90), and pupil (0.77)—show higher inter-participant variability, suggesting that observer-specific factors play the dominant role. The contrast between the AOI ratio (1.82) and the amplitude ratio (0.58) is noteworthy: although both channels classify saccade-related events, the spatial destination of a saccade is more strongly constrained by compositional features of the painting, while the distance travelled is relatively more observer-specific. Figure 6 visualises these patterns simultaneously across all five channels.

4.6. Normalised Mutual Information

Figure 7 shows the normalised MI I ( X ; Y ) / H ( X ) . Values are nearly identical across the 3-category and 4-category schemes, confirming robustness to the choice of categorisation boundary.

4.7. Transition Matrices

Figure 8 and Figure 9 show the pooled transition matrices P ( Y | X ) . In the 3-category scheme (Figure 8), medium–medium self-transitions are the strongest ( p M M 0.657 ), reflecting the dominance of medium-amplitude saccades in the stationary distribution. Long saccades have the lowest self-transition probability ( p L L 0.077 ), as they are more likely to be followed by a short or medium saccade. In the 4-category scheme (Figure 9), very-short–very-short self-transitions tie with short–short at the highest level ( p V S p S S 0.48 0.56 ), while medium–medium self-transitions are the weakest ( p M M 0.158 ).

4.8. Participant-Level Pupil Analysis

Table 4 and Figure 10 (left) show I ( X ; Y ) per participant. The range is 0.144 (P01) to 0.771 (P04), with mean 0.489 ± 0.209 bits. The stationary distribution π of the pupil channel is shown in Figure 2 (bottom row): the Medium state dominates ( π medium 0.59 ), with large fixations accounting for approximately 0.31 and small fixations rare ( 0.10 ). These values substantially exceed the amplitude and duration channels, and the pupil channel ranks second overall after the AOI channel.
Inspecting the per-painting panel, group b paintings tend to elicit higher pupil MI than their group a counterparts within the same period (means 0.796 vs. 0.696 bits), though with only six period pairs this pattern should be treated as descriptive.

4.9. Pupil Transition Matrices

Figure 11 shows P ( Y | X ) for the pupil channel, averaged separately across participants (left) and across paintings (right). Self-transition probabilities are very high in both cases, consistent with slow physiological persistence of pupil dilation. The two pooled matrices are nearly identical, with self-transition probabilities around 0.78 (Small), 0.88 (Medium), and 0.90 (Large), suggesting that pupil persistence is somewhat more consistent across paintings than across individuals—in line with the finding from Table 3 that the pupil channel discriminates observers slightly better than paintings. However, pupil diameter is also influenced by luminance, baseline differences across participants, and measurement conditions; these factors may contribute to the observed persistence independently of arousal.

4.10. Cross-Channel Association

Table 5 (left and right panels) presents the full 5 × 5 Spearman rank-correlation matrix between I ( X ; Y ) values from all five channels. Given the small sample sizes ( N = 10 participants, N = 12 paintings), these results should be interpreted as exploratory and require validation on larger datasets. Of the 20 off-diagonal entries, 19 did not reach statistical significance at a nominal significance level of 0.05 (uncorrected). Under Bonferroni correction within each correlation matrix for 10 unique channel pairs (threshold p < 0.005 ), the single nominally significant result—Pupil–Duration ( ρ = + 0.697 , p = 0.025 )—does not remain significant. Applying a correction across all 20 participant- and painting-level tests would be even more conservative and leads to the same conclusion.
A plausible interpretation is that both the pupil and duration channels are sensitive to observer-level differences in cognitive engagement or arousal. At the painting level, the correlation did not reach statistical significance ( ρ = + 0.028 , p = 0.931 ).
  • Sensitivity analysis. The baseline per-participant I ( X ; Y ) values used in the cross-channel analysis are given in Table 2 (left panel). Inspection of the scatter plots (Figure 12) reveals that P01 is an outlier across several channel combinations: it has the lowest I ( X ; Y ) in both the pupil channel (0.144, z = 1.79 ) and the direction channel (0.047, z = 2.22 ), and zero MI in the duration channel. The baseline Duration–Pupil correlation with the full sample ( N = 10 ) is ρ = + 0.697 , p = 0.025 . When P01 is removed ( N = 9 ), this correlation loses significance ( ρ = + 0.583 , p = 0.099 ), indicating that the Duration–Pupil association is substantially driven by a single participant and is not robust.

4.11. Relationship with Computational Aesthetics Measures (Exploratory Analysis)

Hao et al. [1] compared AOI channel measures with three computational aesthetics quantities computed from the pixel structure of the same 12 paintings: Kolmogorov complexity-based compressibility M k , Bense’s palette redundancy M B [16], and compositional complexity M s 1 [16]. They found that the curve of normalised AOI I ( X ; Y ) across paintings closely follows M k and 1 M B . With all five channels now available on the same dataset, we can extend this comparison. Per-painting values of M k , M B , and M s 1 ( 0.25 ) for all 12 stimuli were extracted from [1,17]. In addition, we compute the normalised permutation entropy H PE and statistical complexity C PE for each painting following Sigaki et al. [18], using a 2 × 2 sliding window (24 ordinal patterns) applied to the greyscale image. Full definitions of all five measures are given in Section 2.4.
Table 6 shows the Spearman rank correlations between each channel’s I ( X ; Y ) per painting and all five aesthetics measures.
All results should be treated with caution given the small number of paintings ( N = 12 ) and the multiple comparisons involved (25 pairs tested across five measures).
The strongest association is between the pupil channel and Bense’s palette redundancy ( ρ = 0.692 , p = 0.013 , uncorrected): paintings with a more heterogeneous, colouristically diverse palette are associated with stronger sequential pupil dynamics. One possible interpretation is that a richer palette engages the psychosensory pupil response more continuously across fixations, although luminance-driven contributions cannot be excluded (see Section 6). The direction channel shows a marginal positive correlation with M k ( ρ = + 0.510 , p = 0.090 ) and the AOI channel with compositional complexity M s 1 ( ρ = + 0.503 , p = 0.095 ); the amplitude and duration channels show no significant association with any image-based measure. The H PE and C PE columns show no significant associations with any channel (all | ρ | 0.48 , all p 0.117 ), likely because all 12 Van Gogh paintings occupy a uniformly high entropy range (Table 7: 0.934–0.995) that limits between-painting discrimination.

5. Discussion

The robustness of the amplitude channel across two categorisation schemes confirms that the sequential structure it captures is not an artefact of the particular bin boundaries chosen, a property guaranteed theoretically by Remark 2 and verified empirically by the near-identical normalised MI values (Section 4.6). The dominance of medium–medium self-transitions is consistent with the ambient/focal framework of visual attention [10], suggesting that observers tend to maintain their saccade amplitude regime across consecutive fixations rather than alternating freely between scales.
The link between transition persistence and mutual information, formalised in Proposition 1, is illustrated across all five channels in Figure 13, which plots I ( X ; Y ) (vertical axis) vs. the expected self-transition probability α = i π i p i i (horizontal axis).
We verified the Proposition 1 bound H ( Y | X ) H b ( α ) + ( 1 α ) log 2 ( m 1 ) numerically for all five channels using the grand-pooled transition matrices; Table 8 shows the actual H ( Y | X ) , the bound, and the slack (bound minus actual) for each channel.
The slack quantifies how far the actual channel is from the worst-case (maximally diffuse off-diagonal structure) assumed by the bound. The bound is tightest for the pupil channel (slack = 0.058 bits), where high persistence leaves little room for off-diagonal entropy, and for the direction channel (slack = 0.072 bits), which has eight states and a relatively diffuse transition structure. The bound is loosest for AOI (slack = 0.309 bits): despite moderate α , its rich spatial composition produces a highly structured off-diagonal pattern that keeps H ( Y | X ) well below the worst case, illustrating that α alone does not determine H ( Y | X ) —off-diagonal structure matters too (Remark 1). The five channels occupy well-separated regions along the α axis (Figure 13): direction ( α 0.23 ) and amplitude ( α 0.57 ) have the lowest persistence; AOI ( α 0.62 ) and duration ( α 0.65 ) have intermediate persistence; and the pupil channel ( α 0.86 ) has the highest persistence and the highest MI among the four non-AOI channels. This between-channel pattern is broadly consistent with the expectation that higher persistence is associated with greater sequential dependence, with AOI as the notable exception owing to its large state space. A noteworthy detail is that amplitude ( α 0.57 , I 0.029 ) and duration ( α 0.65 , I 0.046 ) are the two lowest-MI channels, both well below the direction, pupil, and AOI channels, despite representing different physical quantities—consistent with both being components of the ambient/focal scanning mode captured by Krejtz et al.’s κ coefficient [10]. Their cross-channel Spearman correlation is nonetheless not significant (participants: ρ = + 0.418 , p = 0.229 ; paintings: ρ = 0.091 , p = 0.779 ), confirming that they carry similar amounts of sequential structure but not the same structure. Within each channel, α varies only modestly across paintings and participants, so the dominant source of MI variation within a channel is the shape of the off-diagonal transition structure rather than persistence alone.
The pupil diameter channel shows the second highest I ( X ; Y ) of all five channels (after the AOI channel), which is consistent with the slow physiological dynamics of pupil dilation [14]. Pupil size reflects both psychosensory and luminance-driven processes, which unfold over seconds and are thus inherently persistent across consecutive fixations; this physiological timescale explains why self-transition probabilities are very high across both aggregations (around 0.78 for Small, 0.88 for Medium, and 0.90 for Large, nearly identical across participants and paintings) and why I ( X ; Y ) substantially exceeds the amplitude, duration, and direction channels. The near-zero Pupil–Duration painting-level correlation ( ρ = + 0.028 ) stands in contrast to the nominally significant participant-level correlation ( ρ = + 0.697 ). The sensitivity analysis shows that this participant-level result is not robust, losing significance upon removal of P01 ( ρ = + 0.583 , p = 0.099 ).
The overall pattern of weak and statistically non-significant cross-channel associations suggests that the channels may capture partially distinct aspects of gaze behaviour, although the present sample size does not allow strong conclusions regarding channel independence.
A connection worth noting is that the amplitude and duration channels together correspond to the components of Krejtz et al.’s κ coefficient [10], which quantifies the temporal correlation between fixation duration and subsequent saccade amplitude as a marker of the ambient–focal distinction. Despite this conceptual link, the Spearman correlation between duration and amplitude I ( X ; Y ) values is not significant at either level (participants: ρ = + 0.418 , p = 0.229 ; paintings: ρ = 0.091 , p = 0.779 ), suggesting that the channel measures capture different aspects of these dimensions than the scalar κ statistic does.
The relationship between channel measures and computational aesthetics quantities [1] is examined in Section 4.11. Notably, the pupil channel shows a nominally significant negative correlation with Bense’s palette redundancy M B ( ρ = 0.692 , p = 0.013 , uncorrected), the AOI channel shows a marginal positive correlation with compositional complexity M s 1 ( ρ = + 0.503 , p = 0.095 ), and the direction channel shows a marginal positive correlation with M k ( ρ = + 0.510 , p = 0.090 ). By contrast, neither permutation entropy H PE nor statistical complexity C PE shows a significant association with any channel, likely because all 12 Van Gogh paintings occupy a compressed high-entropy range that limits between-painting discrimination.

6. Limitations

Several limitations of this study should be noted.
Sample size. The dataset comprises 10 observers and 12 paintings. The small N limits statistical power for cross-channel association tests ( N = 10 or N = 12 per Spearman correlation) and means that individual outlier participants can substantially influence results, as shown by the sensitivity analysis for the Pupil–Duration pair. Replication with larger and more diverse samples is necessary before drawing strong conclusions.
Single dataset and stimulus type. All 12 stimuli are paintings by a single artist. The channel properties—particularly the finding that amplitude discriminates observers better than paintings while pupil discriminates observers better than paintings—may not generalise to other stimulus types (natural scenes, faces, diagrams) or tasks (visual search, reading).
Luminance confound in the pupil channel. As noted in Section 3.3, fixation-period pupil size reflects a mixture of psychosensory arousal and the pupil light response to local luminance [14]. Without per-fixation luminance estimates, these contributions cannot be separated. The pupil– M B correlation ( ρ = 0.692 ) should therefore be interpreted with caution: it may partly reflect structured luminance transitions in paintings with a more ordered, limited palette (high M B ) rather than purely cognitive differences in arousal.
Choice of channel input order. The channel X t X t + 1 constructed in this paper is a valid information channel regardless of whether the underlying gaze process is first-order Markov or not: the transition matrix P ( Y | X ) and the mutual information I ( X t ; X t + 1 ) are well-defined descriptors of the sequential structure between consecutive fixation states. The question of Markov order is therefore not one of validity but of completeness: a second-order channel with compound input ( X t 1 , X t ) captures strictly more sequential dependence than the first-order channel, since by the data-processing inequality I ( X t ; X t + 1 ) I ( X t 1 , X t ; X t + 1 ) . Bonev et al. [7] reported empirical evidence of higher-order Markovian patterns in saccade length sequences (pixel displacement), suggesting that a second-order channel may capture additional sequential dependence beyond what is reported here. The standard tool for testing whether this additional structure is statistically detectable is the asymptotic likelihood-ratio G-test, but for the second-order amplitude channel ( 9 × 3 transition matrix, 27 cells) the present dataset is too sparse to satisfy the Cochran condition for the χ 2 approximation in most units, so this question cannot be answered reliably here. A larger dataset would allow both reliable G-test evaluation and more stable estimation of the second-order channel MI.
Discretisation choices and pupil threshold bias. All channel measures depend on the choice of category boundaries. Although the amplitude channel showed robustness across two categorisation schemes (Remark 2 guarantees that finer discretisation cannot decrease MI), alternative binning strategies could alter absolute MI values and transition structures. The choice of boundaries for the pupil channel was motivated by the empirical distribution of the data; different datasets or viewing conditions may require different thresholds. More importantly, fixed absolute thresholds are a limitation for the pupil channel because individual baseline pupil diameter varies with age, iris pigmentation, and ambient illumination [14]. Although the present experiment used constant room illumination and a single recording session per observer, the absolute categories (Small/Medium/Large) may not represent equivalent physiological states for all participants. A more principled alternative would be to normalise each observer’s pupil diameters (e.g., by per-observer z-score or tertile split) before assigning categories, producing equal-frequency states per observer and eliminating inter-individual baseline differences. Adopting this participant-normalised scheme would not be expected to alter the qualitative pattern of results (pupil showing the highest MI among the two new channels) but would change the exact numerical values and potentially the cross-channel correlation results; this is noted as a direction for future work.
Multiple comparisons. The exploratory correlation analyses in Section 4.11 involve 25 pairwise tests across five channels and five aesthetic measures. With a nominal significance level of 0.05 (uncorrected), up to one or two false positives would be expected by chance alone. The single nominally significant result (Pupil– M B , p = 0.013 ) does not survive Bonferroni correction (threshold p < 0.002 ) and should therefore be treated as hypothesis-generating rather than confirmatory.

7. Conclusions

This paper introduced two new gaze information channels: the saccade amplitude channel and the pupil diameter channel. Applied to 10 observers viewing 12 Van Gogh paintings:
  • The amplitude channel shows that observer-driven variation exceeds stimulus-driven variation in this dataset, in contrast to the AOI channel.
  • The pupil channel shows the highest I ( X ; Y ) among the two new channels (participant mean 0.489 bits, painting mean 0.746 bits), which is consistent with the slow dynamics of pupil responses.
  • Two theoretical observations (Proposition 1 and Remark 2) provide a simple upper bound on the conditional entropy in terms of transition persistence, and show that state-space refinement cannot decrease channel mutual information, directly explaining the 3-category to 4-category increase in amplitude MI.
  • Goodness-of-fit tests confirm significantly non-random sequential structure in both channels at p < 0.01 for all pooled matrices.
  • Of the 20 pairwise Spearman correlations across five channels, 19 did not reach statistical significance, suggesting that the channels may capture partially distinct aspects of gaze behaviour, although the present sample size does not allow strong conclusions regarding channel independence; the single nominally significant result (Pupil–Duration, ρ = + 0.697 ) does not survive Bonferroni correction and is not robust to removal of one outlier participant.
  • In an exploratory comparison with five computational aesthetics measures, the pupil channel I ( X ; Y ) shows a nominally significant negative correlation with Bense’s palette redundancy M B ( ρ = 0.692 , p = 0.013 , uncorrected, does not survive Bonferroni correction): paintings with more diverse colour palettes are associated with stronger sequential pupil dynamics, though this result is hypothesis-generating only, and the contribution of luminance-driven pupil responses cannot be separated from cognitive effects without per-fixation luminance data. The AOI channel shows a marginal positive association with compositional complexity M s 1 ( ρ = + 0.503 , p = 0.095 ), and the direction channel with Kolmogorov compressibility M k ( ρ = + 0.510 , p = 0.090 ). Permutation entropy H PE and statistical complexity C PE show no significant association with any channel, consistent with the narrow high-entropy range occupied by all 12 Van Gogh paintings.
Future work should pursue several directions. First, both channels should be validated on larger and more diverse datasets spanning different stimulus types (natural scenes, visual search, reading), to establish whether the observer-versus-stimulus discrimination pattern reported here generalises beyond art viewing. Second, the Pupil–Duration association should be tested with an independent measure of arousal or cognitive load (e.g., task-evoked pupillary response, skin conductance, or subjective workload rating) to determine whether the shared variance is genuinely cognitive or partly artifactual. Third, a luminance-corrected version of the pupil channel should be computed once per-fixation luminance values are available, to disentangle psychosensory and light-response contributions to the sequential structure. Fourth, extending the channel input from X t to the compound state ( X t 1 , X t ) would define a second-order channel that, by the data-processing inequality, captures at least as much sequential dependence as reported here. Whether this additional structure is practically detectable requires a larger dataset: the second-order amplitude channel ( 9 × 3 transition matrix) is too sparse for reliable G-test evaluation in the present data [7]. Finally, additional channels—such as saccade velocity or blink rate — could further enrich the multi-channel framework.

Author Contributions

Conceptualization, M.S., M.F. and Q.H.; methodology, M.S., M.V., M.F. and Q.H.; software, M.V. and M.S.; formal analysis, M.V., M.S. and M.F.; data curation, Q.H.; writing—original draft, M.V. and M.S.; writing—review and editing, Q.H., M.V., M.F., M.Y.M. and M.S.; visualization, M.V. and M.S.; supervision, M.S. All authors have read and agreed to the published version of the manuscript.

Funding

M.V., M.F. and M.S. have been supported by grant PID2023-149976OB-C22 funded by MICIU/AEI/10.13039/501100011033 and by ERDF/EU, M.Y.M. by grant PID2023-149976OB-C21, funded by MCIN/AEI/10.13039/501100011033/FEDER, EU, and by the Conselleria de Cultura, Educación y Ciencia, Generalitat Valenciana, and CIACIF, and Q.H. by grant KQ2417 from the Scientific Research Foundation for High-level Talents of Henan Institute of Technology.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The eye-tracking dataset used in this study is available from the corresponding authors upon reasonable request.

Acknowledgments

The authors thank the participants of the eye-tracking experiment. The authors used AI-based language models (ChatGPT 5.5, OpenAI, and Claude Sonnet 4.6, Anthropic) to assist with language editing and manuscript revision. Figures were generated using Python 3.12.3 (matplotlib 3.10.8, scipy 1.17.1). Statistical analyses were performed in SPSS 31.0.0 (IBM). The authors carefully reviewed and verified all content and take full responsibility for the accuracy and integrity of the manuscript.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

AOIArea of Interest
MIMutual Information
SDShort Duration
MDMedium Duration
LDLong Duration

References

  1. Hao, Q.; Ma, L.; Sbert, M.; Feixas, M.; Zhang, J. Gaze information channel in Van Gogh’s paintings. Entropy 2020, 22, 540. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  2. Hao, Q.; Sbert, M.; Feng, Q.; Zhang, J. Entropy based analysis of gaze fixation duration. In Proceedings of the 2022 International Joint Conference on Neural Networks, IJCNN 2022, Padua, Italy, 18–23 July 2022; IEEE: Piscataway, NJ, USA, 2022; pp. 1–9. ISBN 978-1-7281-8671-9. [Google Scholar]
  3. Hao, Q.; Sbert, M.; Feixas, M.; Zhang, Y.; Vila, M.; Zhang, J. Saccade direction information channel. In International Conference on Neural Information Processing 2022; LNCS; Springer: Cham, Switzerland, 2023; Volume 13623, pp. 37–50. [Google Scholar]
  4. Shiferaw, B.; Downey, L.; Crewther, D. A review of gaze entropy as a measure of visual scanning efficiency. Neurosci. Biobehav. Rev. 2019, 96, 353–366. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  5. Foulsham, T.; Kingstone, A. Asymmetries in the direction of saccades during perception of scenes and fractals. Vis. Res. 2010, 50, 779–795. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  6. Tatler, B.W.; Vincent, B.T. Systematic tendencies in scene viewing. J. Eye Mov. Res. 2008, 2, 1–18. [Google Scholar] [CrossRef] [Scilit]
  7. Bonev, B.; Chuang, L.L.; Escolano, F. How do image complexity, task demands and looking biases influence human gaze behavior? Pattern Recogn. Lett. 2013, 34, 723–730. [Google Scholar] [CrossRef] [Scilit]
  8. Fuhl, W.; Kuebler, T.; Santini, T.; Kasneci, E. A temporally quantized distribution of pupil diameters as a new feature for cognitive load classification. arXiv 2023, arXiv:2303.12757. [Google Scholar]
  9. Cover, T.M.; Thomas, J.A. Elements of Information Theory; Wiley: Hoboken, NJ, USA, 1991. [Google Scholar]
  10. Krejtz, K.; Duchowski, A.; Szmidt, T.; Krejtz, I.; González Perilli, F.; Pires, A.; Vilaro, A.; Villalobos, N. Gaze transition entropy. ACM Trans. Appl. Percept. 2015, 13, 4. [Google Scholar] [CrossRef] [Scilit]
  11. Ellis, S.R.; Stark, L. Statistical dependency in visual scanning. Hum. Factors 1986, 28, 421–438. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  12. Ponsoda, V.; Scott, D.; Findlay, J.M. A probability vector and transition matrix analysis of eye movements during visual search. Acta Psychol. 1995, 88, 167–185. [Google Scholar] [CrossRef] [Scilit]
  13. Hao, Q.; Sbert, M.; Ma, L. Gaze information channel in cognitive comprehension of poster reading. Entropy 2019, 21, 444. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  14. Mathôt, S. Pupillometry: Psychology, Physiology, and Function. J. Cogn. 2018, 1, 16. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  15. Alvarez, S.A.; Winner, E.; Hawley-Dolan, A.; Snapper, L. What Gaze Fixation and Pupil Dilation Can Tell Us About Perceived Differences Between Abstract Art by Artists Versus by Children and Animals. Perception 2015, 44, 1310–1331. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  16. Rigau, J.; Feixas, M.; Sbert, M. Informational aesthetics measures. IEEE Comput. Graph. Appl. 2008, 28, 24–34. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  17. Rigau, J.; Feixas, M.; Sbert, M.; Wallraven, C. Toward Auvers period: Evolution of Van Gogh’s style. Comput. Aesthet. 2010, 99–106. [Google Scholar]
  18. Sigaki, H.Y.; Perc, M.; Ribeiro, H.V. History of art paintings through the lens of entropy and complexity. Proc. Natl. Acad. Sci. USA 2018, 115, E8585–E8594. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  19. Vandeberg, L.; Bouwmeester, S.; Bocanegra, B.R.; Zwaan, R.A. Detecting cognitive interactions through eye movement transitions. J. Mem. Lang. 2013, 69, 445–460. [Google Scholar] [CrossRef] [Scilit]
  20. Rayner, K. Eye movements in reading and information processing: 20 years of research. Psychol. Bull. 1998, 124, 372–422. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  21. Besag, J.; Mondal, D. Exact goodness-of-fit tests for Markov chains. Biometrics 2013, 69, 488–496. [Google Scholar] [CrossRef] [Scilit]
  22. Yarbus, A.L. Eye Movements and Vision; Plenum Press: New York, NY, USA, 1967. [Google Scholar]
  23. Locher, P.; Krupinski, E.A.; Mello-Thoms, C.; Nodine, C.F. Visual interest in pictorial art during an aesthetic experience. Spat. Vis. 2007, 21, 55–77. [Google Scholar] [PubMed]
Figure 1. The 12 Van Gogh paintings used in the experiment: (a1) Fisherman’s Wife on the Beach; (b1) Two Women in the Woods; (a2) Shepherd with a Flock of Sheep; (b2) The Potato Eaters; (a3) The Seine, Pont de la Grande Jatte; (b3) Self-Portrait with Straw Hat; (a4) Sunset: Wheat Fields near Arles; (b4) Vase with Fifteen Sunflowers; (a5) Olive Grove: Pale Blue Sky; (b5) The Starry Night; (a6) Daubigny’s Garden; (b6) Thatched Cottages at Cordeville. The paintings arranged by chronological period (rows) and group a/b (columns). Credits (except (a3) and (b2)): The Vincent Van Gogh Gallery, David Brooks (http://www.vggallery.com (accessed on 9 March 2026), © 1996–2022). Credits for (a3) and (b2): Van Gogh Museum, Amsterdam (Vincent van Gogh Foundation).
Figure 1. The 12 Van Gogh paintings used in the experiment: (a1) Fisherman’s Wife on the Beach; (b1) Two Women in the Woods; (a2) Shepherd with a Flock of Sheep; (b2) The Potato Eaters; (a3) The Seine, Pont de la Grande Jatte; (b3) Self-Portrait with Straw Hat; (a4) Sunset: Wheat Fields near Arles; (b4) Vase with Fifteen Sunflowers; (a5) Olive Grove: Pale Blue Sky; (b5) The Starry Night; (a6) Daubigny’s Garden; (b6) Thatched Cottages at Cordeville. The paintings arranged by chronological period (rows) and group a/b (columns). Credits (except (a3) and (b2)): The Vincent Van Gogh Gallery, David Brooks (http://www.vggallery.com (accessed on 9 March 2026), © 1996–2022). Credits for (a3) and (b2): Van Gogh Museum, Amsterdam (Vincent van Gogh Foundation).
Entropy 28 00767 g001aEntropy 28 00767 g001b
Figure 2. Stationary distributions π per participant (left) and per painting (right). Top row: amplitude 3-category scheme; middle row: amplitude 4-category scheme; bottom row: pupil diameter channel. For the 3-category amplitude channel, medium saccades (1–5°) dominate ( π medium 0.58 ); long saccades are rare ( π long 0.06 ). For the 4-category scheme, the medium band is split at 3°: short (1°–3°) and medium (3°–5°) saccades together account for the same dominant mass. For the pupil channel, medium-diameter fixations dominate the stationary distribution ( π medium 0.59 ), with large fixations accounting for the remainder ( π large 0.31 ) and small fixations rare ( π small 0.10 ). Dotted line: uniform distribution ( π i = 1 / n for n states).
Figure 2. Stationary distributions π per participant (left) and per painting (right). Top row: amplitude 3-category scheme; middle row: amplitude 4-category scheme; bottom row: pupil diameter channel. For the 3-category amplitude channel, medium saccades (1–5°) dominate ( π medium 0.58 ); long saccades are rare ( π long 0.06 ). For the 4-category scheme, the medium band is split at 3°: short (1°–3°) and medium (3°–5°) saccades together account for the same dominant mass. For the pupil channel, medium-diameter fixations dominate the stationary distribution ( π medium 0.59 ), with large fixations accounting for the remainder ( π large 0.31 ) and small fixations rare ( π small 0.10 ). Dotted line: uniform distribution ( π i = 1 / n for n states).
Entropy 28 00767 g002
Figure 3. H ( X ) (left) and I ( X ; Y ) (right) per participant. Blue bars: 3-category scheme; orange bars: 4-category scheme.
Figure 3. H ( X ) (left) and I ( X ; Y ) (right) per participant. Blue bars: 3-category scheme; orange bars: 4-category scheme.
Entropy 28 00767 g003
Figure 4. H ( X ) (left) and I ( X ; Y ) (right) per painting for the 3-category (solid blue) and 4-category (hatched blue) amplitude schemes. Dashed vertical lines separate chronological periods.
Figure 4. H ( X ) (left) and I ( X ; Y ) (right) per painting for the 3-category (solid blue) and 4-category (hatched blue) amplitude schemes. Dashed vertical lines separate chronological periods.
Entropy 28 00767 g004
Figure 5. Mean I ( X ; Y ) per Van Gogh chronological period for all five channels. Filled circles: group a paintings; open squares: group b paintings; solid line: period mean; error bars: ±half-range across the two paintings per period. Spearman ρ and p-value are computed on all 12 individual paintings ( N = 12 ); asterisk: p < 0.05 ; dagger: p < 0.10 (uncorrected). Only the AOI channel shows a statistically significant positive trend with period; the direction channel shows a marginal negative trend ( ρ = 0.57 , p = 0.055 ); all other channels are flat.
Figure 5. Mean I ( X ; Y ) per Van Gogh chronological period for all five channels. Filled circles: group a paintings; open squares: group b paintings; solid line: period mean; error bars: ±half-range across the two paintings per period. Spearman ρ and p-value are computed on all 12 individual paintings ( N = 12 ); asterisk: p < 0.05 ; dagger: p < 0.10 (uncorrected). Only the AOI channel shows a statistically significant positive trend with period; the direction channel shows a marginal negative trend ( ρ = 0.57 , p = 0.055 ); all other channels are flat.
Entropy 28 00767 g005
Figure 6. I ( X ; Y ) for all five channels per participant (left) and per painting (right). Each channel has its own colour: AOI (blue), amplitude (green), duration (orange), direction (purple), pupil (brown). Dashed vertical lines separate chronological periods (paintings panel).
Figure 6. I ( X ; Y ) for all five channels per participant (left) and per painting (right). Each channel has its own colour: AOI (blue), amplitude (green), duration (orange), direction (purple), pupil (brown). Dashed vertical lines separate chronological periods (paintings panel).
Entropy 28 00767 g006
Figure 7. Normalised MI I ( X ; Y ) / H ( X ) for the amplitude channel, per participant (left) and per painting (right). Blue: 3-category scheme; blue hatched: 4-category scheme. Values are nearly identical across the two schemes, confirming robustness to the choice of categorisation boundary (Remark 2).
Figure 7. Normalised MI I ( X ; Y ) / H ( X ) for the amplitude channel, per participant (left) and per painting (right). Blue: 3-category scheme; blue hatched: 4-category scheme. Values are nearly identical across the two schemes, confirming robustness to the choice of categorisation boundary (Remark 2).
Entropy 28 00767 g007
Figure 8. Pooled P ( Y | X ) for the 3-category amplitude scheme: across participants (left) and across paintings (right).
Figure 8. Pooled P ( Y | X ) for the 3-category amplitude scheme: across participants (left) and across paintings (right).
Entropy 28 00767 g008
Figure 9. Pooled P ( Y | X ) for the 4-category amplitude scheme: across participants (left) and across paintings (right).
Figure 9. Pooled P ( Y | X ) for the 4-category amplitude scheme: across participants (left) and across paintings (right).
Entropy 28 00767 g009
Figure 10. I ( X ; Y ) of the pupil diameter channel per participant (left) and per painting (right). Dashed line: group mean. Dashed vertical lines separate chronological periods (paintings panel).
Figure 10. I ( X ; Y ) of the pupil diameter channel per participant (left) and per painting (right). Dashed line: group mean. Dashed vertical lines separate chronological periods (paintings panel).
Entropy 28 00767 g010
Figure 11. Pooled P ( Y | X ) for the pupil diameter channel: across participants (left) and across paintings (right).
Figure 11. Pooled P ( Y | X ) for the pupil diameter channel: across participants (left) and across paintings (right).
Entropy 28 00767 g011
Figure 12. Pairwise Spearman rank correlations between I ( X ; Y ) across all five channels. Each panel shows the scatter of I ( X ; Y ) values for one channel pair, with the Spearman ρ and two-tailed p-value annotated at the top (asterisk: p < 0.05 , uncorrected). (Top row): participant-level data ( N = 10 , blue circles); (bottom row): painting-level data ( N = 12 , orange circles). Red dashed line: linear fit for the nominally significant pair (Duration–Pupil, participants: ρ = + 0.70 , p = 0.025 ); grey dashed lines: non-significant fits. The Duration–Pupil result does not survive Bonferroni correction and is not robust to removal of one outlier participant (Section 4.10).
Figure 12. Pairwise Spearman rank correlations between I ( X ; Y ) across all five channels. Each panel shows the scatter of I ( X ; Y ) values for one channel pair, with the Spearman ρ and two-tailed p-value annotated at the top (asterisk: p < 0.05 , uncorrected). (Top row): participant-level data ( N = 10 , blue circles); (bottom row): painting-level data ( N = 12 , orange circles). Red dashed line: linear fit for the nominally significant pair (Duration–Pupil, participants: ρ = + 0.70 , p = 0.025 ); grey dashed lines: non-significant fits. The Duration–Pupil result does not survive Bonferroni correction and is not robust to removal of one outlier participant (Section 4.10).
Entropy 28 00767 g012
Figure 13. Scatter plot of I ( X ; Y ) (vertical axis) vs. expected self-transition probability α = i π i p i i (horizontal axis) for all five channels: AOI (diamonds), amplitude (circles), duration (squares), direction (triangles), pupil (crosses). (Left): per painting ( N = 12 ); (right): per participant ( N = 10 ). Large filled markers with black outlines indicate the channel grand mean. The direction and amplitude channels have the lowest α and low–moderate MI; AOI and duration have intermediate α ; the pupil channel has the highest α and the highest MI among the four non-AOI channels. AOI is the notable exception: moderate α but by far the highest I ( X ; Y ) , reflecting that its large state space and rich spatial structure dominate its mutual information beyond the persistence effect.
Figure 13. Scatter plot of I ( X ; Y ) (vertical axis) vs. expected self-transition probability α = i π i p i i (horizontal axis) for all five channels: AOI (diamonds), amplitude (circles), duration (squares), direction (triangles), pupil (crosses). (Left): per painting ( N = 12 ); (right): per participant ( N = 10 ). Large filled markers with black outlines indicate the channel grand mean. The direction and amplitude channels have the lowest α and low–moderate MI; AOI and duration have intermediate α ; the pupil channel has the highest α and the highest MI among the four non-AOI channels. AOI is the notable exception: moderate α but by far the highest I ( X ; Y ) , reflecting that its large state space and rich spatial structure dominate its mutual information beyond the persistence effect.
Entropy 28 00767 g013
Table 1. Amplitude channel measures per participant (up panel) and per painting (bottom panel).
Table 1. Amplitude channel measures per participant (up panel) and per painting (bottom panel).
Participants
3-cat4-cat
Part.N H ( X ) I ( X ; Y ) H ( X ) I ( X ; Y )
P0118111.2120.0141.5800.031
P0213671.0340.0201.4650.021
P0311591.1510.0211.5180.032
P044521.1730.0611.5800.091
P0513601.1980.0891.6530.100
P0613101.1550.0091.5350.015
P0712731.0940.0111.5320.028
P0811231.0800.0351.4230.039
P0911431.0800.0091.3930.014
P1011791.0900.0181.3190.027
Mean 1.1270.0291.5000.040
SD 0.0590.0260.1000.031
Paintings
3-cat4-cat
Paint.N H ( X ) I ( X ; Y ) H ( X ) I ( X ; Y )
a19211.1580.0191.6020.032
a25161.1570.0511.5710.067
a310941.1130.0501.4550.052
a410511.1690.0321.5330.040
a59581.1020.0391.3530.068
a611001.1140.0251.3370.031
b17491.0580.0361.4270.047
b212551.1530.0101.5230.018
b39821.1640.0101.5300.017
b411141.1530.0121.5420.027
b513021.1340.0111.6250.019
b611351.0640.0221.5190.025
Mean 1.1280.0261.5010.037
SD 0.0380.0150.0910.018
Table 2. I ( X ; Y ) (bits) for all five channels per participant (up panel) and per painting (bottom panel). AOI values from Hao et al. [1]. SD: sample standard deviation ( N 1 denominator).
Table 2. I ( X ; Y ) (bits) for all five channels per participant (up panel) and per painting (bottom panel). AOI values from Hao et al. [1]. SD: sample standard deviation ( N 1 denominator).
Participants
Part.AOIAmpDurDirPup
P011.2440.0140.0000.0470.144
P021.2530.0200.0710.1610.617
P031.3510.0210.0210.2860.423
P041.2050.0610.0750.2300.771
P051.3640.0890.0310.1730.732
P061.3090.0090.0460.2170.694
P071.2160.0110.0240.2380.300
P081.3990.0350.1170.1400.459
P091.4440.0090.0410.2370.301
P101.4560.0180.0350.1640.448
Mean1.3240.0290.0460.1890.489
SD0.0930.0260.0340.0670.209
Paintings
Paint.AOIAmpDurDirPup
a11.1500.0190.0800.2050.480
a21.1930.0510.1120.2220.747
a31.3340.0500.0810.1300.927
a41.3590.0320.0380.2090.795
a51.5300.0390.0510.1480.600
a61.6800.0250.0630.1950.624
b11.1420.0360.1020.2740.995
b21.5240.0100.0770.1510.545
b31.2800.0100.0630.1160.827
b41.3040.0120.1040.0620.708
b51.5170.0110.0710.1150.928
b61.3910.0220.1320.1050.773
Mean1.3670.0260.0810.1610.746
SD0.1690.0150.0270.0600.161
Table 3. Observer-level vs. stimulus-level discrimination by channel, measured as the sample standard deviation of I ( X ; Y ) across participants ( σ obs , N = 10 ) and across paintings ( σ stim , N = 12 ). A ratio > 1 indicates better discrimination of paintings than observers.
Table 3. Observer-level vs. stimulus-level discrimination by channel, measured as the sample standard deviation of I ( X ; Y ) across participants ( σ obs , N = 10 ) and across paintings ( σ stim , N = 12 ). A ratio > 1 indicates better discrimination of paintings than observers.
Channel σ obs σ stim RatioDiscriminates
AOI0.0930.1691.82stimuli
Amplitude0.0260.0150.58observers
Duration0.0340.0270.79observers
Direction0.0670.0600.90observers
Pupil0.2090.1610.77observers
Table 4. Pupil diameter channel H ( X ) and I ( X ; Y ) per participant (up panel) and per painting (bottom panel).
Table 4. Pupil diameter channel H ( X ) and I ( X ; Y ) per participant (up panel) and per painting (bottom panel).
Participants
Part.N H ( X ) I ( X ; Y )
P0118110.5330.144
P0213671.1090.617
P0311591.2210.423
P044521.3220.771
P0513601.3420.732
P0613101.4920.694
P0712730.8110.300
P0811231.0460.459
P0911430.8430.301
P1011790.9590.448
Mean 1.0680.489
SD 0.2910.209
Paintings
PaintingN H ( X ) I ( X ; Y )
a19210.9030.480
a25161.2180.747
a310941.5220.927
a410511.5300.795
a59581.2970.600
a611001.2900.624
b17491.3040.995
b212551.2700.545
b39821.5550.827
b411141.4030.708
b513021.4120.928
b611351.2840.773
Mean 1.3320.746
SD 0.1770.161
Table 5. Spearman ρ across participants ( N = 10 , up panel) and paintings ( N = 12 , bottom panel). * p < 0.05 uncorrected; does not survive Bonferroni correction.
Table 5. Spearman ρ across participants ( N = 10 , up panel) and paintings ( N = 12 , bottom panel). * p < 0.05 uncorrected; does not survive Bonferroni correction.
Participants ( N = 10 )
AOIAmpDurDirPup
AOI + 0.03 + 0.08 0.12 0.18
Amp + 0.42 0.41 + 0.36
Dur 0.21 + 0.70 *
Dir + 0.02
Pup
Paintings ( N = 12 ) — no entry significant
AOIAmpDurDirPup
AOI 0.18 0.50 0.34 0.16
Amp 0.09 + 0.00 + 0.38
Dur 0.15 + 0.03
Dir 0.34
Pup
Table 6. Spearman ρ between per-painting I ( X ; Y ) and aesthetics measures. M k : Kolmogorov compressibility [1,17]; M B : Bense palette redundancy [1,17]; M s 1 : compositional complexity (number of regions capturing 25% of colour–space MI) [17]; H PE : normalised permutation entropy [18]; C PE : statistical complexity [18]. H PE and C PE were computed from the painting images following the Sigaki et al. method (2 × 2 sliding window, 24 ordinal patterns). * p < 0.05 ; † p < 0.10 .
Table 6. Spearman ρ between per-painting I ( X ; Y ) and aesthetics measures. M k : Kolmogorov compressibility [1,17]; M B : Bense palette redundancy [1,17]; M s 1 : compositional complexity (number of regions capturing 25% of colour–space MI) [17]; H PE : normalised permutation entropy [18]; C PE : statistical complexity [18]. H PE and C PE were computed from the painting images following the Sigaki et al. method (2 × 2 sliding window, 24 ordinal patterns). * p < 0.05 ; † p < 0.10 .
Channel ρ ( M k ) p ρ ( M B ) p ρ ( M s 1 ) p ρ ( H PE ) p ρ ( C PE ) p
AOI 0.21 0.513 0.01 0.966 + 0.50   0.095 + 0.00 1.000 + 0.00 1.000
Amplitude 0.06 0.846 0.41 0.182 + 0.25 0.429 + 0.01 0.974 0.01 0.974
Duration 0.12 0.712 + 0.16 0.609 0.08 0.803 + 0.48 0.117 0.48 0.117
Direction + 0.51   0.090 + 0.20 0.542 0.41 0.191 0.29 0.366 + 0.29 0.366
Pupil 0.48 0.118 0.69 *0.013 + 0.29 0.366 + 0.07 0.829 0.07 0.829
Table 7. Per-painting values of H PE (normalised permutation entropy) and C PE (statistical complexity) corresponding to the aesthetics measures used in Table 6. Computed from painting images following Sigaki et al. [18] (2 × 2 sliding window, 24 ordinal patterns).
Table 7. Per-painting values of H PE (normalised permutation entropy) and C PE (statistical complexity) corresponding to the aesthetics measures used in Table 6. Computed from painting images following Sigaki et al. [18] (2 × 2 sliding window, 24 ordinal patterns).
Painting H PE C PE PeriodPainting H PE C PE Period
a10.9690.0401b10.9830.0231
a20.9790.0272b20.9570.0562
a30.9610.0493b30.9340.0853
a40.9440.0704b40.9950.0074
a50.9910.0125b50.9800.0265
a60.9680.0416b60.9890.0146
Table 8. Numerical verification of Proposition 1. H ( Y | X ) : actual conditional entropy; bound: H b ( α ) + ( 1 α ) log 2 ( m 1 ) ; slack: bound − actual (must be 0 ).
Table 8. Numerical verification of Proposition 1. H ( Y | X ) : actual conditional entropy; bound: H b ( α ) + ( 1 α ) log 2 ( m 1 ) ; slack: bound − actual (must be 0 ).
Channelm α H ( Y | X ) BoundSlack
AOI100.6181.8602.1690.309
Amplitude30.5721.1211.4130.292
Duration30.6491.0351.2870.252
Direction80.2282.8702.9420.072
Pupil30.8600.6680.7260.058
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Vila, M.; Hao, Q.; Feixas, M.; Martin, M.Y.; Sbert, M. Saccade Amplitude and Pupil Diameter Information Channels: Extending the Gaze Information Channel Framework and Assessing Cross-Channel Association in Eye Tracking of Van Gogh Paintings. Entropy 2026, 28, 767. https://doi.org/10.3390/e28070767

AMA Style

Vila M, Hao Q, Feixas M, Martin MY, Sbert M. Saccade Amplitude and Pupil Diameter Information Channels: Extending the Gaze Information Channel Framework and Assessing Cross-Channel Association in Eye Tracking of Van Gogh Paintings. Entropy. 2026; 28(7):767. https://doi.org/10.3390/e28070767

Chicago/Turabian Style

Vila, Marius, Qiaohong Hao, Miquel Feixas, Micaela Y. Martin, and Mateu Sbert. 2026. "Saccade Amplitude and Pupil Diameter Information Channels: Extending the Gaze Information Channel Framework and Assessing Cross-Channel Association in Eye Tracking of Van Gogh Paintings" Entropy 28, no. 7: 767. https://doi.org/10.3390/e28070767

APA Style

Vila, M., Hao, Q., Feixas, M., Martin, M. Y., & Sbert, M. (2026). Saccade Amplitude and Pupil Diameter Information Channels: Extending the Gaze Information Channel Framework and Assessing Cross-Channel Association in Eye Tracking of Van Gogh Paintings. Entropy, 28(7), 767. https://doi.org/10.3390/e28070767

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop