Next Article in Journal
Association between Shift Work and Health Outcomes in the General Population in China: A Cross-Sectional Study
Next Article in Special Issue
Human Recognition: The Utilization of Face, Voice, Name and Interactions—An Extended Editorial
Previous Article in Journal
The Interplay of Anxiety, Depression, Sleep Quality, and Socioeconomic Factors in Somali Hemodialysis Patients
Previous Article in Special Issue
Familiarity Is Key: Exploring the Effect of Familiarity on the Face-Voice Correlation
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Extensive Visual Training in Adulthood Reduces an Implicit Neural Marker of the Face Inversion Effect

1
Université de Lorraine, CNRS, IMoPA, F-54000 Nancy, France
2
Psychological Sciences Research Institute, UCLouvain, 1348 Louvain-La-Neuve, Belgium
3
Université de Lorraine, CHRU-Nancy, Service de Neurologie, F-54000 Nancy, France
4
Université de Lorraine, CHRU-Nancy, Service de Neurochirurgie, F-54000 Nancy, France
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Brain Sci. 2024, 14(2), 146; https://doi.org/10.3390/brainsci14020146
Submission received: 15 December 2023 / Revised: 16 January 2024 / Accepted: 26 January 2024 / Published: 30 January 2024
(This article belongs to the Special Issue People Recognition through Face, Voice, Name and Their Interactions)

Abstract

:
Face identity recognition (FIR) in humans is supported by specialized neural processes whose function is spectacularly impaired when simply turning a face upside-down: the face inversion effect (FIE). While the FIE appears to have a slow developmental course, little is known about the plasticity of the neural processes involved in this effect—and in FIR in general—at adulthood. Here, we investigate whether extensive training (2 weeks, ~16 h) in young human adults discriminating a large set of unfamiliar inverted faces can reduce an implicit neural marker of the FIE for a set of entirely novel faces. In all, 28 adult observers were trained to individuate 30 inverted face identities presented under different depth-rotated views. Following training, we replicate previous behavioral reports of a significant reduction (56% relative accuracy rate) in the behavioral FIE as measured with a challenging four-alternative delayed-match-to-sample task for individual faces across depth-rotated views. Most importantly, using EEG together with a validated frequency tagging approach to isolate a neural index of FIR, we observe the same substantial (56%) reduction in the neural FIE at the expected occipito-temporal channels. The reduction in the neural FIE correlates with the reduction in the behavioral FIE at the individual participant level. Overall, we provide novel evidence suggesting a substantial degree of plasticity in processes that are key for face identity recognition in the adult human brain.

1. Introduction

Human faces constitute a special visual category from which we rapidly identify people based on their idiosyncratic facial characteristics—face identity recognition (FIR). Human adults‘ performance at this socially crucial function is impressive, with thousands of faces to recognize individually [1], rapidly (e.g., within 1–2 fixations and a few hundreds of milliseconds; [2,3,4]), and automatically (i.e., without the intention to do so and being able to suppress it; [5,6]). In neurotypical human adults, simply flipping a face upside-down drastically impairs FIR, even though upright and inverted faces contain exactly the same visual content (the face inversion effect [FIE]; [7,8]). The FIE is weak or even non-existent in other animal species including non-human primates [9,10,11], and despite more than 50 years of investigation, it is still debated what factors give rise to the increased sensitivity to upright faces in humans. As detailed below, current evidence pointing toward both biological constraints at birth and visual experience accrued over development. However, the extent to which this specialization is malleable after development, in the mature adult brain, is less known and a topic of the current study.
Several lines of evidence support the role of biological constraints present in the visual system at birth (for review, see [12]). For example, human newborns preferentially orient to faces or face-like stimuli relative to inverted faces and other visual controls [13,14], even though this preference seems to be driven by more general constraints than faceness per se [15]. Consistent with this, EEG responses measured in 1- to 4-day-old awake human newborns show stronger signal to upright than inverted schematic face-like patterns [16]. Also, a recent study testing a person born with a condition that causes his head to be rotated back showed that his FIR performance for upright faces was as poor as for inverted faces, which matched the inverted face discrimination of controls, suggesting that lifetime experience with inverted faces was not sufficient to overcome initial biological constraints [17].
However, a wealth of evidence indicates that visual experience accrued after birth plays a critical role in shaping FIR and the FIE in particular. For example, people who lack visual input to the retina from birth until 2–18 months after birth, due to dense congenital bilateral cataracts, show a persistent FIR deficit in later adult age [18,19,20,21], to the extent that upright FIR is nearly as poor as for inverted faces [19], and the deficit is especially prominent if the lack of visual input is to the right hemisphere [20]. More generally, and although there are discrepancies between studies, the FIE emerges relatively late in development and increases progressively until adulthood [22,23,24]. While even a late emergence and gradual increase does not rule out the contribution of genetic factors, there is independent evidence that the FIR system remains plastic until at least in late childhood. For example, the ORE (i.e., better FIR for own than other “race” faces; [25,26,27]: see [28] for a recent special issue on this other-race face effect), which may start to develop by the age of 9 months [29,30], is reversed for adult Asians who are exposed to Caucasian faces in late childhood following adoption by western European families [31,32]. Thus, visual experience during development plays a critical role in tuning the system to allow for the rapid and automatic FIR characteristic of the mature system.
A growing body of evidence also suggests that the FIR system, in the adult mature brain, remains plastic. For example, face individuation training with other-race faces attenuates the behavioral ORE [33,34,35], while training with other-age faces attenuate the behavioral other-age effect [36,37,38]. However, the strongest evidence arguably comes from studies examining whether individuation training of inverted faces can influence the FIE [39,40,41,42]. While early studies did not test whether inverted training generalized to inverted face identities not seen during training [39,42], or failed to find such a generalization effect [40], Laguesse et al. [41] employed an extensive inverted face discrimination training protocol—that mitigated downfalls in earlier studies—and found that it led to a robust improvement in inverted FIR that generalized to novel faces, thereby leading to a substantial reduction (40%) in the FIE. Thus, behavioral evidence now suggests that the FIR system may still be highly plastic well after maturation.
However, with behavioral evidence obtained in explicit tasks only, an outstanding issue is whether this modulation of the FIE truly reflects the core FIR function or a change in other general cognitive systems (e.g., attention, decision making), or even include task-specific learning. We address the issue in the present study by replicating the previous behavioral study that successfully trained inverted face individuation [41], (critically) adding a robust and valid neural measure of FIR with EEG before and after training. Specifically, the participants underwent extensive training (2 weeks, ~16 h) discriminating a set of 30 unfamiliar inverted faces across viewpoints and in different learning tasks (Figure 1A; Table 1). Pre- and post-training, they completed a behavioral FIR test where they matched a study face to one out of four test faces presented in a different depth-rotated view (Figure 1C; [41]). Crucially, unlike previous studies, the pre- and post-tests also included a separate neural measure of FIR, namely, EEG coupled with a validated frequency tagging approach (Fast Periodic Visual Stimulation [FPVS]-EEG) for isolating automatic FIR neural responses (Figure 1B; [5]).
In this paradigm, an unfamiliar face identity is repeated at a fixed frequency rate (F, usually 6 Hz) for about one minute, with different face image identities interleaved as every fifth item (F/5; i.e., 1.2 Hz), with image size varying at each cycle to minimize low-level repetition effects (Figure 1B). Thus, a face individuation signal is objectively quantified at the F/5 frequency (1.2 Hz) and associated harmonics (2.4 Hz, 3.6 Hz, etc.; [5]; for review: see [43]). This approach provides an objective identification of FIR responses (i.e., at experimentally defined frequencies) and full quantification (as a sum of harmonics) of neural activity in the EEG frequency domain. Previous research has shown a robust FIE in this paradigm [5] (53% of signal decrease with inversion: see [43]) and validated its effectiveness at isolating neural FIR mechanisms. For instance, there is no FIR signal in the well-known case of prosopagnosia PS [44], and a substantial reduction in cases of developmental prosopagnosia/prosopdysgnosia [45]. Moreover, when coupled with spatially resolved intracerebral EEG, the paradigm measures strong FIR signals in ventral occipo-temporal cortex (VOTC) regions considered core face to this function, i.e., the inferior occipital and fusiform gyri with a right hemispheric dominance [46]. Finally, within these regions, amplitude maxima in this paradigm have been identified at the very same intracerebral electrode contacts, leading to transient and specific FIR impairments in several cases [47].
Here, with measures on the scalp (EEG), we hypothesized that if inverted face training modulates these neural face FIR processes, then there would be an increase in the FIR amplitude at F/5 frequencies and harmonics for inverted novel faces.

2. Methods

Participants. Twenty-eight participants (ten males; mean age = 22.9 years, SD = 1.75 years) took part in the study, a sample that is sufficiently large to measure the FIE with FPVS-EEG [5] and to perform reliable correlation analyses between behavioral and neural measures. All participants were native French speakers with normal or corrected-to-normal vision. The participants were informed about the training and testing aspects of the experiment and that they could opt out at any time throughout the experiment. Subsequently, participant consent was obtained from each participant. Two out of the twenty-eight participants were excluded from the analysis due to inconsistent scalp topographies and lack of ROIs (see Section 2.3 below). The study was approved by the human ethical committee of UCLouvain and the participants received monetary compensation for their participation.
Stimuli. The stimuli in the behavioral tasks (training and pre- and post-tests) were identical to that used in a previous study [41] and consisted of a total of 118 high-quality color photographs of face identities that varied across three viewpoints: (1) full-front, (2) 30 degrees depth rotation to the right (3) and to the left (Figure 1). A subset of these images (n = 64) was used to test for inversion effects in the pre- (n = 32; 16 females, 16 males) and post- (n = 32, 24 females; 8 males) training tests. All face images were cropped from their background, contained no external features (e.g., hair), and were pasted on a uniform gray background. The images ranged in size from 170 to 200 pixels wide and 250 pixels height. The faces were flipped vertically for the inverted condition.
The stimuli in the FPVS-EEG pre- and post-test were identical to that used in previous studies with this paradigm [5] and consisted of full-front colored photographs of 25 male and 25 female faces with a neutral expression. They were taken under standardized conditions in terms of background, lighting, and distance from the camera. Moreover, external features such as hair and ears were cropped out using Adobe Photoshop before the isolated faces were pasted against a gray background. Final images were resized to a height of 250 pixels (width = 186 ± 11 pixels). The faces were flipped vertically for the inverted condition. The mean luminance of the images was equalized online during stimulation and a gamma correction was applied.
Apparatus. The different tasks were run using the Psychtoolbox (MATLAB; Mathworks, Inc., Natick, MA, USA), E-Prime (Psychology Software Tools, Pittsburgh, PA, USA), or JavaScript. For the behavioral tasks, the participants were seated in a dimly lit room approximately 70 cm from the computer screen. For the EEG recording, the participants were seated in a dimly lit and sound-attenuated room approximately 100 cm from the computer monitor (screen resolution of 800 × 600 pixels with a frame rate of 100 Hz).
The EEG was acquired at 512 Hz using a 128-channel Biosemi Active II system (Biosemi, Amsterdam, Netherlands), with electrodes including standard 10–20 system locations as well as additional intermediate positions. Two additional electrodes (Common 252 Mode Sense [CMS] active electrode and Driven Right Leg [DRL] passive electrode) were used as reference and ground electrodes, respectively. Eye movements were monitored using four electrodes placed at the outer canthi of the eyes and above and below the right eye. In both the behavioral and the EEG paradigms, the images subtended approximately 4.0 horizontal and 6.53 vertical degrees of visual angle. A chinrest was used to avoid movement of the head throughout the experiments.

2.1. Training Sessions

Table 1 illustrates the training protocols of the study, which were identical to the protocol used by Laguesse et al. [41]. The participants were trained to individuate thirty inverted faces, split across three face sets with each set of ten faces. The face sets were progressively introduced over the course of a two-week period and across four different tasks: exposure/learning, naming, old/new recognition, and forced-choice matching, all of which are described below and elsewhere [41]. Each participant underwent individual training of approximately 2 h per day for 8 days, for a total of approximately 16 h of training. The sessions took place in late afternoon or in early evening to facilitate the consolidation of learning [48].
Exposure/learning task. The three face sets were presented separately in three identical tasks (E1, E2, E3) and each task was divided into six blocks. In the first block, the participants were exposed to five inverted full-front face pictures together with their names. Each inverted face-and-name combination was presented twice. The participants were instructed to associate the name with the face. In the second block, the same five faces were presented but in the other two depth-rotated views (30L, 30R). Each face was presented separately for 5 s. In the third block, the participants were first presented with a name-list of the already exposed faces (without their faces). Next, the faces were presented separately (without labels) and the participants were instructed to name the faces. The images were shown twice in each of the three viewpoints (10 faces × 3 viewpoints = 30 trials). The same procedure was used in the three subsequent blocks for the other five faces of the set.
Naming task. The three face sets were presented separately in three identical tasks (N1, N2, N3). Before a task, the participants were provided with a list of the relevant face names. After seeing the list, the participants performed the task, in which the faces were presented separately on the screen until the participant pressed the keyboard key corresponding with the first letter of the face name (once the third face set was introduced, the participants also provided verbally the full name of each face). A visual feedback that contained the accuracy of their keypress (‘‘correct’’/‘‘incorrect’’) and the correct name was provided after each key press. Each task contained a total of 30 trials (10 faces × 3 viewpoints). The task repeated until an accuracy of 100% was reached. The list with the names of the faces was provided before starting the task each time.
Once the participants had completed N1 and N2, they were combined into one test (N1 + N2 = 20 trials; for overview of training protocol: see Table 1). Moreover, once the participants had completed N3, all three tests were combined into one (N1 + N2 + N3 = 30 trials).
Old/New task. An old/new recognition task was administered subsequent to the exposure/learning and naming tasks (three old/new tasks in total). In a trial, a face image was shown from one of three possible viewpoints (FF, 30L, 30R) and the participant had to indicate with a keypress if the face was previously seen (old) or novel (new). The first task contained face set 1 (old) and face set 2 (new; 20 faces × 3 viewpoints = 60 trials). The second task contained face set 1 and 2 (old) and face set 3 together with an additional 10 novel faces (new; 40 faces × 3 viewpoints = 120 trials). The third task consisted of face sets 1, 2, and 3 (old) and 30 novel faces (new; 60 faces × 3 viewpoints = 180 trials).
4AFC Delayed Matching Task during the Training Session. In a given trial, a face was presented for 400 ms, followed by a brief delay (500 ms) and then by four faces arranged in a square around the center of the screen, which remained visible until the participant’s response. The task was to indicate with a key press which one of the four faces was presented at encoding. The participant received visual feedback after each response about the accuracy of the trial and the overall accuracy at that point in the task. The faces were always presented in the inverted (INV) orientation.
The first (target) face was always presented in a different depth-rotated view than the four subsequent faces, which were all presented in the same depth-rotated view. Six depth-rotated view combinations between the target and the distractor faces were possible: Full-front (FF)-30 Right (R); 30R-FF; FF-30 Left (L); 30L-FF; 30L-30R; 30R-30L. The test consisted of a total of 56 faces, 32 of which were present at pre-test and 24 new faces. There were a total of 672 possible trials (56 faces × 6 depth combinations × 2 repetitions), out of which 336 were randomly selected for each participant and session.
Responses were made with the two hands using the keyboard keys 1, 3, 4, and 6 on the numeric pad, corresponding to the four positions on the screen of the four faces to discriminate (see Figure 1C).

2.2. Testing Sessions

The participants were tested in two sessions: a pre- and post-training test. The first test occurred 3 days prior to the first training session (Figure 1A). The second test occurred 1 day after the last training session. In both sessions, the participants were tested in a behavioral four-alternative forced-choice test (4AFC), as used previously by Laguesse et al. [41], and in a separate FPVS-EEG protocol, both of which are described in detail below. The order of the behavioral and EEG tests was counterbalanced across the participants. The pre- and post-tests used different images than those used during training, thereby controlling for learning effects that are stimuli specific.
4AFC Delayed Matching Task during the Testing Sessions. The participants completed a pre-and post- 4AFC test (Figure 1C; [41]). This test was similar to the 4AFC training paradigm, with the exception that the (a) face images were all novel (32 in each test), (b) the images were shown randomly in both upright (UP) and inverted (INV) orientations (target and distractor faces were always in same orientation), and (c) no feedback was provided after each trial. There were a total of 384 possible trials (32 faces × 6 depth combinations × 2 orientations) out of which 280 were randomly selected for each participant and session to limit the duration of testing. The participants were instructed to respond as rapidly as possible while maintaining high levels of accuracy.
EEG Recording during Testing Sessions. The pre- and post- FPVS-EEG test consisted of presenting face images periodically for 64 s during EEG recording, with upright and inverted faces presented in separate sequences (Figure 1B). In a given sequence, a frontal-view face image was presented at a base rate of 5.88 cycles per second (5.88 Hz = base stimulation frequency) through sinusoidal contrast modulation using a custom MATLAB script [5]. The images varied randomly in size (between 80% and 120% in 2% steps) at every cycle of presentation to prevent adaptation in low-level retinotopic areas. Each sequence started with a fixation-cross displayed for a random duration of 2 to 5 s, followed by a 2 s fade-in during which the image stimulation progressed gradually from 0% to 100% contrast level. This was to avoid eye movements at the beginning and end of the stimulation. Within each sequence, a face image was randomly selected to serve as a base image (e.g., Face A) that was presented repeatedly for four consecutive cycles (each cycle = 170.07 ms), and at every fifth cycle (5.88/5 = 1.176 Hz) different face images (e.g., Face B, C, D) presented in place of the base face. This manipulation ensures that a signal occurring at 1.176 Hz reflects a differential signal between the base and the oddball faces, which is an indication that the neural system is discriminating between the individual faces despite variations in image size.
During image presentation, the participants performed an orthogonal task where they were instructed to fixate a cross—centered between the eyes of the faces—and to press the space bar every time they detected random changes in color from blue to red (duration of color change: 200 ms; six changes randomly timed in each sequence). This task ensured that the participants would maintain attention in the center of the objects while removing explicit task demands to the images.
In total, each FPVS-EEG session consisted of eight 60 s image sequences. Four of these sequences contained upright faces and four contained inverted faces. Moreover, they each comprised two sequences of female faces and two sequences of male faces. Thus, each session consisted of 8 min of image stimulation (60s × 4 repetitions × 2 conditions) and short breaks were provided in between each sequence. The order of upright and inverted sequences was random.

2.3. EEG Analysis

Preprocessing. Preprocessing was conducted with a customized software (Letswave 5: http://nocions.webnode.com/letswave, accessed on 1 December 2023) running in the MATLAB environment (The Mathworks). EEG data were band-pass filtered (0.1–120 Hz zero-phase Butterworth filter, 24 dB/octave slope). A notch filter was applied to remove 50 Hz line-noise (50, 100 Hz). The data were then down sampled from 512 Hz to 256 Hz, and each stimulation sequence was segmented into epochs starting 2 s before the first image presentation until 2 s after the last image presentation (−2 to 62 s). To isolate and remove large artifacts generated by eye blinks, independent component analysis (ICA) was applied to the data of four and five participants in the pre- and post-test, respectively, who blinked more than 0.20 times/second on average during the sequences (one component removed in each case). All channels were subsequently re-referenced to the common average reference, and the data were cropped down to an integer number of 1.176 Hz that contained the start of the first presentation cycle and the end of the last presentation cycle (0–59.5238 s, 70 oddball cycles, 15,238 time bins). The segmented sequences were averaged within each participant separately for each condition in the time domain to increase signal-to-noise ratio; (e.g., [44]). One segment was excluded from one participant due to a lack of signal in all channels.
Frequency domain analysis. To extract amplitude spectra for all channels, a Fast Fourier Transform was applied to the averaged segments (frequency resolution, 1/59.5238, i.e., 0.017 Hz). To determine the number of harmonics included in the discrimination and general signals, the amplitude data from the frequency domain for each session (session, orientation) were first averaged across the participants and channels. Next, the amplitude in each frequency bin was converted to Z-scores by subtracting its amplitude from the average amplitude of the ten surrounding bins in each direction, excluding the two directly neighboring bins (SNS: signal-to-noise subtraction), and dividing it by the standard deviation of the twenty surrounding bins. Harmonics for the discrimination and general responses were extracted and analyzed until they were no longer significant at a threshold of z > 1.96 (p < 0.05; i.e., signal > noise; (e.g., [5,44])). This criterion was equal across all conditions (session, orientation). For the discrimination frequency, the harmonics were analyzed up to the seventh harmonic (7 F/5 = 9.41 Hz), excluding the fifth harmonic (5 F/5 = 5.88 Hz) because it overlaps with the fundamental frequency of the base response (F = 5.88 Hz). For the general frequency, the harmonics were analyzed up to the eighth harmonic (8F = 47.04 Hz).
For subsequent analysis and to consider noise variations across the EEG spectrum, we converted the amplitude in each frequency bin to a baseline corrected signal-to-noise subtraction measure (SNS) by subtracting out the average amplitude of the ten surrounding frequency bins in each direction, excluding the two directly neighboring bins (noise–noise = 0; signal–noise > 0). Separately for each participant and each condition, the discrimination and general response was quantified as the sum of the significant baseline corrected harmonics, as determined by the step defined above.
The regions of interests based on the electrodes that showed the maximum responses for the discrimination (1.172 Hz) and base (5.88 Hz) responses, averaged across all conditions, were separately determined at the individual participant level. This was performed to account for variability in individual scalp topographies in the face discrimination response. For each participant, two channels with the strongest face discrimination response—one from each hemisphere—were selected to serve as the face discrimination ROI (except for two participants where both electrodes were taken from the same hemisphere, since the other hemisphere showed no distinct signal peak). In all the participants, these electrodes were all located in the lateral occipito-temporal regions. The same approach was applied to determine individual ROIs for the common visual response at the base rate. In all the participants, these electrodes were all located in the medial-occipital region. The dissociation between the scalp topography for the discrimination and base response is consistent with previous studies using the same paradigm; for review, see [43].

3. Results

3.1. Behavioral Results: Pre/Post 4AFC Delayed Matching Task

Accuracy. Figure 2A shows the mean accuracy data (%) for the pre- and post-4AFC test as a function of session (pre-, post-) and image orientation (upright, inverted). The accuracy data were analyzed in a repeated-measures analysis of variance (ANOVA) with session and orientation as within-subjects variables. The significant main effects of session, F(1,25) = 49.09, p < 0.001, generalized eta2 = 0.15, indicated that accuracy increased after training. The significant main effect of orientation, F(1,25) = 113.13, p < 0.001, generalized eta2 = 0.39, indicated an inversion effect with higher accuracies for upright compared to inverted faces. Crucially, the significant two-way interaction between session and orientation, F(1,25) = 30.87, p < 0.001, generalized eta2 = 0.09, indicated that the pre-test FIE (Mup = 86.72%; SEup = 1.25%; Minv = 70.04%; SEinv = 1.94%) was larger than the post-training FIE (Mup = 88.28%; SEup = 1.21%; Minv = 81.01%; SEinv = 1.45%), with a 56% reduction in the FIE in the post-test.
Response time. Figure 2B shows the mean correct response times (RT) for the pre- and post-4AFC test as a function of session (pre-, post-) and image orientation (upright, inverted). RT data were analyzed in a repeated-measures ANOVA with session and orientation as within-subjects variables. The significant main effect of session, F(1,25) = 19.43, p < 0.001, generalized eta2 = 0.17, indicated that the RTs were faster after compared to before training. The significant main effect of orientation, F(1,25) = 35.33, p < 0.001, generalized eta2 = 0.07, indicated that the RTs were faster for upright compared to inverted faces. The two-way interaction between session and orientation was not significant, F(1,25) = 3.06, p = 0.093, generalized eta2 = 0.003, but it showed a trend in the same direction as the accuracy data (Figure 2B), with a 35% reduction in the FIE in the post-test, ruling out speed-accuracy trade-offs in the pre- to post-sessions.
Inverse efficiency scores. Figure 2C shows the mean inverse efficiency scores (IES; RT/proportion correct) for the pre- and post-4AFC test as a function of session (pre-, post-) and image orientation (upright, inverted). The IES data were submitted to an ANOVA with session and orientation as within-subjects variables. The significant main effect of session, F(1,25) = 44.44, p < 0.001, generalized eta2 = 0.22, indicated that the IES were faster in the post- than the pre-test. The significant main effect of orientation, F(1,25) = 69.40, p < 0.001, generalized eta2 = 0.23, indicated that the IES were faster for upright compared to inverted faces. The significant two-way interaction between session and orientation, F(1,25) = 24.59, p < 0.001, generalized eta2 = 0.05, showed that the pre-test FIE (Mup = 2012 ms; SEup = 92 ms; Minv = 2845 ms; SEinv = 155 ms) was larger than the post-test FIE (Mup = 1680 ms; SEup = 68 ms; Minv = 2021 ms; SEinv = 103 ms), with a 59% reduction in the FIE in the post-test.

3.2. EEG Results: Pre/Post FPVS-EEG Test

FPVS-EEG responses averaged across all conditions. First, to examine the overall differences between the face identity discrimination (F/5 and harmonics) and base (F and harmonics) frequency tagged signals, we analyzed the EEG responses averaged across all conditions (i.e., average across session and image orientation, separately for each participant; see Methods for description of response quantification in the frequency domain). Figure 3A shows the scalp topographies for the baseline corrected amplitudes for the face discrimination (F/5 and harmonics; left) and the general visual response (F and harmonics; right) averaged across all conditions (session, image orientation). For the face discrimination signal, there were clear peaks at bilateral occipito-temporal channels, while for the general visual response there was a clear peak at medial-posterior channels. These topographies are consistent with previous studies using the same paradigm [5]; for review of all studies using this paradigm, see [43]. Figure 3B shows the baseline corrected amplitude spectrum averaged over two peak channels (one in each hemisphere, P9 and P10) and across all conditions (session, image orientation). Obvious signal peaks at 1.176 Hz (F/5) and harmonics reflect the onset and offset of different identities in the sequence, while the clear signal peaks at 5.88 Hz (F) and harmonics reflect the onset and offset of general responses to any stimuli in the sequence (only the first two harmonics are shown in the graph).
Identity recognition response. Next, we analyzed whether the face identity discrimination response was influenced by training session (pre-, post-) and image orientation (up, inverted) (see Methods for description of response quantification in the frequency domain). Figure 4A shows the scalp topographies for the group average face discrimination amplitudes (F/5 and harmonics) as a function of session (pre-, post-) and image orientation (upright, inverted). Figure 4B shows the face identity discrimination response averaged across peak channels as a function of session and image orientation. The data were analyzed in a repeated-measures ANOVA with session (pre-, post-) and orientation (upright, inverted) as within-subjects variables. The main effect of session was not significant, F(1,25) = 2.61, p = 0.187, generalized eta2 = 0.01. The main effect of orientation was significant, F(1,25) = 13.22, p = 0.001, generalized eta2 = 0.08, indicating a larger amplitude for upright (M = 1.12 µV; SE = 0.15 µV) compared to inverted faces (M = 0.72 µV; SE = 0.12 µV). Crucially, the significant two-way interaction between session and orientation, F(1,25) = 6.78, p = 0.015, generalized eta2 = 0.01, indicated that the pre-test FIE (Mup = 1.14 µV; SEup = 0.17 µV; Minv = 0.57 µV; SEinv = 0.11 µV) was larger compared to the post-test FIE (Mup = 1.11 µV; SEup = 0.14 µV; Minv = 0.86 µV; SEinv = 0.12 µV), with a 56% reduction in the FIE in the post-test.
General visual stimulation response. As a control analysis, we analyzed whether the general visual response was influenced by training session (pre-, post-) and image orientation (up, inverted). This can serve as a control analysis because this signal captures responses that are evoked by any visual stimuli and that generalize across all faces (i.e., note specific to face identity recognition). Moreover, general visual responses that are frequency tagged at a base frequency capture attentional effects [49]. Thus, training effects that are not specific to face identity recognition should be captured at the general visual response frequency tagged at 6 Hz and harmonics. Figure 5A shows the scalp topographies for the group average general visual response amplitudes (F and harmonics) as a function of session (pre-, post-) and image orientation (upright, inverted). Figure 5B shows the general visual response averaged across peak channels as a function of session and image orientation. The data were analyzed in repeated-measures ANOVA with session (pre-, post-) and orientation (upright, inverted) as within-subjects variables. The main effect of the session approached significance, F(1,25) = 3.60, p = 0.069, generalized eta2 = 0.006, but this trend was driven by a higher amplitude in the pre- (M = 2.30 µV; SE = 0.27 µV) compared to the post-session (M = 2.10 µV; SE = 0.23 µV). The main effect of the orientation approached significance, F(1,25) = 3.97, p = 0.057, generalized eta2 = 0.02, indicating a larger amplitude for upright (M = 2.38 µV; SE = 0.27 µV) compared to inverted faces (M = 2.02 µV; SE = 0.23 µV). Crucially, the two-way interaction between the session and the orientation was not significant, F(1,25) = 0.078, p = 0.782, generalized eta2 = 0.0003.
Correlation between behavior and EEG. The previous analysis showed that the training reduced both the behavioral and neural FIE by increasing the behavioral accuracy and neural amplitude for the inverted FIR. Next, we examined the relationship between the change in the FIE for the behavioral accuracy measure and the neural measure. First, for each participant, we quantified the FIE (upright–inverted), separately for each session. This was performed for both the behavioral accuracy and the neural EEG measure. Second, we quantified a change in the FIE after training, by subtracting the FIE in pre-test from the FIE in the post-test (pre–post). A positive number would indicate a reduction in the FIE, while a negative number would indicate an increase in FIE. Third, we correlated the participant’s behavioral and neural FIE change, using a Pearson correlation test. For the neural measure, this procedure was performed separately for the face identity discrimination signal (F/5 and harmonics) and the base rate general signal (F and harmonics).
For the discrimination signal (F/5 and harmonics), there was a significant positive correlation, r = 0.46, p = 0.0195, 95% CI = [0.08, 0.72], indicating that larger reduction in the neural FIE was associated with a larger reduction in the behavioral FIE (Figure 6A). In contrast, for the base rate general signal (F + harmonics), which captures visual signals that are not specific to face identity recognition, there was no significant correlation, r = −0.03, p = 0.903, 95% CI = [−0.41, 0.37] (Figure 6B). Thus, the brain–behavior association was specific to the neural correlates of face identity discrimination.

4. Discussion

The goal of this study was to examine if extensive experience, exclusively acquired in adulthood, could influence the rapid and automatic neural processes underlying face identity recognition in humans. Toward that aim, we tested if extensive training with inverted face identity discrimination influenced the discrimination of inverted faces that were not seen during the training. The main finding was that training improved identity discrimination of the novel faces at inverted orientation, as measured both behaviorally (Figure 2) and (most importantly in the present study) neurally (Figure 4), thereby leading to a reduced face inversion effect (FIE). Moreover, we found that larger reductions in the neural FIE were associated with larger reductions in the behavioral FIE (Figure 6A). Finally, control analyses performed on the concurrently measured and isolated general visual responses (6 Hz and harmonics) showed that the training specifically influenced the neural processes involved in face identity recognition and did not extend to general visual processes or attention [49] (Figure 5 and Figure 6B). Overall, our findings provide novel evidence in favor of the claim that FIR processes in the adult mature brain remain highly plastic (e.g., [41]).
Our behavioral findings are consistent with previous behavioral studies, suggesting that the human adult face identity recognition system is influenced by discrimination experience. This previous evidence includes findings that experience can improve discrimination for subclasses of faces for which we do not have saturated experience, including other-race faces (for review, see [27]), other-age faces [36], and inverted faces, (e.g., [41]). The case of inverted face training [41] provides a particularly strong test for experience in adulthood because inverted faces violate the biological fixation constraint at birth, and they are rarely, if at all, experienced during late development. While several studies either failed to find effects of inverted face training that generalized to novel identities not used during training [42], or did not test generalization [39,42], Laguesse et al. [41] reported robust generalization effects following an extensive training protocol that mitigated downfalls of earlier studies. Our replication of their findings, using the same task and a larger participant sample, therefore provides a crucial verification that extensive inverted face identity discrimination training can improve identity recognition for that orientation.
Crucially, our study also extends previous behavioral studies, by examining for the first time whether inverted face training influences the neural processes of FIR. This is important to ascertain because an explicit behavioral measure could reflect training effects on non-perceptual factors, including attentional and decisional factors, and/or learning of task-related strategies. Our findings rule this out, since we observe increased inverted FIR in an implicit neural perceptual discrimination task with novel faces, where the task setup was highly distinct from any of the training tasks. Interestingly, at the group level, the magnitude of the FIE reduction, i.e., 56%, was exactly the same for accuracy rates and the neural measure. Moreover, unlike previous studies that tested whether face individuation training in adulthood with other-race faces [35], or face familiarization through lab experience or real-world encounters [50,51,52], had an effect on a general response to the face (e.g., grouped response to OR-faces before and after training, or familiar versus unfamiliar faces), our neural measure directly isolated the neural processes responding differently to different unfamiliar face identities. While it was recently shown that face identity responses were not modulated by face familiarity (e.g., a few encounters versus extensive encounters; [53]), our findings show that neural FIR responses can depend on discrimination experience, at least when the faces are suboptimally processes by the system. To our knowledge, this is the first evidence that neural FIR processes can be influenced by visual experience exclusively acquired in adulthood.
While we measured global brain activity at the scalp level, and therefore cannot resolve which region(s) instantiated the training effects, it was specific to a few bilateral occipito-temporal electrodes that also showed strong signals during upright face discrimination. Previous studies with EEG/MEG and fMRI have shown that inverted faces are processed by the face recognition system in the VOTC, albeit less efficiently [54,55,56,57,58,59]. Moreover, as presented in the introduction section, previous research on cases of prosopagnosia (due to brain damage or intracerebral electrical stimulation) and intracerebral recordings has validated the effectiveness of the current FPVS-EEG approach at isolating neural FIR processes [44,46,47]. Taken together, this suggests that the increased neural inverted discrimination was instantiated in face-selective regions also involved in discrimination of upright faces. Nevertheless, future studies using more spatially resolved recording methods would need to ultimately verify this conclusion and further test if different face-selective regions exhibit different degrees of plasticity (e.g., adopting our training approach with fMRI).
Previous studies focusing on neural correlates of human face recognition have largely focused on the developmental trajectory of the face-selective system in the VOTC (for recent review: see [60]). Research has shown that face-selectivity in FFA exists already at the age of 2.8 months [61] and that, throughout development, local clustering of face-selective responses increases in at least the inferior-occipital-gyrus and posterior fusiform gyrus [62,63,64,65,66,67,68]. For face individuation responses, an ERP study showed responses in 2.5–5-month olds that were specific to the right hemisphere [69]; also see [24] for 5 year olds. Using fMRI, face individuation responses in face-selective regions has been shown in 5-year olds (youngest group tested; [66]). There is evidence that face individuation changes with experience, as adult face-selective regions show larger face individuation responses compared to children [66], and adults exhibit larger FIE compared to children as measured with FPVS-EEG [24]. Moreover, children and adults show larger discrimination responses to own- compared to other-age faces in some face-selective regions [64,66]. However, the difference between children and adults could reflect changes toward later stages of maturation and thus does not provide direct evidence that experience exclusively acquired in adulthood influences the face identity recognition system. Thus, our findings add to this literature, suggesting that the functional architecture underlying FIR remains plastic long after maturation. Whether the plasticity reflects the recruitment of more neural sources to process inverted faces—and whether these would be recruited exclusively from face-selective neurons—and/or stronger sensitivity within neuronal sources for inverted faces, remain unknown and are topics for future studies. Moreover, we found that the training effect was present one day after the training stopped, but it is currently unknown if it would persist for a long time when the participants no longer experience inverted faces.
It is thought that the larger inversion effect for faces compared to non-face objects [7] reflects processing of upright faces as an integrated whole entity of diagnostic face features (eyes, nose, mouth), rather than a more part-based collection of features. This “holistic/configural” view is supported by a large body of evidence showing that inversion reduces well-known behavioral markers of holistic processing, including the “whole-part advantage” [70,71] and the “composite face effect” [72], as well as sensitivity to spatial relationships between (distant) facial features [19,73,74,75,76]. To account for these phenomena, it has been proposed that inversion shrinks the “perceptual field” (or functional field of vision) when dealing with face identity recognition [77], explaining a change in relative performance for gaze-contingent window and mask conditions for upright and inverted faces [78]. In line with this proposal, a recent fMRI study found that face-selective regions exhibited larger population receptive fields (pRFs) and visual field coverage for upright compared to inverted faces, where the visual field coverage of upright faces included the eye and the mouth regions, while that of inverted faces missed the mouth [79]. In the current study, it is possible that the inverted face training expanded the perceptual field for inverted faces, thereby increasing the discrimination ability of inverted faces, (e.g., [80]), without changing the optimal fixation point away from the eyes [2]. Future work could examine if inverted face discrimination training broadens the perceptual field coverage for inverted faces, as measured with behavioral measures of holistic processing or fMRI pRF mapping. A possible mechanism for broadening visual field coverage could be strengthening the functional connectivity between face-selective regions and retinotopic regions with upper visual field bias—increasing the retinotopic convergence in face-selective regions—which could be examined using functional connectivity analyses; (see also [81]).
Note that there is evidence that experience can influence both part-based and holistic processing. On one hand, a behavioral study found that inverted face training improved part-based learning of inverted faces [42]. However, this effect could reflect that training was conducted with a small set of images that were also used in the test phase (i.e., no generalization to novel faces was tested and a small set of face images were trained thereby potentially allowing for learning image cues). On the other hand, a wide range of evidence indicates that experience can influence holistic processing. In the face domain, preschool teachers and maternity ward nurses, who benefit from prolonged visual experience with child and newborn faces, respectively, display similar hallmarks of holistic processing when presented with adult and child/infant faces, while novices show stronger holistic effects for own-age faces [37,38,82]. In the non-face domain, behavioral markers of holistic perception have been reported for people with extensive real-world experience discrimination objects within a domain (i.e., domain experts), including car experts recognizing cars [83], chess experts recognizing chess-board configurations [84], bird watchers recognizing birds [85], and in laboratory-trained experts recognizing artificial objects [86]. Moreover, it has been shown that discrimination training with novel objects is more effective when the stimuli to be learned have face-like configurations [87]. Overall, while this indicates that inverted faces training could, in principle, lead to more holistic processing of inverted faces, this would need to be verified by future studies.
In summary, we revealed that extensive inverted face discrimination training in adulthood influenced both behavioral and neural inverted face discrimination. The behavioral findings replicate and support previous behavioral evidence [41], and crucially, the neural findings show novel evidence pinpointing the training effects to cortical perceptual face identity recognition processes in the right occipito-temporal cortex. This casts new light on the plasticity of the FIR system: while it is widely accepted that children’s cortical face processes are highly malleable [88,89], our findings show that also adult face processing can be highly malleable to visual experience. Future work should directly compare the malleability in children and adults using tasks where both groups show malleability, such as the tasks of the current study. For example, it could be that the FIE would be entirely abolished in children due to higher plasticity. Thus, overall, our findings substantially strengthen the notion that the mature FIR system is highly plastic and opens up for a range of new questions regarding why and how this system changes with experience in our everyday adult lives.

Author Contributions

Conceptualization, B.R. and R.L.; methodology, B.R. and R.L.; software, B.R. and R.L.; validation, B.R., S.H. and R.L.; formal analysis, S.H.; investigation, R.L.; resources, B.R.; data curation, S.H.; writing—original draft preparation, S.H. and R.L.; writing—review and editing, B.R., S.H. and R.L; visualization, S.H.; supervision, B.R.; project administration, B.R. and R.L.; funding acquisition, B.R. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Agence Nationale de la Recherche (ANR IGBDEV) grant number 22-CE28-0028.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the Institutional Review Board (or Ethics Committee) of UCLouvain (protocol code: B403201111965. Date of approval: 1 December 2011).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data are available at the Open Science Framework (https://osf.io/8y6hx/), accessed on 1 December 2023.

Conflicts of Interest

The authors declare no conflicts of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.

References

  1. Jenkins, R.; Dowsett, A.J.; Burton, A.M. How Many Faces Do People Know? Proc. R. Soc. B 2018, 285, 20181319. [Google Scholar] [CrossRef]
  2. Hsiao, J.H.W.; Cottrell, G. Two Fixations Suffice in Face Recognition. Psychol. Sci. 2008, 19, 998–1006. [Google Scholar] [CrossRef]
  3. Jacques, C.; d’Arripe, O.; Rossion, B. The Time Course of the Inversion Effect during Individual Face Discrimination. J. Vis. 2007, 7, 3. [Google Scholar] [CrossRef] [PubMed]
  4. Retter, T.L.; Jiang, F.; Webster, M.A.; Michel, C.; Schiltz, C.; Rossion, B. Varying Stimulus Duration Reveals Consistent Neural Activity and Behavior for Human Face Individuation. Neuroscience 2021, 472, 138–156. [Google Scholar] [CrossRef] [PubMed]
  5. Liu-Shuang, J.; Norcia, A.M.; Rossion, B. An Objective Index of Individual Face Discrimination in the Right Occipito-Temporal Cortex by Means of Fast Periodic Oddball Stimulation. Neuropsychologia 2014, 52, 57–72. [Google Scholar] [CrossRef] [PubMed]
  6. Palermo, R.; Rhodes, G. Are You Always on My Mind? A Review of How Face Perception and Attention Interact. Neuropsychologia 2007, 45, 75–92. [Google Scholar] [CrossRef] [PubMed]
  7. Yin, R.K. Looking at Upside-down Faces. J. Exp. Psychol. 1969, 81, 141. [Google Scholar] [CrossRef]
  8. Rossion, B. Picture-Plane Inversion Leads to Qualitative Changes of Face Perception. Acta Psychol. 2008, 128, 274–289. [Google Scholar] [CrossRef] [PubMed]
  9. Bruce, C. Face Recognition by Monkeys: Absence of an Inversion Effect. Neuropsychologia 1982, 20, 515–521. [Google Scholar] [CrossRef] [PubMed]
  10. Rossion, B.; Taubert, J. What Can We Learn about Human Individual Face Recognition from Experimental Studies in Monkeys? Vis. Res. 2019, 157, 142–158. [Google Scholar] [CrossRef]
  11. Griffin, J.W. Quantifying the Face Inversion Effect in Nonhuman Primates: A Phylogenetic Meta-Analysis. Anim. Cogn. 2020, 23, 237–249. [Google Scholar] [CrossRef] [PubMed]
  12. Morton, J.; Johnson, M.H. CONSPEC and CONLERN: A two-process theory of infant face recognition. Psychol. Rev. 1991, 98, 164. [Google Scholar] [CrossRef] [PubMed]
  13. Goren, C.C.; Sarty, M.; Wu, P.Y.K. Visual Following and Pattern Discrimination of Face like Stimuli by Newborn Infants. Pediatrics 1975, 56, 544–549. [Google Scholar] [CrossRef] [PubMed]
  14. Johnson, M.H.; Dziurawiec, S.; Ellis, H.; Morton, J. Newborns’ Preferential Tracking of Face-like Stimuli and Its Subsequent Decline. Cognition 1991, 40, 1–19. [Google Scholar] [CrossRef] [PubMed]
  15. Simion, F.; Valenza, E.; Cassia, V.M.; Turati, C.; Umiltà, C. Newborns’ Preference for up-down Asymmetrical Configurations. Dev. Sci. 2002, 5, 427–434. [Google Scholar] [CrossRef]
  16. Buiatti, M.; Di Giorgio, E.; Piazza, M.; Polloni, C.; Menna, G.; Taddei, F.; Baldo, E.; Vallortigara, G. Cortical Route for Facelike Pattern Processing in Human Newborns. Proc. Natl. Acad. Sci. USA 2019, 116, 4625–4630. [Google Scholar] [CrossRef] [PubMed]
  17. Duchaine, B.; Rezlescu, C.; Garrido, L.; Zhang, Y.; Braga, M.V.; Susilo, T. The Development of Upright Face Perception Depends on Evolved Orientation-Specific Mechanisms and Experience. iScience 2023, 26, 107763. [Google Scholar] [CrossRef] [PubMed]
  18. Geldart, S.; Mondloch, C.J.; Maurer, D.; De Schonen, S.; Brent, H.P. The Effect of Early Visual Deprivation on the Development of Face Processing. Dev. Sci. 2002, 5, 490–501. [Google Scholar] [CrossRef]
  19. Le Grand, R.; Mondloch, C.J.; Maurer, D.; Brent, H.P. Early Visual Experience and Face Processing. Nature 2001, 410, 890. [Google Scholar] [CrossRef]
  20. Le Grand, R.; Mondloch, C.J.; Maurer, D.; Brent, H.P. Expert Face Processing Requires Visual Input to the Right Hemisphere during Infancy. Nat. Neurosci. 2003, 6, 1108–1112. [Google Scholar] [CrossRef]
  21. Le Grand, R.; Mondloch, C.J.; Maurer, D.; Brent, H.P. Impairment in Holistic Face Processing Following Early Visual Deprivation. Psychol. Sci. 2004, 15, 762–768. [Google Scholar] [CrossRef]
  22. Carey, S. Becoming a Face Expert. Philos. Trans. R. Soc. Lond. B Biol. Sci. 1992, 335, 95–103. [Google Scholar] [CrossRef] [PubMed]
  23. Hills, P.J.; Lewis, M.B. The Development of Face Expertise: Evidence for a Qualitative Change in Processing. Cogn. Dev. 2018, 48, 1–18. [Google Scholar] [CrossRef]
  24. Lochy, A.; Schiltz, C.; Rossion, B. The Right Hemispheric Dominance for Face Perception in Preschool Children Depends on the Visual Discrimination Level. Dev. Sci. 2020, 23, e12914. [Google Scholar] [CrossRef]
  25. Meissner, C.A.; Brigham, J.C. Thirty Years of Investigating the Own-Race Bias in Memory for Faces: A Meta-Analytic Review. Psychol. Public Policy Law 2001, 7, 3–35. [Google Scholar] [CrossRef]
  26. Rossion, B.; Michel, C. An Experience-Based Holistic Account of the Other-Race Face Effect. In Oxford Handbook of Face Perception; Oxford University Press: Oxford, UK, 2012; pp. 215–244. [Google Scholar] [CrossRef]
  27. Tanaka, J.W.; Heptonstall, B.; Hagen, S. Perceptual Expertise and the Plasticity of Other-Race Face Recognition. Vis. Cogn. 2013, 21, 1183–1201. [Google Scholar] [CrossRef]
  28. Stelter, M.; Schweinberger, S.R. Bridging the Gap between Intergroup and Face Perception Research: Understanding the Mechanisms Underlying the Other-“race” Effect. Br. J. Psychol. 2021, 112, 373. [Google Scholar] [CrossRef]
  29. Kelly, D.J.; Quinn, P.C.; Slater, A.M.; Lee, K.; Ge, L.; Pascalis, O. The other-race effect develops during infancy: Evidence of perceptual narrowing. Psychol. Sci. 2007, 18, 1084–1089. [Google Scholar] [CrossRef] [PubMed]
  30. Kelly, D.J.; Liu, S.; Lee, K.; Quinn, P.C.; Pascalis, O.; Slater, A.M.; Ge, L. Development of the other-race effect during infancy: Evidence toward universality? J. Exp. Child. Psychol. 2009, 104, 105–114. [Google Scholar] [CrossRef]
  31. Sangrigoli, S.; Pallier, C.; Argenti, A.M.; Ventureyra, V.A.G.; De Schonen, S. Reversibility of the Other-Race Effect in Face Recognition during Childhood. Psychol. Sci. 2005, 16, 440–444. [Google Scholar] [CrossRef]
  32. De Heering, A.; De Liedekerke, C.; Deboni, M.; Rossion, B. The Role of Experience during Childhood in Shaping the Other-Race Effect. Dev. Sci. 2010, 13, 181–187. [Google Scholar] [CrossRef]
  33. Lebrecht, S.; Pierce, L.J.; Tarr, M.J.; Tanaka, J.W. Perceptual Other-Race Training Reduces Implicit Racial Bias. PLoS ONE 2009, 4, e4215. [Google Scholar] [CrossRef]
  34. McKone, E.; Brewer, J.L.; MacPherson, S.; Rhodes, G.; Hayward, W.G. Familiar Other-Race Faces Show Normal Holistic Processing and Are Robust to Perceptual Stress. Perception 2007, 36, 224–248. [Google Scholar] [CrossRef]
  35. Tanaka, J.W.; Pierce, L.J. The Neural Plasticity of Other-Race Face Recognition. Cogn. Affect. Behav. Neurosci. 2009, 9, 122–131. [Google Scholar] [CrossRef]
  36. Yovel, G.; Halsband, K.; Pelleg, M.; Farkash, N.; Gal, B.; Goshen-Gottstein, Y. Can Massive but Passive Exposure to Faces Contribute to Face Recognition Abilities? J. Exp. Psychol. Hum. Percept. Perform. 2012, 38, 285. [Google Scholar] [CrossRef]
  37. Cassia, V.M.C.; Picozzi, M.; Kuefner, D.; Bricolo, E.; Turati, C. Holistic Processing for Faces and Cars in Preschool-Aged Children and Adults: Evidence from the Composite Effect. Dev. Sci. 2009, 12, 236–248. [Google Scholar] [CrossRef]
  38. Kuefner, D.; Cassia, V.M.; Picozzi, M.; Bricolo, E. Do All Kids Look Alike? Evidence for an Other-Age Effect in Adults. J. Exp. Psychol. Hum. Percept. Perform. 2008, 34, 811. [Google Scholar] [CrossRef]
  39. Ashworth, A.R.S.; Vuong, Q.C.; Rossion, B.; Tarr, M.J. Recognizing Rotated Faces and Greebles: What Properties Drive the Face Inversion Effect? Vis. Cogn. 2008, 16, 754–784. [Google Scholar] [CrossRef]
  40. Hussain, Z.; Sekuler, A.B.; Bennett, P.J. How Much Practice Is Needed to Produce Perceptual Learning? Vis. Res. 2009, 49, 2624–2634. [Google Scholar] [CrossRef] [PubMed]
  41. Laguesse, R.; Dormal, G.; Biervoye, A.; Kuefner, D.; Rossion, B. Extensive Visual Training in Adulthood Significantly Reduces the Face Inversion Effect. J. Vis. 2012, 12, 14. [Google Scholar] [CrossRef] [PubMed]
  42. Robbins, R.; McKone, E. Can Holistic Processing Be Learned for Inverted Faces? Cognition 2003, 88, 79–107. [Google Scholar] [CrossRef]
  43. Rossion, B.; Retter, T.L.; Liu-Shuang, J. Understanding Human Individuation of Unfamiliar Faces with Oddball Fast Periodic Visual Stimulation and Electroencephalography. Eur. J. Neurosci. 2020, 52, 4283–4344. [Google Scholar] [CrossRef]
  44. Liu-Shuang, J.; Torfs, K.; Rossion, B. An Objective Electrophysiological Marker of Face Individualisation Impairment in Acquired Prosopagnosia with Fast Periodic Visual Stimulation. Neuropsychologia 2016, 83, 100–113. [Google Scholar] [CrossRef]
  45. Fisher, K.; Towler, J.; Rossion, B.; Eimer, M. Neural Responses in a Fast Periodic Visual Stimulation Paradigm Reveal Domain-General Visual Discrimination Deficits in Developmental Prosopagnosia. Cortex 2020, 133, 76–102. [Google Scholar] [CrossRef]
  46. Jacques, C.; Rossion, B.; Volfart, A.; Brissart, H.; Colnat-Coulbois, S.; Maillard, L.; Jonas, J. The Neural Basis of Rapid Unfamiliar Face Individuation with Human Intracerebral Recordings. Neuroimage 2020, 221, 117174. [Google Scholar] [CrossRef]
  47. Volfart, A.; Rossion, B.; Yan, X.; Angelini, L.; Maillard, L.; Colnat-Coulbois, S.; Jonas, J. Intracerebral Electrical Stimulation of the Face-Selective Right Lateral Fusiform Gyrus Transiently Impairs Face Identity Recognition. Neuropsychologia 2023, 190, 108705. [Google Scholar] [CrossRef] [PubMed]
  48. Stickgold, R.; Hobson, J.A.; Fosse, R.; Fosse, M. Sleep, Learning, and Dreams: Off-Line Memory Reprocessing. Science 2001, 294, 1052–1057. [Google Scholar] [CrossRef] [PubMed]
  49. Quek, G.; Nemdorov, D.; Rossion, B.; Liu-Shuang, J. Selective Attention to Faces in a Rapid Visual Stream: Hemispheric Differences in Enhancement and Suppression of Category-Selective Neural Activity. J. Cogn. Neurosci. 2018, 30, 393–410. [Google Scholar] [CrossRef] [PubMed]
  50. Campbell, A.; Tanaka, J.W. When a Stranger Becomes a Friend: Measuring the Neural Correlates of Real-World Face Familiarisation. Vis. Cogn. 2021, 29, 689–707. [Google Scholar] [CrossRef]
  51. Popova, T.; Wiese, H. Developing Familiarity during the First Eight Months of Knowing a Person: A Longitudinal EEG Study on Face and Identity Learning. Cortex 2023, 165, 26–37. [Google Scholar] [CrossRef]
  52. Tanaka, J.W.; Curran, T.; Porterfield, A.L.; Collins, D. Activation of Preexisting and Acquired Face Representations: The N250 Event-Related Potential as an Index of Face Familiarity. J. Cogn. Neurosci. 2006, 18, 1488–1497. [Google Scholar] [CrossRef]
  53. Ambrus, G.G.; Eick, C.M.; Kaiser, D.; Kovács, G. Getting to Know You: Emerging Neural Representations during Face Familiarization. J. Neurosci. 2021, 41, 5687–5698. [Google Scholar] [CrossRef] [PubMed]
  54. Bentin, S.; Allison, T.; Puce, A.; Perez, E.; McCarthy, G. Electrophysiological Studies of Face Perception in Humans. J. Cogn. Neurosci. 1996, 8, 551–565. [Google Scholar] [CrossRef]
  55. Kanwisher, N.; Tong, F.; Nakayama, K. The Effect of Face Inversion on the Human Fusiform Face Area. Cognition 1998, 68, B1–B11. [Google Scholar] [CrossRef]
  56. Gilaie-Dotan, S.; Gelbard-Sagiv, H.; Malach, R. Perceptual Shape Sensitivity to Upright and Inverted Faces Is Reflected in Neuronal Adaptation. Neuroimage 2010, 50, 383–395. [Google Scholar] [CrossRef] [PubMed]
  57. Itier, R.J.; Herdman, A.T.; George, N.; Cheyne, D.; Taylor, M.J. Inversion and Contrast-Reversal Effects on Face Processing Assessed by MEG. Brain Res. 2006, 1115, 108–120. [Google Scholar] [CrossRef] [PubMed]
  58. Mazard, A.; Schiltz, C.; Rossion, B. Recovery from Adaptation to Facial Identity Is Larger for Upright than Inverted Faces in the Human Occipito-Temporal Cortex. Neuropsychologia 2006, 44, 912–922. [Google Scholar] [CrossRef]
  59. Watanabe, S.; Miki, K.; Kakigi, R. Mechanisms of Face Perception in Humans: A Magneto- and Electro-Encephalographic Study. Neuropathology 2005, 25, 8–20. [Google Scholar] [CrossRef]
  60. Scott, L.S.; Arcaro, M.J. A Domain-Relevant Framework for the Development of Face Processing. Nat. Rev. Psychol. 2023, 2, 183–195. [Google Scholar] [CrossRef]
  61. Kosakowski, H.L.; Cohen, M.A.; Takahashi, A.; Keil, B.; Kanwisher, N.; Saxe, R. Selective Responses to Faces, Scenes, and Bodies in the Ventral Visual Pathway of Infants. Curr. Biol. 2022, 32, 265–274. [Google Scholar] [CrossRef]
  62. Aylward, E.H.; Park, J.E.; Field, K.M.; Parsons, A.C.; Richards, T.L.; Cramer, S.C.; Meltzoff, A.N. Brain Activation during Face Perception: Evidence of a Developmental Change. J. Cogn. Neurosci. 2005, 17, 308–319. [Google Scholar] [CrossRef]
  63. Golarai, G.; Ghahremani, D.G.; Whitfield-Gabrieli, S.; Reiss, A.; Eberhardt, J.L.; Gabrieli, J.D.E.; Grill-Spector, K. Differential Development of High-Level Visual Cortex Correlates with Category-Specific Recognition Memory. Nat. Neurosci. 2007, 10, 512–522. [Google Scholar] [CrossRef]
  64. Golarai, G.; Liberman, A.; Grill-Spector, K. Experience Shapes the Development of Neural Substrates of Face Processing in Human Ventral Temporal Cortex. Cereb. Cortex 2015, 27, bhv314. [Google Scholar] [CrossRef]
  65. Peelen, M.V.; Glaser, B.; Vuilleumier, P.; Eliez, S. Differential Development of Selectivity for Faces and Bodies in the Fusiform Gyrus. Dev. Sci. 2009, 12, F16–F25. [Google Scholar] [CrossRef]
  66. Natu, V.S.; Barnett, M.A.; Hartley, J.; Gomez, J.; Stigliani, A.; Grill-Spector, K. Development of Neural Sensitivity to Face Identity Correlates with Perceptual Discriminability. J. Neurosci. 2016, 36, 10893–10907. [Google Scholar] [CrossRef] [PubMed]
  67. Nordt, M.; Gomez, J.; Natu, V.S.; Rezai, A.A.; Finzi, D.; Kular, H.; Grill-Spector, K. Cortical Recycling in High-Level Visual Cortex during Childhood Development. Nat. Hum. Behav. 2021, 5, 1686–1697. [Google Scholar] [CrossRef]
  68. Scherf, K.S.; Behrmann, M.; Humphreys, K.; Luna, B. Visual Category-Selectivity for Faces, Places and Objects Emerges along Different Developmental Trajectories. Dev. Sci. 2007, 10, F15–F30. [Google Scholar] [CrossRef] [PubMed]
  69. Adibpour, P.; Dubois, J.; Dehaene-Lambertz, G. Right but Not Left Hemispheric Discrimination of Faces in Infancy. Nat. Hum. Behav. 2018, 2, 67–79. [Google Scholar] [CrossRef] [PubMed]
  70. Tanaka, J.W.; Farah, M.J. Parts and Wholes in Face Recognition. Q. J. Exp. Psychol. Sect. A 1993, 46, 225–245. [Google Scholar] [CrossRef] [PubMed]
  71. Tanaka, J.W.; Simonyi, D. The “parts and wholes” of face recognition: A review of the literature. Q. J. Exp. Psychol. 2016, 69, 1876–1889. [Google Scholar] [CrossRef] [PubMed]
  72. Young, A.W.; Hellawell, D.; Hay, D.C. Configurational Information in Face Perception. Perception 2013, 42, 747–759. [Google Scholar] [CrossRef]
  73. Goffaux, V.; Rossion, B. Face Inversion Disproportionately Impairs the Perception of Vertical but Not Horizontal Relations Between Features. J. Exp. Psychol. Hum. Percept. Perform. 2007, 33, 995. [Google Scholar] [CrossRef]
  74. Sekunova, A.; Barton, J.J.S. The Effects of Face Inversion on the Perception of Long-Range and Local Spatial Relations in Eye and Mouth Configuration. J. Exp. Psychol. Hum. Percept. Perform. 2008, 34, 1129. [Google Scholar] [CrossRef]
  75. Tanaka, J.W.; Kaiser, M.D.; Hagen, S.; Pierce, L.J. Losing Face: Impaired Discrimination of Featural and Configural Information in the Mouth Region of an Inverted Face. Atten. Percept. Psychophys. 2014, 76, 1000–1014. [Google Scholar] [CrossRef]
  76. Freire, A.; Lee, K.; Symons, L.A. The Face-Inversion Effect as a Deficit in the Encoding of Configural Information: Direct Evidence. Perception 2000, 29, 159–170. [Google Scholar] [CrossRef]
  77. Rossion, B. Distinguishing the Cause and Consequence of Face Inversion: The Perceptual Field Hypothesis. Acta Psychol. 2009, 132, 300–312. [Google Scholar] [CrossRef] [PubMed]
  78. Van Belle, G.; de Graef, P.; Verfaillie, K.; Rossion, B.; Lefèvre, P. Face Inversion Impairs Holistic Perception: Evidence from Gaze-Contingent Stimulation. J. Vis. 2010, 10, 10. [Google Scholar] [CrossRef] [PubMed]
  79. Poltoratski, S.; Kay, K.; Finzi, D.; Grill-Spector, K. Holistic Face Recognition Is an Emergent Phenomenon of Spatial Processing in Face-Selective Regions. Nat. Commun. 2021, 12, 4745. [Google Scholar] [CrossRef] [PubMed]
  80. Wang, R.; Li, J.; Fang, H.; Tian, M.; Liu, J. Individual Differences in Holistic Processing Predict Face Recognition Ability. Psychol. Sci. 2012, 23, 169–177. [Google Scholar] [CrossRef] [PubMed]
  81. Rosenthal, G.; Sporns, O.; Avidan, G. Stimulus Dependent Dynamic Reorganization of the Human Face Processing Network. Cereb. Cortex 2017, 27, 4823–4834. [Google Scholar] [CrossRef] [PubMed]
  82. de Heering, A.; Rossion, B. Prolonged Visual Experience in Adulthood Modulates Holistic Face Perception. PLoS ONE 2008, 3, e2317. [Google Scholar] [CrossRef] [PubMed]
  83. Gauthier, I.; Curran, T.; Curby, K.M.; Collins, D. Perceptual Interference Supports a Non-Modular Account of Face Processing. Nat. Neurosci. 2003, 6, 428–432. [Google Scholar] [CrossRef] [PubMed]
  84. Boggan, A.L.; Bartlett, J.C.; Krawczyk, D.C. Chess Masters Show a Hallmark of Face Processing with Chess. J. Exp. Psychol. Gen. 2012, 141, 37. [Google Scholar] [CrossRef]
  85. Hagen, S.; Vuong, Q.C.; Jung, L.; Chin, M.D.; Scott, L.S.; Tanaka, J.W. A Perceptual Field Test in Object Experts Using Gaze-Contingent Eye Tracking. Sci. Rep. 2023, 13, 11437. [Google Scholar] [CrossRef]
  86. Wong, A.C.N.; Palmeri, T.J.; Gauthier, I. Conditions for Facelike Expertise with Objects: Becoming a Ziggerin Expert—But Which Type? Psychol. Sci. 2009, 20, 1108–1117. [Google Scholar] [CrossRef] [PubMed]
  87. Lochy, A.; Zimmermann, F.G.S.; Laguesse, R.; Willenbockel, V.; Rossion, B.; Vuong, Q.C. Does Extensive Training at Individuating Novel Objects in Adulthood Lead to Visual Expertise? The Role of Facelikeness. J. Cogn. Neurosci. 2018, 30, 449–467. [Google Scholar] [CrossRef]
  88. Macchi Cassia, V. Age biases in face processing: The effects of experience across development. Br. J. Psychol. 2011, 102, 816–829. [Google Scholar] [CrossRef] [PubMed]
  89. Bate, S.; Adams, A.; Bennetts, R.J. Guess who? Facial identity discrimination training improves face memory in typically developing children. J. Exp. Psychol. Gen. 2020, 149, 901–913. [Google Scholar] [CrossRef]
Figure 1. (A) Schematic illustration of the test and training pipeline, where eight training sessions, with up to four different training tasks per session (see Table 1), were flanked by pre- and post-training tests. The pre- and post-training tests consisted of separate neural and behavioral measures, as illustrated in the next panels. (B) Schematic illustration of the FPVS-EEG experimental paradigm. Separate sequences showed upright and inverted faces. The test was administered before and after training. The participants fixated a cross centered between the eyes and pressed the space bar every time they detected random changes in color from blue to red. (C) The four-alternatives forced-choice (4-AFC) delayed matching task [41], which was performed for both upright and inverted faces before and after training (different sets of faces).
Figure 1. (A) Schematic illustration of the test and training pipeline, where eight training sessions, with up to four different training tasks per session (see Table 1), were flanked by pre- and post-training tests. The pre- and post-training tests consisted of separate neural and behavioral measures, as illustrated in the next panels. (B) Schematic illustration of the FPVS-EEG experimental paradigm. Separate sequences showed upright and inverted faces. The test was administered before and after training. The participants fixated a cross centered between the eyes and pressed the space bar every time they detected random changes in color from blue to red. (C) The four-alternatives forced-choice (4-AFC) delayed matching task [41], which was performed for both upright and inverted faces before and after training (different sets of faces).
Brainsci 14 00146 g001
Figure 2. Group behavioral performance as a function of session (pre-, post-) and image orientation (upright, inverted) for (A) accuracy, (B) correct response times, and (C) inverse efficiency scores (RT/proportion correct). Error bars represent standard error of the means. **, ***, n.s. represent p < 0.01 p < 0.001, p > 0.05, respectively.
Figure 2. Group behavioral performance as a function of session (pre-, post-) and image orientation (upright, inverted) for (A) accuracy, (B) correct response times, and (C) inverse efficiency scores (RT/proportion correct). Error bars represent standard error of the means. **, ***, n.s. represent p < 0.01 p < 0.001, p > 0.05, respectively.
Brainsci 14 00146 g002
Figure 3. The EEG response averages across conditions (session, image orientation). (A) The scalp topography for the face discrimination response (left) and the general visual response (right). (B) The EEG amplitude spectrum over the average of two occipito-temporal electrodes (one in each hemisphere: P9, P10). There were clear responses at the face identity discrimination frequency (F/5 = 1.176 Hz and its harmonics) and at the general visual stimulation frequency (F = 5.88 Hz and its harmonics; only the two first harmonics are shown).
Figure 3. The EEG response averages across conditions (session, image orientation). (A) The scalp topography for the face discrimination response (left) and the general visual response (right). (B) The EEG amplitude spectrum over the average of two occipito-temporal electrodes (one in each hemisphere: P9, P10). There were clear responses at the face identity discrimination frequency (F/5 = 1.176 Hz and its harmonics) and at the general visual stimulation frequency (F = 5.88 Hz and its harmonics; only the two first harmonics are shown).
Brainsci 14 00146 g003
Figure 4. Neural face discrimination responses (F/5 and harmonics). (A) Scalp topographies displaying the group average face discrimination amplitudes as a function of session (pre-, post-) and image orientation (upright, inverted). (B) The average face discrimination amplitude averaged across peak channels as a function of session (pre-, post-) and image orientation (upright, inverted). Error bars represent standard error of the means. *, *** represent p < 0.05, p < 0.001, respectively.
Figure 4. Neural face discrimination responses (F/5 and harmonics). (A) Scalp topographies displaying the group average face discrimination amplitudes as a function of session (pre-, post-) and image orientation (upright, inverted). (B) The average face discrimination amplitude averaged across peak channels as a function of session (pre-, post-) and image orientation (upright, inverted). Error bars represent standard error of the means. *, *** represent p < 0.05, p < 0.001, respectively.
Brainsci 14 00146 g004
Figure 5. Neural general visual responses (F and harmonics). (A) Scalp topographies displaying the group average general visual response amplitudes as a function of session (pre-, post-) and image orientation (upright, inverted). (B) The average general visual response amplitude averaged across peak channels as a function of session (pre-, post-) and image orientation (upright, inverted). Error bars represent standard error of the means. n.s. represents p > 0.05.
Figure 5. Neural general visual responses (F and harmonics). (A) Scalp topographies displaying the group average general visual response amplitudes as a function of session (pre-, post-) and image orientation (upright, inverted). (B) The average general visual response amplitude averaged across peak channels as a function of session (pre-, post-) and image orientation (upright, inverted). Error bars represent standard error of the means. n.s. represents p > 0.05.
Brainsci 14 00146 g005
Figure 6. Correlation between behavioral and neural FIE change. (A) The correlation between the change in inversion effect from pre- to post-test for the behavioral accuracy measure (x-axis) and for the neural face discrimination response (F/5 and harmonics) (y-axis). (B) The correlation between the change in inversion effect from pre- to post-test for the behavioral accuracy measure (x-axis) and for the neural general visual response (F and harmonics) (y-axis). A positive change indicates a decrease in the FIE, while a negative change indicates an increase in the FIE. Each colored dot represents an individual participant. Each dot represents a participant and the gray line represents the regression line.
Figure 6. Correlation between behavioral and neural FIE change. (A) The correlation between the change in inversion effect from pre- to post-test for the behavioral accuracy measure (x-axis) and for the neural face discrimination response (F/5 and harmonics) (y-axis). (B) The correlation between the change in inversion effect from pre- to post-test for the behavioral accuracy measure (x-axis) and for the neural general visual response (F and harmonics) (y-axis). A positive change indicates a decrease in the FIE, while a negative change indicates an increase in the FIE. Each colored dot represents an individual participant. Each dot represents a participant and the gray line represents the regression line.
Brainsci 14 00146 g006
Table 1. Test and training program.
Table 1. Test and training program.
Pre-test, day 1, week 1 (Friday)
1Forced-choice matching task Set 0 (32 faces)
Learning session
Session 1, day 4, week 2 (Monday) Estimated time
1Exposure/learning task Set 1 (10 faces) ±10min
2Naming task Set 1 ±75min
3Forced-choice matching task ±25min
Session 2, day 5, week 2 (Tuesday)
1Exposure/learning task Set 1 ±10min
2Naming task Set 1 ±50min
3Old/New task Set 1 ±5min
4Exposure/learning task Set 2 (10 faces) ±10min
5Naming task Set 2 ±20min
6Naming task Set 1 + Set 2 ±15min
Session 3, day 6, week 2 (Wednesday)
1Exposure/learning task Set 1 ±10min
2Exposure/learning task Set 2 ±10min
3Naming task Set1 + Set 2 ±60min
4Forced-choice matching task ±20min
5Naming task Set 1 + Set 2 ±15min
Session 4, day 7, week 2 (Thursday)
1Naming task Set 1 + Set 2 ±60min
2Exposure/learning task Set 1 ±10min
3Exposure/learning task Set 2 ±10min
4Old/New task Set 1 + Set 2 ±10min
5Naming task Set 1 + Set 2(two successes required)±15min
Session 5, day 8, week 2 (Friday)
1Old/New task Set 1 + Set 2 ±10min
2Naming task Set 1 + Set 2 ±30min
3Exposure/learning task Set 3 ±10min
4Naming task Set 3 (10 faces) ±15min
5Forced-choice matching task ±15min
6Naming task Set 3 ±25min
7Naming task Set 1 + Set 2 + Set 3 ±15min
Session 6, day 11, week 3 (Monday)
1Exposure/learning task Set 3 ±10min
2Naming task Set 1 + Set 2 + Set 3 ±40min
3Old/New task Set 1 + Set 2 + Set 3 ±15min
4Forced-choice matching task ±15min
5Naming task Set 1 + Set 2 + Set 3(two successes required)±40min
Session 7, day 12, week 3 (Tuesday)
1Old/New task Set 1 + Set 2 + Set 3 ±15min
2Forced-choice matching task ±15min
3Naming task Set 1 + Set 2 + Set 3(two successes required)±40min
4Old/New task Set 1 + Set 2 + Set 3 ±15min
5Naming task Set 1 + Set 2 + Set 3(two successes required)±40min
Session 8, day 13, week 3 (Wednesday)
1Forced-choice matching task ±15min
2Naming task Set 1 + Set 2 + Set 3(two successes required)±40min
3Old/New task Set 1 + Set 2 + Set 3 ±15min
4Naming task Set 1 + Set 2 + Set 3 ±40min
Post-test, day 14, week 3 (Thursday)
1Forced-choice matching task (Set 4)
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Hagen, S.; Laguesse, R.; Rossion, B. Extensive Visual Training in Adulthood Reduces an Implicit Neural Marker of the Face Inversion Effect. Brain Sci. 2024, 14, 146. https://doi.org/10.3390/brainsci14020146

AMA Style

Hagen S, Laguesse R, Rossion B. Extensive Visual Training in Adulthood Reduces an Implicit Neural Marker of the Face Inversion Effect. Brain Sciences. 2024; 14(2):146. https://doi.org/10.3390/brainsci14020146

Chicago/Turabian Style

Hagen, Simen, Renaud Laguesse, and Bruno Rossion. 2024. "Extensive Visual Training in Adulthood Reduces an Implicit Neural Marker of the Face Inversion Effect" Brain Sciences 14, no. 2: 146. https://doi.org/10.3390/brainsci14020146

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop