Next Article in Journal
Generation and Characterization of Stable Redox-Reporter Mammalian Cell Lines of Biotechnological Relevance
Previous Article in Journal
Ageing Safely in the Digital Era: A New Unobtrusive Activity Monitoring Framework Leveraging on Daily Interactions with Hand-Operated Appliances
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Long-Latency Event-Related Potentials (300–1000 ms) of the Visual Insight †

1
Department of Normal Physiology, St. Petersburg State Pediatric Medical University, 194100 Saint Petersburg, Russia
2
Lab of Applied Informatics, St. Petersburg Federal Research Center of the Russian Academy of Sciences, 199178 Saint Petersburg, Russia
This article is an extended version of the conference paper from the 12th International Conference on Applied Human Factors and Ergonomics, New York, NY, USA, 25–29 July 2021 (Lytaev 2021).
Sensors 2022, 22(4), 1323; https://doi.org/10.3390/s22041323
Submission received: 12 December 2021 / Revised: 2 February 2022 / Accepted: 7 February 2022 / Published: 9 February 2022
(This article belongs to the Section Biomedical Sensors)

Abstract

:
The line of insight research methods that have high temporal and surface resolution is not large—these are EEGs, EPs, and fMRI, as well as their combinations and various options for assessing temporal events of random understanding. The objective of this research was to study the classification of insight for visual illusory images consisting of several objects simultaneously according to the analysis of early, middle, late, and ultra-late components (up to 1000 ms) of event-related potentials (ERPs). ERP research on 42 healthy subjects (men) aged 20–28 years was performed. The stimuli were a line of visual images with an incomplete set of signs, as well as images-illusions, which, with different perceptions, represent different images. The results showed the similarity of the tests to correct recognition of fragments of unrecognition and double images. At the intermediate stage of perception (100–200 ms), in both cases, the activity of the central and frontal cortex decreased, mainly in the left hemisphere. At the later stages of information processing (300–500 ms), the temporal-parietal and occipital brain parts on the right were activated, with the difference that when double objects were perceived, this process expanded to 700–800 ms with the activation of the central and occipital fields of the right hemisphere. Outcomes allowed discussing two possible options for actualizing the mechanisms of long-term memory that ensure the formation of insight—the simultaneous perception of images as part of an illusion. The first of them is associated with the inhibition of the frontal cortex at the stage of synthesis of information flows, with the subsequent activation of the occipital brain parts. The second variant is traditional and manifests itself in the activation of the frontal brain areas, with the subsequent excitation of all brain fields by the mechanisms of exhaustive search.

1. Introduction

There is a line of definitions of insight, depending on the selected combination of characteristics or, rather, on the objectives of the study—psychological, clinical, physiological, marketing, etc. [1,2,3,4,5]. Typically, the definition is associated with a sudden solution to a problem, which is preceded by an impasse and restructuring of the problem, followed by a positive emotional reaction. There is a mismatch in cognitive psychology and neuroscience, which we consider to be the main criterion for understanding, namely surprise. For example, in a series of studies on insight, the authors do not specifically highlight decisions that have arisen suddenly [6,7,8]. Another widespread use of the term “insight” can be found in clinical psychology, where understanding refers to self-awareness, often personal symptoms, functional impairment, or other types of foresight. The clinical and unscientific use of the term does not require sudden awareness or any concomitant emotional response. Indeed, in clinical psychology, the absence of an emotional response can itself be seen as a symptom indicating a lack of understanding [9,10,11].
Currently, there are no universal scales that measure the variability of insight perception. Scales have been created to measure factors that are believed to be key drivers of insight. In particular, it is proposed that the radicality of insight (the perceived deviation between previous and new ideas about problems) and the restructuring of experience (the subjective experience of restructuring the representation of a problem) be considered [12].
The mechanisms for the benefits of memory in the process of insight, which are best supported by the results, are that these mechanisms are a joint consequence of finding the right solutions, the subjective feeling that the person has found the right solution (confidence), and the experience of an emotional pleasant reaction (reward) while solving the problem. This is the process that all contributes to better memory for the solution [13].
In particular, there is a definition of insight as any sudden understanding, awareness, or solution of a problem, which includes reorganizing the elements of a person’s mental representation of a stimulus, situation, or event to obtain a non-obvious or non-dominant interpretation [11]. More recently, the responsibility for gross semantic coding and internal focused attention before and during the solution to the problem of insight has been established in the right hemisphere. Individual differences in the propensity to solve problems in an insightful rather than conscious and analytical way are associated with different patterns of brain activity at rest. Direct brain stimulation has also recently come to be used to facilitate understanding.
It is known that a number of conscious and unconscious effects are used to improve the marketing efficiency of an advertising campaign. However, little is known about the individual contribution that conscious and unconscious processes make to the cognitive effectiveness of creative advertising. Some of these processes can also trigger insights.
The analysis of such studies shows that the moment of insight associated with advertising, whether it is standard or creative, consolidates unconscious memory, while non-insightful advertising improves conscious memory. It is widely accepted that insight decisions carry the Aha! experience. Such experiences are better remembered than those that lack a sense of insight. One question in recent research is whether the memory advantage for problem solving is modulated by the affective component of insight (the strong emotions usually accompanying the Aha! experience) or the cognitive component of insight in the form of a restructuring or change in representation that occurs during insightful problem solving [14,15].
Evaluation of the effectiveness of direct and indirect advertising is one of the tasks of applied research in assessing the mechanisms of insight. Direct advertising openly portrays the advertised products and brands. In indirect advertising, the advertising message needs to be improved. One of the methods for assessing the difference in the perception of advertising products is registration of eye movements. Overall, it was found that indirect advertising images received more fixation, as did indirect brand preference. Indirect brand logo recognition improved when tested after a shorter delay. Most interestingly, consumers perceived indirect advertising as more original, surprising, intelligent, and more difficult to interpret than direct advertising. The results showed that indirect advertising induces cognitive rework, leading to higher preference and memorability for brands [16].
It is believed that sudden insight while solving a problem can improve learning, but the underlying neural processes are largely undeveloped. For this purpose, the neural correlates of learning based on the sudden understanding of a verbal task based on the data of functional magnetic resonance imaging have been investigated. The findings suggested that learning by sudden comprehension may constitute one of the special cases where new information is directly encoded into semantic memory, similar to previous records of schema-dependent memory or prior knowledge. In addition, the results also provide further insight into how mnemonic schemas can be quickly generated from previously remotely related semantic representations [17,18].
Unconscious information can influence our behavior both in an experimental context and in life conditions. The reverse question is whether these effects can be applied in the context of everyday life (e.g., in advertising), which is a subject of serious controversy. Research shows that if real information is minimally presented at a conscious or even unconscious level, it can affect our subsequent behavior, even if more than five seconds elapse between the presentation of minimally conscious or unconscious information and the behavior that it affects [19].
Thus, the cognitive neurobiology of insight is an exciting new area of research related to fundamental neurocognitive processes [20,21,22]. The article discusses the results of original research in the context of the discussion of modern studies of the well-known psychological phenomenon of P300 visual evoked potentials (VEPs). The objective of this research was to study the classification of insight for visual illusory images consisting of several objects simultaneously according to the analysis of early, middle, late, and ultra-late components (up to 1000 ms) of event-related potentials.

2. Material and Methods

Research on 42 healthy subjects (men) aged 20–28 years was performed. Event-related potentials (ERPs) traditionally in 19 monopolar sites were recorded with reference electrodes on the earlobes. Accordingly, the dipole was the signal between the scalp and reference electrodes on each side. The signal sampling rate was –500 Hz, and the amplifier bandwidth was 0.5–30 Hz. These are the traditional parameters for recording long-latency evoked potentials (EPs) and EEGs. The purity of the signal was determined by automatic indicators. The registration of biosignals began with the registration of a traditional EEG. After that, the amplifier was switched to registration of super-averaged VEPs.
Visual images for a short time (duration 0.3 ms, frequency 0.5 Hz, 30 savings) on the display screen were presented. The stimuli were a line of visual images with an incomplete set of signs, as well as images-illusions, which, with different perceptions, represent different images. Dual visual images-illusions with complete correct identification were a model of the phenomenon of insight [23].
A dual image “vase face candlestick” was presented on the monitor screen as a test object. The subjects received the instruction: “The image of the 1st or several figures will be rhythmically shown on the screen in front of you. You need to memorize them and, after the end of the study, submit a report on the figures that you memorized.” The use of dual images-illusions as a model made it possible, on the one hand, to fix all three possible answers (1: not a single figure was identified; 2: one figure was identified; and 3: everything) and, on the other hand, on this basis, to fix relatively homogeneous groups for mathematical analysis. A stepwise discriminant analysis was carried out in comparison with the data of a control group of healthy subjects, where ERP registration was performed in response to a traditionally recognized visual image (key fragments) [8].
The recognition of one of the dual visual images, as well as the recognition of images with an incomplete set of features, presented a model of perception of oddball images. The lack of correct identification was considered as a common figurative stimulation. The quantitative characteristics of the answer options in the recognition of dual visual images-illusions and fragments of oddball images are presented in Table 1.
The P300 wave, as well as the later waves N450, N750, and N900, ERPs in solving ergonomic problems can be considered indicators of the categorization of the perception of visual illusions. The baseline amplitude and peak latency (PL) automatically in 2 ms steps were measured. Further, the amplitude-time characteristics were transferred to the big data processing system, where stepwise discriminant and factor analyses to establish the stability of ERP parameters were applied. Differences were considered statistically significant when the value of the F-statistic of the stepwise discriminant analysis was more than 4 (F > 4.0) or the discriminant function (DF) was calculated. A stepwise discriminant analysis was carried out in comparison with the data of a control group of healthy subjects with VEP registration in response to an identifiable visual image.

3. Results

Visual event-related potential in response to visual imagery stimulation at an analysis epoch of 1000 ms had the following typical pattern (see Figure 1). Mainly, the maximum activation in the brain posterior parts was recorded. In addition, we analyzed early negative waves with a peak latency (PL) of 50–100 ms (N70), intermediate components having a maximum amplitude at PL values of 120–200 ms (N150), and late negative fluctuations in the interval of the analyzed epoch of 300–450 ms (N350 and N450). After that, in the dynamics of VEPs, there was a certain lull corresponding to a time interval of 450–700 ms and representing an averaged electroencephalogram. Following this “quiet” area, VEP waves also were noted, sometimes comparable in amplitude with the intermediate components, and named by us N750 and N900. Of the positive waves, only an oscillation with a PL of 200–300 ms (P250) was analyzed, which, among other components located below the isoline, had the maximum amplitude and a more stable manifestation.
The N70 and N150 components changed their parameters relatively insignificantly in this study (see Table 2). At the same time, it can be noted that the N70 amplitude in the occipital leads (F > 4.0) reduced during the perception of glass fragments, and the N150 amplitude decreased in the left hemisphere in the central (F = 8.0) and both frontal registration points. In the case of correct recognition of dual images, the N70 parameters did not differ from the control ones (F < 4.0), but by analogy with the perception of glasses, the N150 amplitude reduced in leads C3 (F = 6.4, DF) and both frontal leads, with a predominance in the left half of the brain (F = 6.1). Correct detection of one figure was accompanied by a lightening of the N70 amplitude in the right frontal sites (F = 9.9), and in the absence of recognition, the N70 amplitude increased in the entire frontal cortex. In this case, the characteristics of the N150 did not change (F < 4.0).
The error-free detection of glasses was characterized by an increase in the P250 amplitude in all areas of the neocortex, but it was significantly recorded only in the right frontal area (F = 5.4, DF). The parameters of the N350 wave in this group of subjects did not differ from the control ones (F < 4.0). Correct detection of dual images did not change the P250 amplitude but contributed to a noticeable shortening of P250 PL throughout the neocortex (F > 4.0). The N350 amplitude increased in the posterior parts of the cortex (F > 4.0), and a shortening of the N350 PL was also noted here. With the correct detection of one of the dual objects, the peak latency of P250 and N350 was shortened at almost all registration points (F > 4.0). The amplitude of P250 increased in the central (F = 4.1) and frontal (F = 5.1) leads of the right hemisphere, and N350 in the left occiput (F = 4.2). In the absence of recognition, the PL and the P250 amplitude did not differ from the control ones (F < 4.0), and the N350 amplitude reduced mainly in the anterior half of the brain (F > 4.0); see Table 3.
Later waves changed insignificantly with this type of identification. Only a slight increase in amplitude was noted: N450 in the left occiput (F = 4.4) and N750 in the occipital (F = 5.2) and central (F = 4.4) leads of the right hemisphere. The N900 parameters remained unchanged from the control parameters (F < 4.0); see Table 4, Table 5 and Table 6.
Correct detection of glass fragments did not affect the parameters of the latest (N900) wave (see Table 6). In this case, the N450 amplitude increased in the occipital cortex (F > 4.0), while its PL increased in the frontal areas (F > 4.0); see Table 4. The N750 amplitude did not differ from the control one (F < 4.0), but the PL reduced throughout the entire cortex (F > 4.0); see Table 5. Recognition of one of the dual images did not affect the characteristics of N450, but in almost all leads, the amplitude of N750 increased (F > 4.0) with a maximum in the right frontal cortex (F = 17.3, DF). The amplitude of N900 increased only in the right occiput (F = 4.8) and right frontal points (F = 7.5), as well as in leads C3 (F = 9.2, DF) and F3 (F = 6.3). In cases of lack of recognition upon presentation of dual images, the amplitude of N450 increased throughout the neocortex (F > 4.0), while the amplitude of N750 and N900 increased in all leads (F > 4.0), except for the occipital (F < 4.0).
Later waves with full recognition of images-illusions changed as follows (see Table 4). The amplitude of N450 in the left occiput increased (F = 4.4), and the amplitude of N750 also increased in the occipital (F = 5.2) and central (F = 4.4) sites of the right hemisphere. The N900 parameters remained unchanged from the control data (F < 4.0); see Table 6.
Correct detection of oddball patterns did does not affect the parameters of the latest (N900) wave (see Table 6). At the same time, the N450 amplitude increased in the occipital cortex (F > 4.0), while the PL increased in the anterior regions (F > 4.0); see Table 4. The N750 amplitude did not differ from the control one (F < 4.0), but the PL reduced throughout the cortex (F > 4.0); see Table 5.
Recognition of one of the dual images did not affect the characteristics of N450, but in almost all sites, the amplitude of N750 increased (F > 4.0), with a maximum in the right frontal cortex (F = 17.3). The amplitude of N900 increased only in the right occiput (F = 4.8) and frontal (F = 7.5) points, as well as in sites C3 (F = 9.2) and F3 (F = 6.3); see Table 4–6.
Unrecognition upon presentation of dual visual images-illusions, the amplitude of N450 increased in a generalized manner (F > 4.0; see Table 4) and the amplitude of N750 and N900 increased in all leads (F > 4.0), except for the occipital registration points (F < 4.0); see Table 5 and Table 6.
Figure 2, Figure 3 and Figure 4 summarize the main statistical findings. A particular typical example of the spatial distribution of VEP is presented with the correct recognition of dual visual images-illusions (Figure 2). There was a reduction in evoked activity (especially at the early and intermediate stages of information processing) in the frontal and central regions of the brain, as well as an increase in the amplitude of the N350 wave in the temporal-parietal regions of the right hemisphere (O2, P4, T6). Figure 3 reflects a typical example of the VEP spatial distribution in the case of identifying one of the dual figures—the oddball image variant. There was an activation of the frontal cortex (F3, Fz, F4), as well as a well-pronounced component N450, by analogy with the variants of the lack of recognition and activation of short-term visual memory. The lack of recognition of visual images was characterized by generalized symmetric activation throughout the entire epoch of analysis, more pronounced in the posterior half of the brain (Figure 4).

4. Discussion

Despite the existing psychological reasons for the hypothesis that the effect of insight is theoretically and functionally important, much less research has been carried out on its neural basis than psychological experiments [17]. Insight as a psychological phenomenon has been studied for at least 100 years, but the methods of neuroimaging and neurophysiology in the study of insight began to be used only in the past 20–30 years [20,21,23,24,25]. In summary, the set of research methods is not large—these are EEGs, EPs, and fMRI, as well as their combinations and various options for assessing temporal events of random understanding, the moment of Aha! [26].
Neuroimaging studies of insight are carried out mainly based on EEG data. Other methods of brain research are less common [21,27,28]. The EEG is considered to have high temporal resolution with limited spatial resolution. fMRI, on the other hand, has excellent spatial resolution with limited temporal resolution, so it is better suited for localizing a neural event in space. Together, these methods are able to isolate neural correlates of insight in both space and time. The combination of techniques is critical because fMRI’s ability to localize insight-related neural activity would be less informative if it were not for knowing whether these neural correlates arose before, after, or at the time of decision [9].
When the problem is solved intuitively, the EEG shows a burst of high-frequency EEG gamma activity over the right temporal lobe and fMRI shows a corresponding change in blood flow in the right anterior superior temporal gyrus [9]. In the original fMRI experiment, this right temporal region was the only area that exceeded the statistical thresholds. Further, weak activity was found in the hippocampus and parahippocampal gyri, as well as in the anterior and posterior cingulate cortex. In later research, the same network of regions far exceeded the critical statistical threshold, with the right anterior temporal region again being the strongest [5].
The results of this study of ERP registration in response to ambiguous images of illusion show the similarity of the tests to correct recognition of fragments of glasses and double images. At the intermediate stage of perception (100–200 ms), in both cases, the activity of the central and frontal cortex decreases, mainly in the left hemisphere. At the later stages of information processing (300–500 ms), the temporo-parietal and occipital parts of the brain on the right are activated, with the difference that when double objects are perceived, this process expands to 700–800 ms with the activation of the central and occipital fields of the right hemisphere.
It is known that the area of interaction of the inferior temporal and posterior parietal cortex is the secondary projection zone of the visual system. It is here that the formation (but not recognition) of visual images, complex scenes, frames, frames, etc., takes place. Final recognition is a more complex process involving the associative frontal cortex of the cerebral hemispheres, as well as the reward system. It should be noted that an important mechanism for coordinating the functioning of these departments is the inhibition reaction [29]. This response is the essence of various neurological disorders, such as schizophrenia and attention deficit hyperactivity disorder, which are also targeted by insight research.
Other electrophysiological data suggest that even from two opposite ERP results, it is possible to trace the features of internal and external insight [13]. Internal insight is associated with positive ERP components after stimulus onset (P200-600) above the superior temporal gyrus [15]. External insight is associated with a negative component of ERP (N320) [16]. These results already show that external and internal insights differ at the behavioral and neurophysiological levels. Various neurobiological insights suggest that presenting a solution or a decision clue leads to the same Aha! moment as attempting an inner decision [30,31,32,33,34,35].
The spatial and temporal consistency of fMRI and EEG results suggested that these findings are caused by the same underlying brain activation [9,21]. The response of the right temporal brain was identified as the main neural correlate of the experience of insight, because (a) it occurred approximately at the moment when the participants realized the solution to each of these problems, (b) the same area is involved in other tasks requiring semantic analysis and integration, and (c) gamma-band activity has been proposed as a mechanism for binding conscious information.
This assumption is supported by other neurophysiological data [9]. Significantly more activity in the alpha range was found before analysis than before an analytical report was obtained on the parietal electrodes on the right. The authors localized this effect of internal insight in the time interval from −1310 ms up to −560 ms relative to the solution. In both intrinsic and extrinsic insight effects, no indicators of some error on time were found due to different response times. Moreover, repeated-measures ANOVA confirmed the hypothesis that internal and external insights have the opposite effect on alpha power, with significant cross talk between the problem-solving strategy, that is, insight or analysis, and range, generating or recognizing a solution.
In the problem of sudden insight, the neural correlates of learning using fMRI and the verbal problem of problem solving were investigated. Activation of the hippocampus, medial prefrontal cortex (mPFC), amygdala, and striatum was found during sudden awareness. Remarkably, mPFC and temporo-parietal structures, rather than the hippocampus, were associated with later learning to sudden decision making. At the same time, complex traditional insight, compared to light flash insights, triggered stem activation at the midbrain level and was associated with successful learning through intrinsic reward [17,18].
Participants’ neural responses to induced, possibly insight-like, sudden understandings where solutions to complex problems for remote workers were revealed to them after a short delay were measured. Increased activity has been found in the striatum, part of the brain’s reward system, as well as in the amygdala, hippocampus, and medial prefrontal cortex, suggesting a link between the hypothetical neural reward and its integration into memory [17].
While the participants were solving complex problems of remote partners, we used an ultrahigh magnetic field (7T) to obtain high-resolution fMRI images in the subcortical regions [36]. Evidence has been found for insight-related brain activity in the dopaminergic regions of the nucleus accumbens and the ventral region (VTA), implying that insight engages neural reward mechanisms. However, the specifics of the procedure of this study limited the scope of its results. For example, instead of asking subjects to report whether each solution was obtained through insight or analysis, they were asked to “estimate the amount of insight and deadlock they experienced while completing the task.” This instruction confused understanding and deadlock and did not separate understanding from analysis [19]. In addition, the study included a small number of solutions for each condition, which increased the likelihood that differences in dopaminergic activity associated with insight could be related to additional characteristics of problems or their solutions.
Another study tested the hypothesis that solving sudden insight problems is accompanied by neural reward. A high-frequency EEG was recorded while solving a series of anagrams. At each decision, the participants reported on the mechanisms for forming the response—as a sudden understanding or “analytically.” The participants then completed a questionnaire that assessed the overall dispositional sensitivity to reward. The frequency-time characteristics of the EEG were calculated separately for situations with solutions by the type of insight (I) and tests with analytical (A) solutions. Statistical parametric mapping (SPM) allowed the timing, frequency, and location of several effects to be established, where I > A. In contrast, no A > I effect was observed. The primary neural correlate of insight was a burst (I > A) in the vibrational activity of the EEG gamma range in the prefrontal cortex approximately 500 ms before the participants pressed the button indicating the solution to the problem [37].
A separate anterior prefrontal burst of EEG gamma activity was also recorded approximately 100 ms after the primary insight I-A effect, which was interpreted as a reward signal associated with insight. This interpretation was confirmed by reconstruction of the source showing that the signal was partially generated by the orbitofrontal cortex [37].
A limitation of the use of fMRI to study the mechanisms of neural reward associated with insight is its relatively low temporal resolution. To determine how much the brain response is integrated with or triggered by the insight, the technique must be able to show that the brain response occurs concurrently with or after the insight. A slow hemodynamic response, as measured by fMRI, is not an ideal tool for determining whether a brain response occurs immediately before, during, or after insight.
A line of studies has shown the presence of a neural reward signal associated with both insight and rewarding experience. This reward signal comes in part from the orbitofrontal cortex, a region associated with reward learning and subjective experiences of hedonic pleasure [17,21,24].
The results support fMRI data suggesting the presence of reward-related subcortical activity during insight solving and other studies in which limbic structures, in particular the amygdala, are involved in the processing of insights [15,17,37].
For investigation of the subcortical contribution to insight, ultrahigh-field fMRI was used. During the task, the subjects were offered triples of words and instructed to find a solution word associated with all three given words. They had to press the button as soon as they felt confident in their decision without further revision, which allowed them to capture the exact event—the Aha! moment. In addition to the detection of cortical involvement of the left anterior middle temporal gyrus, persistent changes in subcortical activity are associated with discerning problem solving in the bilateral thalamus, hippocampus, and dopaminergic midbrain, including the ventral tegmental region, nucleus accumbens, and caudate core. These results shed new light on the affective neural mechanisms underlying discerning problem solving [38].
In addition, there is a more general relationship between individual differences in the characteristics of the reward neural network and creative cognition [32,39].
The EEG, unlike fMRI, has a high temporal resolution. To this end, high temporal resolution of the EEG is used to isolate the neural reward signal from decision time and to show that its magnitude correlates with overall dispositional reward sensitivity. It has been found that people with a high sensitivity to reward perceive a sudden solution to the problem of awareness as a strong reward, while people with a low sensitivity to reward may perceive insight as sudden and attention grabbing but not hedonistic.
Thus, although the insight-related reward signal is generated close in time to the insight response, the reward signal does not appear to be the only necessary characteristic of insight. The short interval between insight and its associated reward signal suggests that this activity is not the product of a conscious appraisal of insight but rather is triggered by it. This finding is further supported by the fact that the amount of insight-related activity in the left temporal lobe was positively correlated with reward-related activity in the right orbitofrontal gyrus at the source level.
Seeking insightful solutions during the Remote Worker Assignment problem has been found to induce specific changes in the activity of the cerebral cortex. Given the strong affective components (Aha! moments) that manifest in subjectively experienced feelings of relief following the sudden appearance of a solution to a problem without any conscious warning, it has been suggested that the subcortical dopaminergic reward network is critically involved during insight.
Electrophysiological correlates of sensation of novelty in creative advertising were studied in 28 healthy subjects using ERPs. Participants viewed images that were difficult to interpret until a description was presented that contained either a creative description (CD) with an unexpected image description based on the original ad or a normal description (normal ND) that was a literal description of the image (and served as the initial condition). Participants rated the level of creativity in the description. The results showed that the amplitude of the N2 wave was higher for the CD than for the ND in the middle and right regions of the skull between 240 and 270 ms, which most likely reflects the detection of conflict. Moreover, the CDs showed a larger N400 value than the ND value over a time window of 380 to 500 ms, which is said to reflect semantic integration. This study investigated the electrophysiological correlates of novelty in advertising with environmentally sound incentives [39].
As expected, N2 (240–270 ms) and N400 (380–500 ms) were observed with higher amplitudes in the creative (CD) state than in the normal (ND) state. Moreover, creative stimuli were found to have a larger negative component (LNC; 500–700 ms) than normal stimuli. For the difference wave (CD-ND), the mean N2 amplitude caused a lot of negative activity in the scalp areas of the right and middle hemispheres; the mean amplitude of N400 was distributed with strong negative activity over the right hemisphere and the most posterior regions of the skull; the LNC amplitude is mainly distributed over the back of the scalp [40].

5. Conclusions

Thus, today we can talk about the following directions, methods of research on the phenomenon of insight, and the main research problems (see Figure 5). Among the areas of research are traditional ones—cognitive psychology, clinic, first of all, neurology, and psychiatry, as well as neurophysiology—in order to study the interaction of conscious and unconscious mechanisms of memory and learning. About the past decade, marketing research was added to the traditional directions—this is the peculiarity of the perception of advertising for brands and banking products, as well as research in the field of artificial intelligence and machine learning.
There are three groups of traditional neurophysiological research methods—EEGs, fMRI, and ERPs—with the basis of the P300 component. The authors have attributed to the advantages of EEGs the high temporal resolution, the registered EEG high-gamma activity in the right temporal lobe, as an indicator of the mechanism of binding of conscious information, and the time interval of the insight effect (1310–560 ms)—from the standpoint of making an analytical decision. The advantages of fMRI are high spatial resolution and registered increased blood flow in the right temporal lobe, hippocampus (as a reaction of pleasure), striatum, medial prefrontal cortex, and dopamine region—nuclei adjacent to the ventral region. The ERPs to a certain extent, combine the advantages of EEGs and fMRI: ERPs have high spatial and temporal resolution, allow a closer approach to the problem of insight scaling, the results allow us to evaluate internal and external insight, apart from the P300 component, and the components are important in the indication of insight over a period of time 500–700 ms.
The main research problems include, first of all, scaling (assessment) of advertising perception mechanisms, both direct (conventional) and indirect, where creative processes and cognitive processing are included. The decision to activate the mechanisms of cognitive processing (memory) represents the second group of problems. There are also questions about the indication of subjective sensations, emotional components associated with the enjoyment of insight, and the reorganization of the thought process based on the relationship between conscious and unconscious effects.
Thus, the main trends in the change in ERPs, depending on the variants of recognition of visual illusions and oddball images, are as follows. Complete recognition of illusions, which corresponded to insight in the model of our experiment, was accompanied by an increase in the amplitude of the P300 wave in the temporal-parietal regions on the right. With correct identification of one of the dual images, the activation of the N450 component was recorded in the frontal regions on both sides. Negative recognition was characterized by generalized symmetric activation of all ERP components, more pronounced in the posterior half of the brain.
A discussion of our results allows us to talk about two possible options for actualizing the mechanisms of long-term memory that ensure the formation of insight—the simultaneous perception of images as part of an illusion. The first of them is associated with the inhibition of the frontal cortex at the stage of synthesis of information flows, with the subsequent activation of the posterior parts of the brain and, most likely, directly related to the mechanisms of “extra-logical” thinking. The second variant is traditional and manifests itself in the activation of the anterior sections of the neocortex, with the subsequent excitation of all brain fields by the mechanisms of “exhaustive search.”

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki and was approved by the local ethics committee of the St. Petersburg State Pediatric Medical University (protocol no. 12/1, 4 December 2017).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Conflicts of Interest

The author declares no conflict of interest.

References

  1. Kounios, J.; Beeman, M. The Aha! Moment: The cognitive neuroscience of insight. Curr. Dir. Psychol. Sci. 2009, 18, 210–216. [Google Scholar] [CrossRef]
  2. Salvi, C.; Bowden, E.M. Looking for creativity: Where do we look when we look for new ideas? Front. Psychol. 2016, 7, 161. [Google Scholar] [CrossRef] [PubMed]
  3. Salvi, C.; Bricolo, E.; Kounios, J.; Bowden, E.; Beeman, M. Insight solutions are correct more often than analytic solutions. Think. Reason. 2016, 22, 443–460. [Google Scholar] [CrossRef] [PubMed]
  4. Shen, W.; Zhao, Y.; Hommel, B.; Yuan, Y.; Zhang, Y.; Liu, Z.; Gu, H. The impact of spontaneous and induced mood states on problem solving and memory. Think. Ski. Creat. 2019, 32, 66–74. [Google Scholar] [CrossRef] [Green Version]
  5. Subramaniam, K.; Kounios, J.; Parrish, T.B.; Jung-Beeman, M. A Brain Mechanism for Facilitation of Insight by Positive Affect. J. Cogn. Neurosci. 2009, 21, 415–432. [Google Scholar] [CrossRef]
  6. Luo, J.; Niki, K. Function of hippocampus in “insight” of problem solving. Hippocampus 2003, 13, 316–323. [Google Scholar] [CrossRef]
  7. Wagner, U.; Gais, S.; Haider, H.; Verleger, R.; Born, J. Sleep inspires insight. Nature 2004, 427, 352–355. [Google Scholar] [CrossRef]
  8. Lytaev, S.; Vatamaniuk, I. Physiological and medico-social research trends of the wave P300 and more late components of visual event-related potentials. Brain Sci. 2021, 11, 125. [Google Scholar] [CrossRef]
  9. Bowden, E.M.; Jung-Beeman, M.; Fleck, J.; Kounios, J. New approaches to demystifying insight. Trends Cogn. Sci. 2005, 9, 322–328. [Google Scholar] [CrossRef]
  10. Lytaev, S.; Shevchenko, S. VEPs and AEPs: Mapping of occlusive lesions in cerebral vessels. Ann. N. Y. Acad. Sci. 1997, 821, 524–528. [Google Scholar] [CrossRef]
  11. Lytaev, S. Neurophysiological Visual Classification Indicators in the Brain-Computer Interface. Lect. Notes Comput. Sci. 2021, 12767, 197–211. [Google Scholar]
  12. Jarman, M.S. Quantifying the qualitative: Measuring the insight experience. Creat. Res. J. 2014, 26, 276–288. [Google Scholar] [CrossRef]
  13. Danek, A.H.; Wiley, J. What causes the insight memory advantage? Cognition 2020, 205, 104411. [Google Scholar] [CrossRef] [PubMed]
  14. White, T.L.; Gonsalves, M.A. Dignity neuroscience: Universal rights are rooted in human brain science. Ann. N. Y. Acad. Sci. 2021, 1505, 40–54. [Google Scholar] [CrossRef] [PubMed]
  15. Shen, W.; Bai, H.; Yuan, Y.; Ball, L.J.; Lu, F. Quantifying the roles of conscious and unconscious processing in insight-related memory effectiveness within standard and creative advertising. Psychol. Res. 2021. [Google Scholar] [CrossRef] [PubMed]
  16. Simola, J.; Kuisma, J.; Kaakinen, J.K. Attention, memory and preference for direct and indirect print advertisements. J. Bus. Res. 2020, 111, 249–261. [Google Scholar] [CrossRef]
  17. Kizilirmak, J.M.; Schott, B.H.; Thuerich, H.; Sweeney-Reed, C.M.; Richter, A.; Folta-Schoofs, K.; Richardson-Klavehn, A. Learning of novel semantic relationships via sudden comprehension is associated with a hippocampus-independent network. Conscious. Cognit. 2019, 69, 113–132. [Google Scholar] [CrossRef]
  18. Balderston, N.L.; Schultz, D.H.; Helmstetter, F.J. The human amygdala plays a stimulus specific role in the detection of novelty. NeuroImage 2011, 55, 1889–1898. [Google Scholar] [CrossRef] [Green Version]
  19. Muscarella, C.; Brintazzoli, G.; Gordts, S.; Soetens, E.; Bussche, E.V.D. Short- and long-term effects of conscious, minimally conscious and unconscious brand logos. PLoS ONE 2013, 8, e57738. [Google Scholar] [CrossRef] [Green Version]
  20. Salvi, C.; Simoncini, C.; Grafman, J.; Beeman, M. Oculometric signature of switch into awareness? Pupil size predicts sudden insight whereas microsaccades predict problem solving via analysis. NeuroImage 2020, 217, 116933. [Google Scholar] [CrossRef]
  21. Kounios, J.; Beeman, M. The cognitive neuroscience of insight. Annu. Rev. Psychol. 2014, 65, 71–93. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Reber, P.J.; Kounios, J. Neural Activity When People Solve Verbal Problems with Insight. PLoS Biol. 2004, 2, 500–510. [Google Scholar]
  23. Lytaev, S. Neurocognitive Indicators of Insight According to P300 and Later Visual ERP Components. Adv. Neuroergon. Cognit. Eng. Lect. Notes Netw. Syst. 2021, 259, 186–193. [Google Scholar]
  24. Rothmaler, K.; Nigburb, R.; Ivanova, G. New insights into insight: Neurophysiological correlates of the difference between the intrinsic “aha” and the extrinsic “oh yes” moment. Neuropsychologia 2017, 95, 204–214. [Google Scholar] [CrossRef] [PubMed]
  25. Sandkühler, S.; Bhattacharya, J. Deconstructing insight: EEG correlates of insightful problem solving. PLoS ONE 2008, 3, e1459. [Google Scholar] [CrossRef] [PubMed]
  26. Metuki, N.; Sela, T.; Lavidor, M. Enhancing cognitive control components of insight problems solving by anodal tDCS of the left dorsolateral prefrontal cortex. Brain Stimul. 2012, 5, 110–115. [Google Scholar] [CrossRef] [PubMed]
  27. Dietrich, A.; Kanso, R. A review of EEG, ERP, and neuroimaging studies of creativity and insight. Psychol. Bull. 2010, 136, 822–848. [Google Scholar] [CrossRef]
  28. Khil’ko, V.A.; Shostak, V.I.; Khlunovskii, A.N.; Lytaev, S.A. The topographic mapping of evoked bioelictrical activity and others methods for the functional neural vizualization of the brain/Topograficheskoe kartirovanie vyzvannoi bioelektricheskoi aktivnosti i drugie metody funktional’noi neirovizualizatsii mozga. Vestn. Rossiiskoi Akad. Med. Nauk Rossiiskaia Akad. Med. Nauk 1993, 3, 36–41. [Google Scholar]
  29. Chikara, R.K.; Komarov, O.; Ko, L.W. Neural signature of event related N200 and P300 modulation in parietal lobe during human response inhibition. Int. J. Comput. Biol. Drug Des. 2018, 11, 171–182. [Google Scholar] [CrossRef]
  30. Qiu, J.; Li, H.; Yang, D.; Luo, Y.; Li, Y.; Wu, Z.; Zhang, Q. The neural basis of insight problem solving: An event-related potential study. Brain Cogn. 2008, 68, 100–106. [Google Scholar] [CrossRef]
  31. Qiu, J.; Li, H.; Jou, J.; Wu, Z.; Zhang, Q. Spatiotemporal cortical activation underlies mental preparation for successful riddle solving: An event-related potential study. Exp. Brain Res. 2008, 186, 629–634. [Google Scholar] [CrossRef] [PubMed]
  32. Shen, W.; Liu, C.; Zhang, X.; Zhao, X.; Zhang, J.; Yuan, Y.; Chen, Y. Right hemispheric dominance of creative insight: An event-related potential study. Creat. Res. J. 2013, 25, 48–58. [Google Scholar] [CrossRef]
  33. Lytaev, S. Modeling and estimation of physiological, psychological and sensory indicators for working capacity. Adv. Intell. Syst. Comput. 2021, 1201, 207–213. [Google Scholar]
  34. Kashevnik, A.; Othman, W.; Ryabchikov, I.; Shilov, N. Estimation of motion and respiratory characteristics during the meditation practice based on video analysis. Sensors 2021, 21, 3771. [Google Scholar] [CrossRef]
  35. Klimesch, W.; Sauseng, P.; Hanslmayr, S.; Gruber, W.; Freunberger, R. Event-related phase reorganization may explain evoked neural dynamics. Neurosci. Biobehav. Rev. 2007, 31, 1003–1016. [Google Scholar] [CrossRef]
  36. Salvi, C.; Bricolo, E.; Franconeri, S.L.; Kounios, J.; Beeman, M. Sudden insight is associated with shutting out visual inputs. Psychon. Bull. Rev. 2015, 22, 1814–1819. [Google Scholar] [CrossRef] [Green Version]
  37. Oh, Y.; Chesebrough, C.; Erickson, B.; Zhang, F.; Kounios, J. An insight-related neural reward signal. NeuroImage 2020, 214, 116757. [Google Scholar] [CrossRef]
  38. Tik, M.; Sladky, S.; Luft, C.D.B.; Willinger, D.; Hoffmann, A.; Banissy, M.J.; Bhattacharya, J.; Windischberger, C. Ultra-high-field fMRI insights on insight: Neural correlates of the Aha!-moment. Hum. Brain Mapp. 2018, 39, 3241–3252. [Google Scholar] [CrossRef]
  39. Shen, W.; Bai, H.; Ball, L.J.; Yuan, Y.; Wang, M. What makes creative advertisements memorable? The Role of Insight. Psychol. Res. 2020, 85, 2538–2552. [Google Scholar] [CrossRef]
  40. Zhou, S.; Yin, Y.; Yu, T.; Stupple, E.J.N.; Luo, J. Exploring the experience of novelty when viewing creative adverts: An ERP study. Front. Psychol. 2018, 9, 471. [Google Scholar] [CrossRef] [Green Version]
Figure 1. (a) The visual evoked potential (numbers—time, ms) and distribution of the VEP (b) according to the 10/20 system during the perception of an unrecognizable (oddball) visual image. Analysis time: 1000 ms.
Figure 1. (a) The visual evoked potential (numbers—time, ms) and distribution of the VEP (b) according to the 10/20 system during the perception of an unrecognizable (oddball) visual image. Analysis time: 1000 ms.
Sensors 22 01323 g001
Figure 2. VEP distribution by the 10/20 system with correct recognition of images-illusions. Analysis epoch: 1000 ms.
Figure 2. VEP distribution by the 10/20 system with correct recognition of images-illusions. Analysis epoch: 1000 ms.
Sensors 22 01323 g002
Figure 3. VEP distribution by the 10/20 system with correct recognition of one of the images-illusions. Analysis epoch: 1000 ms.
Figure 3. VEP distribution by the 10/20 system with correct recognition of one of the images-illusions. Analysis epoch: 1000 ms.
Sensors 22 01323 g003
Figure 4. VEP distribution by the 10/20 system with unrecognition of images-illusions. Analysis epoch: 1000 ms.
Figure 4. VEP distribution by the 10/20 system with unrecognition of images-illusions. Analysis epoch: 1000 ms.
Sensors 22 01323 g004
Figure 5. The general directions, methods, and problems of insight research.
Figure 5. The general directions, methods, and problems of insight research.
Sensors 22 01323 g005
Table 1. Quantitative characteristics of answer options in experiments with the presentation of dual visual images-illusions and correct identification of the oddball image.
Table 1. Quantitative characteristics of answer options in experiments with the presentation of dual visual images-illusions and correct identification of the oddball image.
Answer OptionsFull IdentificationIdentification of One ImageUnrecognitionOddball Image Identification
Number of responses815127
Table 2. Amplitude (A, uV) and time (T, ms) characteristics of the component N150 ERP.
Table 2. Amplitude (A, uV) and time (T, ms) characteristics of the component N150 ERP.
ParametersSitesN150
ControlRecognition IllusionsUnrecognition Illusions
TO2161.3 ± 14.9156.6 ± 22.9
A 8.7 ± 3.47.4 ± 2.6
TO1157.0 ± 15.6146.5 ± 26.5
A 10.4 ± 3.77.2 ± 3.8n/a
TPz144.0 ± 15.7133.3 ± 18.6
A 10.9 ± 3.512.6 ± 4.0F < 4.0
TC4136.3 ± 12.7133.3 ± 22.0
A 14.2 ± 4.511.1 ± 1.7
TC3132.6 ± 13.8131.6 ± 15.0
A 14.6 ± 4.39.4 ± 3.8 *
TF4135.3 ± 14.9135.8 ± 25.7
A 11.7 ± 3.68.5 ± 3.0
TF3131.0 ± 14.9133.3 ± 17.5
A 13.0 ± 3.28.6 ± 3.6 *
Notes: T: time, ms; A: amplitude, uV; O2, O1…F3: sites on the 10/20 system; n/a: not applicable. The differences are not significant compared to the control group. The F-statistic value by compared to the control: * F > 4.0; in others, the differences are insignificant: F < 4.0.
Table 3. Amplitude (A, uV) and time (T, ms) characteristics of the component N350 ERP.
Table 3. Amplitude (A, uV) and time (T, ms) characteristics of the component N350 ERP.
ParametersSitesN350
ControlRecognition IllusionsUnrecognition Illusions
TO2364.0 ± 59.3291.6 ± 47.8 *
A 2.8 ± 0.55.3 ± 2.4 *
TO1371.6 ± 59.3316.6 ± 46.6 *
A 2.7 ± 0.84.1 ± 1.4 *
TPz374.0 ± 60.7300.8 ± 57.3 *
A 2.8 ± 0.84.6 ± 2.6n/a
TC4371.3 ± 57.1300.0 ± 68.8 *
A 2.9 ± 1.24.5 ± 2.0F < 4.0
TC3369.7 ± 56.0335.0 ± 27.2
A 2.9 ± 1.43.7 ± 1.1
TF4367.6 ± 64.6305.0 ± 77.3
A 3.0 ± 1.14.6 ± 2.3
TF3362.6 ± 65.5302.5 ± 78.5
A 3.2 ± 1.34.6 ± 2.1
Notes: T: time, ms; A: amplitude, uV; O2, O1…F3: sites on the 10/20 system; n/a: not applicable. The differences are not significant compared to the control group. The F-statistic value by compared to the control: * F > 4.0; in others, the differences are insignificant: F < 4.0.
Table 4. Amplitude (A, uV) and time (T, ms) characteristics of the component N450 ERP.
Table 4. Amplitude (A, uV) and time (T, ms) characteristics of the component N450 ERP.
ParametersSitesN450
ControlRecognition IllusionsUnrecognition Illusions
TO2461.6 ± 42.7450.0 ± 43.3461.6 ± 42.7
A 3.0 ± 1.34.1 ± 1.15.0 ± 1.3 *
TO1466.0 ± 37.9460.0 ± 39.3466.0 ± 37.9
A 2.9 ± 1.24.3 ± 1.6 *4.9 ± 1.2 *
TPz464.6 ± 40.3460.8 ± 40.9464.6 ± 40.3
A 3.5 ± 1.53.6 ± 2.35.5 ± 1.5 *
TC4459.7 ± 42.0450.8 ± 44.5459.7 ± 42.0
A 3.8 ± 1.84.3 ± 1.95.8 ± 1.8 *
TC3460.6 ± 40.8459.1 ± 40.1460.6 ± 40.8
A 4.0 ± 1.93.5 ± 2.25.0 ± 1.9 *
TF4456.2 ± 42.2470.8 ± 59.0456.2 ± 42.2
A 4.2 ± 1.52.8 ± 1.66.2 ± 2.5 **
TF3455.0 ± 44.3460.0 ± 41.5455.0 ± 44.3
A 4.5 ± 1.43.8 ± 2.16.5 ± 1.4 **
Notes: T: time, ms; A: amplitude, uV; O2, O1…F3: sites on the 10/20 system; n/a: not applicable. The differences are not significant compared to the control group. The F-statistic value by compared to the control: * F > 4.0; ** F > 10.0; in others, the differences are insignificant: F < 4.0.
Table 5. Amplitude (A, uV) and time (T, ms) characteristics of the component N750 ERP.
Table 5. Amplitude (A, uV) and time (T, ms) characteristics of the component N750 ERP.
ParametersSitesN750
ControlRecognition IllusionsUnrecognition Illusions
TO2767.0 ± 71.3724.1 ± 64.9767.0 ± 71.3
A 2.5 ± 0.83.6 ± 1.3 *2.3 ± 0.8
TO1774.6 ± 60.3724.1 ± 77.0774.6 ± 60.3
A 2.6 ± 1.02.9 ± 0.72.2 ± 1.0
TPz761.8 ± 62.4727.5 ± 65.4761.8 ± 62.4
A 2.7 ± 1.03.3 ± 1.03.7 ± 1.0 *
TC4754.0 ± 70.1725.0 ± 70.9754.0 ± 70.1
A 2.5 ± 1.44.0 ± 1.6 *3.5 ± 1.4 *
TC3766.3 ± 67.9724.1 ± 76.2766.3 ± 67.9
A 2.6 ± 1.33.5 ± 1.93.6 ± 1.3 *
TF4760.6 ± 64.3717.5 ± 78.4760.6 ± 64.3
A 2.1 ± 1.42.8 ± 0.54.1 ± 1.4 *
TF3762.3 ± 63.0716.6 ± 73.8762.3 ± 63.0
A 2.2 ± 1.03.0 ± 0.84.2 ± 1.2 *
Notes: T: time, ms; A: amplitude, uV; O2, O1…F3: sites on the 10/20 system; n/a: not applicable. The differences are not significant compared to the control group. The F-statistic value by compared to the control: * F > 4.0; in others, the differences are insignificant: F < 4.0.
Table 6. Amplitude (A, uV) and time (T, ms) characteristics of the component N900 ERP.
Table 6. Amplitude (A, uV) and time (T, ms) characteristics of the component N900 ERP.
ParametersSitesN900
ControlRecognition IllusionsUnrecognition Illusions
TO2925.6 ± 38.0 925.6 ± 38.0
A 2.8 ± 1.2 2.4 ± 1.2
TO1922.6 ± 42.1 922.6 ± 42.1
A 2.5 ± 1.3n/a2.2 ± 1.0
TPz921.0 ± 35.1 921.0 ± 35.1
A 2.8 ± 1.2 3.8 ± 1.2 *
TC4929.0 ± 27.3F < 4.0929.0 ± 27.3
A 2.3 ± 0.9 4.3 ± 0.9 *
TC3931.3 ± 31.3 931.3 ± 31.3
A 2.4 ± 0.9 4.4 ± 0.9 *
TF4929.6 ± 30.5 929.6 ± 30.5
A 2.1 ± 1.1 4.1 ± 1.1 *
TF3927.6 ± 30.1 927.6 ± 30.1
A 2.1 ± 1.6 5.1 ± 1.6 *
Notes: T: time, ms; A: amplitude, uV; O2, O1…F3: sites on the 10/20 system; n/a: not applicable. The differences are not significant compared to the control group. The F-statistic value by compared to the control: * F > 4.0; in others, the differences are insignificant: F < 4.0.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Lytaev, S. Long-Latency Event-Related Potentials (300–1000 ms) of the Visual Insight. Sensors 2022, 22, 1323. https://doi.org/10.3390/s22041323

AMA Style

Lytaev S. Long-Latency Event-Related Potentials (300–1000 ms) of the Visual Insight. Sensors. 2022; 22(4):1323. https://doi.org/10.3390/s22041323

Chicago/Turabian Style

Lytaev, Sergey. 2022. "Long-Latency Event-Related Potentials (300–1000 ms) of the Visual Insight" Sensors 22, no. 4: 1323. https://doi.org/10.3390/s22041323

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop