Next Article in Journal
Ambiguity of Residual Constraint-Based Precise Point Positioning with Partial Ambiguity Resolution under No Real-Time Network Corrections Using Real Global Positioning System (GPS) Data
Previous Article in Journal
Enhanced Infrared Absorbance of the CMOS Compatible Thermopile by the Subwavelength Rectangular-Hole Arrays
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Sensors
Volume 20
Issue 11
10.3390/s20113219
sensors-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Multimodal Analysis Combining Behavioral Experiments and Survey-Based Methods to Assess the Cognitive Effect of Video Game Playing: Good or Evil?

by
Ji Hyeok Jeong
1,
Hyun-Jung Park
1,
Sang-Hoon Yeo
2,* and
Hyungmin Kim
1,*
1
Center for Bionics, Biomedical Research Institute, Korea Institute of Science and Technology, Seoul 02792, Korea
2
School of Sport, Exercise and Rehabilitation Sciences, University of Birmingham, Birmingham B15 2TT, UK
*
Authors to whom correspondence should be addressed.
Sensors 2020, 20(11), 3219; https://doi.org/10.3390/s20113219
Submission received: 3 May 2020 / Revised: 1 June 2020 / Accepted: 3 June 2020 / Published: 5 June 2020
(This article belongs to the Section Biomedical Sensors)
Browse Figures
Versions Notes

Abstract

:
This study aims to bridge the gap between the discrepant views of existing studies in different modalities on the cognitive effect of video game play. To this end, we conducted a set of tests with different modalities within each participant: (1) Self-Reports Analyses (SRA) consisting of five popular self-report surveys, and (2) a standard Behavioral Experiment (BE) using pro- and antisaccade paradigms, and analyzed how their results vary between Video Game Player (VGP) and Non-Video Game Player (NVGP) participant groups. Our result showed that (1) VGP scored significantly lower in Behavioral Inhibition System (BIS) than NVGP (p = 0.023), and (2) VGP showed significantly higher antisaccade error rate than NVGP (p = 0.005), suggesting that results of both SRA and BE support the existing view that video game play has a maleficent impact on the cognition by increasing impulsivity. However, the following correlation analysis on the results across individual participants found no significant correlation between SRA and BE, indicating a complex nature of the cognitive effect of video game play.

1. Introduction

On 24 May 2019, the committee of the World Health Organization (WHO) unanimously agreed to include video game addiction in the 11th edition of the International Classification Diseases (ICD-11) as a disease. WHO claimed that this decision is based on reviews of the available evidence and reflects a consensus of experts from different disciplines and geographical regions [1]. However, the decision has provoked substantial debates on whether video gaming should be devalued as a harmful or addictive activity, like gambling, that potentially leads to disease.
As pointed out by the WHO, there are studies emphasizing the addictiveness of video gaming and resulting health problems [2,3,4]. The Internet Gaming Disorder (IGD) group may experience health issues such as sleep deprivation, impulsivity and emotional disorders [5,6,7], and can be associated with neuroticism, low extraversion, and decreased conscientiousness [8,9]. On the other hand, opponents of WHO’s decision argue that there is a significant lack of scientific evidence or clear consensus defining symptoms of gaming addiction [10,11,12,13,14,15] and that this seemingly hasty decision could result in major social problems caused by faulty diagnoses and treatments, or by devastating impacts on the video game and related industries. Furthermore, they claimed that normal video game players could in fact benefit from several positive effects of video gaming, including cognitive enhancement or stress relief [16,17].
From a methodological point of view, studies on the psychological effects of video game playing can be largely divided into two groups: (1) Self-Report Analysis (SRA) studies and (2) Behavioral Experiment (BE) studies. The first group of studies mainly incorporates self-report surveys that are widely used in psychiatric [5,8,9,18,19,20,21,22,23,24,25] and behavioral studies [26,27,28,29], and aims to quantify how video game affects the quality of life. As far as we know, the results of such studies unanimously suggest that video game players score significantly worse in psychiatric scales, such as Brief Self-Control Scale (BSCS) [20,21,23] and Barratt Impulsiveness Scale (BIS-11) [19,25], indicating that video game players develop addictive, compulsive and antisocial behaviors that can potentially reduce the quality of life.
On the other hand, the second group of studies is mainly focused on how video game changes the cognitive performance factors related to perception, memory, attention, and sensorimotor control. Unlike the self-report-based studies mentioned above, this line of studies primarily takes quantitative, behavioral experiment, using psychometric measures such as sensory acuities [30,31,32], attention and memory capacities [33,34,35,36] or reaction times [37,38], in order to quantify the influences of video gaming on cognitive abilities. Interestingly, the results of such studies tend to advocate the efficacy of video gaming to improve cognitive performance and mental health. In particular, a series of studies have shown that video gaming has a positive effect on top-down inhibition and cognitive performance [39,40,41,42,43,44,45], which exhibits a sharp contrast to the results of the aforementioned self-report-based studies.
Notwithstanding this clear contradiction, only a few studies (for example, Littel et al. [46], Azizi et al. [47]) have attempted to reconcile this conflict between SRA- and BE-based studies. Interestingly, these conflicting results from two methods seem to be cited rather selectively by follow-up or related studies in order to support their own argument, and therefore are likely to contribute to the serious babelization in this field. For this reason, we propose an integrated, multimodal approach combining assessments based on existing SRA and BE. First, we combine five representative questionnaires commonly used to assess or diagnose the psychological states of video game players (see Materials and Methods for details). The results of these assessments will be compared with the result of antisaccade experiment, a widely used behavioral measure of response inhibition [48], obtained from the same participants. The correlation between self-report scores and antisaccade performance measures will be analyzed using multimodal statistical analysis. Through this approach, our study aims to bridge the gap between the findings of two different research frameworks and to provide a unified view of the neurocognitive effect of video games and its implications.

2. Materials and Methods

2.1. Participants

Naive and young participants (n = 30, 10 females, age = 25.3 ± 2.6 years, range = 21–33) were recruited from the Korea Institute of Science and Technology (KIST) and surrounding university through KIST’s recruitment announcement. Participants were divided into two groups based on their video gaming frequencies [37]. Those who have been playing video games for more than one hour per week over a year were categorized as Video Game Player (VGP, n = 18, 1 female) group and the rest were categorized as Non-Video Game Players (NVGP, n = 12, 9 females). On average, video game play time of the VGP group was 6.78 ± 3.9 h per week, while that of the NVGP group was 0.04 ± 0.14 h per week. There was no significant age difference between the two groups (p = 0.798, Wilcoxon–Mann–Whitney test). The experiment was conducted in the Korea Institute of Science and Technology and the institutional ethics board has approved the study (IRB No. 2018-016).

2.2. Saccade Experiment

2.2.1. Experimental Setup

Participants were seated comfortably on a chair and looked at a high-speed LED screen (120 Hz refresh rate) in front. The screen was 32 inches in size and placed 70 cm away from the participants, and the height of the chair was adjusted so that its center aligned to the participant’s eye level. To prevent head movement, the participant’s head was fixed using a custom-made chin rest. The experiment was conducted in a dark, soundproofed room, where no light source other than the screen was available.

2.2.2. Experimental Design

Stimuli were presented using MATLAB Psychophysics Toolbox Version 3 [49]. Fixation target was displayed as a black circle (radius = 0.6°) with a grey bull’s eye (radius = 0.18°) on a light-grey (RGB value 127, 127, 127) background. When a trial started, a target appeared at the center of the screen, and participants were asked to fixate on the target. The duration of the fixation for each trial was randomly sampled from a non-ageing distribution [50] in order to discourage participants’ prediction of the remaining time, but the minimum and maximum waiting time were set to be 2.0 and 3.5 s respectively for practicality. After the fixation period ended, the target disappeared for 0.2 s as a gap period [51,52], and reappeared either on the left or on the right side of the screen for 1.0 s until the end of the trial. The distances from the center to the reappeared target were 6.5 cm (13.3°). Figure 1 (bottom left) summarizes the trial design.
The experiment consists of two types of trials: prosaccade and antisaccade. In prosaccade trials, when the target jumped to the left or right, participants were asked to make an eye movement toward the new target position as soon as possible. In the antisaccade trials, participants were asked to make the same saccadic movement, but toward the mirrored position of the target. Both prosaccade and antisaccade trials are sketched in Figure 1 (bottom right). The whole experiment consisted of five blocks of prosaccade and antisaccade trials in total. Participants first performed sixty-four prosaccade trials (block 1), followed by three consecutive blocks of forty antisaccade trials (blocks 2–4) and another sixty-four prosaccade trials (block 5). For each block, the same number of left and right targets appeared in a randomized order. Participants took three minutes break in-between the blocks [50]. Overall, each participant completed a total of 248 trials, consisting of 128 prosaccade and 120 antisaccade trials (Figure 1, top).
Throughout the experiment, the participant’s horizontal eye movements were recorded using an electrooculogram (EOG). Two electrodes were placed at both sides of the eye around the temple, with the anode on the left and cathode on the right, and the ground electrode was placed in the glabella. A commercial amplifier (ECG100C, IPS100C-1, BIOPAC, Goleta, CA, USA) and a data acquisition board (USB-6001, National Instruments, Austin, TX, USA) were used to record EOG with a sampling rate of 1 kHz.

2.2.3. Data Processing

Before analysis, EOG data were low pass filtered (Butterworth with a cutoff frequency at 30 Hz). Reaction time (RT) was determined by the time difference between the time when the target reappeared (time = 0) and the moment when a corresponding saccade was initiated. To avoid the effect of baseline drift commonly observed in EOG signals, a heuristic filter was used, similar to the ones used in previous studies [53,54]. In the heuristic filter, the signal is divided into a monotone increasing (f(X)) and monotone decreasing (g(X)), and then combined (h(X)). If heuristic filtered signal (h(X)) exceeds Threshold (±0.2, fixed value), it is determined that saccade occurred (see Figure 2a). Then, in order to find RT, we found the nearest point where monotone increasing and monotone decreasing intersect (h(X) = 0) from the point where saccade occurred (see Figure 2b). At this time, the left and right saccades are judged through a positive and negative value of EOG.
If a saccade was made toward the opposite direction of the target, it was classified as a direction error trial. The frequency of direction error trials over the experiment is quantified as an error rate [55]. Some trials were excluded from the statistics as outliers if saccade detected within 50 ms after the target moved, or if no saccade could be detected within 800 ms [51]. These excluded trials were 4.18 ± 4.19% over the total participants, and the difference between VGP (5.35 ± 4.48%) and NVGP (2.42 ± 3.11%) was not significant (p = 0.065, Wilcoxon–Mann–Whitney test). In the prosaccade task, the prosaccade error rate was too low to give meaningful statistics.

2.3. Self-Report Surveys

Five surveys have been measured for analysis based on the SRA framework: Brief Self-Control Scale (BSCS), Behavioral Activation System and Behavioral Inhibition System (BIS/BAS), Barratt Impulsiveness Scale (BIS-11), Beck Depression Inventory (BDI-II), Beck Anxiety Inventory (BAI). The BSCS is a measure of individual differences in self-control [56]. BSCS consists of 13 items on the 5-point Likert scale from 1 (strongly disagree) to 5 (strongly agree). The BIS/BAS measure two motivational systems that control behavior and contribute to determining human personality [57]. BIS/BAS consists of 20 items on the 4-point Likert scale from 1 (very true for me) to 4 (very false for me). In order to measure impulsivity, BIS-11-R [58], which is the revised version of BIS-11 [59], was used. BIS-11-R consists of 30 items on the 4-point Likert scale from 1 (very true for me) to 4 (very false for me). The scale is scored to a total score, three second-order factors, and six first-order factors. In this study, we use the total score. BDI-II is a revision of the BDI [60], and it has 21 items on the 4-point Likert scale from 0 (Not at all) to 3 (it bothered me a lot). If the total score is high, it can be diagnosed as having severe depressive symptoms. BAI [61] has 21 items on the 4-point Likert scale from 0 (Not at all) to 3 (it bothered me a lot). For all surveys, higher total scores indicate more severe symptoms.

3. Results

3.1. Behavioral Experiment Performance Measurements

3.1.1. Reaction Time (RT)

The difference in prosaccade RT between VGP and NVGP was statistically tested by student’s t-test. As shown in Figure 3 and Table 1, when comparing VGP (166.59 ± 28.48 ms) and NVGP (183.85 ± 29.90 ms), they did not show a significant difference (p = 0.122). The difference in antisaccade RT between VGP and NVGP was statistically tested by student’s t-test. When comparing VGP (228.30 ± 35.48 ms) and NVGP (243.99 ± 31.62 ms), they did not show a significant difference (p = 0.226). In addition, prosaccade RT was significantly faster than antisaccade RT for both VGP (p < 0.001) and NVGP (p < 0.001).

3.1.2. Error Rate

The error rate of prosaccade task did not show normality, but the error rate of antisaccade task show normality. Therefore, the prosaccade error rate between VGP and NVGP was compared by Wilcoxon–Mann–Whitney test, and the antisaccade error rate was compared by student’s t-test. As shown in Figure 3 and Table 1, the result showed that the error rate of VGP (3.4 ± 2.42%) in the prosaccade test is not significantly different (p = 0.085) from that of NVGP (1.78 ± 1.76%), while the error rate of VGP (17.42 ± 12.33%) in the antisaccade test is significantly higher (p = 0.005) than that of NVGP (7.37 ± 4.69%).

3.2. Self-Report Surveys

3.2.1. Brief Self-Control Scale (BSCS)

The self-report surveys’ score of BSCS in VGP, NVGP was statistically compared by student’s t-test. As shown in Table 1, when comparing VGP (37.66 ± 4.58) and NVGP (36.92 ± 5.42) in BSCS’s score, they did not show any significant difference (p = 0.686).

3.2.2. Behavioral Activation System and Behavioral Inhibition System (BIS/BAS)

In BIS/BAS, self-report surveys’ total scores of BIS and BAS were statistically compared by student’s t-test. As shown in Table 1, when comparing VGP (15.5 ± 3.17/26.22 ± 5.09) and NVGP (18 ± 2.09/26.33 ± 5.19) in BIS/BAS’s total scores, BIS showed a significant difference (p = 0.023), however, BAS did not show a significant difference (p = 0.954).

3.2.3. Barratt Impulsiveness Scale (BIS-11-R)

In BIS-11-R, self-report surveys’ score was statistically compared by student’s t-test. As shown in Table 1, when comparing VGP (61.33 ± 10.85) and NVGP (59.75 ± 11.09) in BIS-11-R’s score, they did not show a significant difference (p = 0.701).

3.2.4. Beck Depression Inventory (BDI-II)

In BDI-II, self-report surveys’ score was statistically compared by student’s t-test. As shown in Table 1, when comparing VGP (10.39 ± 7.06) and NVGP (8.83 ± 5.89) in BDI-II’s score, they did not show a significant difference (p = 0.534). There was no participant over the cutoff score of severe depression [62].

3.2.5. Beck Anxiety Inventory (BAI)

In BAI, self-report surveys’ score did not show normality. Therefore, the score was compared by Wilcoxon–Mann–Whitney test. As shown in Table 1, when comparing VGP (5.83 ± 6.11) and NVGP (5.42 ± 3.6) in BAI’s score, they did not show a significant difference (p = 0.671). There was no participant over the cutoff score of severe anxiety [63].

3.3. Correlation Analysis of the Behavioral Experiment Performance Measurements and the Self-Report Surveys

Pearson correlation analysis was conducted to investigate the correlation between the performance measures of the saccade tasks (RT and error rate) and the results of the self-report surveys. As shown in Table 2, no significant correlation was observed between the measurements of the saccade task and the score of the self-report surveys.
In the correlation between variables in the saccade task, highly significant correlations were observed between the prosaccade RT and the antisaccade RT for all groups (all participants: r = 0.74, p < 0.001, VGP: r = 0.72, p < 0.001, NVGP: r = 0.73, p = 0.007). There was also a significant correlation between the prosaccade RT and antisaccade error rate for all participants and VGP groups (all participants: r = −0.5, p = 0.005, VGP: r = −0.55, p = 0.017), but not for NVGP group (NVGP: r = −0.15, p = 0.647). As shown in Table 2, the antisaccade RT and antisaccade error rate did not have a significant overall correlation.
In the correlation analysis between variables in the self-report, the significant correlation was observed for all participants group between BSCS and BIS-11-R (r = 0.49, p = 0.006), BSCS and BIS (r = −0.48, p = 0.008), BIS-11-R and BDI-II (r = 0.4, p = 0.029), BIS-11-R and BIS (r = −0.42, p = 0.02), BIS-11-R and BAS (r = −0.43, p < 0.018), BDI-II and BAI (r = 0.43, p = 0.019), BIS and BAS (r = 0.46, p = 0.01). Specifically, there was significant correlation BIS and BAS for VGP and NVGP groups (VGP: r = 0.48, p = 0.041, NVGP: r = 0.58, p = 0.049), while in contrast, there was no significant correlation between BIS-11-R and BDI-II (VGP: r = 0.4, p = 0.096, NVGP: r = 0.38, p = 0.226), BIS-11-R and BAS (VGP: r = −0.42, p = 0.083, NVGP: r = −0.45, p = 0.144), and BDI-II and BAI (VGP: r = 0.4, p = 0.104, NVGP: r = 0.53, p = 0.076) for VGP and NVGP groups. The correlation analysis between BSCS and BIS-11-R maintained a significant correlation in NVGP group but disappeared in VGP group (VGP: r = 0.34, p = 0.163, NVGP: r = 0.67, p = 0.018). In BSCS and BIS, significant correlation was maintained in VGP group but disappeared in NVGP group (VGP: r = −0.5, p = 0.037, NVGP: r = −0.54, p = 0.071). In BIS-11-R and BIS, significant correlation in VGP group was maintained but disappeared in NVGP group (VGP: r = -0.52, p = 0.029, NVGP: r = −0. 27, p = 0.395) (Table 2).

4. Discussion and Conclusions

To understand and reconcile the prominent discrepancies in evaluating the cognitive effect of video game playing, the present study directly compared the results of two representative frameworks (BE and SRA) that are widely used in the literature. As a typical test of the BE framework, we used the pro- and antisaccade task and statistically analyzed whether the video game playing has an effect of altering the RT and error rate of the saccadic tasks. For SRA, the same participants also completed five standardized self-report surveys that are normally used in the previous studies, with the same purpose of testing whether and how the video game playing affects the survey scores. As far as we are aware, this research is among few studies that directly compared, within and across participants, the effect of video game playing on the results of two different test frameworks and their correlations.

4.1. Behavioral Experiment Analysis on the Cognitive Effect of Video Game Playing

First, the VGP group showed significantly higher error rates during antisaccade trials than NVGP as shown in Figure 3 and Table 1. It is commonly believed that normal saccades are a mixture of two different types: (1) express saccades, fast reflexive saccades triggered by a direct stimulus–response mapping, and (2) regular saccades, slower saccades managed by a higher attentional control [48]. Since express saccades are less affected by higher-level task instructions and therefore are always triggered toward the stimulus, they should be effortfully inhibited during the antisaccade trials. For this reason, the higher number of erroneous antisaccades in the VGP group implies that VGPs are likely to generate more express saccades, or are likely to have greater difficulty inhibiting express saccades. In addition to the higher antisaccade error rates observed in VGPs, this interpretation is also supported by the following correlation analysis between saccade tasks, revealing a significant negative correlation between the prosaccade RT, where shorter RT implies a larger number of express saccades, and the antisaccade error rate in VGP, but not in NVGP. Therefore, the observed higher error rates of VGP groups can be interpreted as their weaker abilities in inhibitory control or, to some extent, an impulsivity problem [64].
Our result on the antisaccade error rate agrees well with the results of a group of studies on the impulse control characteristics of VGPs [46,65,66], which supported the idea that VGPs suffer an increased level of impulsivity [37,46,47]. This is also confirmed by neuroimaging studies demonstrating that video game playing can adversely affect regions in the frontal lobe that are involved in impulse control [6,7] and other mental functions related to IGD [67,68,69]. On the other hand, it is also important to point out that our result clearly dissents from another group of studies claiming that video game playing may improve perceptual–cognitive skills without any negative effect on the impulsiveness [34,37,39,70]. Therefore, our result of the saccadic experiment supports the idea that video game playing has a detrimental effect on cognition, and the effect is related to impulsivity.
While antisaccade error rates were different between VGPs and NGVPs, neither pro- nor antisaccade RTs showed any significant difference between the two groups, although there was a marginal trend toward faster RT for the VGP group. Therefore, our result of RT analysis does not agree with those from the literature that reported significantly faster RTs of VGPs [37,47]. It should be noted, however, that such discrepancy could have been simply caused by differences in task difficulty or data processing method; compared to our pro- and antisaccade tasks that followed rather standardized protocols in neuroscience studies [50], both pro- and antisaccade experiments used by Mack and Ilg [37] were substantially more difficult, including mixed pro- and antisaccade conditions within the same block with four targets (instead of two in our study) and additional double-step requirement. Indeed, the RTs detected by Mack and Ilg [37] tend to be substantially longer than the known RTs of human pro- and antisaccade [71]. Additionally, while the control group’s antisaccade error rate in our study was 7.4%, which is within the range of normally reported error rates [48], those reported by in Mack and Ilg [37] were noticeably higher, ranging from 30% to 40%. It is, therefore, possible that the greater task difficulty of their study might have an effect of amplifying the marginal trend observed in our study. Interestingly, the follow-up study by the same group [38] suggested that the observed effect of video game playing is likely to be caused by the change in higher cognitive processes, which supports the idea that the difference in RTs may become more prominent in cognitively more demanding tasks. In terms of the data processing method, it is important to point out that Mack and Ilg [37] included RTs of erroneous antisaccades when analyzing the prosaccade RT. Since erroneous antisaccades are likely to be express saccades and therefore are likely to have shorter RTs, this extra data processing may have an effect of altering the statistics of RT. The study by Azizi et al. [47] includes only a small number of antisaccade trials (60 trials for each participant), which makes it difficult to be compared with our result.
Apart from the video game playing studies, another point to notice is that our results fit very well with the result of studies on the Attention Deficit Hyperactivity Disorder (ADHD). A group of studies focused on how ADHD affects the saccadic performance showed that ADHD only affects the error rate but not RT [48,72,73], which is identical to our findings. This link between ADHD and video game playing can be easily speculated because ADHD is known to be primarily related to deficits in inhibitory control [74], and also it was confirmed by neuroimaging studies that ADHD impedes the activation of inhibitory brain areas such as the dorsolateral prefrontal cortex or superior parietal lobe [75], which play central roles in saccadic control. This raises a new research question of investigating the potential of using BEs to understand the relationship between video game playing and ADHD.

4.2. Self-Report Survey Analysis on the Cognitive Effect of Video Game Playing

The result of SRA on the same set of participants showed that VGP has significantly lower BIS scores than NVGP, while no difference between VPG and NVGP was observed in the other four surveys (see Table 1). Regarding the BIS/BAS scores, Quay [76,77] argued that high BAS scores would trigger extreme responses to reward signals, contributing to the development of aggressive behaviors such as behavioral disorders, and low BIS scores will contribute to the development of ADHD due to their low sensitivities of punishment clue associated with anxiety. In addition, Wang et al.’s study [78] interpreted that the higher the BIS score indicates the higher behavioral inhibition and predisposing characteristic of social anxiety [79,80,81]. Based on these interpretations, the low BIS scores in our SRA results correlated with low behavioral inhibition and ADHD, which may be interpreted as correlated with the above BE results.
However, the lower BIS score in our study is different from other studies that show a higher BIS score [78] and a similar BIS score [21,82,83] compared to the standard BIS score. Further investigation would be needed in order to understand this conflict, but it is likely that such discrepancies were caused by the difference between selection criteria; while VGPs in BE-based studies [34,37,47], including ours, were classified based on video game usage time, VGPs in the SRA-based studies [21,78,82,83] were classified through questionnaires used to identify gaming-related mental disorders, indicating that more severe criteria were applied for SRA-based studies.
Indeed, in the study of Wang et al. [78], where the BIS score of the IGD group was significantly higher than the control group, the average weekly game play time significantly exceeded the other studies [21,82,83] that did not show a difference [78]: average 40 h, Park et al. [82]: 83.2% of participants do not exceed 8 h, Zvyagintsev et al. [83]: average 5 h, Na et al. [21]: average time does not exceed 10 h, and in our study: average 6.78 h). This can be seen in the results of other survey scales; in a study [23] using the BSCS scale, Chen and Leung [23] used BSCS to assess self-control, which indicated that self-control was associated with mobile game addiction but not mobile game use. Studies [20,84] using other surveys, including BIS-11, have also focused on identifying addicts by IGD.
In addition, only 22% of the VGP (4 out of 18) group in our study corresponded to the IGD of the DSM-5 and, based on our case, it is reasonable to assume that a large portion of VGPs recruited in the previous BE-based studies could be categorized as NVGP in the SRA-based studies. And considering the study [85,86,87] that only a small group of general gamers are IGDs, this implies that the main controversy between BE- and SRA-based studies on the cognitive effect of video game playing can potentially originate from the nonlinearity of participant, which requires further investigation.

4.3. Correlation Analysis between Behavioral-Experiment-Based and Self-Report-Based Analysis

Although both our BE and SRA consistently showed the cognitive effect of video game playing, the following correlation analyses in Table 2 have revealed that there was no significant correlation between the antisaccade task and the BIS score. In fact, such lack of correlation has also been participants of controversy in the previous studies [88,89,90,91]; while there are studies that found correlation [88] in the antisaccade error rate and the overall score of BIS-11, or only in the subscale of BIS-11 [89,91], other studies did not find any correlation including additional subscale of BIS-11 [90]. Similar to our argument above, it was pointed out that such discrepancy can possibly be due to a complex interaction between the participant recruitment criteria and the survey score [90]. Based on this interpretation, our result implies that no elements of BIS-11 could affect the antisaccade error rate in the VGP group.
Regarding the correlation analyses to the survey scores other than BIS, the results of the correlation analysis of BSCS and the saccadic parameters, which did not have a significant result, are consistent with the literature, suggesting that there was no negative transfer of executive control to the performance of antisaccade [92]. In addition, whereas previous studies have shown that depression or anxiety disorders affect the saccade task [93], the lack of correlations between saccadic parameters and the survey scores related to depression or anxiety disorders, BDI-II and BAI in our case, is understandable since no participant either in the VGP or in the NVGP group has exceeded the cutoff scores for those disorder criteria.
Notwithstanding the conflict in literature, it is still worthy to speculate on possible reasons for such decorrelations. First, it is noticeable that the variances of the antisaccade error rate in VGP and NVGP are significantly different (p = 0.002, Levene’s Test) as shown in Figure 4. The higher variance of VGP’s antisaccade error rate suggests that the effect of video game playing on the saccadic task could be highly heterogeneous, affecting only a portion of participants in the VGP group. This implies that the criteria used by existing studies, including ours, to classify VGPs based on the frequency of video game playing could be highly oversimplifying the possibly multi-dimensional nature of the video game’s cognitive effects, ignoring potential effects of the other parameters, such as the genre [21] or the contents [83] of the game.
There was some limitation of our study is the difference in gender ratio between groups. In fact, the lack of gender balance, i.e., a male dominancy, is one of the typical aspects characterizing the video game population [94]. This does not only make it practically difficult to recruit video game players while maintaining the gender balance, but also indicate that enforcing the gender balance of the participants could potentially distort the true characteristics of the video game player population. For these reasons, we did not consider gender balance like previous studies [37,47] and relied on a random selection process to eliminate methodological flaws [95]. This resulted in a pronounced unbalance in gender between our participant groups: the percentage of females in the NVGP group (75%) was substantially higher than that in the VGP group (6%). Although previous studies [58,96,97,98] consistently showed no gender differences, there are also studies suggesting the gender difference in the survey score [99,100] and the effect of video game playing [101,102,103], which remain future consideration. As with gender bias, some studies [104,105,106] have shown that caffeine has little effect on oculomotor testing, but the lack of screening for caffeine ingest by participants prior to the study should be supplemented in future studies.
In summary, our results of BE and SRA support the connection between video game and impulsivity. However, VGP’s distribution of antisaccade error rate is higher, and there is no correlation between the results of BE and SRA, suggesting that the cognitive effects of video games depend on a complex interplay between psychological and neurocognitive processes, and that the effects and domain vary widely from person to person. With these findings, the result of our study support the necessity of incorporating multimodal approaches to assess the effect of video game play.

Author Contributions

H.K. and S.-H.Y. were responsible for the study concept and design. J.H.J. and H.-J.P. contributed to the acquisition of participant data. J.H.J. performed the analyses. H.K. and S.-H.Y. assisted with the data analysis and interpretation of findings. J.H.J. drafted the manuscript. H.K. and S.-H.Y. provided critical revision of the manuscript for important intellectual content. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the Brain Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Science, ICT and Future Planning (2015M3C7A1064833) and the Institute of Information and Communications Technology Planning and Evaluation (IITP) grant funded by the Korea government (No. 2017-0-00432).

Conflicts of Interest

None of the authors have potential conflicts of interest to be disclosed.

References

  1. World Health Organization Home Page. Available online: http://www.who.int/en/ (accessed on 27 May 2020).
  2. Billieux, J.; King, D.L.; Higuchi, S.; Achab, S.; Bowden-Jones, H.; Hao, W.; Long, J.; Lee, H.K.; Potenza, M.N.; Saunders, J.B.; et al. Functional impairment matters in the screening and diagnosis of gaming disorder. J. Behav. Addict. 2017, 6, 285–289. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Saunders, J.B.; Hao, W.; Long, J.; King, D.L.; Mann, K.; Fauth-Bühler, M.; Rumpf, H.-J.; Bowden-Jones, H.; Rahimi-Movaghar, A.; Chung, T.; et al. Gaming disorder: Its delineation as an important condition for diagnosis, management, and prevention. J. Behav. Addict. 2017, 6, 271–279. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Rumpf, H.-J.; Achab, S.; Billieux, J.; Bowden-Jones, H.; Carragher, N.; Demetrovics, Z.; Higuchi, S.; King, D.L.; Mann, K.; Potenza, M.; et al. Including gaming disorder in the ICD-11: The need to do so from a clinical and public health perspective. J. Behav. Addict. 2018, 7, 556–561. [Google Scholar] [CrossRef] [PubMed]
  5. Achab, S.; Nicolier, M.; Mauny, F.; Monnin, J.; Trojak, B.; Vandel, P.; Sechter, D.; Gorwood, P.; Haffen, E. Massively multiplayer online role-playing games: Comparing characteristics of addict vs non-addict online recruited gamers in a French adult population. BMC Psychiatry 2011, 11, 156. [Google Scholar] [CrossRef] [Green Version]
  6. Ko, C.H.; Hsieh, T.J.; Wang, P.W.; Lin, W.C.; Yen, C.F.; Chen, C.S.; Yen, J.Y. Altered gray matter density and disrupted functional connectivity of the amygdala in adults with Internet gaming disorder. Prog. Neuro-Psychopharmacology Biol. Psychiatry 2015, 57, 185–192. [Google Scholar] [CrossRef]
  7. Weinstein, A.; Livny, A.; Weizman, A. New developments in brain research of internet and gaming disorder. Neurosci. Biobehav. Rev. 2017, 75, 314–330. [Google Scholar] [CrossRef]
  8. Müller, K.W.; Beutel, M.E.; Egloff, B.; Wölfling, K. Investigating risk factors for internet gaming disorder: A comparison of patients with addictive gaming, pathological gamblers and healthy controls regarding the big five personality traits. Eur. Addict. Res. 2014, 20, 129–136. [Google Scholar] [CrossRef]
  9. Zadra, S.; Bischof, G.; Besser, B.; Bischof, A.; Meyer, C.; John, U.; Rumpf, H.-J. The association between Internet addiction and personality disorders in a general population-based sample. J. Behav. Addict. 2016, 5, 691–699. [Google Scholar] [CrossRef] [Green Version]
  10. Griffiths, M.D.; van Rooij, A.J.; Kardefelt-Winther, D.; Starcevic, V.; Király, O.; Pallesen, S.; Müller, K.; Dreier, M.; Carras, M.; Prause, N.; et al. Working towards an international consensus on criteria for assessing internet gaming disorder: A critical commentary on Petry et al. (2014). Addiction 2016, 111, 167–175. [Google Scholar] [CrossRef] [Green Version]
  11. Aarseth, E.; Bean, A.M.; Boonen, H.; Colder Carras, M.; Coulson, M.; Das, D.; Deleuze, J.; Dunkels, E.; Edman, J.; Ferguson, C.J.; et al. Scholars’ open debate paper on the World Health Organization ICD-11 Gaming Disorder proposal. J. Behav. Addict. 2017, 6, 267–270. [Google Scholar] [CrossRef]
  12. Bean, A.M.; Nielsen, R.K.L.; van Rooij, A.J.; Ferguson, C.J. Video game addiction: The push to pathologize video games. Prof. Psychol. Res. Pr. 2017, 48, 378–389. [Google Scholar] [CrossRef] [Green Version]
  13. van Rooij, A.J.; Ferguson, C.J.; Colder Carras, M.; Kardefelt-Winther, D.; Shi, J.; Aarseth, E.; Bean, A.M.; Bergmark, K.H.; Brus, A.; Coulson, M.; et al. A weak scientific basis for gaming disorder: Let us err on the side of caution. J. Behav. Addict. 2018, 7, 1–9. [Google Scholar] [CrossRef] [PubMed]
  14. de Palo, V.; Monacis, L.; Sinatra, M.; Griffiths, M.D.; Pontes, H.; Petro, M.; Miceli, S. Measurement Invariance of the Nine-Item Internet Gaming Disorder Scale (IGDS9-SF) Across Albania, USA, UK, and Italy. Int. J. Ment. Health Addict. 2019, 17, 935–946. [Google Scholar] [CrossRef] [Green Version]
  15. Pontes, H.M.; Stavropoulos, V.; Griffiths, M.D. Emerging insights on internet gaming disorder: Conceptual and measurement issues. Addict. Behav. Rep. 2019, 11, 100242. [Google Scholar] [CrossRef]
  16. Kardefelt-Winther, D. A conceptual and methodological critique of internet addiction research: Towards a model of compensatory internet use. Comput. Hum. Behav. 2014, 31, 351–354. [Google Scholar] [CrossRef] [Green Version]
  17. Snodgrass, J.G.; Lacy, M.G.; Dengah, F.; Eisenhauer, S.; Batchelder, G.; Cookson, R.J. A vacation from your mind: Problematic online gaming is a stress response. Comput. Hum. Behav. 2014, 38, 248–260. [Google Scholar] [CrossRef]
  18. Gentile, D.A.; Choo, H.; Liau, A.; Sim, T.; Li, D.; Fung, D.; Khoo, A. Pathological Video Game Use Among Youths: A Two-Year Longitudinal Study. Pediatrics 2011, 127, e319–e329. [Google Scholar] [CrossRef] [Green Version]
  19. Swing, E.L.; Gentile, D.A.; Anderson, C.A.; Walsh, D.A. Television and Video Game Exposure and the Development of Attention Problems. Pediatrics 2010, 126, 214–221. [Google Scholar] [CrossRef] [Green Version]
  20. Rho, M.J.; Lee, H.; Lee, T.H.; Cho, H.; Jung, D.J.; Kim, D.J.; Choi, I.Y. Risk factors for internet gaming disorder: Psychological factors and internet gaming characteristics. Int. J. Env. Res. Public Health 2018, 15, 40. [Google Scholar] [CrossRef] [Green Version]
  21. Na, E.; Choi, I.; Lee, T.-H.; Lee, H.; Rho, M.J.; Cho, H.; Jung, D.J.; Kim, D.-J. The influence of game genre on Internet gaming disorder. J. Behav. Addict. 2017, 6, 248–255. [Google Scholar] [CrossRef] [Green Version]
  22. Müller, K.W.; Psych, D.; Dreier, M.; Soz, D.; Duven, E.; Giralt, S.; Beutel, M.E.; Wölfling, K. Adding clinical validity to the statistical power of large-scale epidemiological surveys on internet addiction in adolescence: A combined approach to investigate psychopathology and development-specific personality traits associated with internet addictio. J. Clin. Psychiatry 2017, 78, e244–e251. [Google Scholar] [CrossRef] [PubMed]
  23. Chen, C.; Leung, L. Are you addicted to Candy Crush Saga? An exploratory study linking psychological factors to mobile social game addiction. Telemat. Inform. 2016, 33, 1155–1166. [Google Scholar] [CrossRef]
  24. Beutel, M.E.; Hoch, C.; Wölfling, K.; Müller, K.W. Klinische merkmale der computerspiel- und internetsucht am beispiel der inanspruchnehmer einer spielsuchtambulanz. Z. Psychosom. Med. Psychother. 2011, 57, 77–90. [Google Scholar] [CrossRef] [PubMed]
  25. Bargeron, A.H.; Hormes, J.M. Psychosocial correlates of internet gaming disorder: Psychopathology, life satisfaction, and impulsivity. Comput. Hum. Behav. 2017, 68, 388–394. [Google Scholar] [CrossRef]
  26. Thorens, G.; Achab, S.; Billieux, J.; Khazaal, Y.; Khan, R.; Pivin, E.; Gupta, V.; Zullino, D. Characteristics and treatment response of self-identified problematic Internet users in a behavioral addiction outpatient clinic. J. Behav. Addict. 2014, 3, 78–81. [Google Scholar] [CrossRef] [Green Version]
  27. Sprong, M.E.; Griffiths, M.D.; Lloyd, D.P.; Paul, E.; Buono, F.D. Comparison of the video game functional assessment-revised (VGFA-R) and internet gaming disorder test (IGD-20). Front. Psychol. 2019, 10, 310. [Google Scholar] [CrossRef]
  28. Buono, F.D.; Sprong, M.E.; Lloyd, D.P.; Cutter, C.J.; Printz, D.M.B.; Sullivan, R.M.; Moore, B.A. Delay Discounting of Video Game Players: Comparison of Time Duration among Gamers. Cyberpsychology Behav. Soc. Netw. 2017, 20, 104–108. [Google Scholar] [CrossRef] [Green Version]
  29. Buono, F.D.; Upton, T.D.; Griffiths, M.D.; Sprong, M.E.; Bordieri, J. Demonstrating the validity of the Video Game Functional Assessment-Revised (VGFA-R). Comput. Hum. Behav. 2016, 54, 501–510. [Google Scholar] [CrossRef] [Green Version]
  30. Anguera, J.A.; Boccanfuso, J.; Rintoul, J.L.; Al-Hashimi, O.; Faraji, F.; Janowich, J.; Kong, E.; Larraburo, Y.; Rolle, C.; Johnston, E.; et al. Video game training enhances cognitive control in older adults. Nature 2013, 501, 97–101. [Google Scholar] [CrossRef] [Green Version]
  31. Oei, A.C.; Patterson, M.D. Enhancing Cognition with Video Games: A Multiple Game Training Study. PLoS ONE 2013, 8, e58546. [Google Scholar] [CrossRef]
  32. Steenbergen, L.; Sellaro, R.; Stock, A.K.; Beste, C.; Colzato, L.S. Action video gaming and cognitive control: Playing first person shooter games is associated with improved action cascading but not inhibition. PLoS ONE 2015, 10, e0144364. [Google Scholar] [CrossRef] [PubMed]
  33. Boot, W.R.; Kramer, A.F.; Simons, D.J.; Fabiani, M.; Gratton, G. The effects of video game playing on attention, memory, and executive control. Acta Psychol. 2008, 2, 226. [Google Scholar] [CrossRef] [PubMed]
  34. Green, C.S.; Bavelier, D. Learning, attentional control, and action video games. Curr. Biol. 2012, 22, R197–R206. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Ninaus, M.; Pereira, G.; Stefitz, R.; Prada, R.; Paiva, A.; Neuper, C.; Wood, G. Game elements improve performance in a working memory training task. Int. J. Serious Games 2015, 2, 3–16. [Google Scholar] [CrossRef] [Green Version]
  36. Chopin, A.; Bediou, B.; Bavelier, D. Altering perception: The case of action video gaming. Curr. Opin. Psychol. 2019, 29, 168–173. [Google Scholar] [CrossRef]
  37. Mack, D.J.; Ilg, U.J. The effects of video game play on the characteristics of saccadic eye movements. Vision Res. 2014, 102, 26–32. [Google Scholar] [CrossRef] [Green Version]
  38. Mack, D.J.; Wiesmann, H.; Ilg, U.J. Video game players show higher performance but no difference in speed of attention shifts. Acta Psychol. 2016, 169, 11–19. [Google Scholar] [CrossRef]
  39. Dye, M.W.G.; Green, C.S.; Bavelier, D. Increasing Speed of Processing With Action Video Games. Curr. Dir. Psychol. Sci. 2009, 18, 321–326. [Google Scholar] [CrossRef] [Green Version]
  40. Dye, M.W.G.; Green, C.S.; Bavelier, D. The development of attention skills in action video game players. Neuropsychologia 2009, 47, 1780–1789. [Google Scholar] [CrossRef] [Green Version]
  41. Chisholm, J.D.; Kingstone, A. Action video game players’ visual search advantage extends to biologically relevant stimuli. Acta Psychol. 2015, 159, 93–99. [Google Scholar] [CrossRef]
  42. Bediou, B.; Adams, D.M.; Mayer, R.E.; Tipton, E.; Green, C.S.; Bavelier, D. Meta-analysis of action video game impact on perceptual, attentional, and cognitive skills. Psychol. Bull. 2018, 144, 77–110. [Google Scholar] [CrossRef] [PubMed]
  43. West, G.L.; Al-Aidroos, N.; Pratt, J. Action video game experience affects oculomotor performance. Acta Psychol. 2013, 142, 38–42. [Google Scholar] [CrossRef] [PubMed]
  44. Cain, M.S.; Prinzmetal, W.; Shimamura, A.P.; Landau, A.N. Improved control of exogenous attention in action video game players. Front. Psychol. 2014, 5, 69. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Chisholm, J.D.; Kingstone, A. Improved top-down control reduces oculomotor capture: The case of action video game players. Atten. Percept. Psychophys. 2012, 74, 257–262. [Google Scholar] [CrossRef] [Green Version]
  46. Littel, M.; Van Den Berg, I.; Luijten, M.; Van Rooij, A.J.; Keemink, L.; Franken, I.H.A. Error processing and response inhibition in excessive computer game players: An event-related potential study. Addict. Biol. 2012, 17, 934–947. [Google Scholar] [CrossRef]
  47. Azizi, E.; Stainer, M.J.; Abel, L.A. Is experience in multi-genre video game playing accompanied by impulsivity? Acta Psychol. 2018, 190, 47–84. [Google Scholar] [CrossRef]
  48. Munoz, D.P.; Everling, S. Look away: The anti-saccade task and the voluntary control of eye movement. Nat. Rev. Neurosci. 2004, 5, 218–228. [Google Scholar] [CrossRef]
  49. Brainard, D.H. The Psychophysics Toolbox. Spat. Vis. 1997, 10, 433–436. [Google Scholar] [CrossRef] [Green Version]
  50. Antoniades, C.; Ettinger, U.; Gaymard, B.; Gilchrist, I.; Kristjánsson, A.; Kennard, C.; John Leigh, R.; Noorani, I.; Pouget, P.; Smyrnis, N.; et al. An internationally standardised antisaccade protocol. Vis. Res. 2013, 84, 1–5. [Google Scholar] [CrossRef] [Green Version]
  51. Saslow, M.G. Latency for saccadic eye movement. J. Opt. Soc. Am. 1967, 57, 1030–1033. [Google Scholar] [CrossRef]
  52. Reuter-Lorenz, P.A.; Oonk, H.M.; Barnes, L.L.; Hughes, H.C. Effects of warning signals and fixation point offsets on the latencies of pro- versus antisaccades: Implications for an interpretation of the gap effect. Exp. Brain Res. 1995, 103, 287–293. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  53. Stampe, D.M. Heuristic filtering and reliable calibration methods for video-based pupil-tracking systems. Behav. Res. Methods Instrum. Comput. 1993, 25, 137–142. [Google Scholar] [CrossRef] [Green Version]
  54. Behrens, F.; MacKeben, M.; Schröder-Preikschat, W. An improved algorithm for automatic detection of saccades in eye movement data and for calculating saccade parameters. Behav. Res. Methods 2010, 42, 701–708. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  55. Hallett, P.E. Primary and secondary saccades to goals defined by instructions. Vis. Res. 1978, 18, 1279–1296. [Google Scholar] [CrossRef]
  56. Tangney, J.P.; Baumeister, R.F.; Boone, A.L. High Self-Control Predicts Good Adjustment, Less Pathology, Better Grades, and Interpersonal Success. J. Pers. 2004, 72, 271–324. [Google Scholar] [CrossRef]
  57. Carver, C.S.; White, T.L. Behavioral Inhibition, Behavioral Activation, and Affective Responses to Impending Reward and Punishment: The BIS/BAS Scales. J. Pers. Soc. Psychol. 1994, 67, 319–333. [Google Scholar] [CrossRef]
  58. Lee, S.-R.; Lee, W.-H.; Park, J.-S.; Kim, S.-M.; Kim, J.-W.; Shim, J.-H. The Study on Reliability and Validity of Korean Version of the Barratt Impulsiveness Scale-11-Revised in Nonclinical Adult Subjects. J. Korean Neuropsychiatr. Assoc. 2014, 51, 378–386. [Google Scholar] [CrossRef] [Green Version]
  59. Patton, J.H.; Stanford, M.S.; Barratt, E.S. Factor structure of the barratt impulsiveness scale. J. Clin. Psychol. 1995, 51, 768–774. [Google Scholar] [CrossRef]
  60. Beck, A.T.; Steer, R.A.; Ball, R.; Ranieri, W.F. Comparison of Beck depression inventories -IA and -II in psychiatric outpatients. J. Pers. Assess. 1996, 67, 588–597. [Google Scholar] [CrossRef]
  61. Beck, A.T.; Epstein, N.; Brown, G.; Steer, R.A. An Inventory for Measuring Clinical Anxiety: Psychometric Properties. J. Consult. Clin. Psychol. 1988, 56, 893–897. [Google Scholar] [CrossRef]
  62. Kapci, E.G.; Uslu, R.; Turkcapar, H.; Karaoglan, A. Beck depression inventory II: Evaluation of the psychometric properties and cut-off points in a Turkish adult population. Depress. Anxiety 2008, 25, E104–E110. [Google Scholar] [CrossRef] [PubMed]
  63. Julian, L.J. Measures of Anxiety. Arthritis Care 2011, 63, S467–S472. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  64. Roberts, W.; Fillmore, M.T.; Milich, R. Separating automatic and intentional inhibitory mechanisms of attention in adults with attention-deficit/hyperactivity disorder. J. Abnorm. Psychol. 2011, 120, 223–233. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  65. Gentile, D.A.; Swing, E.L.; Lim, C.G.; Khoo, A. Video game playing, attention problems, and impulsiveness: Evidence of bidirectional causality. Psychol. Pop. Media Cult. 2012, 1, 62–70. [Google Scholar] [CrossRef] [Green Version]
  66. Deleuze, J.; Christiaens, M.; Nuyens, F.; Billieux, J. Shoot at first sight! First person shooter players display reduced reaction time and compromised inhibitory control in comparison to other video game players. Comput. Hum. Behav. 2017, 72, 570–576. [Google Scholar] [CrossRef] [Green Version]
  67. Dong, G.; Potenza, M.N. A cognitive-behavioral model of Internet gaming disorder: Theoretical underpinnings and clinical implications. J. Psychiatr. Res. 2014, 58, 7–11. [Google Scholar] [CrossRef] [Green Version]
  68. Fauth-Bühler, M.; Mann, K. Neurobiological correlates of internet gaming disorder: Similarities to pathological gambling. Addict. Behav. 2017, 64, 349–356. [Google Scholar] [CrossRef]
  69. Saunders, J.B.; Degenhardt, L.; Farrell, M. Excessive gambling and gaming: Addictive disorders? Lancet Psychiatry 2017, 4, 433–435. [Google Scholar] [CrossRef]
  70. Chisholm, J.D.; Hickey, C.; Theeuwes, J.; Kingstone, A. Reduced attentional capture in action video game players. Atten. Percept. Psychophys. 2010, 72, 667–671. [Google Scholar] [CrossRef] [Green Version]
  71. Leigh, R.J.; Zee, D.S. The Neurology of Eye Movements; Oxford University Press: Oxford, UK, 2015. [Google Scholar]
  72. Munoz, D.P.; Armstrong, I.T.; Hampton, K.A.; Moore, K.D. Altered Control of Visual Fixation and Saccadic Eye Movements in Attention-Deficit Hyperactivity Disorder. J. Neurophysiol. 2003, 90, 503–514. [Google Scholar] [CrossRef]
  73. Yep, R.; Soncin, S.; Brien, D.C.; Coe, B.C.; Marin, A.; Munoz, D.P. Using an emotional saccade task to characterize executive functioning and emotion processing in attention-deficit hyperactivity disorder and bipolar disorder. Brain Cogn. 2018, 124, 1–13. [Google Scholar] [CrossRef] [PubMed]
  74. Mulligan, R.C.; Knopik, V.S.; Sweet, L.H.; Fischer, M.; Seidenberg, M.; Rao, S.M. Neural correlates of inhibitory control in adult attention deficit/hyperactivity disorder: Evidence from the Milwaukee longitudinal sample. Psychiatry Res. Neuroimaging 2011, 194, 119–129. [Google Scholar] [CrossRef] [Green Version]
  75. Liu, G.C.; Yen, J.Y.; Chen, C.Y.; Yen, C.F.; Chen, C.S.; Lin, W.C.; Ko, C.H. Brain activation for response inhibition under gaming cue distraction in internet gaming disorder. Kaohsiung J. Med. Sci. 2014, 30, 43–51. [Google Scholar] [CrossRef] [PubMed]
  76. Quay, H.-C. The Behavioral Reward and Inhibition System In childhood Behavior Disorder. In Attention Deficit Disorder, New Research in Attention, Treatment, and Psychopharmacology; Bloomingdale, L.M., Ed.; Pergamon Press: Oxford, UK, 1988; pp. 176–186. [Google Scholar]
  77. Quay, H.C. The psychobiology of undersocialized aggressive conduct disorder: A theoretical perspective. Dev. Psychopathol. 1993, 5, 165–180. [Google Scholar] [CrossRef]
  78. Wang, C.-Y.; Wu, Y.-C.; Su, C.-H.; Lin, P.-C.; Ko, C.-H.; Yen, J.-Y. Association between Internet gaming disorder and generalized anxiety disorder. J. Behav. Addict. 2017, 6, 564–571. [Google Scholar] [CrossRef] [PubMed]
  79. Schofield, C.A.; Coles, M.E.; Gibb, B.E. Retrospective reports of behavioral inhibition and young adults’ current symptoms of social anxiety, depression, and anxious arousal. J. Anxiety Disord. 2009, 23, 884–890. [Google Scholar] [CrossRef] [Green Version]
  80. Morgan, B.E.; Van Honk, J.; Hermans, E.J.; Scholten, M.R.M.; Stein, D.J.; Kahn, R.S. Gray’s BIS/BAS dimensions in non-comorbid, non-medicated social anxiety disorder. World J. Biol. Psychiatry 2009, 10, 925–928. [Google Scholar] [CrossRef]
  81. Yen, J.Y.; Ko, C.H.; Yen, C.F.; Chen, C.S.; Chen, C.C. The association between harmful alcohol use and Internet addiction among college students: Comparison of personality. Psychiatry Clin. Neurosci. 2009, 63, 218–224. [Google Scholar] [CrossRef]
  82. Park, J.; Lee, Y.S.; Kim, B.-N.; Cheong, J.H.; Han, D.H. The Factors for the Aggression in Patients with On-Line Game Addiction: Behavioral Inhibition/Activation System and Comorbid Disease. J. Korean Neuropsychiatr. Assoc. 2014, 52, 84–90. [Google Scholar] [CrossRef] [Green Version]
  83. Zvyagintsev, M.; Klasen, M.; Weber, R.; Sarkheil, P.; Esposito, F.; Schwenzer, M.; Mathiak, K. Violence-related content in video game may lead to functional connectivity changes in brain networks as revealed by fMRI-ICA in young men. Neuroscience 2016, 320, 247–258. [Google Scholar] [CrossRef]
  84. Lim, J.A.; Lee, J.Y.; Jung, H.Y.; Sohn, B.K.; Choi, S.W.; Kim, Y.J.; Kim, D.J.; Choi, J.S. Changes of quality of life and cognitive function in individuals with Internet gaming disorder: A 6-month follow-up. Medicine 2016, 95, e5695. [Google Scholar] [CrossRef] [PubMed]
  85. Gentile, D. Pathological video-game use among youth ages 8 to 18: A national study: Research article. Psychol. Sci. 2009, 20, 594–602. [Google Scholar] [CrossRef] [PubMed]
  86. Rehbein, F.; Psych, G.; Kleimann, M.; Mediasci, G.; Mößle, T. Prevalence and risk factors of video game dependency in adolescence: Results of a German nationwide survey. Cyberpsychology Behav. Soc. Netw. 2010, 13, 269–277. [Google Scholar] [CrossRef] [PubMed]
  87. Pontes, H.M.; Király, O.; Demetrovics, Z.; Griffiths, M.D. The conceptualisation and measurement of DSM-5 internet gaming disorder: The development of the IGD-20 test. PLoS ONE 2014, 9, e110137. [Google Scholar] [CrossRef] [Green Version]
  88. Spinella, M. Neurobehavioral correlates of impulsivity: Evidence of prefrontal involvement. Int. J. Neurosci. 2004, 114, 95–104. [Google Scholar] [CrossRef] [PubMed]
  89. Jacob, G.A.; Gutz, L.; Bader, K.; Lieb, K.; Tüscher, O.; Stahl, C. Impulsivity in borderline personality disorder: Impairment in self-report measures, but not behavioral inhibition. Psychopathology 2010, 43, 180–188. [Google Scholar] [CrossRef]
  90. Taylor, A.J.G. Trait impulsivity and oculomotor inhibition. Stud. Psychol. 2016, 58, 134–144. [Google Scholar] [CrossRef]
  91. Preciado, D.; Theeuwes, J. To look or not to look? Reward, selection history, and oculomotor guidance. J. Neurophysiol. 2018, 120, 1740–1752. [Google Scholar] [CrossRef]
  92. Brewer, G.A.; Spillers, G.J.; McMillan, B.; Unsworth, N. Extensive performance on the antisaccade task does not lead to negative transfer. Psychon. Bull. Rev. 2011, 18, 923–929. [Google Scholar] [CrossRef]
  93. García-Blanco, A.C.; Perea, M.; Salmerón, L. Attention orienting and inhibitory control across the different mood states in bipolar disorder: An emotional antisaccade task. Biol. Psychol. 2013, 94, 556–561. [Google Scholar] [CrossRef] [Green Version]
  94. Ogletree, S.M.; Drake, R. College students’ video game participation and perceptions: Gender differences and implications. Sex Roles 2007, 56, 537–542. [Google Scholar] [CrossRef]
  95. Boot, W.R.; Blakely, D.P.; Simons, D.J. Do action video games improve perception and cognition? Front. Psychol. 2011, 2, 226. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  96. Heponiemi, T.; Keltikangas-Järvinen, L.; Kettunen, J.; Puttonen, S.; Ravaja, N. BIS-BAS sensitivity and cardiac autonomic stress profiles. Psychophysiology 2004, 41, 37–45. [Google Scholar] [CrossRef] [PubMed]
  97. Vervoort, L.; Vandeweghe, L.; Vandewalle, J.; Van Durme, K.; Vandevivere, E.; Wante, L.; McIntosh, K.; Verbeken, S.; Moens, E.; Goossens, L.; et al. Measuring Punishment and Reward Sensitivity in children and adolescents with a parent-report version of the Bis/Bas-scales. Pers. Individ. Differ. 2015, 87, 272–277. [Google Scholar] [CrossRef]
  98. Wilson, S.J.; Glue, P.; Ball, D.; Nutt, D.J. Saccadic eye movement parameters in normal subjects. Electroencephalogr. Clin. Neurophysiol. 1993, 86, 69–74. [Google Scholar] [CrossRef]
  99. Cross, C.P.; Copping, L.T.; Campbell, A. Sex Differences in Impulsivity: A Meta-Analysis. Psychol. Bull. 2011, 137, 97–130. [Google Scholar] [CrossRef] [Green Version]
  100. Jorm, A.F.; Christensen, H.; Henderson, A.S.; Jacomb, P.A.; Körten, A.E.; Rodgers, B. Using the BIS/BAS scales to measure behavioural inhibition and behavioural activation: Factor structure, validity and norms in a large community sample. Pers. Individ. Differ. 1998, 26, 49–58. [Google Scholar] [CrossRef]
  101. Cherney, I.D. Mom, let me play more computer games: They improve my mental rotation skills. Sex Roles 2008, 59, 776–786. [Google Scholar] [CrossRef]
  102. Hoeft, F.; Watson, C.L.; Kesler, S.R.; Bettinger, K.E.; Reiss, A.L. Gender differences in the mesocorticolimbic system during computer game-play. J. Psychiatr. Res. 2008, 42, 253–258. [Google Scholar] [CrossRef]
  103. Shibuya, A.; Sakamoto, A.; Ihori, N.; Yukawa, S. The effects of the presence and contexts of video game violence on children: A longitudinal study in Japan. Simul. Gaming 2008, 39, 528–539. [Google Scholar] [CrossRef]
  104. Connell, C.J.W.; Thompson, B.; Kuhn, G.; Gant, N. Exercise-induced fatigue and caffeine supplementation affect psychomotor performance but not covert visuo-spatial attention. PLoS ONE 2016. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  105. Doettl, S.M.; Easterday, M.K.; Plyler, P.N.; Behn, L.L.; Poget, A.S. Mental tasking and rotary Chair-Induced vestibular nystagmus utilizing Video-Oculography. Int. J. Audiol. 2020, 59, 360–366. [Google Scholar] [CrossRef] [PubMed]
  106. McNerney, K.M.; Coad, M.L.; Burkard, R. The influence of caffeine on rotary chair and oculomotor testing. J. Am. Acad. Audiol. 2018, 29, 587–595. [Google Scholar] [CrossRef] [PubMed]
Sensors 20 03219 g001 550
Figure 1. Saccade task protocol. The experiment consisted of five blocks of trials, in the order of pro, anti, anti, anti, pro. In each trial, the target appeared for 2 to 3.5 s in the center of the screen for fixation, then disappeared for 0.2 s (gap period). Then the circle randomly appeared again on the left or right side of the screen, and after 1 s, went back to the center and repeated the entire sequence. A detailed description of the Saccade task’s judgment and measurement is given in the next subsection.
Figure 1. Saccade task protocol. The experiment consisted of five blocks of trials, in the order of pro, anti, anti, anti, pro. In each trial, the target appeared for 2 to 3.5 s in the center of the screen for fixation, then disappeared for 0.2 s (gap period). Then the circle randomly appeared again on the left or right side of the screen, and after 1 s, went back to the center and repeated the entire sequence. A detailed description of the Saccade task’s judgment and measurement is given in the next subsection.
Sensors 20 03219 g001
Sensors 20 03219 g002 550
Figure 2. (a) Flow chart of the heuristic filter. Xt was noise removed signal from the original signal, h(Xt) was monotonic changed signal, and RT was Reaction Time when saccade occurred after target moved. (b) Example plots of original signal and heuristic filtered signal. The vertical solid line in original signal indicates when the target moved, and the vertical dotted line indicates RT. The horizontal dotted line in the heuristic filtered signal indicates a threshold for saccade detection, and the horizontal arrow indicates the point at which the saccadic reaction occurred.
Figure 2. (a) Flow chart of the heuristic filter. Xt was noise removed signal from the original signal, h(Xt) was monotonic changed signal, and RT was Reaction Time when saccade occurred after target moved. (b) Example plots of original signal and heuristic filtered signal. The vertical solid line in original signal indicates when the target moved, and the vertical dotted line indicates RT. The horizontal dotted line in the heuristic filtered signal indicates a threshold for saccade detection, and the horizontal arrow indicates the point at which the saccadic reaction occurred.
Sensors 20 03219 g002
Sensors 20 03219 g003 550
Figure 3. Normalized frequency histograms of the prosaccade (left) and the antisaccade (right) task. Histograms above the zero-line represent the RT distribution of correct trials, and those below represent incorrect trials. The distributions of RT of the VGP group are shown in red (correct) and purple (incorrect), and those of the NVGP group are shown in blue (correct) and green (incorrect). Dotted lines indicate mean RT values. Pie charts in the lower right corner summarize the error rates of VGP (left) and NVGP (right) group, respectively.
Figure 3. Normalized frequency histograms of the prosaccade (left) and the antisaccade (right) task. Histograms above the zero-line represent the RT distribution of correct trials, and those below represent incorrect trials. The distributions of RT of the VGP group are shown in red (correct) and purple (incorrect), and those of the NVGP group are shown in blue (correct) and green (incorrect). Dotted lines indicate mean RT values. Pie charts in the lower right corner summarize the error rates of VGP (left) and NVGP (right) group, respectively.
Sensors 20 03219 g003
Sensors 20 03219 g004 550
Figure 4. The scatter plot with 95% confidence ellipse for antisaccade error rate and BIS scores. VGP and NVGP were represented in red and blue. BIS: Behavioral Inhibition System.
Figure 4. The scatter plot with 95% confidence ellipse for antisaccade error rate and BIS scores. VGP and NVGP were represented in red and blue. BIS: Behavioral Inhibition System.
Sensors 20 03219 g004
Table
Table 1. Verification of statistical differences between VGP and NVGP.
Table 1. Verification of statistical differences between VGP and NVGP.
ScaleVGP (n = 18)NVGP (n = 12)p-ValueEffect Size (Cohen’s d)
Prosaccade RT (ms)166.6 ± 28.5183.9 ± 29.90.122 (t)0.5943
Antisaccade RT (ms)228.3 ± 35.5244 ± 31.60.226 (t)0.4614
Prosaccade Error Rate (%)3.4 ± 2.421.78 ± 1.760.085 (W)0.7440
Antisaccade Error Rate (%)17.4 ± 12.37.4 ± 4.70.005 ** (t)1
BSCS37.7 ± 4.636.9 ± 5.40.686 (t)0.1523
BIS/BAS15.5 ± 3.2/26.2 ± 5.118 ± 2.1/26.3 ± 5.20.023 */0.954 (t)0.8949/0.0216
BIS-11-R61.3 ± 10.859.7 ± 11.10.701 (t)0.1447
BDI-II10.4 ± 7.18.8 ± 5.90.534 (t)0.2349
BAI5.8 ± 6.15.4 ± 3.60.671 (W)0.0791
RT: Reaction Time, BSCS: Brief Self-Control Scale, BIS: Behavioral Inhibition System, BAS: Behavioral Activation System, BIS-11-R: Barratt Impulsiveness Scale, BDI-II: Beck Depression Inventory, BAI: Beck Anxiety Inventory. * p < 0.05, ** p < 0.01, t: Student’s t-test, W: Wilcoxon–Mann–Whitney test.
Table
Table 2. Correlation Matrices of all participants, VGP, and NVGP.
Table 2. Correlation Matrices of all participants, VGP, and NVGP.
Group All Participant
Pro RTAnti RTAnti ErrorBSCSBIS-11-RBDI-IIBAIBISBAS
Pro RT-0.74 ***−0.50 **0.110.220.06−0.200.03−0.03
Anti RT--−0.340.070.290.07−0.09−0.05−0.18
Anti Error---0.240.160.260.19−0.160.03
BSCS----0.49 **0.220.06−0.48 **−0.12
BIS-11-R-----0.40 *0.23−0.42 *−0.43 *
BDI-II------0.43 *−0.26−0.24
BAI-------−0.10−0.20
BIS--------0.46 *
BAS---------
Group VGP. Above Main Diagonal
Group NVGP. Below Main Diagonal
Pro RTAnti RTAnti ErrorBSCSBIS-11-RBDI-IIBAIBISBAS
Pro RT-0.72 ***−0.55 *0.050.040.04−0.29−0.07−0.05
Anti RT0.73 **-−0.40−0.010.330.10−0.10−0.12−0.29
Anti Error−0.150.21-0.180.120.220.190.030.10
BSCS0.250.250.53-0.340.02−0.03−0.50 *0.15
BIS−11-R0.570.280.300.67 *-0.400.18−0.52 *−0.42
BDI-II0.230.110.310.520.38-0.40−0.28−0.37
BAI0.04−0.020.250.270.360.53-−0.11−0.41
BIS−0.19−0.290.08−0.54−0.27−0.12−0.02-0.48 *
BAS−0.01−0.01−0.19−0.47−0.450.000.340.58 *-
Pro RT: Prosaccade Reaction Time, Anti RT: Antisaccade Reaction Time, Anti Error: Antisaccade Error Rate, BSCS: Brief Self-Control Scale, BIS-11-R: Barratt Impulsiveness Scale, BDI-II: Beck Depression Inventory, BAI: Beck Anxiety Inventory, BIS: Behavioral Inhibition System, BAS: Behavioral Activation System. * p < 0.05, ** p < 0.01, *** p < 0.001.

Share and Cite

MDPI and ACS Style

Jeong, J.H.; Park, H.-J.; Yeo, S.-H.; Kim, H. A Multimodal Analysis Combining Behavioral Experiments and Survey-Based Methods to Assess the Cognitive Effect of Video Game Playing: Good or Evil? Sensors 2020, 20, 3219. https://doi.org/10.3390/s20113219

AMA Style

Jeong JH, Park H-J, Yeo S-H, Kim H. A Multimodal Analysis Combining Behavioral Experiments and Survey-Based Methods to Assess the Cognitive Effect of Video Game Playing: Good or Evil? Sensors. 2020; 20(11):3219. https://doi.org/10.3390/s20113219

Chicago/Turabian Style

Jeong, Ji Hyeok, Hyun-Jung Park, Sang-Hoon Yeo, and Hyungmin Kim. 2020. "A Multimodal Analysis Combining Behavioral Experiments and Survey-Based Methods to Assess the Cognitive Effect of Video Game Playing: Good or Evil?" Sensors 20, no. 11: 3219. https://doi.org/10.3390/s20113219

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop