Next Article in Journal
Effects of Situation-Based Flipped Learning and Gamification as Combined Methodologies in Psychiatric Nursing Education: A Quasi-Experimental Study
Next Article in Special Issue
Predicting the Risk of Future Multiple Suicide Attempt among First-Time Suicide Attempters: Implications for Suicide Prevention Policy
Previous Article in Journal
Korean Version of the 17-Item Utrecht Work Engagement Scale for University Students: A Validity and Reliability Study
Previous Article in Special Issue
Utilization of Artificial Intelligence in Disease Prevention: Diagnosis, Treatment, and Implications for the Healthcare Workforce
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

CGP17Pat: Automated Schizophrenia Detection Based on a Cyclic Group of Prime Order Patterns Using EEG Signals

1
Department of Management Information Systems, Management Faculty, Sakarya University, Sakarya 54050, Turkey
2
Department of Digital Forensics Engineering, College of Technology, Firat University, Elazig 23119, Turkey
3
Department of Computer Engineering, College of Engineering, Ardahan University, Ardahan 75000, Turkey
4
School of Science and Technology, Singapore University of Social Sciences, Singapore 599494, Singapore
5
School of Business (Information System), University of Southern Queensland, Toowoomba, QLD 4350, Australia
6
Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW 2007, Australia
7
Ngee Ann Polytechnic, Department of Electronics and Computer Engineering, Singapore 599489, Singapore
8
Department of Biomedical Engineering, School of Science and Technology, SUSS University, Singapore 599491, Singapore
9
Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung 413, Taiwan
*
Author to whom correspondence should be addressed.
Healthcare 2022, 10(4), 643; https://doi.org/10.3390/healthcare10040643
Submission received: 18 February 2022 / Revised: 18 March 2022 / Accepted: 25 March 2022 / Published: 29 March 2022
(This article belongs to the Special Issue Artificial Intelligence Applications in Medicine)

Abstract

:
Background and Purpose: Machine learning models have been used to diagnose schizophrenia. The main purpose of this research is to introduce an effective schizophrenia hand-modeled classification method. Method: A public electroencephalogram (EEG) signal data set was used in this work, and an automated schizophrenia detection model is presented using a cyclic group of prime order with a modulo 17 operator. Therefore, the presented feature extractor was named as the cyclic group of prime order pattern, CGP17Pat. Using the proposed CGP17Pat, a new multilevel feature extraction model is presented. To choose a highly distinctive feature, iterative neighborhood component analysis (INCA) was used, and these features were classified using k-nearest neighbors (kNN) with the 10-fold cross-validation and leave-one-subject-out (LOSO) validation techniques. Finally, iterative hard majority voting was employed in the last phase to obtain channel-wise results, and the general results were calculated. Results: The presented CGP17Pat-based EEG classification model attained 99.91% accuracy employing 10-fold cross-validation and 84.33% accuracy using the LOSO strategy. Conclusions: The findings and results depicted the high classification ability of the presented cryptologic pattern for the data set used.

1. Introduction

Schizophrenia is a serious mental illness where patients have difficulty distinguishing between what is real and what is not [1,2]. Schizophrenia is a chronic brain disorder that affects a person’s thoughts, feelings, and behavior [3]. People with schizophrenia often experience symptoms such as hallucinations, delusions, abnormal behavior, and disorganized speech [4,5]. Although the symptoms come and go, schizophrenia significantly affects the social lives, education, and professional performance of the affected individuals [6].
Schizophrenia is a global disorder [7] with a prevalence of approximately 1% worldwide, and it is reported that 20 million people are affected by schizophrenia [8]. In addition, studies have shown that schizophrenia is more common in men than women [9,10]. The disorder usually starts between 18 and 25 years in men and between 25 and 35 years in women [11]. The causes of schizophrenia are still unknown, but researchers have observed that genetics, brain chemistry, and environment may be associated with the development of the disorder [12,13]. Moreover, psychological factors are also known to trigger this disorder. Schizophrenia is treatable with medication and psychosocial support [14]. Without treatment, people with schizophrenia can develop other mental health disorders and significant health problems. It is thus essential to establish a correct diagnosis and early treatment of the disease.
Schizophrenia (SZ) is diagnosed from the patient’s symptoms and a specialist’s opinion in mental health. In addition, techniques such as magnetic resonance imaging, computed tomography, and EEGs can also be used in the diagnostic phase [15,16]. In short, there is no single test method to diagnose SZ. These days, machine learning techniques are actively used to automatically interpret EEG signals [17]. Due to the fact of these machine learning techniques, EEG data collected from patients are automatically classified, permitting early diagnosis of various diseases. One of these diseases is SZ, and there are various studies on automatic SZ classification in the literature as summarized in Table 1.
Various data sources, such as EEG signals and MRI imaging, have been used to support schizophrenia diagnosis via machine learning. As shown in Table 1, EEG signals are some of the most commonly used medical data for schizophrenia diagnosis. Table 1 also shows the various EEG signal-based schizophrenia detection models that were developed using hand-crafted, feature-based deep learning models. The deep learning models attained high classification performances but had high computational complexities. Moreover, most of the EEG signal-based schizophrenia detection models did not use LOSO cross-validation [33]. The signals were segmented, which may cause overfitting with other validation techniques. On the other hand, real classification performance can be accurately calculated using LOSO cross-validation. Therefore, LOSO cross-validation is a critical validation technique, and in this work, we used LOSO cross-validation in our proposed model.
In this paper, two validation techniques (i.e., 10-fold cross-validation and LOSO validation) were used, and high classification accuracies were obtained with our developed model. Our proposed model can automatically classify EEG signals collected from schizophrenia patients and healthy individuals. The new feature extractor (i.e., CGP17Pat) was also tested on an open-access schizophrenia data set with much success.
Feature engineering is one of the most important machine learning and classification issues. By deploying feature engineering methodologies, hand-crafted feature engineering models have been developed. In this work, we employed a cryptologic structure to propose a new nonlinear pattern. Cryptographic systems generally use finite groups that have been generated using various algorithms. The most popular finite group creation model is multiplication-based group creation. The prime numbers have been used to create cyclic finite group and is named the cyclic group of prime (CGP) order [34,35]. Using the values of the group and a prime number, unique vectors are generated, and these vectors can be used to create permutation or substitution boxes. In this work, using these nonlinear values by generating CGP, a new local binary pattern, such as a signal descriptor, was generated. A local binary pattern and versions of it, generally, used a pattern to generate features. Using CGP with modulo 17, eight different patterns were created, and all of these patterns were applied to the signal to generate a feature vector. Thus, the proposed feature extraction function was named CGP17Pat.
Schizophrenia is a serious mental disorder, and diagnosing schizophrenia is not easy. Constant follow ups with suspected cases are required before a diagnosis can be made. Moreover, early diagnosis and treatment are vital for a better prognosis. Hence, to simplify the diagnosis process of schizophrenia, an automated EEG-based diagnosis model is proposed. Our machine learning method uses CGP17Pat as the feature extractor. A successful machine learning method needs an effective feature extractor, a feature selection function to choose the most discriminative ones, and an appropriate classifier. Our proposed model extracted 2048 features using eight patterns of the presented CGP17Pat. The MAP decomposer was used to create high-level features, while INCA [36] was employed to choose the top features. kNN [37] was employed to generate channel-wise results using 10-fold cross-validation and LOSO. Finally, iterative hard majority voting created the general results. The objectives of this study were (i) to show the feature generation ability of the proposed CGP17Pat, (ii) develop an automated schizophrenia detection model using EEG signals with a low time burden, and (iii) to analyze the schizophrenia detection ability using each EEG channel.
A new generation hand-modeled EEG signal classification method is proposed in this research, and the novelty of this research is the CGP17Pat. CGP has generally been used for cryptographic engineering models, since it is a finite group creator. CGP and 17 (a prime number) were used in this work to present a new feature extractor. The contributions of this work are given as below.
(i) A new one-dimensional feature extraction function using a cryptographic model is proposed. The main aim of this feature extractor was to suggest a nonlinear local feature extractor, and this feature extractor is a local binary pattern (LBP) feature extractor. Therefore, the proposed CGP17Pat generates textural features. The informative feature generation ability of CGP17Pat is demonstrated using EEG signals;
(ii) The CGP17Pat is the main feature extraction function of this model. An effective feature selector (i.e., INCA) was employed to decrease the number of features, and a shallow/conventional classifier (i.e., kNN) was deployed to obtain the classification results. Furthermore, two validations methods (i.e., 10-fold cross-validation and LOSO) were used to validate the robustness of the CGP17Pat-based EEG signal classification method. A schizophrenia data set with 19 channels was analyzed in this work.

2. Materials and Methods

2.1. Materials

This study used freely available data from a public repository created by Olejarczyk and Jernajczyk [18,19]. The 10/20 EEG montage methodology was used to collect the EEG signals. It consists of EEG recordings from 14 schizophrenic patients and 14 healthy subjects from the Institute of Psychiatry and Neurology in Warsaw (excluding brain disordered patients). To choose the control group, gender and age criteria were considered. The patients included in this study consisted of those above 18 years of age with a diagnosis of F20.0 in the ICD-10 category. These patients did not use any drugs at least seven days before data recording. Pregnant patients, patients with organic brain pathology, severe neurological diseases, the presence of a general medical condition, and persons under 18 years of age were excluded from the study. In addition, early-stage patients, such as those exhibiting their first attack, were not included in the study. The recordings were for an average of 15 min with eyes closed and in a resting state. The electrodes were placed according to the 10/20 system. Data were collected from 19 channels (i.e., Fp1, Fp2, F7, F3, Fz, F4, F8, T3, C3, Cz, C4, T4, T5, P3, Pz, P4, T6, O1, and O2) at a sampling rate of 250 Hz. Further information on the collected EEG data is given in the Table 2 below.

2.2. Method

The main aim of the proposed model was to show the automatic detection ability of a novel nonlinear feature extraction model using the CGP model. CGP has been used to create finite cyclic groups. A basic EEG signal classification hand-modeled method has been presented to detect schizophrenia automatically. Our method contains textural feature generation using the presented CGP17Pat, the most informative features chosen using INCA, classification, and iterative hard majority voting phases. The schematic summarization of our model is illustrated in Figure 1.
In this model, EEG signals are decomposed using the multilevel MAP function. In this function, 2-, 4-, and 8-sized overlapping blocks are used to generate decomposed signals (i.e., D1, D2, and D3). In the feature extraction phase, the proposed CGP17Pat is employed for each decomposed signal and raw EEG signal. Therefore, four vectors (i.e., F1, F2, F3, and F4) are created. The length of each feature vector generated is 2048. These feature vectors are merged in the feature merging step (concat), and a feature vector with a length of 8192 (=2048 × 4) is created. INCA chooses the most informative features, and kNN calculates the channel-wise results. Iterative hard majority voting is deployed to generate/calculate the general classification performance using 19 channels.

2.2.1. Feature Creation

The first phase is feature vector creation. Before feature extraction, each EEG signal is divided into segments of 10 s. Then, a mathematical function/method is used to create the feature generator automatically. The used mathematical function is CGP. Here, 17 (Z17) is selected as the prime order. By utilizing 17, eight cyclic groups are obtained. The general function of the CGP is given in Equation (1):
a i   ( m o d   p ) ,   a { 2 , 3 , , p 1 } ,   i { 1 , 2 , , p 1 }
By deploying this equation (Equation (1)), cyclic groups are generated. Herein, p defines the prime number, a represents the used number to create a group, and i is the exponent. By deploying 17 and Equation (1), eight cyclic groups are generated, and the generated cyclic groups are tabulated in Table 3.
By deploying these values (Table 3), a multiple pattern center symmetric feature extraction function is presented (CGP17Pat). The created eight patterns using Table 3 are also demonstrated in Figure 2.
To better explain the presented CGP17Pat feature extractor, a schematic denotation is shown in Figure 3.
MAP is used to create textural features at both low and high levels. The details of our presented MAP and CGP17Pat-based model are as below.
Step 1: Create decomposed signals using the MAP method. The mathematical definition of the MAP is denoted in Equation (2):
M A P ( a , b ) = max ( | b l | ) ,   b l ( j ) = a ( i + j 1 ) j { 1 , 2 , , b } ,   i { 1 , b , , l e n g b + 1 }
Herein, M A P ( . , . ) is the maximum absolute pooling function, a is the input signal, b defines the length of the used non-overlapping block ( b l ) ,   l e n g represents the length of the used EEG signal, | . | function is the absolute value calculation function, and i , j defines indexes.
The raw EEG signal is divided into 2-, 4-, and 8-sized non-overlapping blocks, and three decomposed signals are created. Decomposed signal creation is defined in Equation (3).
D t = M A P ( E S , 2 t ) ,   t { 1 , 2 , 3 }
Herein, D t defines the tth decomposed signal.
Step 2: Extract features from decomposed signals and the raw schizophrenia EEG signal deploying the presented CGP17Pat.
F 1 = C G P 17 P a t ( S g n l )
F t + 1 = C G P 17 P a t ( D t ) ,   t { 1 , 2 , 3 }
where CGP17Pat(.) is the introduced feature extraction function, and F defines the generated features’ vectors with a length of 2048. Our proposed function (CGP17Pat(.)) was deployed with raw EEG signals (Sgnl) and decomposed signals to extract features. Our proposed textural feature extraction function details are depicted in sub-steps (Step 2.1–2.4).
Step 2.1: Create overlapping blocks with a length of 16.
b i ( j + 1 ) = S g n l ( i + j ) ,   i { 1 , 2 , , l e n g 15 } ,   j { 0 , 1 , , 15 }
Herein, b i is the ith overlapping block.
Step 2.2: Generate binary features using the signum function.
b i t h ( k ) = s i g n ( b i ( G h ( k ) ) , b i ( G h ( 17 k ) ) ) , h { 1 , 2 , , 8 } , k { 1 , 2 , , 8 }
s i g n ( t , l ) = { 0 , t l < 0 1 ,   t l 0
Herein, b i t h is the hth bit group with a length of eight, and we generated eight-bit groups deploying the signum ( s i g n ( . , . ) ) function; G h defines the hth cyclic group (see Table 2).
Step 2.3: Generate eight map signals deploying the created bits (binary features).
m a p h ( i ) = k = 1 8 b i t h ( k ) × 2 h 1
Herein, m a p h is the hth map signal.
Step 2.4: Extract a histogram of each map signal and merge these histograms. The length of each histogram is 256. Therefore, the proposed CGP17 creates 256 × 8 = 2048 features from each EEG segment.
Step 3: Merge/concatenate the generated textural vectors (i.e., F 1 ,   F 2 ,   F 3 ,   and   F 4 ) to create a merged feature vector with a length of 8192.
f t ( h + 2048 × ( t 1 ) ) = F t ( h ) ,   h { 1 , 2 , , 2048 } ,   t { 1 , 2 , 3 , 4 }
where f t merges the feature vector that has a length of 8192.

2.2.2. Feature Selection

The INCA (an improved/developed version of the NCA selector) feature selector is applied to the most distinctive features from the generated 8192 features in the feature selection phase. The NCA is a weight-based feature selector and is a kNN-like function. To increase the automatic feature selection ability of the NCA, INCA was proposed by Tuncer et al. [38,39]. INCA uses two parameters, and these parameters are named iteration range and loss value calculator. The iteration range is used to decrease the computational complexity of the INCA. In this study, the iteration/loop was initialized at 100 and finished at 1000.
Step 4: Apply the NCA to the generated features and obtain the qualified indexes.
Step 5: Choose the most valuable/meaningful from 100 to 1000 features using the generated qualified indexes. By using this iterative feature selection, 901 feature vectors are chosen.
Step 6: Find the feature vector with the minimum loss value.
Step 7: Select the most appropriate feature vector according to Step 6.

2.2.3. Classification

In the classification phase, a conventional/shallow classifier is utilized, and this classifier is named Fine kNN. The hyperparameters of the classifier are tabulated in Table 4.
Step 8: Calculate the results of the selected most appropriate feature vector deploying two validations. The validations used were 10-fold cross-validation and LOSO cross-validation.

2.2.4. Iterative Hard Majority Voting

Iterative hard majority voting [40] is the last phase of the presented CGP17Pat-based schizophrenia detection model. The used data set had 19 channels. The calculated prediction labels from each channel were used to calculate general results. They were qualified according to their classification accuracy. The qualified predicted labels were voted using the mode function. In this work, iteration was initialized from 3 (three channels) to 19. Finally, the best classification accuracy was chosen using a greedy search.
Step 9: Apply iterative hard majority voting to the generated 19 predicted labels from 19 channels using kNN.

3. Results

The performance of the presented CGP17Pat-based schizophrenia detection model is evaluated in this section.

3.1. Experimental Setup

The proposed parametric CGP17Pat-based EEG classification model used in this study contains four phases. To implement the CGP17Pat-based EEG classification model, a MATLAB (2021b) environment was used. The parameters used in this EEG classification model are listed in Table 5.

3.2. Performance Metrics

By deploying the parameters above (Table 5), the proposed CGP17Pat-based schizophrenia detection model was implemented using a MATLAB (2021b) environment. The model’s accuracy ( a c c ), sensitivity ( s e n ), specificity ( s p e ), and geometric mean ( g m ) were calculated. Mathematical notations of the performance metrics are given in Equations (11)–(14) [41,42]:
a c c = t p + t n t p + f n + t n + f p
s e n = t p t p + f n
s p e = t n t n + f p
g e o = s p e × s e n
Herein, t p ,   f n ,   t n , and f p are the number of true positives, false negatives, true negatives, and false positives.

3.3. Performance Evaluation

The results were calculated using 10-fold cross-validation and LOSO. Moreover, this data set contained 19 channels, and the channel-wise (channel by channel) results are listed in Table 6.
The best results are noted in bold font type. According to the results in Table 6, the best accurate channel was Pz based on the 10-fold cross-validation, and our proposed model reached a 99.82% classification accuracy and geometric mean. Furthermore, our model yielded an 82.40% classification accuracy using LOSO validation on the F7 channel.
The EEG data set had 19 channels, and the channel-wise results were also calculated using the presented CGP17Pat-based EEG signal classification model. To calculate the general (channel-wise) results, iterative hard majority voting was applied to the prediction vectors. The calculated voted results are tabulated in Table 7.
Table 7 shows that iterative hard majority voting algorithm increased classification accuracy from 99.82% to 99.91% for the 10-fold cross-validation and from 82.40% to 84.33% for the LOSO validation.
CGP is the most widely used mathematical model to create cyclic groups for cryptographic applications. Here, CGP was utilized to propose a new generation nonlinear pattern. By using 17 as modulo, eight cyclic groups were created. Each group’s creation was considered to create a center symmetric local feature extractor. The presented CGP17Pat created 2048 features. The most valuable feature vector was chosen using the INCA selector. The range of the length of the selected optimal feature vectors was [133–973]. INCA chose 133 features for the Fp2 channel, and 973 features for the P3 channel. The number of the selected features from each channel chosen by INCA are depicted in Figure 4.
These feature vectors were then classified using kNN. By using the kNN classifier, the results of all channels were calculated. Iterative hard majority voting was used to calculate the general classification results, and 99.91% and 84.33% classification accuracies were obtained using 10-fold cross-validation and LOSO cross-validation, respectively.
The second evaluation parameter was time/computational complexity. Big O notation was used to calculate the time complexity of our proposed CGP17Pat-based model, and the phase-by-phase results are given below.
Feature extraction: In this phase, a decomposition model and CGP17Pat feature generation function were used. The time burden of the CGP17Pat was equal to O ( 8 n ) O ( n ) . Furthermore, this feature extractor (CGP17Pat) generates features from decomposed signals. Therefore, O ( n d l o g n d ) is calculated as the time complexity of the CGP17Pat-based multilevel feature extraction method. Here, n represents the length of the signal, and d defines the number of instances.
Feature selection: In the feature chosen phase, the INCA function was used, and it uses two parameters: loop range and loss function. Moreover, NCA was applied to calculate the indexes qualified of the features. Considering these parameters, the complexity of the INCA was calculated as O ( t d + l n d ) . Herein, t is the complexity coefficient of the NCA, and l defines the number of feature vectors.
Classification: kNN was employed to obtain the classification results. The time complexity of the kNN is O ( n d ) .
The computational/time complexity of this model is equal to O ( n d l o g n d + t d + l n d + n d ) O ( n d l o g n d + t d + l n d ) . This result demonstrates that our proposed CGP17Pat-based schizophrenia classification model has linear complexity. Therefore, this model is a lightweight classification model.

4. Discussion

In this work, a hand-crafted feature extraction function (CGP17Pat)-based EEG signal classification model was presented to detect schizophrenia automatically. The proposed hand-modeled learning method uses kNN as both the INCA classifier and loss value generator. This classifier was selected according to the experiments. According to the results of the shallow classifiers (testing results), the best classifier was Fine kNN. The test results of the tested classifier on the Fp2 by employing a 10-fold cross-validation are depicted in Figure 5.
From Figure 4, the best classifier was weighted kNN for this data set. Therefore, kNN was used as the classifier in this research. Moreover, two validation techniques were used, and they were 10-fold cross-validation and LOSO cross-validation. The classification results according to the validation techniques are shown in Figure 6.
From Figure 6, the best accurate validation technique was the 10-fold cross-validation. This model attained the best results on the Pz channel for 10-fold cross-validation and the F7 channel for LOSO validation. Iterative hard majority voting was applied to these results, and the general results calculated are denoted in Figure 7 using confusion matrices.
To denote the success of the presented model, we compared our results with other machine learning models for the automatic detection of schizophrenia reported from 2019 to 2021 as tabulated in Table 8.
As observed from Table 8, Shoeibi et al. [49] attained 99.25% accuracy using five-fold cross-validation when CNN and LSTM were used. Oh et al. [21] presented a CNN-based model, where they calculated both subject-wise and non-subject-wise results. An accuracy of 98.07% was obtained using 10-fold cross-validation and 81.26% with LOSO cross-validation. Shoeibi et al. [49] and Oh et al. [21] used deep learning to attain high classification accuracies. Our CGP17Pat-based model, on the other hand, achieved the highest classification accuracy of 99.91% for 10-fold cross-validation and 84.33% with LOSO validation. Furthermore, our presented model is a lightweight EEG classification method, where the time complexity of the CGP17Pat is O ( n ) and the time burden of the presented multilevel CGP17Pat-based feature extraction method is O ( n l o n g ) . Since a hand-modeled classification method was used here, parameter tuning was not required. Baygin [46] presented a statistical model to automatically detect SZ and attained over 99% classification accuracy deploying 10-fold cross-validation. However, there were no results on LOSO cross-validation in the paper. In summary, the presented CGP17Pat-based EEG signal classification model attained the best classification accuracy among the available machine learning methods with 10-fold cross-validation.
The benefits and limitations of the work are discussed below.
Benefits:
  • A cryptographic model (CGP) was used, where CGP was used for its feature extraction ability;
  • A simple machine learning model was presented using the presented CGP17Pat;
  • A hand-modeled EEG signal classification model was proposed with low time complexity. Only CGP17Pat was used to extract the salient features, and the time complexity of this function is O(nlong) according to Big O notation;
  • LOSO and 10-fold cross-validations were used to depict the robustness of this model;
  • To denote the feature generation capability of the CGP17Pat, a shallow classifier was used, and high accuracy values were obtained.
Limitations:
  • Using LOSO validation, the presented model (i.e., CGP17Pat-based classification model) attained unsatisfactory results for several channels (especially Fz, F4, C3, and Cz);
  • We used a hand-modeled learning technique, but INCA had high time complexity;
  • The hyperparameters of the kNN can be optimized.
The proposed model can be used in psychiatry clinics to detect schizophrenia using EEG signals, and we also intend to use this model to detect different types of schizophrenia to help clinicians in their treatment.

5. Conclusions

We presented a new feature extraction function using a cryptologic method, which we named CGP17Pat. The CGP17Pat function was used to classify EEG signals for automatic detection of SV. The model attained high accuracies of 99.91% and 84.33% with 10-fold cross-validation and LOSO cross-validation, respectively. The results demonstrated the excellent feature classification ability using CGP17Pat. By deploying LOSO cross-validation, the real-world performance of the proposed CGP17Pat-based model was simulated, and comparable results were obtained using 10-fold cross-validation. This model can assist psychologists/psychiatrists in their diagnosis of schizophrenia so that early treatment can be provided to affected patients.
Our future plan is to develop an automated detection application for various mental disorders using EEG signals. These signals collected from worldwide medical centers will be fed into our smart system. As a result, the computerized system will diagnose the different mental disorders quickly and accurately so that the medical professionals can provide the necessary treatment and intervention to help their patients. Moreover, many feature extraction functions can be presented using CGP with other modulo values and another new CGP-based deep learning model can be developed in the near future.

Author Contributions

Conceptualization, E.A., S.D., M.B., C.P.O., P.D.B., T.T. and U.R.A.; methodology, E.A., S.D., M.B., C.P.O., P.D.B., T.T. and U.R.A.; software, T.T.; validation, E.A., S.D. and M.B.; formal analysis, E.A.; investigation, E.A., S.D., M.B., C.P.O., P.D.B., T.T. and U.R.A.; resources, E.A., S.D. and M.B.; data curation, E.A., S.D. and M.B.; writing—original draft preparation, E.A., S.D., M.B., C.P.O., P.D.B., T.T. and U.R.A.; writing—review and editing, E.A., S.D., M.B., C.P.O., P.D.B., T.T. and U.R.A.; visualization, E.A.; supervision, U.R.A.; project administration, U.R.A. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. James, S.L.; Abate, D.; Abate, K.H.; Abay, S.M.; Abbafati, C.; Abbasi, N.; Abbastabar, H.; Abd-Allah, F.; Abdela, J.; Abdelalim, A. Global, regional, and national incidence, prevalence, and years lived with disability for 354 diseases and injuries for 195 countries and territories, 1990–2017: A systematic analysis for the Global Burden of Disease Study 2017. Lancet 2018, 392, 1789–1858. [Google Scholar] [CrossRef] [Green Version]
  2. Morgan, A.J.; Reavley, N.J.; Ross, A.; Too, L.S.; Jorm, A.F. Interventions to reduce stigma towards people with severe mental illness: Systematic review and meta-analysis. J. Psychiatr. Res. 2018, 103, 120–133. [Google Scholar] [CrossRef] [PubMed]
  3. Cooke, A.; Kinderman, P. “But What about Real Mental Illnesses?” Alternatives to the Disease Model Approach to “Schizophrenia”. J. Humanist. Psychol. 2018, 58, 47–71. [Google Scholar] [CrossRef]
  4. Bakken, T.L. Behavioural equivalents of schizophrenia in people with intellectual disability and autism spectrum disorder. A selective review. Int. J. Dev. Disabil. 2021, 67, 310–317. [Google Scholar] [CrossRef] [PubMed]
  5. Waters, F.; Blom, J.D.; Jardri, R.; Hugdahl, K.; Sommer, I.E.C. Auditory hallucinations, not necessarily a hallmark of psychotic disorder. Psychol. Med. 2018, 48, 529–536. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Bhandari, S. Schizophrenia: Definition, Symptoms, Causes, Diagnosis, Treatment. Available online: https://www.webmd.com/schizophrenia/mental-health-schizophrenia (accessed on 2 January 2022).
  7. Millier, A.; Schmidt, U.; Angermeyer, M.C.; Chauhan, D.; Murthy, V.; Toumi, M.; Cadi-Soussi, N. Humanistic burden in schizophrenia: A literature review. J. Psychiatr. Res. 2014, 54, 85–93. [Google Scholar] [CrossRef] [PubMed]
  8. McGrath, J.; Saha, S.; Chant, D.; Welham, J. Schizophrenia: A concise overview of incidence, prevalence, and mortality. Epidemiol. Rev. 2008, 30, 67–76. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Abel, K.M.; Drake, R.; Goldstein, J.M. Sex differences in schizophrenia. Int. Rev. Psychiatry 2010, 22, 417–428. [Google Scholar] [CrossRef]
  10. Räsänen, S.; Pakaslahti, A.; Syvälahti, E.; Jones, P.B.; Isohanni, M. Sex differences in schizophrenia: A review. Nord. J. Psychiatry 2000, 54, 37–45. [Google Scholar] [CrossRef]
  11. Ochoa, S.; Usall, J.; Cobo, J.; Labad, X.; Kulkarni, J. Gender Differences in Schizophrenia and First-Episode Psychosis: A Comprehensive Literature Review. Schizophr. Res. Treatment 2012, 2012, 916198. [Google Scholar] [CrossRef] [Green Version]
  12. Misiak, B.; Stramecki, F.; Gawęda, Ł.; Prochwicz, K.; Sąsiadek, M.M.; Moustafa, A.A.; Frydecka, D. Interactions Between Variation in Candidate Genes and Environmental Factors in the Etiology of Schizophrenia and Bipolar Disorder: A Systematic Review. Mol. Neurobiol. 2018, 55, 5075–5100. [Google Scholar] [CrossRef] [PubMed]
  13. Antonucci, L.A.; Pergola, G.; Pigoni, A.; Dwyer, D.; Kambeitz-Ilankovic, L.; Penzel, N.; Romano, R.; Gelao, B.; Torretta, S.; Rampino, A.; et al. A Pattern of Cognitive Deficits Stratified for Genetic and Environmental Risk Reliably Classifies Patients with Schizophrenia from Healthy Control Subjects. Biol. Psychiatry 2020, 87, 697–707. [Google Scholar] [CrossRef]
  14. Browne, J.; Nagendra, A.; Kurtz, M.; Berry, K.; Penn, D.L. The relationship between the therapeutic alliance and client variables in individual treatment for schizophrenia spectrum disorders and early psychosis: Narrative review. Clin. Psychol. Rev. 2019, 71, 51–62. [Google Scholar] [CrossRef] [PubMed]
  15. Del Guerra, A.; Ahmad, S.; Avram, M.; Belcari, N.; Berneking, A.; Biagi, L.; Bisogni, M.G.; Brandl, F.; Cabello, J.; Camarlinghi, N.; et al. TRIMAGE: A dedicated trimodality (PET/MR/EEG) imaging tool for schizophrenia. Eur. Psychiatry 2018, 50, 7–20. [Google Scholar] [CrossRef] [PubMed]
  16. Lai, J.W.; Ang, C.K.E.; Rajendra Acharya, U.; Cheong, K.H. Schizophrenia: A survey of artificial intelligence techniques applied to detection and classification. Int. J. Environ. Res. Public Health 2021, 18, 6099. [Google Scholar] [CrossRef]
  17. Buettner, R.; Beil, D.; Scholtz, S.; Djemai, A. Development of a Machine Learning Based Algorithm to Accurately Detect Schizophrenia based on One-minute EEG Recordings. In Proceedings of the 53rd Hawaii International Conference on System Sciences, Maui, HI, USA, 7–10 January 2020; pp. 3216–3225. [Google Scholar]
  18. Olejarczyk, E.; Jernajczyk, W. EEG in Schizophrenia. RepOD, 2017. [Google Scholar] [CrossRef]
  19. Olejarczyk, E.; Jernajczyk, W. Graph-based analysis of brain connectivity in schizophrenia. PLoS ONE 2017, 12, e0188629. [Google Scholar] [CrossRef] [PubMed]
  20. Jahmunah, V.; Oh, L.S.; Rajinikanth, V.; Ciaccio, E.J.; Hao Cheong, K.; Arunkumar, N.; Acharya, U.R. Automated detection of schizophrenia using nonlinear signal processing methods. Artif. Intell. Med. 2019, 100, 101698. [Google Scholar] [CrossRef] [PubMed]
  21. Oh, S.L.; Vicnesh, J.; Ciaccio, E.J.; Yuvaraj, R.; Acharya, U.R. Deep Convolutional Neural Network Model for Automated Diagnosis of Schizophrenia Using EEG Signals. Appl. Sci. 2019, 9, 2870. [Google Scholar] [CrossRef] [Green Version]
  22. Santos-Mayo, L.; San-Jose-Revuelta, L.M.; Arribas, J.I. A computer-aided diagnosis system with EEG based on the p3b wave during an auditory odd-ball task in schizophrenia. IEEE Trans. Biomed. Eng. 2017, 64, 395–407. [Google Scholar] [CrossRef] [PubMed]
  23. Zhang, L. EEG Signals Classification Using Machine Learning for the Identification and Diagnosis of Schizophrenia. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society, EMBS, Berlin, Germany, 23–27 July 2019; pp. 4521–4524. [Google Scholar]
  24. Roach, B. EEG Data from Basic Sensory Task in Schizophrenia | Kaggle. Available online: https://www.kaggle.com/broach/button-tone-sz (accessed on 2 January 2022).
  25. Chen, Z.H.; Yan, T.; Wang, E.L.; Jiang, H.; Tang, Y.Q.; Yu, X.; Zhang, J.; Liu, C.; Rostro-Gonzalez, H. Detecting Abnormal Brain Regions in Schizophrenia Using Structural MRI via Machine Learning. Comput. Intell. Neurosci. 2020, 2020, 6405930. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. The Center for Biomedical Research Excellence COBRE Dataset. Available online: http://fcon_1000.projects.nitrc.org/indi/retro/cobre.html (accessed on 2 January 2022).
  27. Espinola, C.W.; Gomes, J.C.; Pereira, J.M.S.; dos Santos, W.P. Vocal acoustic analysis and machine learning for the identification of schizophrenia. Res. Biomed. Eng. 2021, 37, 33–46. [Google Scholar] [CrossRef]
  28. Chandran, A.N.; Sreekumar, K.; Subha, D.P. EEG-based automated detection of schizophrenia using long short-term memory (LSTM) network. In Advances in Machine Learning and Computational Intelligence; Springer: Berlin/Heidelberg, Germany, 2021; pp. 229–236. [Google Scholar]
  29. Lei, D.; Pinaya, W.H.L.; Young, J.; van Amelsvoort, T.; Marcelis, M.; Donohoe, G.; Mothersill, D.O.; Corvin, A.; Vieira, S.; Huang, X.; et al. Integrating machining learning and multimodal neuroimaging to detect schizophrenia at the level of the individual. Hum. Brain Mapp. 2020, 41, 1119–1135. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Akbari, H.; Ghofrani, S.; Zakalvand, P.; Tariq Sadiq, M. Schizophrenia recognition based on the phase space dynamic of EEG signals and graphical features. Biomed. Signal Process. Control 2021, 69, 102917. [Google Scholar] [CrossRef]
  31. Aslan, Z.; Akin, M. Automatic detection of schizophrenia by applying deep learning over spectrogram images of EEG signals. Trait. Du Signal 2020, 37, 235–244. [Google Scholar] [CrossRef]
  32. Borisov, S.V.; Kaplan, A.Y.; Gorbachevskaya, N.L.; Kozlova, I.A. Analysis of EEG structural synchrony in adolescents with schizophrenic disorders. Hum. Physiol. 2005, 31, 255–261. [Google Scholar] [CrossRef]
  33. Kunjan, S.; Grummett, T.S.; Pope, K.J.; Powers, D.M.W.; Fitzgibbon, S.P.; Bastiampillai, T.; Battersby, M.; Lewis, T.W. The Necessity of Leave One Subject Out (LOSO) Cross Validation for EEG Disease Diagnosis. In Proceedings of the International Conference on Brain Informatics, Virtual Event, 17–19 September 2021; Springer: Berlin/Heidelberg, Germany, 2021; pp. 558–567. [Google Scholar]
  34. Reiner, I. Integral representations of cyclic groups of prime order. Proc. Am. Math. Soc. 1957, 8, 142–146. [Google Scholar] [CrossRef]
  35. Sezer, M. A note on the Hilbert ideals of a cyclic group of prime order. J. Algebr. 2007, 318, 372–376. [Google Scholar] [CrossRef] [Green Version]
  36. Goldberger, J.; Hinton, G.E.; Roweis, S.; Salakhutdinov, R.R. Neighbourhood components analysis. Adv. Neural Inf. Process. Syst. 2004, 17, 513–520. [Google Scholar]
  37. Peterson, L.E. K-nearest neighbor. Scholarpedia 2009, 4, 1883. [Google Scholar] [CrossRef]
  38. Tuncer, T.; Dogan, S.; Acharya, U.R. Automated accurate speech emotion recognition system using twine shuffle pattern and iterative neighborhood component analysis techniques. Knowl. Based Syst. 2021, 211, 106547. [Google Scholar] [CrossRef]
  39. Tuncer, T.; Dogan, S.; Ozyurt, F.; Belhaouari, S.B.; Bensmail, H. Novel Multi Center and Threshold Ternary Pattern Based Method for Disease Detection Method Using Voice. IEEE Access 2020, 8, 84532–84540. [Google Scholar] [CrossRef]
  40. Dogan, A.; Akay, M.; Barua, P.D.; Baygin, M.; Dogan, S.; Tuncer, T.; Dogru, A.H.; Acharya, U.R. PrimePatNet87: Prime pattern and tunable q-factor wavelet transform techniques for automated accurate EEG emotion recognition. Comput. Biol. Med. 2021, 138, 104867. [Google Scholar] [CrossRef] [PubMed]
  41. Wu, K.; Zhang, D.; Lu, G.; Guo, Z. Joint learning for voice based disease detection. Pattern Recognit. 2019, 87, 130–139. [Google Scholar] [CrossRef]
  42. Tuncer, T.; Dogan, S.; Ertam, F. Automatic voice based disease detection method using one dimensional local binary pattern feature extraction network. Appl. Acoust. 2019, 155, 500–506. [Google Scholar] [CrossRef]
  43. Buettner, R.; Hirschmiller, M.; Schlosser, K.; Rossle, M.; Fernandes, M.; Timm, I.J. High-performance exclusion of schizophrenia using a novel machine learning method on EEG data. In Proceedings of the 2019 IEEE International Conference on E-Health Networking, Application and Services, HealthCom 2019, Bogotá, Colombia, 14–16 October 2019; pp. 1–6. [Google Scholar]
  44. Krishnan, P.T.; Joseph Raj, A.N.; Balasubramanian, P.; Chen, Y. Schizophrenia detection using MultivariateEmpirical Mode Decomposition and entropy measures from multichannel EEG signal. Biocybern. Biomed. Eng. 2020, 40, 1124–1139. [Google Scholar] [CrossRef]
  45. Singh, K.; Singh, S.; Malhotra, J. Spectral features based convolutional neural network for accurate and prompt identification of schizophrenic patients. Proc. Inst. Mech. Eng. Part H J. Eng. Med. 2021, 235, 167–184. [Google Scholar] [CrossRef]
  46. Baygin, M. An accurate automated schizophrenia detection using TQWT and statistical moment based feature extraction. Biomed. Signal Process. Control 2021, 68, 102777. [Google Scholar] [CrossRef]
  47. Kim, K.; Duc, N.T.; Choi, M.; Lee, B. EEG microstate features for schizophrenia classification. PLoS ONE 2021, 16, e0251842. [Google Scholar] [CrossRef]
  48. Krishnaveni, M.; Geethalakshmi, S.N.; Subashini, P.; Dhivyaprabha, T.T.; Lakshmi, S. Optimized Backpropagation Neural Network Model For Brain Computer Interface System. In Proceedings of the 2019 IEEE International Smart Cities Conference (ISC2), Casablanca, Morocco, 14–17 October 2019; pp. 420–425. [Google Scholar]
  49. Shoeibi, A.; Sadeghi, D.; Moridian, P.; Ghassemi, N.; Heras, J.; Alizadehsani, R.; Khadem, A.; Kong, Y.; Nahavandi, S.; Zhang, Y.-D.; et al. Automatic Diagnosis of Schizophrenia in EEG Signals Using CNN-LSTM Models. Front. Neuroinform. 2021, 15, 777977. [Google Scholar] [CrossRef]
  50. Sharma, M.; Acharya, U.R. Automated detection of schizophrenia using optimal wavelet-based l1 norm features extracted from single-channel EEG. Cogn. Neurodyn. 2021, 15, 661–674. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Schematic diagram of the proposed CGP17Pat-based schizophrenia detection model.
Figure 1. Schematic diagram of the proposed CGP17Pat-based schizophrenia detection model.
Healthcare 10 00643 g001
Figure 2. The created eight patterns using CGP17, where each pattern is named as P; by using each pattern, 256 features are extracted and our presented CGP17Pat uses these eight patterns together: (a) patterns 1–4; (b) patterns 5–8.
Figure 2. The created eight patterns using CGP17, where each pattern is named as P; by using each pattern, 256 features are extracted and our presented CGP17Pat uses these eight patterns together: (a) patterns 1–4; (b) patterns 5–8.
Healthcare 10 00643 g002aHealthcare 10 00643 g002b
Figure 3. The graphical summarization of the presented CGP17Pat. Here, P denotes patterns (see Table 2), and each pattern extracts 256 features. Then, these feature vectors are merged, and 2048 (=256 × 8) features are created.
Figure 3. The graphical summarization of the presented CGP17Pat. Here, P denotes patterns (see Table 2), and each pattern extracts 256 features. Then, these feature vectors are merged, and 2048 (=256 × 8) features are created.
Healthcare 10 00643 g003
Figure 4. The lengths of the optimal feature vectors chosen by INCA.
Figure 4. The lengths of the optimal feature vectors chosen by INCA.
Healthcare 10 00643 g004
Figure 5. Classification accuracies of the decision tree (DT), quadratic discriminant (QD), logistic regression (LR), naive Bayes (NB), support vector machine (SVM), Fine kNN (kNN), bagged tree (BT), ensemble subspace kNN (ESkNN), and artificial neural network (ANN) for the Fp2 channel with 10-fold cross-validation.
Figure 5. Classification accuracies of the decision tree (DT), quadratic discriminant (QD), logistic regression (LR), naive Bayes (NB), support vector machine (SVM), Fine kNN (kNN), bagged tree (BT), ensemble subspace kNN (ESkNN), and artificial neural network (ANN) for the Fp2 channel with 10-fold cross-validation.
Healthcare 10 00643 g005
Figure 6. The obtained comparative results according to the validation technique.
Figure 6. The obtained comparative results according to the validation technique.
Healthcare 10 00643 g006
Figure 7. Voted results: confusion matrices of the presented CGP17Pat-based EEG classification model using (a) 10-fold cross-validation and (b) LOSO cross-validation.
Figure 7. Voted results: confusion matrices of the presented CGP17Pat-based EEG classification model using (a) 10-fold cross-validation and (b) LOSO cross-validation.
Healthcare 10 00643 g007
Table 1. Automatic SZ classification using ML techniques.
Table 1. Automatic SZ classification using ML techniques.
Author(s)YearData Set FeatureMethod
R. Buettner et al. [17]2020EEG [18,19];Spectral analysis-based feature extraction and classification using random forest.
14 schizophrenias, 14 HCs;
1 min segmentation.
V. Jahmunah et al. [20]2019EEG [18,19];Nonlinear statistical moment-based feature extraction, feature selection with t-tests, and classification using SVM.
14 schizophrenias, 14 HCs;
25 s segmentation.
S.L. Oh et al. [21]2019EEG [18,19];Convolutional neural network
14 schizophrenias, 14 HCs;
25 s segmentation.
L.S. Mayo et al. [22]2017EEG;Feature extraction at time and frequency domains, J5 feature selection, and classification with multilayer perceptron.
16 schizophrenias, 31 HCs;
0.8 s segmentation.
L. Zhang [23]2019EEG [24];Event-related potential feature extraction and classification with random forest.
49 schizophrenias, 32 HCs;
3 s segmentation.
Z. Chen et al. [25]2020Magnetic resonance images (MRIs) [26];Image segmentation for detecting gray matter, white matter, and cerebrospinal fluid; two-sample t-test-based feature selection; classification with SVM.
34 schizophrenias, 34 HCs.
C.W. Espinola et al. [27]2021Voice;Acoustic feature extraction, particle swarm optimization (PSO)-based feature selection, and classification using SVM.
20 schizophrenias, 11 HCs;
96.9 min HC, 125.7 min schizophrenia
10 s segmentation.
A.N. Chandran et al. [28]2021EEG [18,19];Time-domain-based feature extraction and classification deploying long short-term memory (LSTM).
14 schizophrenias, 14 HCs;
4 s segmentation
D. Lei et al. [29]2019MRIsGray matter, white matter, low-frequency fluctuation, regional homogeneity, structural covariance matrices, and functional connectivity matrices and SVM classifier.
Combination of five data sets;
295 schizophrenias, 452 HCs;
H. Akbari et al. [30]2021EEG [18,19];Graphical feature extraction, forward feature selection algorithm, and classification with kNN.
14 schizophrenias, 14 HCs;
Z. Aslan and M. Akin [31]2020Two EEG data sets:Spectrogram images from EEG signals and classification using VGG16 deep network.
Data set 1: 45 schizophrenias, 39 HCs [32],
Data set 2: 14 schizophrenias, 14 HCs [18,19];
5 s segmentation.
Table 2. Attributes of the data set used in this work.
Table 2. Attributes of the data set used in this work.
FeatureValue
Groups14 Schizophrenic groups, 14 control groups
Gender28 Patients (14 males, 14 females)
Average Age27.9 ± 3.3 (7 schizophrenic males)
28.3 ± 4.1 (7 schizophrenic females)
26.8 ± 2.9 (7 healthy males)
28.7 ± 3.4 (7 healthy females)
Length of Each EEG Segment25 s (250 × 25 = 6250)
Table 3. Generated cyclic group of 17 orders.
Table 3. Generated cyclic group of 17 orders.
G139101351511161487412261
G258613142101612911431571
G362124781416111551310931
G471534119121610214136851
G510151446951672313118121
G611254108316615121379141
G712811133271659641415101
G814971312156163810452111
Table 4. Fine-tuned hyperparameters of the kNN classifier.
Table 4. Fine-tuned hyperparameters of the kNN classifier.
HyperparameterValue
k1
DistanceEuclidean
WeightNone
Standardize DataTrue
Table 5. Parameters of our CGP17Pat-based EEG classification model.
Table 5. Parameters of our CGP17Pat-based EEG classification model.
PhaseParameters
Feature ExtractionMAP: 2-, 4-, and 8-sized overlapping blocks were used
CGP17Pat: 16-sized overlapping blocks were used, and eight patterns were deployed
INCARange: [100–1000]
Error function: kNN
ClassificationFine kNN with 10-fold cross-validation and LOSO
Iterative Hard Majority VotingThe iteration range selected was [3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19]
Table 6. The 10-fold cross-validation and LOSO cross-validation results (%) of the CGP17Pat-based model.
Table 6. The 10-fold cross-validation and LOSO cross-validation results (%) of the CGP17Pat-based model.
Channel10-Fold Cross-ValidationLOSO Cross-Validation
AccuracySensitivitySpecificityGeometric MeanAccuracySensitivitySpecificityGeometric Mean
Fp199.4799.3699.6199.4975.4869.6582.5675.83
Fp298.9599.0498.8498.9482.2280.0384.8882.42
F799.4799.2099.8199.5082.4080.8384.3082.55
F399.3099.2099.4299.3173.9969.4979.4674.31
Fz98.7798.5699.0398.8071.7270.1373.6471.86
F499.3099.5299.0399.2871.8066.7777.9172.13
F899.1299.3698.8499.1077.5877.9677.1377.54
T399.3999.2099.6199.4179.6880.5178.6879.59
C399.3099.0499.6199.3371.2877.4863.7670.28
Cz98.7798.7298.8498.7871.1068.0574.8171.35
C499.6599.5299.8199.6674.9669.1781.9875.30
T499.6599.5299.8199.6681.6182.2780.8181.54
T599.5699.3699.8199.5881.6180.6782.7581.70
P399.6599.5299.8199.6672.5073.8070.9372.35
Pz99.8299.8499.8199.8276.0980.3570.9375.49
P699.4799.5299.4299.4779.6077.8081.7879.76
T699.5699.6899.4299.5574.6971.7378.2974.94
O199.6599.3610099.6879.9577.4882.9580.16
O299.6599.5299.8199.6679.6078.1281.4079.74
Table 7. The calculated voted results (%) according to the 10-fold cross-validation and LOSO cross-validation.
Table 7. The calculated voted results (%) according to the 10-fold cross-validation and LOSO cross-validation.
ValidationNumber of ChannelsAccuracySensitivitySpecificityGeometric Mean
10-fold399.9199.8410099.92
LOSO1784.337793.2284.72
Table 8. Automatic schizophrenia classification based on EEG signals (2019–2021).
Table 8. Automatic schizophrenia classification based on EEG signals (2019–2021).
Author(s)YearMethodSegmentationValidationResult(s)
R. Buettner et al. [17]2020Spectral analysis, random forest1 min10-Fold cross-validationAcc. = 96.77
Bac. = 96.77
Kap. = 93.55
R. Buettner et al. [43]2019Independent component analysis, random forest-10-Fold cross-validationAcc. = 71.43
Bac. = 80.0
P.T. Krishnan et al. [44]2020Multivariate empirical model decomposition, entropy computation, recursive feature elimination, and SVM2 s10-Fold cross-validationAcc. = 93.0
Auc. = 98.31
Sen. = 94.0
Spe. = 92.0
Pre. = 92.71
FScr. = 93.04
A.N. Chandran et al. [28]2021Time-domain feature extraction, long short-term memory (LSTM)4 sHoldoutAcc. = 99.0
Pre. = 99.2
88:12Rec. = 98.9
FScr. = 99.0
K. Singh et al. [45]2021Fast Fourier transform, spectral feature extraction, CNN, and LSTM5 sHoldoutAcc. = 98.96
Sen. = 99.05
90:10Spe. = 98.88
FScr. = 98.87
S.L. Oh et al. [21]2019Custom convolutional neural network (CNN) design, subject and non-subject based testing25 s10-Fold cross-validationNon-Sub.
Acc. = 98.07
Sen. = 97.32
Spe. = 98.17
Subject
Acc. = 81.26
Sen. = 75.42
Spe. = 87.59
M. Baygin [46]2021Tunable Q-factor wavelet transform (TQWT), statistical moment, ReliefF, and kNN25 s10-Fold cross-validationAcc. = 99.12
Pre. = 99.04
Rec. = 99.36
Geo. = 99.10
FScr. = 99.20
K. Kim et al. [47]2021Microstate features; statistical, frequency, and time domain features; t-test; recursive feature elimination; SVM5 s10-Fold cross-validationAcc. = 75.64
Auc. = 80.19
Sen. = 71.93
Spe. = 75.50
M. Krishnaveni et al. [48]2019Non-local mean algorithm, empirical mode decomposition, discrete Fourier transform, mel-warp triangular filter, and optimized backpropagation neural network-10-Fold cross-validationAcc. = 90.26
Sen. = 88.64
Spe. = 89.17
V. Jahmunah et al. [20]2019Nonlinear feature extraction, t-test, and SVM25 s10-Fold cross-validationAcc. = 92.91
Sen. = 93.45
Spe. = 92.24
H. Akbari et al. [30]2021Graphical feature extraction, forward selection algorithm, and kNN-10-Fold cross-validationAcc. = 94.80
Sen. = 94.30
Spe. = 95.20
Z. Aslan and M. Akin [31]2020Spectrogram images from EEG signals, VGG16-based CNN5 s-Acc. = 97.0
Rec. = 97.0
FScr. = 97.0
A. Shoeibi et al. [49]2021CNN and LSTM25 s5-Fold cross-validationAcc. = 99.25
Pre. = 98.33
Rec. = 98.86
Auc. = 99.73
M. Sharma and U.R. Acharya [50]2021L1 Norm, ES-KNN25 s10-Fold cross-validation and LOSO10-fold CV
Acc. = 99.21
LOSO CV
Acc. = 97.2
Our MethodCGP17Pat, MAP, INCA, kNN, and iterative hard majority voting25 s10-Fold cross-validation and LOSO10-fold CV
Acc. = 99.91
LOSO CV
Acc. = 84.33
Acc. = accuracy; Sen. = sensitivity; Spe. = specificity; Bac. = balanced accuracy; Kap. = kappa; FScr. = F-score; Pre. = precision; Rec. = recall; Geo. = geometric mean; SVM = support vector machine; kNN = k-nearest neighbor; CV = cross-validation.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Aydemir, E.; Dogan, S.; Baygin, M.; Ooi, C.P.; Barua, P.D.; Tuncer, T.; Acharya, U.R. CGP17Pat: Automated Schizophrenia Detection Based on a Cyclic Group of Prime Order Patterns Using EEG Signals. Healthcare 2022, 10, 643. https://doi.org/10.3390/healthcare10040643

AMA Style

Aydemir E, Dogan S, Baygin M, Ooi CP, Barua PD, Tuncer T, Acharya UR. CGP17Pat: Automated Schizophrenia Detection Based on a Cyclic Group of Prime Order Patterns Using EEG Signals. Healthcare. 2022; 10(4):643. https://doi.org/10.3390/healthcare10040643

Chicago/Turabian Style

Aydemir, Emrah, Sengul Dogan, Mehmet Baygin, Chui Ping Ooi, Prabal Datta Barua, Turker Tuncer, and U. Rajendra Acharya. 2022. "CGP17Pat: Automated Schizophrenia Detection Based on a Cyclic Group of Prime Order Patterns Using EEG Signals" Healthcare 10, no. 4: 643. https://doi.org/10.3390/healthcare10040643

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop