Next Article in Journal
Adapting to Altered Sensory Input: Effects of Induced Paresthesia on Goal-Directed Movement Planning and Execution
Next Article in Special Issue
Frequency, Characteristics, and Correlates of Cognitive Complaints in a Cohort of Individuals with Post-Acute Sequelae of COVID-19
Previous Article in Journal
A Dynamic Probabilistic Model for Heterogeneous Data Fusion: A Pilot Case Study from Computer-Aided Detection of Depression
Previous Article in Special Issue
Reliability and Validity of the Geriatric Depression Scale in a Sample of Portuguese Older Adults with Mild-to-Moderate Cognitive Impairment
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Mental Stress Classification Based on Selected Electroencephalography Channels Using Correlation Coefficient of Hjorth Parameters

1
School of Computer Science & Engineering, Taylor’s University, Jalan Taylors, Subang Jaya 47500, Selangor, Malaysia
2
Institute for Intelligent Systems Research and Innovation, Deakin University, Geelong, VIC 3216, Australia
3
Department of Electrical Engineering, Abu Dhabi University, Abu Dhabi P.O. Box 59911, United Arab Emirates
4
Computer Science Department, KICT, International Islamic University Malaysia, Kuala Lumpur 53100, Selangor, Malaysia
*
Author to whom correspondence should be addressed.
Brain Sci. 2023, 13(9), 1340; https://doi.org/10.3390/brainsci13091340
Submission received: 10 July 2023 / Revised: 11 September 2023 / Accepted: 13 September 2023 / Published: 18 September 2023
(This article belongs to the Special Issue Mental Stress and Cognitive Deficits Management)

Abstract

:
Electroencephalography (EEG) signals offer invaluable insights into diverse activities of the human brain, including the intricate physiological and psychological responses associated with mental stress. A major challenge, however, is accurately identifying mental stress while mitigating the limitations associated with a large number of EEG channels. Such limitations encompass computational complexity, potential overfitting, and the prolonged setup time for electrode placement, all of which can hinder practical applications. To address these challenges, this study presents the novel CCHP method, aimed at identifying and ranking commonly optimal EEG channels based on their sensitivity to the mental stress state. This method’s uniqueness lies in its ability not only to find common channels, but also to prioritize them according to their responsiveness to stress, ensuring consistency across subjects and making it potentially transformative for real-world applications. From our rigorous examinations, eight channels emerged as universally optimal in detecting stress variances across participants. Leveraging features from the time, frequency, and time–frequency domains of these channels, and employing machine learning algorithms, notably RLDA, SVM, and KNN, our approach achieved a remarkable accuracy of 81.56% with the SVM algorithm outperforming existing methodologies. The implications of this research are profound, offering a stepping stone toward the development of real-time stress detection devices, and consequently, enabling clinicians to make more informed therapeutic decisions based on comprehensive brain activity monitoring.

1. Introduction

According to recent neurosciences, the human brain is often considered the main target organ of mental stress due to its responsibility for distinguishing between situational circumstances (stressful/threatening or normal situations) [1]. To study the changes in brain activities during stress conditions, several non-invasive neuroimaging modalities have been used, such as functional magnetic resonance imaging (fMRI), positron emission tomography (PET), magnetoencephalography (MEG), electroencephalography (EEG), and functional near-infrared spectroscopy (fNIRS) [2,3]. EEG is a widely preferred modality for assessing brain functionalities due to its non-invasive nature, high temporal resolution, ease of setup, commercial availability, and comparatively low cost [4]. Accordingly, researchers use EEG in various domains that involve neural engineering, neurosciences, and biomedical sciences (e.g., brain–computer interfaces, BCIs) [5,6]. EEG signal plays a crucial role in several EEG-based research and application areas such as clinical applications for epilepsy [7], depression [8,9], the effective monitoring of emotion [10], mental stress [11,12,13], and sinogram [14].
Multiple EEG channels are often used for brain signal acquisition from multiple locations on the scalp to offer both high temporal and spatial resolutions. However, reducing the number of channels in the signal processing setup is necessary since the setup procedure with a high number of channels is time-consuming and can result in subject discomfort. Furthermore, it increases the system’s computational complexity, which is required to be low in specific applications [15,16]. Therefore, channel selection methods play a vital role in the reduction in complexity and high dimensionality of the feature vector space to improve overall performance. This increases the chances of building commercial wearable devices to provide a better diagnosis and accurate treatment for mental stress [17,18].
The common approach to channel selection methods is based on neuroscience skills where data from each region of the brain are highly correlated to some specific tasks. For example, the prefrontal region of the brain is highly associated with cognitive processing such as emotions, thoughts, and actions [2]. Meanwhile, central lobes relate to motor imagery tasks in BCI systems [15]. Consequently, several EEG channel selection methods based on specific tasks have been proposed [19,20] such as sequential floating forward selection (SFFS) in BCIs [21], normalized mutual information selection (NMIS) and minimum redundancy maximum relevance (mRMR) [22] in emotion recognition, spatiotemporal-filtering-based feature selection [20] in BCIs, and harmony search algorithm for alcoholism detection [23]. Their findings revealed that they can reduce channels and maintain the classification performance of the given task. Yet, current channel selection methods suffer from poor performance and/or lack a neurophysiological basis [24].
Apart from that, these methods may demonstrate limitations in terms of eliminating irrelevant channels or reducing redundant channels [22]. It is known that the execution of a single task by a participant will trigger functional changes in different brain regions [15]. One could argue that employing all the channels of EEG not only increases the system’s complexity, but also introduces noise, which might decrease the classification performance. Thus, finding an optimal channel selection method is needed to reduce computational complexity and minimize the occurrence of the over-fitting problem, which may be caused by the issue known as the “curse of dimensionality”, in which the error increases as the number of features increases [22].
In addition to the above, the channel selection methods rely on feature extraction methods that extract temporal, spectral, or spatial EEG patterns of signal processing. The feature extraction approaches have been used effectively in improving the EEG classification performance. However, each EEG channel may contain more than one feature, which results in a sharp increase in feature vector space in multi-EEG channels.
Therefore, current research approaches have employed feature selection methods to find the optimal number of features without reducing the EEG channels. Applying feature selection only in multi-EEG channels can be useful in the laboratory because it provides high accuracy due to high spatial resolution. On the other hand, it is not practically effective in home-based applications or daily usage due to the long setup time for electrode placements, which increases computational complexity and affects the comfort level of the user wearing the device. As a result, several methods for obtaining the relevant channels to the source localization of the intended tasks were proposed. The approach for selecting EEG channels could be seen as a feature selection problem. However, the major difference is that channel selection evaluates all features from one channel as a single entity [22].
In terms of EEG features utilized in channel selection methods, Wang [22] adopted EEG spectrogram representations of short-time Fourier transform (STFT) for each channel by treating the data as time–frequency images passed to SVM for emotion classification. Meanwhile, Park [15] and Jing [24] employed raw EEG signals of each channel with the correlation coefficient methods in motor imagery (MI) tasks. In [22], a channel selection method was proposed to select a relevant subset of EEG channels using normalized mutual information (NMI). The method achieved 74.41% and 73.64% accuracy for emotion classification of valence and arousal, respectively, with only eight channels selected. Another proposed method by the authors of [25] used the ReliefF algorithm to find the subset channels corresponding to mental fatigue classification using multi-domain features, and this method succeeded in reducing the number of channels from sixteen channels to eight optimal channels with acceptable accuracy.
The EEG signal is non-stationary but has an event-dependent property for the given task. Therefore, it is important to analyze the changes in the signal with time. Time–frequency feature extraction methods are preferred because they retain the information of both time and frequency. However, time–frequency features such as STFT have high computational complexity while redundant frequency information remains to be solved in real-time STFT applications [26]. The Hjorth parameter proposed in [26] is considered to be a superior alternative to the STFT due to its high ability to extract important information in both the temporal and frequency domains via a simple computing process.
In 1970, Hjorth [27] introduced a set of three time domain parameters to quantify the EEG signal. The Hjorth parameters are often referred to as the normalized slope descriptors due to their ability to be explained by means of first and second derivatives. The first parameter is a mean power value that represents the signal’s activity. The second parameter, called mobility, represents the approximation of the mean frequency. The third parameter is called complexity, which estimates the signal’s bandwidth. Hjorth parameters are computed using variance; thus, they have a low computing cost in comparison to other methods [28]. According to Hjorth, this approach establishes a link between a physical time domain interpretation and the more traditional frequency domain description. Additionally, the time domain context of the Hjorth representation could be advantageous for scenarios requiring continuous EEG analyses for real-life applications. Several studies have successfully employed Hjorth parameters to extract information from various bio-signals, including the detection of the heart rate from the electrocardiogram (ECG) signal, the classification of lung sounds, the classification of the electromyogram (EMG) signal, the diagnosis of hyperactivity (ADHD), epilepsy, and emotion [29,30]. Additionally, Safi et al. [30] reported that EEG Hjorth features improved the detection rate of Alzheimer’s disease.
Efficient channel selection remains a challenging domain in EEG studies for accurately identifying various cognitive states using optimal channels. A range of research have been proposed, each focusing on specific applications and domains related to EEG data. These aim to identify the most informative channels, while simultaneously achieving better computational efficiency and maintaining acceptable accuracy. In Jin’s 2022 study [31], a novel EEG rhythm energy heatmap was proposed, pinpointing optimal channels for each participant and achieving an average classification accuracy of 63.39%. However, the method’s constraint was the variability in the number of channels selected across participants. Moctezuma [32] utilized a multi-objective optimization method with the non-dominated sorting genetic algorithm (NSGA) for an epileptic seizure classification of 24 patients. Notably, it was observed that employing the full set of channels resulted in an accuracy of 0.95. However, the use of only two selected channels increased this accuracy to 0.975%. Wang, 2019 [22], focused on emotion recognition from EEG signals, proposing a channel selection method based on normalized mutual information (NMI). This method drastically reduced channels while maintaining an acceptable accuracy of 74.41% for valence and 73.64% for arousal on the DEAP database. Lokesh, 2022 [33], presented a deep learning model by presenting a hybrid of Convolution Neural Network and Bidirectional Long Short-Term Memory (CNN–BLSTM), focusing on stress levels by utilizing the Physionet EEG dataset. The study found that, with only 19 channels, the accuracy of individual detection can increase up to 99.20%. In Yuxi 2023 [34] study, he proposed a channel optimization algorithm based on sparse logistic regression (SLR), which managed to filter between 75 and 96.9% of channels, resulting in an accuracy increment of 1.65–5.1%. Notably, this method maintained accuracy even with only 2–15 common EEG electrodes across different participants. Hasan, 2020 [35], combined EEG with functional near-infrared spectroscopy (fNIRS) in a hybrid system, selecting only the most correlated channels from each hemisphere and achieving a comparable classification accuracy to existing studies. Pawan, 2023 [36], delved into motor imagery (MI) activity in EEG data, using the Pearson correlation coefficient (PCC) for channel selection. Remarkably, the model selected 14 channels for the sensorimotor area of the brain and achieved maximum accuracies of 91.66% and 90.33% with SVM and K-NN classifiers, respectively. Additionally, Park, 2020 [15], introduced a method for enhancing features for MI classification. Instead of selecting channels based on signal power, the method identified channels through correlation coefficient values, optimizing performance for MI classification tasks.
Compared to other CS methods, correlation-based CS methods have gained researchers’ interest due to their ability to enhance computational efficiency by improving signal-to-noise ratio and offering insights into underlying contextual processes. Their simplicity and adaptability make them especially suitable for diverse applications, ensuring robust results for accuracy and dimensional reduction. For instance, different extensions of correlation-based CS of common spatial pattern (CSP) methods were proposed. The correlation-based channel selection regularized CSP (CCS-RCSP) methods were proposed to find the optimal channels related to motor imagery (MI) tasks using the correlation coefficient [24]. The CCS-RCSP is trained to select the channels that are highly correlated to the MI task. Another extension called filter-bank CSP (FBCSP) was proposed by Park [15] for MI task classification. Additionally, cross-correlation-based discriminant criterion (XCDC) was proposed by the authors of [37] to find the optimal subset channels that are capable of discriminating MI tasks. Another extension of CSP was proposed by the authors of [38] to select internal features and channels based on the difference and the ratio of average L1-Norm for CSP (DRL1 CSP). However, the results of these approaches still provide many channels with the classification task and are specific to the MI task.
A persistent challenge in current channel selection research is the inherent individual differences in brain activity, especially concerning stress tasks. Many studies focus on identifying significant channels for each individual through dependent and/or independent tests. However, this individualization introduces complexities when seeking common significant EEG channels that can be applied across multiple subjects. Overcoming this challenge and pinpointing such universally significant EEG channels could help in the development of real-life applications for stress recognition.
To address the points mentioned above, our key contributions to this work are as follows:
  • We introduce an innovative channel selection approach leveraging the correlation coefficient of Hjorth parameters. This method not only identifies, but also ranks universally significant EEG channels across different subjects, ensuring that the classification accuracy remains uncompromised.
  • We introduce a new methodology to extract important features from the general optimal channels.
  • We validate and compare the effectiveness of the proposed method with the state-of-the-art channel selection methods.
The rest of this paper is structured as follows. In Section 2, the methods and materials, including details of the dataset and data annotations, are described. Section 3 describes the main proposed method for channel selection. Section 4 details the feature set extracted from general optimal channels. Section 5 provides the ML algorithm, the parameters used, and the evaluation matrix. The results of the proposed method and a comparison with existing methods are discussed in Section 6. The detailed discussion of this work follows in Section 7, and the conclusion is given in Section 8.

2. Materials and Methods

2.1. EEG Dataset

The Dataset for Emotion Analysis using Physiological Signals (DEAP) is a public EEG dataset for emotion recognition [39]. The DEAP comprises data collected at a 512 Hz sampling frequency from 40 physiological channels (32 EEG channels and 8 other physiological channels). In total, 32 healthy subjects participated, with an equal gender distribution of 50% males and 50% females. The EEG data were collected while participants watched selected music videos (40 videos/trials, with each trial lasting one minute) representing the emotion wheel. All participants completed the self-assessment manikin (SAM) [40], rating their arousal levels, like/dislike, valence, and dominance on a scale from 1 to 9. Each subject had 40 trials, with each trial being 63 s long, which included a 3 s pretrial.
The DEAP authors provided preprocessed EEG data. The original EEG data were downsampled to 128 Hz. A band-pass filter ranging from 4.0 to 45.0 Hz was applied to eliminate noise caused by 50/60 Hz line-power and to remove low frequencies (below 4 Hz) resulting from eye blinks. Additionally, artifacts caused by EOG were removed. In this paper, we utilized the preprocessed EEG data provided by DEAP for the mental stress classification task.

2.2. EEG Data Annotation

For the 32 EEG channels, data were annotated based on the online self-assessment rating, the SAM scale provided by DEAP, for valence and arousal. In this study, the online self-assessment rating was utilized to distinguish between calming and stressful tasks for each participant, as defined by Equation (1) and as outlined in [41,42]:
stress = ( valence < 3 ) ( arousal > 5 ) , calm = ( 4 < valence < 6 ) arousal < 4 )
Valence refers to the pleasantness of the stimulus on a scale of negative to positive, while arousal refers to the intensity level of emotion induced by the stimuli and scales between calm (or low) and excited (or high). A calm state is considered when arousal is low and valence is high. Meanwhile, the stress state is obtained from low valence and high arousal. When the criteria from Equations (1) and (2) were applied to each subject data, seven subjects (with participant IDs: 3, 6, 7, 9, 17, 23, 30) were removed since their data did not contain both stress and calm states. Thus, the rest of the analysis continued with the remaining data of 25 participants.

3. Hjorth Multi-Correlation Coefficient

Figure 1 depicts the general flow for selecting channels based on correlation to identify an optimal EEG channel. Essentially, the proposed method favors channels that show strong correlation with class tasks and maintain minimal correlation with each other across various trials. This channel reduction hinges on the premise that specific EEG channels, relevant to the EEG Mental Stress Task (MST), consistently exhibit similar features across all experiment trials when a subject undergoes identical tasks. In contrast, other channels might be less contributive as they are not closely associated with MST. Consequently, we undertook the following procedures to meticulously devise a correlation-centric channel selection approach.
First, we extracted three features of Time Domain Hjorth Parameters (TDHPs), namely activity, mobility, and complexity, from each EEG channel. These parameters offer the advantage of a quantitative evaluation of the EEG signal in the time domain. Table 1 details the TDHPs and their equations. Subsequently, the correlation among these channels was determined based on the statistical measurement of the TDHPs feature set. Next, upon extracting the TDHPs feature vectors for each channel, we applied feature-wise Z-score normalization. This was performed by subtracting each sample value from its feature-wise mean and then dividing the result by the corresponding standard deviation. Finally, we employed the correlation coefficient (CC) method, taking into account the features extracted, to facilitate both channel–channel and channel–class correlations. The subsequent sections delve deeper into the specifics of the CC method.

Correlation Coefficient Measures

Pearson’s correlation utilizes similarity measurement to find the strength of a linear association between any pair of channels or features in a one-dimensional space. For a given N channel, there can be N ( N 1 ) / 2 possible pairs for calculating correlations. The pairs of values are considered highly correlated if the correlation coefficient is close to ± 1 and uncorrelated if the correlation coefficient is 0 or below a threshold value (i.e., 0.5). The best way to find an optimal projection of the selected channel is to maximize the separation between the two classes. For instance, let us assume that there are two classes of observations (s, c∈ (stress, calm)). In a one-dimensional feature space, the separation between two classes is defined by the correlation coefficient: let T D H P A , C , M represent the features of the activity, complexity, and mobility corresponding to x ( s , c ) for classes (stress and calm). The channel–channel-based correlation is computed using the equation below:
P x ( S , K ) = 1 l x i = 1 l x c o v ( A i S , A i K ) + c o v ( M i S , M i K ) + c o v ( C i S , C i K ) A i S ˜ A i K ˜ + C i S ˜ C i K ˜ + M i S ˜ M i K ˜
where x s , c represents the classes of stress and calm, l x represents the total number of trials of the given class, ( S , K ) represents the pair channel index, A i s ˜ A i c ˜ , M i s ˜ M i c ˜ , C i s ˜ C i c ˜ are the standard deviations of TDHPs (activity, complexity, and mobility), and c o v ( A i S , A i K ) is the covariance of T i S , T i K , where T = A, M or C, and which can be calculated using:
c o v ( T i s , T i k ) = 1 N 1 i = 1 N ( T i s T i s ¯ ) ( T i k T i k ¯ ) .
T i s ¯ , T i k ¯ represent the mean of the sample variables T i s and T i s , respectively. Then, we computed the main of the two pair channels, as follows:
C h S , K ¯ = P s ( S , K ) + P c ( S , K ) 2
where P s ( S , K ) and P c ( S , K ) are the average correlation of the pair of channels of two classes (s and c) and C h S , K ¯ is the main of the two channels. After obtaining the correlation of the channel–channel-based correlation, we computed the class–channel-based correlation using the equation below of (channel–class correlation):
p ( s , c ) = i = 1 N c o v ( T i s , T i c ) T i s ˜ + T i c ˜
where T T D H P s represents TDHPs’ activity, i indicates an index of the channel, s and c represent classes (stress and calm, respectively), and c o v ( A j s , A j c ) is the covariance of T j s , T j c . The average of two class correlations of a single channel was calculated as:
C h ¯ q = T T D H P s p ( s , c ) , T D H P s = A , M , C .
The F score was used to estimate the discrimination power of the group of TDHP features since the correlation feature selection depends on a single feature [49]. The purpose of the evaluation function is to precisely find the channel subsets that are highly correlated with the class and uncorrelated with each other. Irrelevant channels with low-class correlations will be omitted. The activation function can be expressed as follows:
E j = K C h q ¯ K + K ( K + 1 ) K C h ¯ ( s , k )
where E j is the significant channels evaluated per independent subject, k is the number of channels, C h q ¯ is the mean channel–class correlation with ( C h S ) , and the C h c h ¯ is the average channel–channel based on inter-correlation.
For general optimal channels among subjects, we counted the frequency of occurrence of each significant channel E j of subjects as the following equation:
U ( j , p t ) = U ( j , p t + 1 ) , i f U j = E ( j , k ) U ( j , p t ) , i f U j E ( j , k )
where U ( j , p t ) is the overall unique significant channels among all subjects and p t represents the total unique occurrences of each channel. Then, we ranked them from high to low occurrences and applied a threshold to select the most commonly occurring channels among subjects that appeared in the significant channel sets:
G j , o p t i m a l = { U j U ( j , p t ) | p t f t h r } .
G j , o p t i m a l represents the general unique significant channels that exist as significant channels on most independent subjects based on the threshold, p t represents the total number of occurrences of each channel, f t h r is the threshold, and U ( j , p t ) represents the matrix of each unique channel with its repeated number of occurrences. The channel selection based on the correlation coefficient of Hjorth parameters is given by Algorithm 1. These general optimal channels are used for the rest of this paper.
Algorithm 1: Channel selection algorithm based on the correlation coefficient of Hjorth’s parameters.
Input: N p = number of participants, K = number of channels
N t r = number of trials.
Activation F u n c t i o n ( E i ) = K C h q ¯ K + K ( K + 1 ) K C h ¯ ( s , k ) .
X = NULL, subset channels that highly correlated with class and low correlated to other channels.
U = NULL, is general ranked channel set among participants.
Result: General Optimal Ranked Channel Set ( U )
Method:
Brainsci 13 01340 i001

4. Feature Extraction

The preprocessed DEAP EEG signals of each participant comprised 40 trials where each trial had 7680 samples (60 s long). In the study by Shon [42], each trial was divided into 16 parts, yielding 480 samples (4 s long) per part. This led to a total of 640 segments per subject (40 trials × 16 segments), which were utilized in this study. Subsequently, we computed the EEG feature extraction of time, frequency, and time–frequency domains from the segmented trial having a time window size of 4 s for the selected general optimal channels proposed by our model. The selected time window size is backed by previous studies which have found that the window size between 3 and 12 s is effective for classifying individuals’ mental status using EEG signals [50,51]. Furthermore, the number of data points within the 4 s is appropriate to demonstrate the stationarity of EEG signals and thus affirm the reliability for achieving channel selection [52,53].
Table 1 presents the features’ descriptions, mathematical equations and the count of each feature per channel used in this study. While previous studies have utilized several time domain features for EEG mental stress and emotion classifications [3,42,51], in this study, we opted to extract multi-domain features. From the time domain, these include: line length, peak-to-peak amplitude, kurtosis, skewness, and Hjorth parameters (activity, mobility, and complexity) of the signal. Concurrently, five features from the frequency domain were extracted based on the relative powers [46] of theta θ (4–8 Hz), low alpha α (8–12 Hz), high alpha α (12–15 Hz), low beta β (15–20 Hz), and high beta β (20–30 Hz). From the time–frequency domain, eight features were derived: six features from the energy of wavelet decomposition coefficient (db4, 6 levels) [11,47], and the spectral entropy of PSD-Welch [48] and Katz’s fraction dimension [43].
A total of 20 features, elaborated in Table 1, were used as a feature set for the optimally selected channels.

5. Classification

Both the general optimal selected channels of CCHP and all EEG channels were assessed to distinguish between mental stress and calm emotional state using two classifiers. In the studies of Hasan and Kim [41,42], KNN was employed to classify mental stress and calm state for the DEAP dataset and demonstrated high performance. However, as highlighted in a report by Alex [54], the most common classifier technique applied to EEG signals is SVM. Moreover, in our recent work [55], where we used seven classifiers for an EEG analysis of mental stress, SVM was found to outperform the others. Consequently, in this study, we employed both (Regularized Linear Discriminant Analysis) RLDA, SVM, and KNN to evaluate the proposed method and assess their performance with a minimum number of channels. Herein, RLDA, SVM, and KNN were implemented in Python to classify data into two categories (stress and calm). Table 2 lists the parameter values assigned to each classifier. For each classifier, an independent subject test with 10-fold cross-validations was conducted.
A total of 20 features from multiple domains were extracted from each EEG channel to compose a comprehensive feature vector, as depicted in Table 1. Subsequently, the features of selected EEG channels for each subject were randomly divided into 10 equal subsets based on the 10-fold validation. During each iteration, one unique subset was designated as the test set while the remaining nine subsets were combined to form the training set. We utilized the following metrics to evaluate the performance of the classifiers: precision, recall, and accuracy. Precision denotes the ratio of correctly predicted positive cases to the total predicted positive cases. Recall is characterized as the ratio of correctly predicted positive cases to all observations in the actual class. Meanwhile, accuracy is quantified as the percentage of correct predictions for the test data. The mathematical formulations of precision, recall, and accuracy are enumerated in Equations (10)–(12):
P r e c i s i o n = T p T p + F p
R e c a l l = T p T p + F n
A c c u r a c y = T p + T n T p + T n + F p + F n
where T p represents the total samples of true positive, F n represents the false negative, T n represents the true negative, and F p is the false positive.

6. Result Analysis and Classification

6.1. Analysis of Channel Selection

The proposed method of CCHP is based on the filter approach which considers an information-based or statistical criterion to provide feedback to the searching algorithms without the classifier’s involvement. The EEG channels were reduced sharply based on the activation function. In particular, for each subject, the proposed CCHP selects EEG channels that are highly correlated to mental state class and are less correlated to other channels within the same class. Selecting relevant channels that are highly correlated to the class (stress/calm) increased performance accuracy. Similarly, the redundant channels were removed by obtaining the low channel–channel-based correlation from the same class. As a result, each subject presented with some important channels that best discriminate mental stress tasks as shown in Figure 2. To find a common channel among all subjects, we ranked the significant channels based on the occurrence of the mode frequency of significant channels as shown in Figure 3, where the high occurrence channels were ranked first, and so on. To determine which set of channels provides an acceptable accuracy, we have compared different sets of ranked channels, 1, 5, 8, 9, 15, 19, and 32 EEG channels, and found that only 8 EEG channels can significantly classify the mental stress state without affecting performance significantly, as shown in Figure 4. Finally, Figure 5 illustrates the selected eight general optimal channels among all subjects that were ranked based on the occurrence of the best subject-independent channels among all subjects as shown in Figure 6.
Figure 2 illustrates the mean accuracies for differentiating between mental stress and calm states using varying numbers of optimally ranked channels. When the entire set of 32 EEG channels was employed to classify mental stress tasks, an accuracy of 85% was observed. This stands in contrast to the 80% accuracy achieved using only eight channels. Notably, utilizing only the top-ranked channel, CH3, yielded an accuracy of 63.4 ± 17.5%. Configurations with 8, 9, 15, and 19 channel sets registered mean accuracies between 80% and 84%. The data reveal a modest enhancement in accuracy when employing the full suite of EEG channels, likely due to the high spatial resolution that covers different brain regions. Nevertheless, with only eight channels, it is possible to secure a satisfactory accuracy, which can help in recognizing the stress states with an optimal number of channels.
Based on insights from Figure 2, we identified the eight channels (‘AF3’, ‘FC5’, ‘F8’, ‘Fp1’, ‘AF4’, ‘P7’, ‘Fp2’, ‘F7’) as the general optimal channels to classify mental stress. To further validate the efficacy of these selected channels, we conducted a two-sample t-test. The analysis revealed no significant enhancement (p > 0.05) in classification accuracy beyond these eight channels. In conclusion, Figure 5 depicts the location of the general optimal EEG channels on the scalp. These channels were ranked based on the occurrence of the best subject-independent channels and are used throughout the remainder of this paper to recognize the stress/calm mental states of each subject.

6.2. Classification Results

We evaluated the proposed channel selection method of CCHP using RLDA, KNN, and SVM. The mean classification accuracy, recall, and precision of each participant were tested in two methods for all channels and with the proposed general optimal selected channels as summarized in Table 3. The classification performance was tested on the two classes (binary classification) of stress and calm states on the EEG data of the DEAP dataset. The classification accuracy of our model using full channels achieved 85.68%, 82.34%, and 79.04% of SVM, RLDA, and KNN, respectively, which outperformed the other stress detection models on the same DEAP dataset. In comparison, our proposed model with eight channels achieved an average classification accuracy of 81.56%, 79.57%, and 75.68% using SVM, RLDA, and KNN, respectively. This suggests that an increased number of EEG channels can lead to a slight increase in accuracy performance.

6.3. Performance Comparison of Mental Stress with Existing Methods in DEAP Dataset

To validate the proposed method, we applied the same procedure to the existing methods. Then, we compared the proposed method with the existing methods listed in [22,42] of minimum-redundancy-maximum-relevance (mRMR), short-time Fourier transform with mutual information (STFT + MI), and genetic algorithm (GA). Table 4 summarizes the comparison results of these methods, taking into account the results of three important parameters: the number of selected channels, classification accuracy, and execution time. We further conducted a statistical analysis using the Friedman test for the methods in Table 4 and we found that there was no significance in terms of classification accuracy with F r = 4.1667 and p-value = 0.244. These results confirm the reliability of the proposed method. However, in terms of the number of channels selected, CCHPs obtained fewer optimal channels that are most related to mental stress tasks. The results show that the proposed method yielded the best result in selecting an optimal number of channels within the shortest time compared to the rest of the methods, with eight channels and a 340 ms execution time. Additionally, with regard to classification performance, the proposed method achieved higher results than mRMR but slightly lower than STFT-MI and GA. This difference was attributable to the larger number of channels in GA and STFT-MI. A comparison of different channel selection methods revealed that a minimum number of EEG channels not only reduced the complexity of feature dimensional space, but also preserved the accuracy and reduced the time needed to set up the channels on the scalp. Furthermore, the proposed model results were compared with other related works using EEG signals of the DEAP dataset to recognize mental stress as shown in Table 5. It is evident that our proposed GOC and design paradigm surpassed related works in terms of stress/calm classification with only a minimum number of channels used, with an 81.65% accuracy obtained by eight channels compared to 73.38% of the highest accuracy achieved by Hassan in his study [41]. In addition, Table 6 compares the effectiveness of our proposed channel selection method using different datasets.

7. Discussion

The primary objective of our study was to pinpoint the brain regions most sensitive to detecting mental stress states via EEG as we realized that this holds the promise of developing accurate wearable technologies capable of diagnosing mental stress in real-time. Guided by this goal, we introduced an innovative channel selection method based on the correlation coefficient of Hjorth parameters. This method was meticulously tailored to both identify and rank EEG channels in terms of their sensitivity to stress states. A distinctive aspect of our approach involved a comprehensive evaluation, wherein we assessed the effectiveness of various channel groupings, namely 1, 5, 8, 9, 15, 19, and the entire EEG channels. As illustrated in Figure 5, a subset of eight channels (‘AF3’, ‘FC5’, ‘F8’, ‘Fp1’, ‘AF4’, ‘P7’, ‘Fp2’, ‘F7’) as general optimal channels (GOCs) emerged as superior in distinguishing mental stress across a majority of subjects. Notably, these channels predominantly localize in the frontal lobe, as depicted in Figure 5. Our observations align with prior research, which emphasizes the pronounced sensitivity of the frontal brain region to stress [57,58,59]. This sensitivity can be attributed to the Prefrontal Cortex (PFC) of the scalp in both hemispheres. Neurophysiologically, the frontal region’s heightened stress sensitivity can be tied to the Prefrontal Cortex (PFC)’s involvement in executive functions and emotional regulation, its dense dopaminergic pathways affecting stress response, and the influential connectivity between the emotion-centric amygdala and the PFC. These elements collectively highlight the frontal brain’s intricate role in mental stress, offering avenues for optimized EEG channel selection and refining stress recognition systems.
In this paper, we compared the results of the proposed GOC with full EEG channels as shown in Table 3. We observed a slight increase in accuracy when using full channels compared to GOCs, with average accuracies of 85% and 80%, respectively. These results align with previous studies, which demonstrated that full EEG channels could boost accuracy compared to optimally selected channels due to the high spatial resolution provided when using full channels. However, using full channels is not suitable for home-based applications due to computational complexity, extended setup time for EEG electrode placements, and higher costs.
The work presented here provides one of the earliest investigations into identifying and ranking the common important channels for mental stress recognition, as depicted in Figure 4. Here, channels were ranked based on GOC weight across all subjects.
To validate our proposed method, we contrasted it with existing approaches. The proposed GOCs in this study yielded a promising result, taking into account computational complexity using execution time, the number of selected channels, and classification performance as presented in Table 4. These results suggest that our method can determine the common essential channels for real-time EEG stress detection while ensuring relatively high accuracy with merely eight channels. Moreover, the outcomes of our method were derived from EEG data from the DEAP dataset and contrasted with other relevant studies that leveraged the same dataset for stress recognition, as indicated in Table 5. The two investigations led by Hasan [41] and Shon [42] utilized EEG data from the DEAP dataset to differentiate between stress and calm states, as defined by Equation (1), by employing all 32 EEG channels with feature selection methods. Their recorded accuracy rates stood at 71.76% and 73.38%, respectively. Hence, our proposed CCHP model demonstrated superior performance over these other models for mental stress classification. Additionally, Patel, 2023 [56], introduced a novel method for detecting emotional stress using EEG data, classifying stress based on emotional state scores. By applying deep learning techniques, including CONV1D-BiLSTM and CONV1D-BiGRU networks, the research achieved accuracy rates of 88.03% and 75%, respectively.
In comparison to the previous studies, it is worth noting that Peter’s approach involves a distinct method of stress data extraction based on valence and arousal scores from 14 channels. This approach introduces a source of variation, making a direct comparison with the earlier studies somehow challenging. Nevertheless, despite this difference in methodology, Peter’s research managed to achieve notable accuracy rates using deep learning techniques.
While our proposed method has proven to be valuable in selecting commonly relevant channels for mental stress classification, it exhibits some limitations. Firstly, our approach primarily utilizes time domain data. Future research should consider features from other domains. Secondly, the dimensionality of our feature vector remains extensive for real-time applications. Integrating our method with feature selection techniques such as Particle Swarm Optimization (PSO) [60], BAT algorithm [61], genetic algorithm (GA) [42], Whale Optimization Algorithm (WOA) [62], and other heuristic optimization methods might mitigate the “curse of dimensionality” and enhance classification performance. Thirdly, although we achieved high accuracy using the selected channels and SVM with default settings, optimizing SVM parameters remains unaddressed. Future studies should explore this optimization for enhanced outcomes. Moreover, exploring approaches like deep learning with the chosen channels presents substantial potential [63]. Lastly, our research concentrated on features within the cortical activation domain. Investigating other feature types, such as functional connectivity network patterns via graph theory analysis or their integration, could further improve stress detection performance, as highlighted in [53,64].

8. Conclusions

In this research, we endeavored to discern between mental stress and calm states by utilizing an optimal selection of EEG channels. We introduced the CCHP method, designed to identify commonly optimal channels across subjects. This approach holds the potential for advancing real-world applications in stress assessment. Our findings underscored that the frontal region of the brain exhibits heightened sensitivity to mental stress. Based on our experimental parameters, the CCHP method ranked channels, with (‘AF3’, ‘FC5’, ‘F8’, ‘Fp1’, ‘AF4’, ‘P7’, ‘Fp2’, ‘F7’) emerging as the optimal channels for differentiating mental stress across participants. Subsequently, we harnessed features from the time, frequency, and time–frequency domains from these eight channels. To train and assess our model, we applied machine learning algorithms, specifically SVM and KNN. Upon comparison with extant methodologies and related studies, our approach demonstrated superior efficacy. Notably, our method successfully differentiated mental stress using only eight channels and achieved a commendable accuracy of 81.56% with the SVM algorithm. The obtained accuracy with the proposed algorithm with eight channels has no significant difference (p-value > 2.4) compared to using 32 channels without feature selection. In essence, our work offers a pioneering model that identifies the most prevalent EEG channels capable of detecting mental stress. Such insights are instrumental for the innovation of portable devices tailored for real-time mental stress detection.

Author Contributions

Conceptualization, A.H.; Methodology, A.H., F.A.-S., D.H. and H.A.; Validation, A.H. and F.A.-S.; Formal analysis, A.H. and F.A.-S.; Resources, H.A.; Writing—original draft, A.H.; Writing—review & editing, F.A.-S., D.H. and H.A.; Supervision, D.H. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded in part by Taylor’s University and Deakin University.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board (or Ethics Committee) of American University of Sharjah (protocol code 19-513 and date of approval 31 March 2020).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Raw EEG data of EDMSS’ dataset can be obtained by writing a formal email to Fares Al-Shargie. http://bcmi.sjtu.edu.cn/home/seed/index.html, https://www.eecs.qmul.ac.uk/mmv/datasets/deap/.

Acknowledgments

The authors would like to thank the support received in part by Taylor’s University and in part of the support by the Journal of Brainsciences.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
CCHPCorrelation Coefficient of Hjorth ParameterA novel approach used to determine the correlation between Hjorth parameters for EEG channel selection
DEAPDataset for Emotion Analysis using Physiological SignalsA widely used dataset for emotion recognition tasks
CSChannel SelectionTechnique used to select the most informative EEG channels
GOCsGeneral Optimal ChannelsThe EEG channels that are found most effective across different subjects
PFCPrefrontal CortexThe front part of the brain, known to be responsive to stress and involved in cognitive functions

References

  1. Dedovic, K.; Renwick, R.; Mahani, N.K.; Engert, V.; Lupien, S.J.; Pruessner, J.C. The Montreal Imaging Stress Task: Using functional imaging to investigate the effects of perceiving and processing psychosocial stress in the human brain. J. Psychiatry Neurosci. 2005, 30, 319. [Google Scholar] [PubMed]
  2. Al-Shargie, F.; Tang, T.B.; Kiguchi, M. Stress Assessment Based on Decision Fusion of EEG and fNIRS Signals. IEEE Access 2017, 5, 19889–19896. [Google Scholar] [CrossRef]
  3. Halim, Z.; Rehan, M. On identification of driving-induced stress using electroencephalogram signals: A framework based on wearable safety-critical scheme and machine learning. Inf. Fusion 2020, 53, 66–79. [Google Scholar] [CrossRef]
  4. Aspiotis, V.; Miltiadous, A.; Kalafatakis, K.; Tzimourta, K.D.; Giannakeas, N.; Tsipouras, M.G.; Peschos, D.; Glavas, E.; Tzallas, A.T. Assessing Electroencephalography as a Stress Indicator: A VR High-Altitude Scenario Monitored through EEG and ECG. Sensors 2022, 22, 5792. [Google Scholar] [CrossRef] [PubMed]
  5. Peksa, J.; Mamchur, D. State-of-the-Art on Brain-Computer Interface Technology. Sensors 2023, 23, 6001. [Google Scholar] [CrossRef]
  6. Sharif, M.S.; Raj Theeng Tamang, M.; Fu, C.H.Y.; Baker, A.; Alzahrani, A.I.; Alalwan, N. An Innovative Random-Forest-Based Model to Assess the Health Impacts of Regular Commuting Using Non-Invasive Wearable Sensors. Sensors 2023, 23, 3274. [Google Scholar] [CrossRef]
  7. Xin, Q.; Hu, S.; Liu, S.; Zhao, L.; Zhang, Y.D. An Attention-Based Wavelet Convolution Neural Network for Epilepsy EEG Classification. IEEE Trans. Neural Syst. Rehabil. Eng. 2022, 30, 957–966. [Google Scholar] [CrossRef]
  8. Hashempour, S.; Boostani, R.; Mohammadi, M.; Sanei, S. Continuous Scoring of Depression From EEG Signals via a Hybrid of Convolutional Neural Networks. IEEE Trans. Neural Syst. Rehabil. Eng. 2022, 30, 176–183. [Google Scholar] [CrossRef]
  9. Wu, W.; Zhang, Y.; Jiang, J.; Lucas, M.V.; Fonzo, G.A.; Rolle, C.E.; Cooper, C.; Chin-Fatt, C.; Krepel, N.; Cornelssen, C.A.; et al. An electroencephalographic signature predicts antidepressant response in major depression. Nat. Biotechnol. 2020, 38, 439–447. [Google Scholar] [CrossRef]
  10. Song, Y.; Yin, Y.; Xu, P. A Customized ECA-CRNN Model for Emotion Recognition Based on EEG Signals. Electronics 2023, 12, 2900. [Google Scholar] [CrossRef]
  11. Al-Shargie, F.; Tang, T.B.; Badruddin, N.; Kiguchi, M. Towards multilevel mental stress assessment using SVM with ECOC: An EEG approach. Med. Biol. Eng. Comput. 2018, 56, 125–136. [Google Scholar] [CrossRef] [PubMed]
  12. Hag, A.; Handayani, D.; Pillai, T.; Mantoro, T.; Kit, M.H.; Al-Shargie, F. A wearable single EEG channel analysis for mental stress state detection. In Proceedings of the 2021 IEEE 7th International Conference on Computing, Engineering and Design (ICCED), Sukabumi, Indonesia, 5–6 August 2021; pp. 1–6. [Google Scholar] [CrossRef]
  13. Hag, A.; Handayani, D.; Altalhi, M.; Pillai, T.; Mantoro, T.; Kit, M.H.; Al-Shargie, F. Enhancing EEG-Based Mental Stress State Recognition Using an Improved Hybrid Feature Selection Algorithm. Sensors 2021, 21, 8370. [Google Scholar] [CrossRef]
  14. Yu, Y.; Liu, Y.; Yin, E.; Jiang, J.; Zhou, Z.; Hu, D. An Asynchronous Hybrid Spelling Approach Based on EEG–EOG Signals for Chinese Character Input. IEEE Trans. Neural Syst. Rehabil. Eng. 2019, 27, 1292–1302. [Google Scholar] [CrossRef] [PubMed]
  15. Park, Y.; Chung, W. Optimal Channel Selection Using Correlation Coefficient for CSP Based EEG Classification. IEEE Access 2020, 8, 111514–111521. [Google Scholar] [CrossRef]
  16. Narayanan, A.M.; Patrinos, P.; Bertrand, A. Optimal versus Approximate Channel Selection Methods for EEG Decoding with Application to Topology-Constrained Neuro-Sensor Networks. IEEE Trans. Neural Syst. Rehabil. Eng. 2021, 29, 92–102. [Google Scholar] [CrossRef]
  17. Gaur, P.; McCreadie, K.; Pachori, R.B.; Wang, H.; Prasad, G. An automatic subject specific channel selection method for enhancing motor imagery classification in EEG-BCI using correlation. Biomed. Signal Process. Control 2021, 68, 102574. [Google Scholar] [CrossRef]
  18. Shen, J.; Zhang, X.; Huang, X.; Wu, M.; Gao, J.; Lu, D.; Ding, Z.; Hu, B. An Optimal Channel Selection for EEG-Based Depression Detection via Kernel-Target Alignment. IEEE J. Biomed. Health Inform. 2021, 25, 2545–2556. [Google Scholar] [CrossRef]
  19. Yin, X.; Meng, M.; She, Q.; Gao, Y.; Luo, Z. Optimal channel-based sparse time-frequency blocks common spatial pattern feature extraction method for motor imagery classification. Math. Biosci. Eng. 2021, 18, 4247–4263. [Google Scholar] [CrossRef]
  20. Qi, F.; Wu, W.; Yu, Z.L.; Gu, Z.; Wen, Z.; Yu, T.; Li, Y. Spatiotemporal-Filtering-Based Channel Selection for Single-Trial EEG Classification. IEEE Trans. Cybern. 2021, 51, 558–567. [Google Scholar] [CrossRef]
  21. Qiu, Z.; Jin, J.; Lam, H.K.; Zhang, Y.; Wang, X.; Cichocki, A. Improved SFFS method for channel selection in motor imagery based BCI. Neurocomputing 2016, 207, 519–527. [Google Scholar] [CrossRef]
  22. Wang, Z.M.; Hu, S.Y.; Song, H. Channel Selection Method for EEG Emotion Recognition Using Normalized Mutual Information. IEEE Access 2019, 7, 143303–143311. [Google Scholar] [CrossRef]
  23. Bavkar, S.; Iyer, B.; Deosarkar, S. Optimal EEG channels selection for alcoholism screening using EMD domain statistical features and harmony search algorithm. Biocybern. Biomed. Eng. 2021, 41, 83–96. [Google Scholar] [CrossRef]
  24. Jin, J.; Miao, Y.; Daly, I.; Zuo, C.; Hu, D.; Cichocki, A. Correlation-based channel selection and regularized feature optimization for MI-based BCI. Neural Netw. 2019, 118, 262–270. [Google Scholar] [CrossRef] [PubMed]
  25. Liu, Q.; Liu, Y.; Chen, K.; Wang, L.; Li, Z.; Ai, Q.; Ma, L. Research on Channel Selection and Multi-Feature Fusion of EEG Signals for Mental Fatigue Detection. Entropy 2021, 23, 457. [Google Scholar] [CrossRef]
  26. Oh, S.H.; Lee, Y.R.; Kim, H.N. A Novel EEG Feature Extraction Method Using Hjorth Parameter. Int. J. Electr. Electron. Eng. 2014, 2, 106–110. [Google Scholar] [CrossRef]
  27. Hjorth, B. EEG analysis based on time domain properties. Electroencephalogr. Clin. Neurophysiol. 1970, 29, 306–310. [Google Scholar] [CrossRef]
  28. Leite, J.P.R. Heartbeat classification with low computational cost using Hjorth parameters. IET Signal Process. 2018, 12, 431–438. [Google Scholar] [CrossRef]
  29. Rahman, M.M.; Sarkar, A.K.; Hossain, M.A.; Hossain, M.S.; Islam, M.R.; Hossain, M.B.; Quinn, J.M.; Moni, M.A. Recognition of human emotions using EEG signals: A review. Comput. Biol. Med. 2021, 136, 104696. [Google Scholar] [CrossRef]
  30. Safi, M.S.; Safi, S.M.M. Early detection of Alzheimer’s disease from EEG signals using Hjorth parameters. Biomed. Signal Process. Control 2021, 65, 102338. [Google Scholar] [CrossRef]
  31. Jin, L.; Qu, H.; Pang, L.; Zhang, Z. Sensitive Channel Selection for Mental Workload Classification. Mathematics 2022, 10, 2266. [Google Scholar] [CrossRef]
  32. Moctezuma, L.A.; Molinas, M. EEG channel-selection method for epileptic-seizure classification based on multi-objective optimization. Front. Neurosci. 2020, 14, 593. [Google Scholar] [CrossRef] [PubMed]
  33. Malviya, L.; Mal, S. A novel technique for stress detection from EEG signal using hybrid deep learning model. Neural Comput. Appl. 2022, 34, 19819–19830. [Google Scholar] [CrossRef]
  34. Shi, Y.; Li, Y.; Koike, Y. Sparse Logistic Regression-Based EEG Channel Optimization Algorithm for Improved Universality across Participants. Bioengineering 2023, 10, 664. [Google Scholar] [CrossRef]
  35. Hasan, M.A.; Khan, M.U.; Mishra, D. A computationally efficient method for hybrid EEG-fNIRS BCI based on the Pearson correlation. BioMed Res. Int. 2020, 2020, 1838140. [Google Scholar] [CrossRef] [PubMed]
  36. Dhiman, R. Electroencephalogram channel selection based on pearson correlation coefficient for motor imagery-brain-computer interface. Meas. Sens. 2023, 25, 100616. [Google Scholar]
  37. Yu, J.; Yu, Z.L. Cross-correlation based discriminant criterion for channel selection in motor imagery BCI systems. J. Neural Eng. 2021, 18, 046083. [Google Scholar] [CrossRef] [PubMed]
  38. Jin, J.; Xiao, R.; Daly, I.; Miao, Y.; Wang, X.; Cichocki, A. Internal Feature Selection Method of CSP Based on L1-Norm and Dempster-Shafer Theory. IEEE Trans. Neural Netw. Learn. Syst. 2020, 32, 4814–4825. [Google Scholar] [CrossRef]
  39. Koelstra, S.; Mühl, C.; Soleymani, M.; Lee, J.S.; Yazdani, A.; Ebrahimi, T.; Pun, T.; Nijholt, A.; Patras, I. DEAP: A database for emotion analysis; Using physiological signals. IEEE Trans. Affect. Comput. 2012, 3, 18–31. [Google Scholar] [CrossRef]
  40. Morris, J.D. Observations: SAM: The Self-Assessment Manikin—An Efficient Cross-Cultural Measurement of Emotional Response. J. Advert. Res. 1995, 35, 63–68. [Google Scholar]
  41. Hasan, M.J.; Kim, J.M. A hybrid feature pool-based emotional stress state detection algorithm using EEG signals. Brain Sci. 2019, 9, 376. [Google Scholar] [CrossRef]
  42. Shon, D.; Im, K.; Park, J.H.; Lim, D.S.; Jang, B.; Kim, J.M. Emotional Stress State Detection Using Genetic Algorithm-Based Feature Selection on EEG Signals. Int. J. Environ. Res. Public Health 2018, 15, 2461. [Google Scholar] [CrossRef] [PubMed]
  43. Esteller, R.; Vachtsevanos, G.; Echauz, J.; Litt, B. A Comparison of waveform fractal dimension algorithms. IEEE Trans. Circuits Syst. I Fundam. Theory Appl. 2001, 48, 177–183. [Google Scholar] [CrossRef]
  44. Boonyakitanont, P.; Lek-uthai, A.; Chomtho, K.; Songsiri, J. A review of feature extraction and performance evaluation in epileptic seizure detection using EEG. Biomed. Signal Process. Control 2020, 57, 101702. [Google Scholar] [CrossRef]
  45. Cai, H.; Han, J.; Chen, Y.; Sha, X.; Wang, Z.; Hu, B.; Yang, J.; Feng, L.; Ding, Z.; Chen, Y.; et al. A pervasive approach to EEG-based depression detection. Complexity 2018, 2018, 5238028. [Google Scholar] [CrossRef]
  46. Subhani, A.R.; Mumtaz, W.; Naufal, M.; Mohamed, B.I.N.; Kamel, N.; Malik, A.S. Machine Learning Framework for the Detection of Mental Stress at Multiple Levels. IEEE Access 2017, 5, 13545–13556. [Google Scholar] [CrossRef]
  47. Al-shargie, F.; Tang, T.B.; Badruddin, N.; Dass, S.C.; Kiguchi, M. Mental stress assessment based on feature level fusion of fNIRS and EEG signals. In Proceedings of the 2016 6th International Conference on Intelligent and Advanced Systems (ICIAS), Kuala Lumpur, Malaysia, 15–17 August 2016; pp. 1–5. [Google Scholar] [CrossRef]
  48. Tian, Y.; Zhang, H.; Xu, W.; Zhang, H.; Yang, L.; Zheng, S.; Shi, Y. Spectral entropy can predict changes of working memory performance reduced by short-time training in the delayed-match-to-sample task. Front. Hum. Neurosci. 2017, 11, 437. [Google Scholar] [CrossRef]
  49. Yang, Y.; Kyrgyzov, O.; Wiart, J.; Bloch, I. Subject-specific channel selection for classification of motor imagery electroencephalographic data. In Proceedings of the IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Vancouver, BC, Canada, 26–31 May 2013; pp. 1277–1280. [Google Scholar] [CrossRef]
  50. Candra, H.; Yuwono, M.; Chai, R.; Handojoseno, A.; Elamvazuthi, I.; Nguyen, H.T.; Su, S. Investigation of window size in classification of EEG-emotion signal with wavelet entropy and support vector machine. In Proceedings of the Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS), Milan, Italy, 25–29 August 2015; pp. 7250–7253. [Google Scholar] [CrossRef]
  51. Jebelli, H.; Hwang, S.; Lee, S.H. EEG-based workers’ stress recognition at construction sites. Autom. Constr. 2018, 93, 315–324. [Google Scholar] [CrossRef]
  52. Fraschini, M.; Demuru, M.; Crobe, A.; Marrosu, F.; Stam, C.J.; Hillebrand, A. The effect of epoch length on estimated EEG functional connectivity and brain network organisation. J. Neural Eng. 2016, 13, 036015. [Google Scholar] [CrossRef]
  53. Al-Shargie, F.; Tariq, U.; Alex, M.; Mir, H.; Al-Nashash, H. Emotion Recognition Based on Fusion of Local Cortical Activations and Dynamic Functional Networks Connectivity: An EEG Study. IEEE Access 2019, 7, 143550–143562. [Google Scholar] [CrossRef]
  54. Alex, M.; Tariq, U.; Al-Shargie, F.; Mir, H.S.; Al Nashash, H. Discrimination of genuine and acted emotional expressions using EEG signal and machine learning. IEEE Access 2020, 8, 191080–191089. [Google Scholar] [CrossRef]
  55. Hag, A.; Handayani, D.; Pillai, T.; Mantoro, T.; Kit, M.H.; Al-Shargie, F. EEG Mental Stress Assessment Using Hybrid Multi-Domain Feature Sets of Functional Connectivity Network and Time-Frequency Features. Sensors 2021, 21, 6300. [Google Scholar] [CrossRef] [PubMed]
  56. Patel, A.; Nariani, D.; Rai, A. Mental Stress Detection using EEG and Recurrent Deep Learning. In Proceedings of the 2023 IEEE Applied Sensing Conference (APSCON), Bengaluru, India, 23–25 January 2023; pp. 1–3. [Google Scholar] [CrossRef]
  57. Katmah, R.; Al-Shargie, F.; Tariq, U.; Babiloni, F.; Al-Mughairbi, F.; Al-Nashash, H. A Review on Mental Stress Assessment Methods Using EEG Signals. Sensors 2021, 21, 5043. [Google Scholar] [CrossRef] [PubMed]
  58. Al-Shargie, F.; Tang, T.B.; Badruddin, N.; Kiguchi, M. Simultaneous measurement of EEG-fNIRS in classifying and localizing brain activation to mental stress. In Proceedings of the IEEE 2015 International Conference on Signal and Image Processing Applications (ICSIPA 2015), Kuala Lumpur, Malaysia, 19–21 October 2015; pp. 282–286. [Google Scholar] [CrossRef]
  59. Al-shargie, F.; Tang, T.B.; Kiguchi, M. Mental stress grading based on fNIRS signals. In Proceedings of the 2016 38th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), Orlando, FL, USA, 16–20 October 2016; pp. 5140–5143. [Google Scholar] [CrossRef]
  60. Li, Z.; Qiu, L.; Li, R.; He, Z.; Xiao, J.; Liang, Y.; Wang, F.; Pan, J. Enhancing BCI-based emotion recognition using an improved particle swarm optimization for feature selection. Sensors 2020, 20, 3028. [Google Scholar] [CrossRef] [PubMed]
  61. Wang, Z.; Zhang, Z.; Wang, W. Emotion recognition based on framework of BADEBA-SVM. Math. Probl. Eng. 2019, 2019, 9875250. [Google Scholar] [CrossRef]
  62. Hussien, A.G.; Oliva, D.; Houssein, E.H.; Juan, A.A.; Yu, X. Binary whale optimization algorithm for dimensionality reduction. Mathematics 2020, 8, 1821. [Google Scholar] [CrossRef]
  63. Liu, J.; Wu, G.; Luo, Y.; Qiu, S.; Yang, S.; Li, W.; Bi, Y. EEG-Based Emotion Classification Using a Deep Neural Network and Sparse Autoencoder. Front. Syst. Neurosci. 2020, 14, 43. [Google Scholar] [CrossRef]
  64. Al-Shargie, F.M.; Hassanin, O.; Tariq, U.; Al-Nashash, H. EEG-Based Semantic Vigilance Level Classification Using Directed Connectivity Patterns and Graph Theory Analysis. IEEE Access 2020, 8, 115941–115956. [Google Scholar] [CrossRef]
Figure 1. Flow diagram illustrating the proposed method for selecting common EEG channels associated with mental stress detection.
Figure 1. Flow diagram illustrating the proposed method for selecting common EEG channels associated with mental stress detection.
Brainsci 13 01340 g001
Figure 2. A comparison of mean accuracies based on the number of the most common EEG channels among subjects.
Figure 2. A comparison of mean accuracies based on the number of the most common EEG channels among subjects.
Brainsci 13 01340 g002
Figure 3. Accuracies and standard deviation for the 10-fold cross-validation per independent subject for 32 channels vs. 8 channels. The bars represent the full EEG channels, while the lines represent the selected significant EEG channels.
Figure 3. Accuracies and standard deviation for the 10-fold cross-validation per independent subject for 32 channels vs. 8 channels. The bars represent the full EEG channels, while the lines represent the selected significant EEG channels.
Brainsci 13 01340 g003
Figure 4. A rank of the common important EEG channels among all subjects.
Figure 4. A rank of the common important EEG channels among all subjects.
Brainsci 13 01340 g004
Figure 5. General optimal channels among all subjects that best discriminate mental stress. A circle around the name of each channel represents the significant channels, while the dot symbols are not significant.
Figure 5. General optimal channels among all subjects that best discriminate mental stress. A circle around the name of each channel represents the significant channels, while the dot symbols are not significant.
Brainsci 13 01340 g005
Figure 6. A topographic map of the significant EEG channels in response to mental stress per individual.
Figure 6. A topographic map of the significant EEG channels in response to mental stress per individual.
Brainsci 13 01340 g006
Table 1. A summary of the feature extraction methods employed in this study.
Table 1. A summary of the feature extraction methods employed in this study.
DomainFeaturesEquationsDescriptionNo. Features
TimeLine Length [43,44] L ( n ) = i = 1 N 1 x [ i ] x [ i 1 ] Called curve length, is the total vertical length of the signal1
Kurtosis [45] K u r t o s i s = 1 T t = 1 T ( x ( t ) μ ) 4 σ 4 Shows the sharpness of EEG signals’ peaks1
Peak-to-Peak Amplitude P T P = p k h i g h p k l o w Time of EEG signal peaks between the various windows1
Skewness [45] S k e w n e s s = 1 T t = 1 T ( x ( t ) μ ) 3 σ 3 An asymmetry of an EEG signal1
Hjorth Parameters [42,45] A c t i v i t y = v a r ( x ( t ) ) A variance of the time function;1
M o b i l i t y = v a r ( d y ( t ) d t ) A c t i v i t y ( y ( t ) ) A mean frequency or the proportion of standard deviation of the power spectrum1
C o m p l e x i t y = M o b i l i t y ( d y ( t ) d t ) M o b i l i t y ( y ( t ) ) Indicates how the shape of a signal is similar to a pure sine wave1
FrequencyRelative Power [46] of: R P = p o w e r ( s e l e c t e d _ b a n d ) p o w e r ( t o t a l _ b a n d s ) × 100 Average absolute power of the
given band interval
5
theta (4–8 Hz)
alpha (8–12 Hz)
sigma (12–15 Hz)
low beta (15–20 Hz)
high beta (20–30 Hz)
Time–FrequencyEnergy of Wavelet
Decomposition Coefficients
(db4, 6 level) [11,47]
E n e r g y ( E ) = t = 1 n x t 2 Measure the square sum of wavelet coefficients of each db level6
Spectral Entropy
(PSD, Welch) [48]
S E = K f = 4 F = 45 P S D ¯ ( F ) ×
l o g ( P S D ¯ ( F ) ) , k = 1 .
Measure the distribution of signal power over frequency1
Katz’s Fractal Dimension [43] D = l o g 10 ( n ) l o g 10 ( d L ) + l o g 10 ( n ) Compute the maximum distance between the first point and any other point of the signal time window1
Table 2. Default parameters for classification techniques.
Table 2. Default parameters for classification techniques.
No.ClassifierDefault Value
1SVMC = 1.0, Kernal = Radial Basis Function (RBF), 1.0 × 10 3
2KNNK = 10, distance function = euclidean distance
3RLDAsolver = eigen, shrinkage = none
Table 3. A summary comparison of classification performance for mental stress detection.
Table 3. A summary comparison of classification performance for mental stress detection.
Subject IDAll ChannelsProposed Channels
KNNSVMRLDAKNNSVMRLDA
PrecisionRecallAccuracyPrecisionRecallAccuracyPrecisionRecallAccuracyPrecisionRecallAccuracyPrecisionRecallAccuracyPrecisionRecallAccuracy
10.920.70.850.910.690.840.830.730.790.710.620.780.860.650.820.820.720.78
20.820.80.790.90.90.90.90.90.90.840.80.780.910.910.910.890.890.89
41110.990.990.991110.990.990.990.990.990.990.950.950.95
50.940.930.930.980.980.980.840.840.850.80.790.790.90.90.90.840.820.82
80.910.920.910.980.970.980.920.920.920.830.840.840.920.860.890.920.860.89
100.790.770.770.830.830.830.630.630.630.60.60.60.620.620.620.620.620.62
110.690.710.690.750.710.760.890.80.840.670.680.660.760.710.770.760.710.77
120.670.650.740.810.640.80.750.710.760.740.70.790.760.680.80.760.70.76
130.550.550.670.780.580.80.840.820.820.550.540.690.760.570.790.550.540.69
140.790.730.880.950.670.90.860.710.80.740.760.860.830.650.880.830.650.88
150.840.820.820.90.90.91110.880.860.870.880.860.870.880.860.87
170.780.790.790.90.90.90.930.880.920.810.810.810.90.890.890.90.880.89
180.680.650.780.860.780.850.740.710.790.680.650.770.730.670.770.690.660.78
190.870.860.870.890.860.890.880.880.880.890.860.880.890.860.880.890.860.88
200.710.670.770.810.690.80.820.690.780.750.670.740.770.710.80.770.690.77
210.790.770.820.920.880.910.880.880.880.790.770.820.820.80.830.830.80.83
220.780.760.830.890.880.890.890.880.890.820.80.820.840.830.840.830.830.83
230.870.860.870.930.880.920.880.870.880.870.860.870.870.860.870.870.860.87
240.780.730.830.820.730.820.750.720.760.750.710.750.740.720.740.740.720.74
250.910.890.910.960.930.940.890.890.890.890.890.890.890.890.890.890.890.89
260.890.890.890.970.930.950.910.910.910.890.890.890.920.910.920.890.890.89
270.740.750.760.850.830.850.850.840.850.720.720.750.740.740.750.750.750.75
280.760.750.810.90.830.880.890.850.880.730.720.780.760.760.810.760.760.81
290.870.850.880.920.920.920.890.890.890.850.850.850.890.890.890.890.890.89
300.720.720.720.770.770.770.760.760.760.720.720.720.730.720.730.730.720.73
310.720.70.770.840.770.830.840.80.820.740.730.740.730.730.730.730.730.73
320.850.710.780.890.80.840.840.820.820.570.540.620.60.580.690.670.670.63
Average0.760.730.790.850.790.850.830.800.820.710.700.750.800.760.810.770.740.79
Table 4. Performance comparison of the proposed model with other popular existing methods.
Table 4. Performance comparison of the proposed model with other popular existing methods.
MethodNo.
Channels
Channel SubsetsClassifierAccuracyExecution
Time
mRMR11‘C4’, ‘FC2’, ‘CP6’, ‘Cz’, ‘T8’, ‘F4’, ‘F8’, ‘P4’, ‘Fz’, ‘FC6’, ‘Pz’SVM0.80 ± 0.121.42 s
KNN0.74 ± 0.12
RLDA0.79 ± 0.13
STFT + MI15‘AF3’, ‘F7’, ‘FC5’, ‘P3’, ‘P7’, ‘Pz’, ‘O2’, ‘P4’, ‘FC6’, ‘Fp2’, ‘FC1’, ‘CP2’,
’C4’, ‘F4’, ‘Fz’
SVM0.82 ± 0.114.46 s
KNN0.74 ± 0.12
RLDA0.80 ± 0.14
GA13‘O2’, ‘O1’, ‘PO3’, ‘AF3’, ‘P4’, ‘P8’, ‘F8’, ‘P7’, ‘C4’, ‘CP5’, ‘Pz’, ‘FC5’, ‘Fp2’SVM0.82 ± 0.121 h 3 min 34 s
KNN0.76 ± 0.13
RLDA0.81 ± 0.13
Proposed8‘AF3’, ‘FC5’, ‘F8’, ‘Fp1’, ‘AF4’, ‘P7’, ‘Fp2’, ‘F7’SVM0.81 ± 0.110.34 s
KNN0.75 ± 0.12
RLDA0.79 ± 0.12
Table 5. Performance comparison of stress detection with related works using EEG signals in the DEAP dataset.
Table 5. Performance comparison of stress detection with related works using EEG signals in the DEAP dataset.
AuthorMethodEEG ChannelsAccuracy/Class
Shon [42]Genetic Algorithm-Based Feature Selection3271.76% (Stress/Calm)
Hasan [41]Boruta-based k-NN feature selection3273.38% (Stress/Calm)
Patel [56]CONV1D + BiLSTM1488.03% (Valance–Arousal Score Level)
CONV1D + BiGRU1475% (Stress/Calm)
ProposedFull Channels SET + SVM3285.68% (Stress/Calm)
CCHP + SVM881.56% (Stress/Calm)
Table 6. Comparison of channel selection method on different datasets.
Table 6. Comparison of channel selection method on different datasets.
DatasetChannelsNo. ChannelsAccuracy
EDMSSTotal777.31%
 Selected575.23%
DEAPTotal3285.68%
 Selected881.56%
SEEDTotal6283.21%
 Selected880.31%
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Hag, A.; Al-Shargie, F.; Handayani, D.; Asadi, H. Mental Stress Classification Based on Selected Electroencephalography Channels Using Correlation Coefficient of Hjorth Parameters. Brain Sci. 2023, 13, 1340. https://doi.org/10.3390/brainsci13091340

AMA Style

Hag A, Al-Shargie F, Handayani D, Asadi H. Mental Stress Classification Based on Selected Electroencephalography Channels Using Correlation Coefficient of Hjorth Parameters. Brain Sciences. 2023; 13(9):1340. https://doi.org/10.3390/brainsci13091340

Chicago/Turabian Style

Hag, Ala, Fares Al-Shargie, Dini Handayani, and Houshyar Asadi. 2023. "Mental Stress Classification Based on Selected Electroencephalography Channels Using Correlation Coefficient of Hjorth Parameters" Brain Sciences 13, no. 9: 1340. https://doi.org/10.3390/brainsci13091340

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop