Next Article in Journal
Cortical Thickness Links Impulsive Personality Traits and Risky Behavior
Next Article in Special Issue
A Bayesian Mixture Modelling of Stop Signal Reaction Time Distributions: The Second Contextual Solution for the Problem of Aftereffects of Inhibition on SSRT Estimations
Previous Article in Journal
Co-Morbid Insomnia and Sleep Apnea (COMISA): Prevalence, Consequences, Methodological Considerations, and Recent Randomized Controlled Trials
Previous Article in Special Issue
Estimating the Parameters of Fitzhugh–Nagumo Neurons from Neural Spiking Data
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

A Comprehensive sLORETA Study on the Contribution of Cortical Somatomotor Regions to Motor Imagery

1
Department of Computer Engineering, Faculty of Engineering, Karadeniz Technical University, 61080 Trabzon, Turkey
2
Department of Physiology, Faculty of Medicine, Karadeniz Technical University, 61080 Trabzon, Turkey
*
Author to whom correspondence should be addressed.
Brain Sci. 2019, 9(12), 372; https://doi.org/10.3390/brainsci9120372
Submission received: 5 November 2019 / Revised: 6 December 2019 / Accepted: 7 December 2019 / Published: 13 December 2019
(This article belongs to the Collection Collection on Theoretical and Computational Neuroscience)

Abstract

:
Brain–computer interface (BCI) is a technology used to convert brain signals to control external devices. Researchers have designed and built many interfaces and applications in the last couple of decades. BCI is used for prevention, detection, diagnosis, rehabilitation, and restoration in healthcare. EEG signals are analyzed in this paper to help paralyzed people in rehabilitation. The electroencephalogram (EEG) signals recorded from five healthy subjects are used in this study. The sensor level EEG signals are converted to source signals using the inverse problem solution. Then, the cortical sources are calculated using sLORETA methods at nine regions marked by a neurophysiologist. The features are extracted from cortical sources by using the common spatial pattern (CSP) method and classified by a support vector machine (SVM). Both the sensor and the computed cortical signals corresponding to motor imagery of the hand and foot are used to train the SVM algorithm. Then, the signals outside the training set are used to test the classification performance of the classifier. The 0.1–30 Hz and mu rhythm band-pass filtered activity is also analyzed for the EEG signals. The classification performance and recognition of the imagery improved up to 100% under some conditions for the cortical level. The cortical source signals at the regions contributing to motor commands are investigated and used to improve the classification of motor imagery.

1. Introduction

The brain is one of the most complex organs in the body, as it controls our biological functions and mental tasks simultaneously. Advances in medicine, physiology, engineering, and neuroimaging have helped scientists understand the brain. In the last couple of decades, it has been shown that external devices can be controlled via EEG signals acquired by sensors, by using signal processing and classification algorithms. In the literature, the brain–machine interface, neural interface, neural prosthetics, and neural engineering terms are also used for brain–computer interfaces (BCIs). Researchers have shown that a person can control cursor movement on a screen or control a robotic or prosthetic arm or leg by using brain signals. The design and implementation of BCI is a multidisciplinary field in which physicians, psychologists, and engineers work together to develop better BCIs. Engineers use advanced signal processing techniques to both filter and extract features and machine learning methods for better signal analysis. A large number of BCI applications have been developed recently, and there has been an increasing amount of interest in this area [1]. Research on how the brain stores information and processes both stored and sensory inputs to generate motor functions has contributed a vast amount of knowledge on the matter, thanks to the availability of low cost and high-performance hardware, as well as open-source software. Engineers use machine learning methods to better learn from a limited number of features and accurately classify signals.
Researchers have proposed advanced signal amplifiers, filters, A/D converters, recording devices, and embedded computers to run new machine learning and artificial intelligence algorithms. A general BCI scheme is given in Figure 1.
There are some restrictions on using BCIs in daily life. Even though a BCIs’ EEG signal classification accuracy cannot reach 100%, several methods have been proposed to improve the accuracy and reliability of BCIs. BCIs are not easy to use, as patients do not feel comfortable. Moreover, sometimes BCIs can be dangerous due to misclassified signals. BCIs are still not permitted in daily life, except in research centers where they are tested in a controlled environment. The number of successful applications must increase for manufacturers to meet the demand for cost-effective BCIs. The proposed method aims to improve the classification accuracy for non-invasive BCIs. There are also invasive and semi-invasive BCI systems, but non-invasive EEG signal acquisition remains better for patients’ health and relaxation. One of the aims of EEG studies is to obtain information without using expensive radiodiagnosis techniques, which are not included in this study. Better success can be achieved with the support of radiodiagnosis data, such as fMRI or MEG, which we plan to use for future work.
BCI technology is used to control prosthetic devices by transforming motor imagery thoughts into motor functions to help paralyzed patients and amputees. It is important for a successful BCI to interpret precisely what the subject imagines by analyzing his or her brain waves. BCI techniques are used for control, assessment, and rehabilitation. Thus, both engineers and neuroscientists are working together to interpret thoughts by using brain signal analysis.
Motor imagery signals have been classified using various methods in the literature. Murguialday [2] used 8–13 Hz ( μ ) band activity for BCI control in 2013. Yuan [3] reviewed sensorimotor rhythms on BCIs in 2014. Handiru et al. [4] studied right and left-hand motor imagery on cortical levels in 2015. Ang and Guan [5] studied the control and rehabilitation potential of BCIs on stroke patients in 2017. Xia et al. [6] moved an on-screen cursor in two dimensions in 2017. In 2018, Li et al. [7] studied motor imagery tasks with the same dataset used in this work and showed that source domain analysis outperforms sensor domain analysis. Alazrai et al. [8] reported success in finger movements, Lu et al. [9] controlled a vehicle using EEG signals, and Xygonakis et al. [10], in 2018, studied four-class motor imagery in the EEG source space and improved its accuracy compared to the sensor data analysis. Qingsong et al. [11] analyzed four-task motor imagery in 2019, while Zhang et al. [12] reported in 2019 that children can successfully use BCIs.
In this work, both the acquired sensor and computed source space signals are used for improved classification of motor imagery using EEG signal analysis. EEG signals are first transformed to sources using inverse problem solution methods. The obtained cortical signals and sensor EEG signals are used together for improved classification. It is shown that augmenting the sensor signals via somatomotor region sources yields better results than those of similar studies reported in the literature. Our aim is to develop a BCI for paralyzed and disabled people, to transform their motor imagery thought signals to motor signals to control external devices. The selected somatomotor area signals improve classification success, as shown in the results. Successful BCIs will soon be able to be designed by interpreting not only the sensor but also the source signals. Furthermore, the known motor signal generating regions of the brain are tested for the improved classification of motor imagery.
Since most of the cortical studies in the literature achieved better results than the sensor level studies, we used cortical level signals in this work. Moreover, the sLORETA approach, which yields superior accuracy performance than the other methods, was selected to map the EEG signals to the cortical ROIs. Our aim is to find the most relevant ROIs for the right hand and right foot motor imagery in order to develop a BCI to transform motor imagery signals to control external devices. The main novelty of our study to improve the accuracy of the right hand and right foot imagery classification problem using only nine ROIs, excluding those not relevant to the chosen motor imagery tasks (i.e., the primary lip motor area (M1L), somatosensory association cortex (SAC), and secondary somatosensory area (S2)). We analyzed the recorded EEG signals using a 10–5 system with 118 channels. We used more channels, as suggested by many researchers, to achieve a better inverse solution.

2. Materials and Methods

2.1. BCI Competition Dataset

The BCI competition dataset IVa for the BCI competition III is used in this study [13]. There are recordings of five healthy subjects in this dataset. The subjects sat in a comfortable armchair and performed the imagery tasks shown by the cues. Subjects were given three motor imagery duties, (L) left hand, (R) right hand, and (F) right foot. Visual cues were indicated for 3.5 s. The EEG signals were sampled at 1000 Hz and then down-sampled to 100 Hz. Only the right hand and right foot signals were used for competition. Many training and test sets were made, each with a different number of samples. One of the aims in the competition was to achieve successful classification with the test sets while using small training sets. Two-second motor imagery time slice recordings are also used in this work. There were a total of 280 training and test sets and 118 channels used for recording the EEG data. The number of training and test trials are listed in Table 1 for each subject in the dataset.
Flow diagram of this work is given in Figure 2.

2.2. Preprocessing

Because motor imagery is one of the important ERPs (event-related potentials), the EEG signals are sampled at 100 Hz. The motor-related μ rhythms at 8 to 13 Hz are filtered from the raw EEG signals by a band-pass filter. Signals in the 0.1–30 Hz delta, theta, alpha, and beta rhythms and 8–13 Hz μ rhythms are used to compare and determine the most relevant regions. In the results section, the results for both 0.1–30 Hz and the μ band analysis are given.

2.2.1. Head Model

We assumed head tissue conductivity values of 1 S/m for both the scalp and brain and 0.0125 S/m for the skull, as suggested by Liu et al. [14] for the layer conductivity values.

2.2.2. Number of Electrodes and Locations

The coordinates of the EEG measurement electrodes must be known to determine the potentials at the electrode locations by
W = L S ,
where L is the lead-field matrix, S is the sources, and W is the measurements.

2.3. Electrode to Source Signal (Inverse) Modeling

Inverse modeling is the most important process, since improved classification performance using the cortical sources computed from electrode measurements is our goal. Since the sources outnumber the electrodes, we must set constraints and assume a head model or source to solve this problem. The scalp EEG signals are converted to cortical sources using the Brainstorm software from The Biomedical Imaging Group of the University of Southern California [15] using Standardized low-resolution brain electromagnetic tomography (sLORETA) [16]. This method calculates the noise-normalized solution.

2.4. Region of Interest (ROI) Selection for Motor Imagery

The brain has cortical areas responsible for specific tasks. The subjects performed motor imagery tasks during their recordings in the dataset used for training and tests. The somatosensory cortical areas responsible for the tasks to be classified are included in the feature vectors (as in [10]) to improve classification performance. Region of interest areas are shown in Figure 3.
  • somatosensory association cortex (SAC),
  • primary foot somatosensory area (S1F),
  • primary hand somatosensory area (S1H),
  • secondary somatosensory area (S2),
  • cingulate motor area (CMA),
  • primary foot motor area (M1F),
  • primary hand motor area (M1H),
  • primary lip motor area (M1L),
  • supplementary motor area (SMA),
  • presupplementary motor area (pSMA),
  • dorsal premotor cortex (PMd),
  • ventral premotor cortex (PMv) areas.
The analysis was performed inside these regions, except for the first, fourth, and eighth regions because these ROIs are not related to programming.

2.5. CSP Features

Extracting meaningful information from raw data to reduce the dimension or number of inputs to a classifier is called feature extraction. Features represent raw data and should not include redundant information. The raw data in this paper comprise EEG signals recorded using 118 electrodes on the scalp. Common spatial pattern (CSP) features are extracted both from the recorded EEG and from the computed cortical signals.
The most commonly used method to classify EEG signals, such as those observed during motor imagery, is the CSP. These are optimal spatial filters that maximize the differences of variance between two classes [17]. In the literature, CSP features have been successfully applied to EEG signal classification for two-class problems [18]. This method uses class labels (in this study, right hand and right foot) and forms spatial filters so that the variance of the filtered data of one class is maximized, while the variance of the filtered data from the other classes is minimized [19]. Thus, the resulting feature vectors enhance the discriminability between two classes. CSP feature vectors are given to an SVM classifier to train and then tested to evaluate their performance.

3. Results

Most of the studies reported in the literature focused on sensor-based BCIs. First, raw sensor data are filtered into two groups in this study: 0.1–30 Hz and μ rhythm (8–13 Hz).
Table 2 lists the classification success of sensor data for 118 channels. Classification performance is determined by true/false predictions for each case to determine the success of the predictions, which is calculated by
Classification performance = Number of correct predictions Total number of predictions 100
The sensor data analysis resulted in a success ratio of 59.82%, 87.50%, 60.71%, 54.46%, and 51.59% for recordings from five subjects using a 0.1–30 Hz frequency range. Even though the performance was satisfactory, some imagery motor commands of the subjects were misclassified. Since the μ rhythm (8–13 Hz) is related to motor activities, the successful performance of the μ rhythm signals was 69.64%, 100%, 71.43%, 76.34%, and 50.4%.
In this study, cortical sources were calculated using the sLORETA inverse problem solution. Then, a classification of the same dataset was performed using neural sources transformed from scalp EEG electrodes. The analysis is categorized into three main groups: a left lobe analysis, a right lobe analysis, and an analysis of the combined (left + right) lobes to understand the motor imagery activations in the brain and better understand which regions of the brain have more information about the right hand or right foot motor imagery. These analyses were carried out for both the 0.1–30 Hz and μ frequency bands. The results are computed using a subset of nine areas, including (S1F), (S1H), (CMA), (M1F), (M1H), (SMA), (pSMA), (PMd), and (PMv). The left lobe results are calculated 2 9 times for all possible subsets and run with a number of CSP filter pairs.
The best results are given for the sources in the selected set of ROIs in Table 3. The “left lobe max” column presents the best results achieved from all subsets of the sources in nine ROIs ( 2 9 times) using different CSP filter pair parameters. The third column lists the best results for subsets of three elements in the left lobe, the fourth column lists the best results for all possible subsets of the right lobe, the fifth column lists the best results for subsets of the three elements in the right lobe, and the sixth column lists the best results for the subsets of six elements of all 18 ROIs from both the right and left lobes using six pairs of CSP filters.
Sensitivity (sens) and specificity (spec) measures are also calculated. The right hand is selected as a positive case and the right foot as a negative case for the calculation of the sensitivity and specificity values.
sensitivity = Number of true positives Number of true positives + Number of false negatives = TP TP + FN
specificity = Number of true negatives Number of true negatives + Number of false positives = TN TN + FP
The ROIs in the left lobe has a higher overall classification accuracy, as shown in Table 3. A slight classification degradation of 4% is observed using only 3 ROIs compared to all the ROI combinations from a single lobe. A maximum classification accuracy of 75.5% was achieved using combinations of six ROIs from the two lobes on average. This result is 7% higher than that of the 3 ROIs from the left lobe and 9% higher than that of the 3 ROIs from the right lobe. Also, this result was 3% and 4% better than that of the left and right lobes’ maximum classification accuracy, respectively. Subject al has the best imagery performance (98.21%), whereas subject av has the worst, with only 64.80%, as seen in the table. Average accuracy in six regions from both lobes are higher than that of the accuracy of all other combinations. Subject al achieved maximum sensitivity and specificity. Although sensitivities are lower than accuracy in some local regions, specificities are higher. Similarly, sensitivities are high for low specificities.
In Table 4, the most successful areas are given in the related Table 3 results.
The regions corresponding to the best classification results of Table 3 are given in Table 4 as the contributing ROIs at the cortical level. Unfortunately, the regions are not the same for different subjects. The first column of Table 4 indicates that the S 1 H L and M 1 F L regions appeared five times, and C M A L and M 1 H L regions appeared four times, in the set of regions corresponding to the best results. The second column indicates that C M A L and S M A L appear three times in the three-region sets corresponding to the best results.
On the other hand, the right lobe results are more interesting, as the C M A R region was observed five times, and the M 1 F R region appeared four times, in the best results. This shows that the right lobe can be as active as the left lobe, which was unexpected. Lastly, the ROIs at the cortical level of six regions from both lobes are listed in the last column corresponding to the best results. The S 1 F L and S 1 F R regions provide the best results for the 0.1–30 Hz filtered data.
The regions and their occurrence numbers from Table 4 for each subject with unique colors are shown to indicate the subjects’ and regions’ contributions to the best results in Figure 4.
The μ band results are given in Table 5. The “Left lobe max” column presents the best results achieved from all subsets of the sources in the nine ROIs ( 2 9 times) using different CSP filter pair parameters. The third column lists the best results for subsets of the three elements in the left lobe, the fourth column lists the best results for all possible subsets of the right lobe, the fifth column lists the best results for subsets of the three elements in the right lobe, and the sixth column lists the best results for subsets of the six elements of all 18 ROIs from both the right and left lobes using six pairs of CSP filters.
The μ band analysis results are given in Table 5. Filtering signals out of the μ band improved the classification accuracy, sensitivity and specificity compared to the 0.1–30 Hz band signal results, which supports Table 3. The left lobe accuracy is better than the right lobe accuracy, as seen in Table 5. Here, a slight classification degradation of 3% and 7.5% can be achieved using only three ROIs in the left lobe and right lobe, respectively, compared to the best average results of all ROI combinations for one lobe. The maximum classification accuracy can be achieved using ROIs from two lobes. This accuracy is 5% and 13% better than that using only three ROIs from the left and right lobes. This accuracy is also 2% and 5% better than that of the best results from all ROI combinations from the left and right lobes. The subject-based results are similar to those in Table 3, as the subject al has the best imagery performance at 100% classification accuracy, and subject av has the worst performance at only 67.86%.
Best sensitivity and specificity are achieved in six regions from both lobes. Sensitivity and specificity achieved from the left lobe is better than that of those from the right lobe. Subject al achieved 100% sensitivity and specificity whereas Subject av achieved 69.23% sensitivity and 66.67% specificity.
In Table 6, the most successful areas are given in the related Table 5 results.
The left lobe μ band analysis indicates that the S 1 H L and S M A L regions appeared for all subjects, but the M 1 F L and M 1 H L regions appeared three times in the best results. For the three-region combinations of subsets, the S 1 H L region was observed three times in the best results.
The right lobe μ band analysis indicates the p S M A R region five times and the S 1 F R , S 1 H R , M 1 H R and P M d R regions four times in the best results. For the three-region combinations of subsets, M 1 H R , S M A R and p S M A R appear three times in the best results. The best classification results for all tests were achieved using both the right and left lobes in the μ band. The S 1 H L and M 1 H L regions appeared four times, but S M A R and P M d R appeared three times in the best results.
The regions and their occurrence numbers from Table 6 for each subject with unique colors are shown to indicate the subjects’ and regions’ contributions to the best results in Figure 5.

4. Discussion

This study aimed to find the most relevant cortical regions of the brain responsible for motor imagery of the right foot and right hand. EEG electrode signals were first transformed into cortical source signals by an inverse solution, and an SVM classifier was then trained to classify all subsets of the cortical sources to find those that contribute the most to the motor imagery of the right hand and right foot. In the tables, the most accurate results and related regions are given. The classification accuracies listed in the Tables revealed that the accuracy varies for each group and region, so the best accuracy is different for each subject. Also, the band-pass frequency of the signals in 0.1–30 Hz delta, theta, alpha, and beta rhythms and 8–13 Hz μ rhythms were used to compare and determine the most relevant regions and achieve success for each group.
The left lobe analysis for the 0.1–30 Hz band provided better results than the right lobe. Competition database maintainers replied to our request to supply hand preferences of subjects. They are all right-handed except Subject al. Foot preferences of the subjects are not specified in the dataset. The dominant hemisphere may have a better result depending on one’s preference for the right or left extremity. Since there is only one left-handed Subject in the dataset, the comparison may not be accurate. The regions M 1 F L , M 1 H L , S 1 F R , C M A R and M 1 H R in the 0.1–30 Hz band and S 1 H L , M 1 H L , S M A L and S M A R in the μ band were the most dominant among the results. The S1F, S1H, M1H, and M1F regions were observed in the most successful classification results. Our findings show that these regions are related to motor imagery. In 2011, Pelgrims et al. [20] studied the primary motor cortex’s contribution to motor imagery and showed the relationship between these tasks. In 2006, Neuper et al. [21] stated that preparation, execution, and imagination activate sensorimotor areas in the μ band.
The S M A L region is among the most successful regions in μ band analysis. This is in good agreement with the study published in 2015 by Dalla–Corte [22], which observed SMA activity while performing right and left-handed motor tasks. This result was also confirmed by an fMRI analysis of these regions. SMA activity was also observed during motor imagery tasks in the same study. The SMA and pSMA regions have a relationship with motor function planning, processing, and execution [23,24].
CMA is one of the most successful regions in 0.1–30 Hz band analysis, as shown in Figure 4. The study of Athanasiou et al. [25] presented an analysis of the motor execution of α and β band connectivity. Their findings show that CMA has connections with premotor areas. The S1H region is common for all subjects in μ band analysis for the left lobe. The M 1 F L and M 1 H L regions are activated in subject al and subject aw where the accuracy is higher compared to subject aa and subject av, in both the current study and in the literature. More interestingly, the accuracy does not drop below 87% when regions M 1 F L and M 1 H L appear at the same time. Most of the time, the left hemisphere gives more accurate results, as expected. It is known that right-handed or right-armed people use the left hemisphere. In μ rhythm activations, the left lobe is more successful than the right lobe, and in the 0.1–30 Hz band, the Subject av’s right lobe gives better results than the left lobe.
In the literature and the BCI Competition III Dataset IVa results page, we see that Subject aa and Subject av’s success is lower, despite having more training data compared to Subject aw and Subject ay. Subject ay has only 28 training data, and its accuracy is higher. In addition to the cortex, subcortical areas also contribute to the programming of motor function for classic information. There is no direct record of the EEG data for subcortical fields. In this study, the primary motor areas, as well as the premotor areas and supplementary areas, were included in the selection of the cortex areas. Selecting the areas of the primary motor areas M 1 F L and M 1 H L increased the accuracy of the subjects (subjects who could increase their activity in areas with M 1 F L and M 1 H L motor movements achieved higher accuracy).
Lastly, we analyzed two lobes. For better analysis, we restricted the study to 6 regions to determine the most important areas. This was done to determine if using only the left areas could achieve better accuracy than using both lobes. The classification accuracy was increased compared to single lobe calculations. In this analysis, four occurrences of the regions S 1 F L and S 1 F R are in the best results, and also four occurrences of S 1 H L and M 1 H L are in the best results of μ band analysis which ensure commonality between the subjects.
It was surprising that the results for every subject using the left and right lobe together were better compared to those using left lobes only. In 2004, Hoshi and Tanji [26] stated that the PMd and PMv areas are related to planning and execution. The successful regions found in our work based on differentiating signals are similar to the areas in this previous study. A left lobe of 0.1–30 Hz S 1 H L and M 1 F L , for the μ band region S 1 H L most commonly appeared in the successful results. The right lobe C M A R appeared more at 0.1–30 Hz and p S M A R for the μ band. The best results were obtained using two lobes. The S 1 F L and S 1 F R pair had the most successful ROIs in 0.1-30 Hz and for the μ band S 1 H L - M 1 H L , and S M A R - P M d R gave the best results.
Motor imagery EEG signals from a dataset are classified at the sensor level and the cortical level. Special attention is given to the comparison of the classification accuracy results of the cortical source level and the corresponding ROIs in this manuscript. Using cortical sources to classify motor imagery improves performance. The cortical sources in some regions can be used for successful BCI, even though the inverse problem must be solved to compute the cortical sources. The recorded right hand and right foot motor imagery EEG signals were used and successfully classified. The source space classification performance is promising, even though source signal computation is based on an inverse problem solution. The classification accuracy of motor imagery based BCI was improved using source space. The neurophysiological constraints while processing data not only improved the calculation time but also increased classification success. Using the source space via an inverse problem solution and biophysical knowledge to select the regions associated with motor functions improved the classification accuracy of the BCI technology.
There are many parameters, such as filter, head model, and source assumptions, that impact the inverse solution for computing cortical sources while processing EEG signals. Invasive BCIs are not applicable because many situations that threaten human health can occur during such operations. Semi-invasive BCIs can be used for some applications that control basic devices but can cause infections. Non-invasive BCIs based on EEG recordings do not pose any risk, and research has lately been focused on improving the performance of BCIs. Successful BCIs have been designed and built by teams over the last few decades. Even though the results given in this manuscript are promising, there are some limitations to this analysis. The dataset, for example, contained EEGs recorded from only five healthy subjects.
Future research should increase the number of subjects and trials and use real patients’ data (e.g., amputees or paralyzed patients) to confirm the findings reported here. Another limitation is that the real MRIs of subjects are not given. A template head model was used for the subjects. It is known that the cortical regions can be expanded or become narrower depending on the dominant usage of specific regions because the brain possesses neural plasticity. Therefore, interdisciplinary studies in the neurophysiology and neuroengineering fields could provide a significantly better understanding of brain activities.

5. Conclusions

Accurate BCI design remains an active research area. Developments in both hardware and software help designers to improve BCIs beyond imagination. Future BCIs are expected to have better classification accuracy compared to the BCIs of today and will be used in daily life. Improved classification performance is possible using information from Physiology to focus on cortical sources in relevant brain regions. Advances in BCI design will certainly improve the quality of the lives of amputees and paralyzed people and let them interact successfully with their environment. Our findings showed that the activity of the cortical regions can vary slightly among subjects. Using both M 1 F L and M1H regions in a 0.1–30 Hz range and using M1H, S 1 H L , and SMA regions in μ band signals achieved better classification accuracy. For a successful BCI, one needs to choose cortical regions carefully in order to include relevant regions and not to include regions that degrade classification.

Author Contributions

Conceptualization, M.Y. and M.U.; methodology, M.Y., M.U. and M.O.; software, M.Y.; validation, M.Y., M.U. and M.O.; formal analysis, M.Y., M.U. and M.O.; investigation, M.Y. and M.O.; resources, M.Y.; data curation, M.Y.; writing—original draft preparation, M.Y., M.U. and M.O.; writing—review and editing, M.Y., M.U. and M.O.; visualization, M.Y.; supervision, M.U. and M.O.; project administration, M.Y., M.U. and M.O.; funding acquisition, M.Y., M.U. and M.O.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
BCIBrain–computer interface
EEGElectroencephalogram
sLORETAStandardized low-resolution brain electromagnetic tomography
CSPCommon spatial patterns
SVMSupport vector machine
MEGMagnetoencephalography
fMRIFunctional Magnetic Resonance Imaging
ROIRegion of Interest
SACsomatosensory association cortex
S1Fprimary foot somatosensory area
S1Hprimary hand somatosensory area
S2secondary somatosensory area
CMAcingulate motor area
M1Fprimary foot motor area
M1Hprimary hand motor area
M1Lprimary lip motor area
SMAsupplementary motor area
pSMApresupplementary motor area
PMddorsal premotor cortex
PMvventral premotor cortex
TPTrue positive
TNTrue negative
FPFalse positive
FNFalse negative
accaccuracy
senssensitivity
specspecificity

References

  1. Bockbrader, M.A.; Francisco, G.; Lee, R.; Olson, J.; Solinsky, R.; Boninger, M.L. Brain Computer Interfaces in Rehabilitation Medicine. PM&R 2018, 10, 233–243. [Google Scholar] [CrossRef] [Green Version]
  2. Ramos-Murguialday, A.; Broetz, D.; Rea, M.; Laer, L.; Yilmaz, O.; Brasil, F.L.; Liberati, G.; Curado, M.R.; Garcia-Cossio, E.; Vyziotis, A.; et al. Brain machine interface in chronic stroke rehabilitation: A controlled study. Ann. Neurol. 2013, 74, 100–108. [Google Scholar] [CrossRef] [PubMed]
  3. Yuan, H.; He, B. Brain Computer Interfaces Using Sensorimotor Rhythms: Current State and Future Perspectives. IEEE Trans. Biomed. Eng. 2014, 61, 1425–1435. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Handiru, V.S.; Vinod, A.P.; Guan, C. Cortical Source Localization for Analysing Single-Trial Motor Imagery EEG. In Proceedings of the 2015 IEEE International Conference on Systems, Man, and Cybernetics, Hong Kong, China, 9–12 October 2015; pp. 3146–3151. [Google Scholar] [CrossRef]
  5. Ang, K.K.; Guan, C. EEG-Based Strategies to Detect Motor Imagery for Control and Rehabilitation. IEEE Trans. Neural Syst. Rehabil. Eng. 2017, 25, 392–401. [Google Scholar] [CrossRef]
  6. Xia, B.; Cao, L.; Maysam, O.; Li, J.; Xie, H.; Su, C.; Birbaumer, N. A binary motor imagery tasks based brain-computer interface for two-dimensional movement control. J. Neural Eng. 2017, 14, 066009. [Google Scholar] [CrossRef]
  7. Li, M.A.; Zhang, C.; Jia, S.; Sun, Y. Classification of Motor Imagery Tasks in Source Domain. In Proceedings of the 2018 IEEE International Conference on Mechatronics and Automation (ICMA), Changchun, China, 5–8 August 2018; pp. 83–88. [Google Scholar]
  8. Alazrai, R.; Alwanni, H.; Daoud, M.I. EEG-based BCI system for decoding finger movements within the same hand. Neurosci. Lett. 2019, 698, 113–120. [Google Scholar] [CrossRef]
  9. Lu, Y.; Bi, L. EEG Signals-Based Longitudinal Control System for a Brain-Controlled Vehicle. IEEE Trans. Neural Syst. Rehabil. Eng. 2019, 27, 323–332. [Google Scholar] [CrossRef]
  10. Xygonakis, I.; Athanasiou, A.; Pandria, N.; Kugiumtzis, D.; Bamidis, P.D. Decoding Motor Imagery through Common Spatial Pattern Filters at the EEG Source Space. Comput. Intell. Neurosci. 2018, 2018, 7957408. [Google Scholar] [CrossRef] [Green Version]
  11. Ai, Q.; Chen, A.; Chen, K.; Liu, Q.; Zhou, T.; Xin, S.; Ji, Z. Feature extraction of four-class motor imagery EEG signals based on functional brain network. J. Neural Eng. 2019, 16, 026032. [Google Scholar] [CrossRef]
  12. Zhang, J.; Jadavji, Z.; Zewdie, E.; Kirton, A. Evaluating If Children Can Use Simple Brain Computer Interfaces. Front. Hum. Neurosci. 2019, 13, 24. [Google Scholar] [CrossRef] [Green Version]
  13. Blankertz, B.; Muller, K.; Krusienski, D.J.; Schalk, G.; Wolpaw, J.R.; Schlogl, A.; Pfurtscheller, G.; Millan, J.R.; Schroder, M.; Birbaumer, N. The BCI competition III: Validating alternative approaches to actual BCI problems. IEEE Trans. Neural Syst. Rehabil. Eng. 2006, 14, 153–159. [Google Scholar] [CrossRef] [PubMed]
  14. Liu, Q.; Balsters, J.H.; Baechinger, M.; Groen, O.; Wenderoth, N.; Mantini, D. Estimating a neutral reference for electroencephalographic recordings: The importance of using a high-density montage and a realistic head model. J. Neural Eng. 2015, 12, 1–13. [Google Scholar] [CrossRef] [PubMed]
  15. Tadel, F.; Baillet, S.; Mosher, J.C.; Pantazis, D.; Leahy, R.M. Brainstorm: A User-Friendly Application for MEG/EEG Analysis. Comput. Intell. Neurosci. 2011, 2011, 879716. [Google Scholar] [CrossRef] [PubMed]
  16. Pascual-Marqui, R.D. Standardized low-resolution brain electromagnetic tomography (sLORETA): Technical details. Methods Find. Exp. Clin. Pharmacol. 2002, 24 (Suppl. D), 5–12. [Google Scholar]
  17. Ramoser, H.; Muller-Gerking, J.; Pfurtscheller, G. Optimal spatial filtering of single trial EEG during imagined hand movement. IEEE Trans. Rehabil. Eng. 2000, 8, 441–446. [Google Scholar] [CrossRef] [Green Version]
  18. Lotte, F.; Guan, C. Regularizing Common Spatial Patterns to Improve BCI Designs: Unified Theory and New Algorithms. IEEE Trans. Biomed. Eng. 2011, 58, 355–362. [Google Scholar] [CrossRef] [Green Version]
  19. Belhadj, S.A.; Benmoussat, N.; Krachai, M.D. CSP features extraction and FLDA classification of EEG-based motor imagery for Brain-Computer Interaction. In Proceedings of the 2015 4th International Conference on Electrical Engineering (ICEE), Boumerdes, Algeria, 13–15 December 2015; pp. 1–6. [Google Scholar] [CrossRef]
  20. Pelgrims, B.; Michaux, N.; Olivier, E.; Andres, M. Contribution of the primary motor cortex to motor imagery: A subthreshold TMS study. Hum. Brain Mapp. 2011, 32, 1471–1482. [Google Scholar] [CrossRef]
  21. Neuper, C.; Wortz, M.; Pfurtscheller, G. ERD/ERS patterns reflecting sensorimotor activation and deactivation. In Event-Related Dynamics of Brain Oscillations; Progress in Brain Research; Neuper, C., Klimesch, W., Eds.; Elsevier: Amsterdam, The Netherlands, 2006; Volume 159, pp. 211–222. [Google Scholar] [CrossRef]
  22. Dalla-Corte, A.; das Neves, C.M.M.; Anes, M.; Portuguez, M.W.; Dacosta, J.C. The Effect of Handedness on Supplementary Motor Area Activation during Complex Motor Tasks. J. Behav. Brain Sci. 2015, 5, 458–469. [Google Scholar] [CrossRef] [Green Version]
  23. Hoshi, E.; Tanji, J. Distinctions between dorsal and ventral premotor areas: Anatomical connectivity and functional properties. Curr. Opin. Neurobiol. 2007, 17, 234–242. [Google Scholar] [CrossRef]
  24. Ruan, J.; Bludau, S.; Palomero-Gallagher, N.; Caspers, S.; Mohlberg, H.; Eickhoff, S.B.; Seitz, R.J.; Amunts, K. Cytoarchitecture, probability maps, and functions of the human supplementary and pre-supplementary motor areas. Brain Struct. Funct. 2018, 223, 4169–4186. [Google Scholar] [CrossRef] [Green Version]
  25. Athanasiou, A.; Klados, M.A.; Styliadis, C.; Foroglou, N.; Polyzoidis, K.; Bamidis, P.D. Investigating the Role of Alpha and Beta Rhythms in Functional Motor Networks. Neuroscience 2018, 378, 54–70. [Google Scholar] [CrossRef] [PubMed]
  26. Hoshi, E.; Tanji, J. Functional specialization in dorsal and ventral premotor areas. In Brain Mechanisms for the Integration of Posture and Movement; Elsevier: Amsterdam, The Netherlands, 2004; Volume 143, pp. 507–511. [Google Scholar] [CrossRef]
Figure 1. A brain–computer interface (BCI) system.
Figure 1. A brain–computer interface (BCI) system.
Brainsci 09 00372 g001
Figure 2. Flow diagram of this work.
Figure 2. Flow diagram of this work.
Brainsci 09 00372 g002
Figure 3. Selected brain regions: (a) top view, (b) midline surface.
Figure 3. Selected brain regions: (a) top view, (b) midline surface.
Brainsci 09 00372 g003
Figure 4. The 0.1–30 Hz ROI occurrence chart: primary foot somatosensory area (S1F), primary hand somatosensory area (S1H), cingulate motor area (CMA), primary foot motor area (M1F), primary hand motor area (M1H), supplementary motor area (SMA), presupplementary motor area (pSMA), dorsal premotor cortex (PMd), ventral premotor cortex (PMv), _L indicates the left lobe, _R indicates the right lobe.
Figure 4. The 0.1–30 Hz ROI occurrence chart: primary foot somatosensory area (S1F), primary hand somatosensory area (S1H), cingulate motor area (CMA), primary foot motor area (M1F), primary hand motor area (M1H), supplementary motor area (SMA), presupplementary motor area (pSMA), dorsal premotor cortex (PMd), ventral premotor cortex (PMv), _L indicates the left lobe, _R indicates the right lobe.
Brainsci 09 00372 g004
Figure 5. μ band ROI occurrence chart: Primary foot somatosensory area (S1F), primary hand somatosensory area (S1H), cingulate motor area (CMA), primary foot motor area (M1F), primary hand motor area (M1H), supplementary motor area (SMA), presupplementary motor area (pSMA), dorsal premotor cortex (PMd), ventral premotor cortex (PMv). _L indicates left lobe, _R indicates right lobe.
Figure 5. μ band ROI occurrence chart: Primary foot somatosensory area (S1F), primary hand somatosensory area (S1H), cingulate motor area (CMA), primary foot motor area (M1F), primary hand motor area (M1H), supplementary motor area (SMA), presupplementary motor area (pSMA), dorsal premotor cortex (PMd), ventral premotor cortex (PMv). _L indicates left lobe, _R indicates right lobe.
Brainsci 09 00372 g005
Table 1. Subjects in the dataset and the number of training and testing signals.
Table 1. Subjects in the dataset and the number of training and testing signals.
Number of Training SamplesNumber of Test Samples
aa168112
al22456
av84196
aw56224
ay28252
Table 2. Sensor level classification accuracies.
Table 2. Sensor level classification accuracies.
Sensor Data 0.1–30 Hz (118 Electrodes) μ Band (118 Electrodes)
aa59.8269.64
al87.50100
av60.7171.43
aw54.4676.34
ay51.5950.40
Table 3. Accuracy (acc), sensitivity (sens) and specificity (spec) of all combinations for 0.1–30 Hz range.
Table 3. Accuracy (acc), sensitivity (sens) and specificity (spec) of all combinations for 0.1–30 Hz range.
0.1–30 HzCriteriaLeft Lobe MaxLeft Lobe 3 RegionsRight Lobe MaxRight Lobe 3 RegionsLeft and Right Lobe 6 Regions
aaacc67.8663.3966.9663.3968.75
sens67.6575.6879.4970.2179.07
spec68.1857.3360.2758.4662.32
alacc92.8685.7189.2983.9398.21
sens10085.7189.2991.30100
spec87.5085.7189.2978.7996.55
avacc61.7358.6764.8062.2464.80
sens60.5557.9467.0659.2363.81
spec63.2259.5563.0668.1865.93
awacc78.5775.4575.0068.3079.46
sens75.4169.7874.5564.0382.00
spec82.3584.7175.4475.2977.42
ayacc60.7157.9459.9255.9566.27
sens56.4254.7155.0752.5660.11
spec71.2364.6382.2275.6882.61
Averageacc72.3568.2371.1966.7675.50
sens72.0168.7673.0964.4777.00
spec74.5070.3974.0671.2876.97
Table 4. The Most successful ROIs for 0.1–30 Hz signals: primary foot somatosensory area (S1F), primary hand somatosensory area (S1H), cingulate motor area (CMA), primary foot motor area (M1F), primary hand motor area (M1H), supplementary motor area (SMA), presupplementary motor area (pSMA), dorsal premotor cortex (PMd), ventral premotor cortex (PMv). Subscript L indicates left lobe, Subscript R indicates right lobe.
Table 4. The Most successful ROIs for 0.1–30 Hz signals: primary foot somatosensory area (S1F), primary hand somatosensory area (S1H), cingulate motor area (CMA), primary foot motor area (M1F), primary hand motor area (M1H), supplementary motor area (SMA), presupplementary motor area (pSMA), dorsal premotor cortex (PMd), ventral premotor cortex (PMv). Subscript L indicates left lobe, Subscript R indicates right lobe.
0.1–30 HzLeft Lobe MaxLeft Lobe 3 RegionsRight Lobe MaxRight Lobe 3 RegionsLeft and Right Lobe 6 Regions
aa S 1 F L , S 1 H L , C M A L , M 1 F L , M 1 H L , S M A L C M A L , M 1 F L , S M A L S 1 F R , C M A R , M 1 F R , S M A R , p S M A R , P M d R , P M v R C M A R , M 1 F R , M 1 H R S 1 F L , C M A L , S M A L , S 1 F R , M 1 H R , p S M A R
al S 1 H L , C M A L , M 1 F L , P M d L , P M v L M 1 H L , S M A L , P M d L S 1 H R , C M A R , M 1 F R , M 1 H R , S M A R , P M v R S 1 H R , M 1 H R , S M A R M 1 H L , P M d L , S 1 F R , S 1 H R , M 1 H R , S M A R
av S 1 H L , C M A L , M 1 F L , M 1 H L , S M A L , p S M A L , P M d L , P M v L C M A L , M 1 F L , S M A L C M A R , M 1 F R , M 1 H R , p S M A R , P M d R S 1 F R , M 1 H R , p S M A R S 1 F L , M 1 F L , M 1 H L , p S M A L , S 1 F R , C M A R
aw S 1 F L , S 1 H L , M 1 F L , M 1 H L , P M d L S 1 H L , M 1 H L , P M v L S 1 F R , S 1 H R , C M A R , M 1 H R , P M d R S M A R , p S M A R , P M v R S 1 F L , S 1 H L , M 1 F L , M 1 H L , S M A R , P M v R
ay S 1 H L , C M A L , M 1 F L , M 1 H L , P M v L S 1 F L , C M A L , P M v L S 1 F R , C M A R , M 1 F R , P M v R S 1 F R , C M A R , P M v R S 1 F L , M 1 F L , P M v L , S 1 F R , C M A R , M 1 H R
Table 5. Accuracy (acc), sensitivity (sens) and specificity (spec) of all combinations for μ band signals.
Table 5. Accuracy (acc), sensitivity (sens) and specificity (spec) of all combinations for μ band signals.
8–13 HzCriteriaLeft Lobe MaxLeft Lobe 3 RegionsRight Lobe MaxRight Lobe 3 RegionsLeft and Right Lobe 6 Regions
aaacc66.9662.5069.6461.6174.11
sens69.4965.5274.0771.7980.39
spec64.1559.2665.5256.1668.85
alacc10098.2194.6491.07100
sens10096.5590.3287.10100
spec10010010096.00100
avacc66.8460.7166.3362.2467.86
sens65.7160.4067.3963.3369.23
spec68.1361.0565.3861.3266.67
awacc87.0584.3886.1680.8090.18
sens85.8483.7889.1181.9090.74
spec88.2984.9683.7479.8389.66
ayacc86.1186.1175.0058.7386.11
sens81.2981.2967.0555.0680.85
spec92.0492.0492.4167.5792.79
Averageacc81.3978.3878.3570.8983.65
sens80.4777.5177.5971.8484.24
spec82.5279.4681.4172.1883.59
Table 6. Most successful ROIs for μ band signals: primary foot somatosensory area (S1F), primary hand somatosensory area (S1H), cingulate motor area (CMA), primary foot motor area (M1F), primary hand motor area (M1H), supplementary motor area (SMA), presupplementary motor area (pSMA), dorsal premotor cortex (PMd), ventral premotor cortex (PMv). Subscript L indicates left lobe, subscript R indicates right lobe.
Table 6. Most successful ROIs for μ band signals: primary foot somatosensory area (S1F), primary hand somatosensory area (S1H), cingulate motor area (CMA), primary foot motor area (M1F), primary hand motor area (M1H), supplementary motor area (SMA), presupplementary motor area (pSMA), dorsal premotor cortex (PMd), ventral premotor cortex (PMv). Subscript L indicates left lobe, subscript R indicates right lobe.
8–13 HzLeft Lobe MaxLeft Lobe 3 RegionsRight Lobe MaxRight Lobe 3 RegionsLeft and Right Lobe 6 Regions
aa S 1 F L , S 1 H L , M 1 F L , S M A L , p S M A L C M A L , M 1 H L , P M d L S 1 F R , S 1 H R , C M A R , M 1 F R , M 1 H R , S M A R , p S M A R , P M d R , C M A R , S M A R p S M A R S 1 H L , M 1 H L , S M A L , P M d L , S M A R , P M d R
al S 1 H L , M 1 F L , M 1 H L , S M A L , S 1 H L , M 1 H L , S M A L , M 1 F R , M 1 H R , S M A R , p S M A R , P M d R , M 1 H R , S M A R , p S M A R S 1 F L , S 1 H L , C M A L , M 1 F L , M 1 H L , M 1 F R ,
av S 1 F L , S 1 H L , C M A L , M 1 H L , S M A L , P M v L , S 1 F L , p S M A L , P M v L S 1 F R , S 1 H R , p S M A R , P M d R S 1 F R , S 1 H R , P M d R S 1 F L , S 1 H L , C M A L , S M A L , M 1 H R , S M A R
aw S 1 H L , M 1 F L , M 1 H L , S M A L S 1 F L , S 1 H L , C M A L , S 1 F R , S 1 H R , M 1 H R , p S M A R , P M d R , S 1 H R , C M A R , M 1 H R S 1 H L , M 1 F L , M 1 H L , S M A L , S M A R , P M d R ,
ay S 1 H L , S M A L , P M d L , P M v L S 1 H L , P M d L , P M v L S 1 F R , S 1 H R , C M A R , M 1 F R , M 1 H R , S M A R , p S M A R , P M v R M 1 H R , S M A R , p S M A R C M A L , M 1 H L , P M d L , P M v L , P M d R , P M v R

Share and Cite

MDPI and ACS Style

Yazici, M.; Ulutas, M.; Okuyan, M. A Comprehensive sLORETA Study on the Contribution of Cortical Somatomotor Regions to Motor Imagery. Brain Sci. 2019, 9, 372. https://doi.org/10.3390/brainsci9120372

AMA Style

Yazici M, Ulutas M, Okuyan M. A Comprehensive sLORETA Study on the Contribution of Cortical Somatomotor Regions to Motor Imagery. Brain Sciences. 2019; 9(12):372. https://doi.org/10.3390/brainsci9120372

Chicago/Turabian Style

Yazici, Mustafa, Mustafa Ulutas, and Mukadder Okuyan. 2019. "A Comprehensive sLORETA Study on the Contribution of Cortical Somatomotor Regions to Motor Imagery" Brain Sciences 9, no. 12: 372. https://doi.org/10.3390/brainsci9120372

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop