Next Article in Journal
Synthesis and Characterization of N-Isopropylacrylamide Microspheres as pH Sensors
Previous Article in Journal
A Heterogeneous RISC-V Processor for Efficient DNN Application in Smart Sensing System
Previous Article in Special Issue
MEG Source Localization via Deep Learning
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Editorial

Acquisition and Processing of Brain Signals

by
Andrea Bizzego
1,* and
Gianluca Esposito
1,2,3,*
1
Department of Psychology and Cognitive Science, University of Trento, 38068 Trento, Italy
2
Psychology Program, Nanyang Technological University, Singapore 639818, Singapore
3
Lee Kong Chian School of Medicine, Nanyang Technological University, Singapore 308232, Singapore
*
Authors to whom correspondence should be addressed.
Sensors 2021, 21(19), 6492; https://doi.org/10.3390/s21196492
Submission received: 15 September 2021 / Accepted: 25 September 2021 / Published: 29 September 2021
(This article belongs to the Special Issue Brain Signals Acquisition and Processing)
We live within a context of unprecedented opportunities for brain research, with a flourishing of novel sensing technologies and methodological approaches. Technological progress has made available a new generation of sensors and devices that facilitate the collection of central and peripheral nervous system signals [1,2,3]. Physiological signals are most efficiently analyzed by means of modern analysis techniques, particularly those based on data fusion and deep learning algorithms [4].
For this Special Issue (SI), we have collected articles that focus on comparisons of the sensing technologies and on standardization of the signal processing procedures to collect and analyze central and peripheral nervous system signals. These studies describe the use of new technologies and technological advancements, both in terms of signal processing methods and innovative applications. The articles of this SI can be grouped into three categories: tutorials and reviews, including three papers that present the current status of the literature in the analysis of cardiac and functional near-infrared spectroscopy (fNIRS) signals; signal processing, including four papers that introduce novel methods and approaches; and sensors and applications, including four papers that highlight potential applications of wearable devices in different clinical and research domains.
Within the fast-paced landscape of brain signal acquisition and processing applications, contributions aimed at improving the standardization of the research are very important. This SI includes three contributions, two focusing on the analysis of cardiac signals, and another targeting hyperscanning experiments using fNIRS signals.
Notwithstanding the importance of heart rate variability (HRV) analysis in research, users with no adequate background might find it difficult to identify and implement the analytical steps required to obtain HRV measures. To address this issue, Pham and colleagues [5] provided a review of the state-of-the-art methods for HRV analysis, and a tutorial to implement them using NeuroKit2 [6], a Python package for Neurophysiological Signal Processing.
HRV measures are also used to identify psychological states, for instance, cognitive fatigue. On this topic, Lee and colleagues [7] reviewed the current machine learning (ML)-based approaches to assess fatigued states and reflected on future directions to be explored.
Recently, research in neuroscience has started to consider the effects of inter-personal interactions on the autonomic and central brain activity [8,9]. Working with data from dyads, instead of single subjects, poses some challenges; furthermore, experiments with fNIRS require standardization [10,11], but presently leave several implementation decisions to the researcher’s discretion. Nguyen and colleagues [12] offer valuable guidelines for implementing reproducible pipelines for the processing and analysis of fNIRS signals in parent–child experimental settings.
Four contributions in this SI proposed new methods for the analysis of brain signals and data from neuroscience studies. Noticeably, all of them are based on artificial intelligence (AI) approaches, which are clearly the new frontier for brain signal processing. Pantazis and Amir [13] used deep learning (DL) for the localization of magnetoencephalography (MEG) brain signals, which improved the results in terms of predictive performance, robustness and computation time compared to the standard RAP-MUSIC localization algorithm [14]. Gabrieli and colleagues [15] proposed a data quality control pipeline based on ML, to discriminate between usable and unusable eye fixation recordings. The results prove that the proposed approach could be effectively used to label collected data. Prasanna and colleagues [16] used DL to discriminate between focal and non-focal electroencephalogram (EEG) signals, which is crucial to localizing the epileptogenic zone during neurosurgery. The network processes entropy features and frequency features computed with the fast Walsh–Hadamard transform [17], and demonstrated state-of-the-art performance on two reference datasets. Lai and colleagues [18] focused on the discrimination of patients with non-severe traumatic brain injury and healthy subjects based on EEG signals. They proposed the use of a hybrid model, composed of a DL network, including a long-short term memory layer, which is used to automatically extract features that are provided to an error-correcting output coding support vector machine.
Finally, this SI includes four contributions focusing on potential applications of new sensors, particularly wearable devices. Sela and colleagues [19] reflected on the technological and ethical challenges of a novel multi-domain socio-ecological model of health, based on the integration of data from neuro-sensors and psychosocial metrics. Kennedy-Metz and colleagues [20] offered a proof of concept of the integrated use of heart rate and fNIRS sensing in a critical setting, a cardiac surgery operating room. Specifically, this use case focused on identifying the influence of intra-operative events on cardiovascular and prefrontal cortex changes. Bizzego and colleagues [21] presented a framework for the validation of devices for physiological signal acquisition for research purposes. In particular, the study dealt with the issue of assessing the replicability of physiological measures, when computed on lower quality data from wearable devices. Al-Ezzi and colleagues [22] analyzed the associations among brain connectivity, measured with EEG sensors, and the severity of social anxiety disorders. The outcomes of this study shed new light on the comprehension of neural biomarkers underlying social anxiety disorders, paving the way to future clinical applications.
The contributions of this SI regarding brain signal acquisition and processing reveal a vital and fruitful research field, which, besides the standard approaches and paradigms, is open to novel models and methods.
This particular context is the result of the co-occurrence of two favorable circumstances: (a) the availability of affordable and portable sensors and devices, and (b) the flourishing of new processing methods based on AI. New sensors and devices reduce the physical constraints on the acquisition of brain signals and allow focusing on novel research contexts. AI methods facilitate the analysis of collected data, providing more powerful and effective methods. Together, they are re-shaping the field of brain signal acquisition and processing.
More than ever, within this context of new opportunities, reproducibility is a key aspect that should be the priority of all researchers working in this domain. To maximize the impact of the research, the advancement of the sensing and processing technologies should be associated with the adoption of rigorous and standardized methods which favor the comparability and reproducibility of the findings.

Funding

A.B. was supported by a Post-doctoral Fellowship within MIUR programme framework “Dipartimenti di Eccellenza” (DiPSCO, University of Trento, Italy).

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Lin, Q.; Song, S.; Castro, I.D.; Jiang, H.; Konijnenburg, M.; van Wegberg, R.; Biswas, D.; Stanzione, S.; Sijbers, W.; Van Hoof, C.; et al. Wearable multiple modality bio-signal recording and processing on chip: A review. IEEE Sens. J. 2020, 21, 1108–1123. [Google Scholar] [CrossRef]
  2. Saganowski, S.; Dutkowiak, A.; Dziadek, A.; Dzieżyc, M.; Komoszyńska, J.; Michalska, W.; Polak, A.; Ujma, M.; Kazienko, P. Emotion recognition using wearables: A systematic literature review-work-in-progress. In Proceedings of the 2020 IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops), Austin, TX, USA, 23–27 March 2020; pp. 1–6. [Google Scholar]
  3. Hickey, B.A.; Chalmers, T.; Newton, P.; Lin, C.T.; Sibbritt, D.; McLachlan, C.S.; Clifton-Bligh, R.; Morley, J.; Lal, S. Smart devices and wearable technologies to detect and monitor mental health conditions and stress: A systematic review. Sensors 2021, 21, 3461. [Google Scholar] [CrossRef]
  4. Bizzego, A.; Gabrieli, G.; Esposito, G. Deep neural networks and transfer learning on a multivariate physiological signal Dataset. Bioengineering 2021, 8, 35. [Google Scholar] [CrossRef]
  5. Pham, T.; Lau, Z.J.; Chen, S.H.A.; Makowski, D. Heart Rate Variability in psychology: A review of HRV indices and an analysis tutorial. Sensors 2021, 21, 3998. [Google Scholar] [CrossRef]
  6. Makowski, D.; Pham, T.; Lau, Z.J.; Brammer, J.C.; Lespinasse, F.; Pham, H.; Schölzel, C.; Chen, S.H.A. NeuroKit2: A Python toolbox for neurophysiological signal processing. Behav. Res. Methods 2021, 53, 1689–1696. [Google Scholar] [CrossRef]
  7. Lee, K.F.A.; Gan, W.S.; Christopoulos, G. Biomarker-informed Machine Learning model of cognitive fatigue from a heart rate response perspective. Sensors 2021, 21, 3843. [Google Scholar] [CrossRef] [PubMed]
  8. Azhari, A.; Lim, M.; Bizzego, A.; Gabrieli, G.; Bornstein, M.H.; Esposito, G. Physical presence of spouse enhances brain-to-brain synchrony in co-parenting couples. Sci. Rep. 2020, 10, 1–11. [Google Scholar] [CrossRef] [PubMed]
  9. Bizzego, A.; Azhari, A.; Campostrini, N.; Truzzi, A.; Ng, L.Y.; Gabrieli, G.; Bornstein, M.H.; Setoh, P.; Esposito, G. Strangers, friends, and lovers show different physiological synchrony in different emotional states. Behav. Sci. 2020, 10, 11. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Pinti, P.; Scholkmann, F.; Hamilton, A.; Burgess, P.; Tachtsidis, I. Current status and issues regarding pre-processing of fNIRS neuroimaging data: An investigation of diverse signal filtering methods within a general linear model framework. Front. Hum. Neurosci. 2019, 12, 505. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  11. Bizzego, A.; Balagtas, J.P.M.; Esposito, G. Commentary: Current status and issues regarding pre-processing of fNIRS neuroimaging data: An investigation of diverse signal filtering methods within a general linear model framework. Front. Hum. Neurosci. 2020, 14, 247. [Google Scholar] [CrossRef]
  12. Nguyen, T.; Hoehl, S.; Vrtička, P. A guide to parent-child fNIRS hyperscanning data processing and analysis. Sensors 2021, 21, 4075. [Google Scholar] [CrossRef] [PubMed]
  13. Pantazis, D.; Adler, A. MEG source localization via Deep Learning. Sensors 2021, 21, 4278. [Google Scholar] [CrossRef]
  14. Mosher, J.C.; Leahy, R.M. Source localization using recursively applied and projected (RAP) MUSIC. IEEE Trans. Signal Process. 1999, 47, 332–340. [Google Scholar] [CrossRef] [Green Version]
  15. Gabrieli, G.; Balagtas, J.P.M.; Esposito, G.; Setoh, P. A Machine Learning approach for the automatic estimation of fixation-time data signals’ quality. Sensors 2020, 20, 6775. [Google Scholar] [CrossRef] [PubMed]
  16. Prasanna, J.; Subathra, M.S.P.; Mohammed, M.A.; Maashi, M.S.; Garcia-Zapirain, B.; Sairamya, N.J.; George, S.T. Detection of focal and non-focal electroencephalogram signals using fast walsh-hadamard transform and artificial neural network. Sensors 2020, 20, 4952. [Google Scholar]
  17. Hamood, M.T.; Boussakta, S. Fast walsh–hadamard–fourier transform algorithm. IEEE Trans. Signal Process. 2011, 59, 5627–5631. [Google Scholar] [CrossRef]
  18. Lai, C.Q.; Ibrahim, H.; Abd Hamid, A.I.; Abdullah, J.M. Classification of son-severe traumatic brain injury from resting-state EEG signal using LSTM network with ECOC-SVM. Sensors 2020, 20, 5234. [Google Scholar] [CrossRef]
  19. Sela, Y.; Santamaria, L.; Amichai-Hamburge, Y.; Leong, V. Towards a personalized multi-domain digital neurophenotyping model for the detection and treatment of mood trajectories. Sensors 2020, 20, 5781. [Google Scholar] [CrossRef] [PubMed]
  20. Kennedy-Metz, L.R.; Dias, R.D.; Srey, R.; Rance, G.C.; Furlanello, C.; Zenati, M.A. Sensors for continuous monitoring of surgeon’s cognitive workload in the cardiac operating room. Sensors 2020, 20, 6616. [Google Scholar] [CrossRef]
  21. Bizzego, A.; Gabrieli, G.; Furlanello, C.; Esposito, G. Comparison of wearable and clinical devices for acquisition of peripheral nervous system signals. Sensors 2020, 20, 6778. [Google Scholar] [CrossRef]
  22. Al-Ezzi, A.; Kamel, N.; Faye, I.; Gunaseli, E. Analysis of default mode network in Social Anxiety Disorder: EEG resting-state effective connectivity study. Sensors 2021, 21, 4098. [Google Scholar] [CrossRef] [PubMed]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Bizzego, A.; Esposito, G. Acquisition and Processing of Brain Signals. Sensors 2021, 21, 6492. https://doi.org/10.3390/s21196492

AMA Style

Bizzego A, Esposito G. Acquisition and Processing of Brain Signals. Sensors. 2021; 21(19):6492. https://doi.org/10.3390/s21196492

Chicago/Turabian Style

Bizzego, Andrea, and Gianluca Esposito. 2021. "Acquisition and Processing of Brain Signals" Sensors 21, no. 19: 6492. https://doi.org/10.3390/s21196492

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop