Next Article in Journal
fMRI Acoustic Noise Enhances Parasympathetic Activity in Humans
Previous Article in Journal
Update on Paraneoplastic Cerebellar Degeneration
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

The Application of Complexity Analysis in Brain Blood-Oxygen Signal

Center for Psychological Sciences, Zhejiang University, Hangzhou 310012, China
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Brain Sci. 2021, 11(11), 1415; https://doi.org/10.3390/brainsci11111415
Submission received: 16 September 2021 / Revised: 22 October 2021 / Accepted: 25 October 2021 / Published: 27 October 2021

Abstract

:
One of the daunting features of the brain is its physiology complexity, which arises from the interaction of numerous neuronal circuits that operate over a wide range of temporal and spatial scales, enabling the brain to adapt to the constantly changing environment and to perform various cognitive functions. As a reflection of the complexity of brain physiology, the complexity of brain blood-oxygen signal has been frequently studied in recent years. This paper reviews previous literature regarding the following three aspects: (1) whether the complexity of the brain blood-oxygen signal can serve as a reliable biomarker for distinguishing different patient populations; (2) which is the best algorithm for complexity measure? And (3) how to select the optimal parameters for complexity measures. We then discuss future directions for blood-oxygen signal complexity analysis, including improving complexity measurement based on the characteristics of both spatial patterns of brain blood-oxygen signal and latency of complexity itself. In conclusion, the current review helps to better understand complexity analysis in brain blood-oxygen signal analysis and provide useful information for future studies.

1. Introduction

One of the distinct features of the brain is its daunting complexity, which remains a popular research topic [1]. Dating back to the 1930s, Sigmund Freud proposed to investigate the relation between mental illness and brain complexity but eventually failed due to the lack of reliable analysis methods [2]. After continuous exploration and development, an academic discipline called complexity science emerged. As the concepts and methodology from mathematics, physics, and computer sciences were introduced into the field of psychology, complexity science also had its contribution in quantifying the behavioral and emotional problems of patients with mental disorders in the past two decades. For example, Paulus et al. [3] found that compared with healthy controls, schizophrenic patients showed more predictable behavior (i.e., less complex) during a consecutive binary choice task. Similarly, researchers found that self-rated consecutive daily record of mood completed by patients with bipolar disorder exhibited a more organized pattern (i.e., less complex) than healthy controls [4]. In many cases, aging and diseases often come along with loss of physiological complexity [5,6]. With the development of brain imaging techniques in recent years, brain blood-oxygen signal has been widely used as an objective indicator of brain activity. Thus, brain signal complexity has been used as an external and objective indicator of complexity of brain activity. In this paper, we provide a review of recent studies (since 2010) measuring complexity of blood-oxygen signal and discuss opportunities and challenges in this field.

2. Complexity of Brain Blood-Oxygen Signal

2.1. Physiological Complexity of Brain

Complexity is a characteristic of a system and is inherently inseparable from it. Intuitively, a complex system can be described as a system that consists of many interacting parts, for example, the metro systems of New York City. The human brain, which is composed of innumerable neurons and synapses, undoubtedly exhibits its astonishing complexity. Although there is an ongoing debate on how to define and measure complexity mathematically, two basic views proposed by Herbert Simon [7] have been widely adopted. First, most of the complex systems are hierarchically organized and can be decomposed into subsystems and interactions among them. Second, complexity is not randomness. In fact, it is a mixture of randomness and regularity. As illustrated in Figure 1, either highly ordered (e.g., crystal) or highly random (e.g., gas) systems are of low complexity. A system, however, when showing coexistence of both order and randomness (e.g., the human brain), exhibits high complexity. As Simon suggested [7], the physiological complexity of the brain does not only arise from the interaction of numerous neuronal circuits that operate over a wide range of temporal and spatial scales, but is also inextricably bound to its unique physiological structure for the coexistence of randomness and regularity [8,9].

2.2. Measuring Brain Complexity through Brain Blood-Oxygen Signals

Despite the definition of complexity by Simon, quantifying brain complexity directly is still difficult. This is because deducting the whole brain into a myriad of subsystems is extremely resource and time consuming, and it appears to be unpractical in application. Therefore, researchers use the complexity of brain neurophysiological outputs as an indirect measure of brain complexity.
Blood-oxygen signal is a common brain neurophysiological output, which reflects changes in cerebral blood flow and oxygen consumption resulted from brain activities. One of the most widely used signals is the blood oxygen level-dependent (BOLD) signal obtained by functional magnetic resonance imaging (fMRI). Besides, there are other kinds of blood-oxygen signals such as oxyhemoglobin (O2Hb) and deoxyhemoglobin (HHb) signals obtained by functional near-infrared spectroscopy (fNIRS). The complexity of brain blood-oxygen signal can be used as a valid estimate of physiological complexity of the brain. The majority of brain blood-oxygen complexity measurements are entropy-based algorithms [11] such as approximate entropy (ApEn), sample entropy (SampEn) and permutation entropy (PE). For different types of complexity measurements, the algorithms vary. However, in general, they can be evaluated with Equation (1):
C o m p l e x i t y c a t e g o r y ( p o s ) = C a l _ C o m p l e x i y c a t e t o r y [ p o s i t i o n , p a r m e t e r s , s i g a n l ]
Category defines the type of algorithm. Parameters specify the required parameters for a specific complexity algorithm. Position denotes the location information: for BOLD signal obtained with fMRI, position represents a certain voxel location; for O2Hb and HHb signals, position represents the corresponding location of a certain channel. When the necessary information (category, position, parameters, and signal) is given, the complexity value can then be calculated. Specifically, if the complexity algorithm is a certain type of entropy, the whole brain complexity pattern, or in other words, brain entropy map (BEM) can be obtained by calculating entropy value at each spatial location.

3. Current Studies in Complexity of Brain Blood-Oxygen Signals

Table 1 summarizes studies on complexity of blood oxygen signals since 2010. These studies can be divided into two categories: one is biomarker-oriented studies aiming to apply complexity measures of brain blood-oxygen signals as a biomarker to characterize patient populations. The other is methodology-oriented studies aiming to develop measurements of brain blood-oxygen signal complexity. Based on aims of the studies from these two categories, this chapter aims to review current literatures in the following three aspects.

3.1. Brain Blood-Oxygen Signal Complexity as a Biomarker

Complexity is a nature of a system and inherently inseparable from it. According to the loss of physiological complexity theory, brain physiological complexity is reduced in many disease states and aging, reflected in the reduction of blood-oxygen signal complexity [6,12,13,14]. Findings from many studies on resting-state brain blood-oxygen activities are consistent with this theory as shown in Table 1. For example, Sokunbi et al. [15] found that ADHD patients showed lower mean whole brain SampEn than healthy controls in resting state. In another similar study, Sokunbi [16] found the mean whole brain SampEn of young adults is significantly higher than older adults in resting state. In most cases, however, significant whole brain BOLD SampEn differences were not observed. Therefore, researchers usually take advantage of the high spatial resolution BOLD signals obtained with fMRI to search for the specific regions that exhibit significant differences. Yang et al. [17] found that MSE of BOLD signals in posterior cingulate gyrus and hippocampal cortex in older adults were significantly lower than that of younger adults. Liu et al. [18] found Alzheimer patients showed a significant reduction in ApEn of BOLD signals in anterior cingulate cortex and left precuneus.
However, some task-state studies indicated that aging or illness does not necessarily reduce the brain blood oxygen complexity. For example, Sokunbi et al. [19] found when performing Cyberball social exclusion task, the whole brain SampEn in schizophrenic patients was significantly higher than that of normal participants. Gu et al. [20] found that compared with normal controls, the permutation entropies (PEs) of BOLD signal in dorsolateral prefrontal cortex were significantly higher in patients with ADHD during a working memory task.
Some researchers consider that resting-state BOLD signal and task-state BOLD signal have different natures, so it explains that they may exhibit different temporal brain entropy (tBEN) patterns [20,21]. Here, however, we argue that the discrepancy in complexity patterns between resting-state and task-state may arise from the fact that many studies falsely equate complexity to entropy. As mentioned above, the value calculated by entropy algorithms can only be treated as an estimate of complexity, regardless of the type of algorithm. This is because when signals are of high randomness, the complexity would decrease but the brain entropy measured by common entropy algorithms shows the opposite trend as shown in Figure 2a. For example, in the studies of Sokunbi et al. [19] and Gu et al. [20], patients with mental illness showed lower task-elicited brain activation, leading to a higher randomness of signals, which in turn led to a higher entropy value.
Table 1. A summary of literatures on brain blood-oxygen complexity analysis in since 2010.
Table 1. A summary of literatures on brain blood-oxygen complexity analysis in since 2010.
MeasureSignal TypeRes. OrientationParticipantsMain FindingsRef
ApEnTask-BOLDBiomarkerOlder adults (40)Cognitive ability was positively correlated with regional brain BOLD complexity.[22]
SampEnTask-BOLDBiomarkerADHD (17);
HC (13)
The mean whole brain BOLD complexity of ADHD group was significantly lower than the HC; the mean regional brain complexity values have a significant negative correlation with ADHD score.[15]
MSERest-BOLDBiomarkerOlder adults (99);
Younger adults (56)
The mean whole brain BOLD complexity of younger adults was significantly higher than that of older adults; the high cognitive ability group showed significantly higher whole brain BOLD complexity than the low cognitive ability group; regional brain BOLD complexity was significantly correlated with cognitive function.[17]
ApEnRest-BOLDBiomarkerYounger adults (8);
Older adults (8);
fAD (22)
Brain BOLD complexity decreased with normal aging and cognitive decline.[18]
SampEnTask-BOLDBiomarkerSZ (13);
HC (16)
Brain BOLD complexity of SZ patients was higher than that of HC when performing Cyberball social exclusion task.[19]
MSERest-BOLDBiomarker/
Methodology
Older adults (8); Younger adults (8)Brain BOLD complexity was used to discriminate younger from older participants as well as grey matter from white matter.[23]
SampEnRest-BOLDBiomarker/
Methodology
Older adults (53); Younger adults (53)SampEn was used to discriminate the younger from the elderly adults with short length data; the suggested value of m was 2.[16]
SampEnRest-BOLDMethodology1049Using a data-driven clustering method, the entire brain was organized into seven regional brain entropy networks that are consistent with known brain parcellation.[24]
MSERest-BOLDBiomarker/
Methodology
20Complexity of the BOLD signal showed different patterns from white, pink, and red noises; neural complexity across all networks was negative.[25]
MSERest-BOLDBiomarkerSZ (105);
HC (210)
Complexity of BOLD signals in SZ patients showed two patterns (toward either regularity or randomness), which were respectively associated with positive or negative symptoms of schizophrenia.[26]
fApEn;
SampEN
Rest-BOLDBiomarker/
Methodology
86Compared to SampEn, fApEn was better at discriminating different age groups and have shown to be a more sensitive method.[27]
SampEnRest-BOLDBiomarkerCPI (29);
HC (29)
The BEN map of CPI patients demonstrated significant differences from HC, and altered functional connectivity patterns were associated with abnormal BEN regions.[28]
SampEnRest-BOLDBiomarkerRRMS (34);
HC (34)
BOLD complexity of RRMS patients was significantly increased in some regions and was positively correlated with disease severity.[29]
SampEnRest-BOLDBiomarkerseafarers (20);
HC (20)
BOLD complexity pattern of seafarers was significant different from HC.[30]
PERest-BOLDBiomarkerMCI (65);
AD (29);
HC (30)
The BOLD complexity of AD patients was significantly lower than that of MCI patients and HC; that of AD patients and MCI patients was significantly correlated with ReHo in several brain regions associated with AD.[31]
PETask-O2HbBiomarkerADHD (15);
HC (16)
BOLD complexity in the right dorsolateral prefrontal cortex of ADHD patients were significantly higher than that of HC.[20]
SampEn;
MSE
Rest-BOLDMethodology354Proposed a generic strategy to minimize the relative error of SampEn to determine the appropriate complexity measurement parameters.[32]
SampEnTask-BOLDBiomarkerCFS (43);
HC (26)
Regional brain complexity in CFS patients was lower than that in HC when performing a Stroop task.[33]
SampEnRest-BOLD
Task-BOLD
BiomarkerCFS (45);
HC (27)
BOLD complexity of CFS patients was higher in the default mode network at resting-state or performing a Stroop task.[21]
SampEnRest-BOLDBiomarker892BOLD complexity was positively associated with intelligence.[34]
SampEn;
MSE
Rest-BOLDBiomarkerMCI (65);
AD (29);
HC (30)
BOLD complexity of AD and MCI were lower than HC; AD patients showed lower BOLD complexity than MCI.[35]
MSERest-O2HbBiomarkerMCI (65);
AD (29);
HC (30)
O2Hb complexity in AD patients was lower than HC and positive correlated with cognitive ability.[36]
SampEn
MSE
Task-O2Hb
Task-HHb
BiomarkerAD (11);
HC (11)
When performing memory-related tasks, O2Hb complexity of AD was higher than that of HC.[37]
SampEnRest-BOLDBiomarker107SampEn-CBF and SampEn-fALFF correlations were only observed in a few brain regions, demonstrating that complexity, CBF, and fALFF are independent brain activity measures.[38]
SampEnRest-BOLDBiomarkerASD (20);
HC (17)
BOLD complexity was negatively correlated with severity of ASD behaviors.[39]
SampEnRest-BOLDBiomarkerSZ (53);
HC (59)
Compared with HC, SZ showed decreased brain BOLD complexity.[40]
SampEn;
MSE
Task-O2HbBiomarkerAD (11);
HC (11)
AD showed significant differences from HC in O2Hb complexity during VFT and WM tasks.[41]
SampEnRest-BOLDBiomarkerStroke patients (23);
HC (19)
Stroke patients showed reduced BOLD complexity in the motor area.[42]
MSERest-BOLDBiomarkerMCI (169);
HC (176)
BOLD complexity in MCI was significantly lower than that in HC and correlated with severity of MCI.[43]
MSERest-BOLDBiomarkerBP (125); SZ (107);
SAD (98); HC (156)
Significant differences as well as overlaps of brain BOLD signal complexity between different psychotic disorder groups were found.[12]
MSETask-O2Hb
Task-HHb
Biomarker15Brain complexity during performing intentional memory task was significantly higher than that during purposefully forgetting.[44]
MSERest-O2Hb
Rest-HHb
BiomarkerASD (25);
HC (22)
Brain complexity could be used to distinguish ASD from HC. Compared with HC, altered brain complexity in ASD is seen more in IFG than in TC and in left hemisphere than in right hemisphere.[45]
MSERest-BOLDBiomarkerLLD (35);
HC (22)
LLD patients showed decreased complexity only in the right posterior cingulate gyrus but increased complexity in affective processing, sensory, motor, and temporal nodes. Complexity in the left frontoparietal network partially mediated the relation between depression severity and the mental components of quality of life.[46]
Note: ADHD: Attention deficit hyperactivity disorder; HC: healthy control; fAD: familial Alzheimer’s Disease; CPI: chronic primary insomnia; AD: Alzheimer’s Disease; CFS: chronic fatigue syndrome; ASD: Autism Spectrum Disorder; BP: psychotic bipolar disorder; SZ: schizophrenia; RRMS; relapsing-remitting multiple sclerosis; LLD: depression in later life; Task-BOLD: task blood oxygen level dependent signal; Rest-BOLD: rest blood oxygen level dependent signal; Task-O2Hb: task oxyhemoglobin signal; Rest-O2Hb: rest oxyhemoglobin signal; Task-HHb: deoxyhemoglobin; fALFF: fractional amplitude of low frequency fluctuation (refering to the ratio of power spectrum of low-frequency (0.01–0.08 Hz) to that of the entire frequency range [47]); ReHo: regional homogeneity (refering to Kendall’s coefficient concordance of BOLD signals in neighboring voxels [48]); BEN: brain entropy; tBEN: temporal brain entropy.
Thus, the increase of complexity observed by the above-mentioned task-state studies may be as a result of a higher randomness rather than true complexity.
Based on a comprehensive consideration of physiological complexity and psychopathology, Yang et al. [49] proposed a revised theory of complexity, which can effectively explain the abnormally elevated complexity found in some studies. This theory suggests aging or neurophysiological disease may degrade mental function (Yang et al. [49] believe that individual mental function manifested in patterns of cognition, speech, behavior, and thought. For example, compared with normal people, the patterns of speech, behavior, and thought in AD patients show higher regularity, leading to a lower complexity of mental function in AD patients.) while reducing physiological complexity. The decrease of complexity can be manifested in two ways, one is toward regular pattern (reduced BOLD complexity due to the increased regularity), and the other is toward random pattern (reduced BOLD complexity due to the increased randomness). From this perspective, it is very likely that the abnormal high entropy values may actually reflect the decreased BOLD complexity toward random pattern. This theory, to some extent, can be tested through simulation. Sokunbi et al. [19] and Gu et al. [20] found that compared with healthy controls, patients with mental illness exhibited lower task-elicited brain activation but higher brain entropy. Based on these findings, we simulated brain activation for two groups (high activation signals simulated for healthy controls; low activation signals simulated for patients; the activation intensity of high activation group was set 10 times higher than that of low activation group) using neuRosim (NeuRosim is a R-based fMRI data simulator developed by Welvaert et al. [50] from Ghent University in Belgium. In addition, to simulate the brain activation under different tasks, it can also simulate system noises, temporal noises, low-frequency drifts, physiological noise, and task-related noise that exist in real task fMRI data.) and calculated the temporal multiscale entropy (MSE) value over a range of scales. As demonstrated in Figure 3d, when the scale factor was set to 1, the MSE (According to Yang et al. [26], the parameters of MSE were set as m = 1; r = 0.35; l = [1–5].) of the patient group was significantly higher than that of the control group, which was the same as reported in previous studies that the BOLD complexity was higher in patients. However, as the scale factor increased, the MSE of the control group gradually increased and became higher than that of the patient group. We also found a significant higher slope of entropy decay across time scales in the patient group than in the control group (Figure 3e). With the MSE measure, we could conclude that compared to high task-related activation group, the complexity of low task-related activation group showed a decreased complexity toward randomness. If previous research applied the MSE measure, it is likely that they may have found decreased complexity in brain activity of the patients. In a subsequent study, researchers found that different types of schizophrenia are associated with different patterns of BOLD complexity. Specifically, positive symptoms of schizophrenia were associated with a reduction in BOLD complexity toward regularity, while negative symptoms of schizophrenia were associated with a reduction in BOLD complexity toward randomness [26]. Then a third study adopting this method explored the altered complexity patterns among multiple groups; researchers found significant differences as well as overlaps of brain BOLD signal complexity between different psychotic disorder groups, suggesting the potential of categorizing psychosis based on such a complexity theory [11]. In sum, the theory proposed by Yang et al. [49] has well explained the abnormally high BOLD complexity and shown potentials for the future multiple group classification analysis. Yet, it has not been wildly applied in recent years due to the limitation of multiscale entropy algorithm, which will be introduced in Section 3.2.
In addition to the association between BOLD complexity and group traits, some researches explored the relation between BOLD complexity and other potential biomarkers. Song et al. [24] examined the relation between SampEn of BOLD signals and the fractional amplitude of low-frequency fluctuations (fALFF) in healthy adults and found no significant correlation in most brain regions, indicating that brain entropy and fALFF can provide independent information of brain activity. Wang et al. [31] investigated the relation between regional homogeneity (ReHo) and permutation entropy (PE) of BOLD signals in patients Alzheimer’s disease; they found no significant correlation in most areas except in disease-related regions, indicating that although brain entropy and ReHo are independent to each other, they are both able to provide effective information regarding the abnormality of the brain.
To sum up, brain BOLD signal complexity does have the potential to be an effective biomarker for different neurophysiological diseases. However, there also remain several challenges, which will be discussed in the next section.

3.2. Main Complexity Measures for Brain Blood-Oxygen Signals

As summarized in Table 1, for brain blood-oxygen signals, the most common complexity measures are approximate entropy (ApEn), sample entropy (SampEn), multiscale entropy (MSE), and permutation entropy (PE). ApEn originated from a theory that describes the regularity of a series of signals proposed by Pincus [51], which is closely linked to Kolmogorov entropy [52], a classical approach for determining the rate of information production. However, since ApEn lacks relative consistency and is heavily dependent on data length, Richman and Moorman [53] then developed sample entropy (SampEn) to reduce the biases of ApEn. Thus, SampEn can be considered as an improved algorithm based on ApEn. Multiscale sample entropy (MSE), another type of entropy described in this article, shares nearly the same core algorithm with SampEn. Compared with other entropy measures, MSE can provide information about complexity over a range of scales. For MSE, the scale factor determines the coarse-graining (coarse-graining means averaging a successive number of data points, as the scale factor increases, the number of consecutive data points increases, making the signals coarser on time scales.) level of signals. Over a range of scale factors, the profile of MSE has a consistent pattern with the relationship between regularity and randomness (as illustrated in Figure 4a, as scale factor increases, the BOLD MSEs of healthy controls gradually increase and eventually became higher than those of complete random or ordered signals), which can differentiate distinct signals. In addition, by comparing the profiles of MSE between target group (TG) and healthy controls (HC), changes in patterns of complexity (i.e., increased complexity; decreased complexity toward regularity or randomness (statistically, the criterion to determine the increased complexity (or decreased complexity toward regularity) of the target group is that, compared to healthy controls, the target group shows significant higher (or lower) MSE or mean MSE in all scale factors. The criterion to determine the decreased complexity toward randomness is that, compared to healthy controls, the target group shows significantly higher MSE in fine scale or significant lower MSE in coarse scale, and also shows a significant lower slope of entropy decay) of the target group could then be obtained. Compared to single-scale entropy measures, MSE can provide more information of brain complexity. However, from Table 1 we can find MSE was less often applied in previous studies. This is because in practical applications, an important limitation of MSE statistic is its requirements of sufficient sampling time points, which is undoubtedly challenging to fMRI data of low temporal resolution. For example, Yang et al. [26] performed an MSE analysis with a scale of 1–5 and 195 time points; such a length of time points was usually difficult to obtain for many fMRI studies due to the limitation of the temporal sampling rate of MRI. However, with an increasing application of fNIRS to obtain blood-oxygen signals of high temporal resolution, MSE may become a promising complexity analytical tool in future studies. As for permutation entropy (PE), in algorithm, it is close to classical Shannon entropy [31]. In practice, it is close to Lyapunov exponents and is particularly suitable for observational and dynamical noise [54]. Because of the essential differences between PE and three other types of entropy, direct comparison cannot be conducted. However, it is clear that as a type of single-scale entropy, the ability of PE to describe signal complexity is inferior to MSE. To sum up, the MSE with multiple scale factors is the best approximation of brain complexity, thus it should be preferred if the data is of enough sampling time points.

3.3. Optimizing Parameters for Complexity Measures

As summarized in Table 1, in practice, there are three common ways to optimize parameters for complexity measures. The first and most common approach is the empirical approach. Based on previous work and data length, the empirical value for parameters could be roughly selected and the recommended range of parameters listed in Table 2 are determined by this method. The second approach is ‘maximizing between-group difference’ approach, that is, to find a combination of parameters that maximize the differences of BOLD complexity between two distinct groups [16,24]. However, as one study pointed out, being able to show greater differences between groups does not guarantee that those parameters are less free from error or bias [25]. The third approach is to minimize the relative error of the entropy of BOLD signal in cerebrospinal fluids (CSFs), which contained minimal physiologic information but uncorrelated noise [32]. However, this approach can only be applied to whole brain BOLD data where signals from a large amount of cerebrospinal fluids are obtained. At present, the empirical approach has been used most frequently in studies because compared with the other two approaches, it was less complicated. From a scientific point of view, however, when analyzing whole brain BOLD signals, the approach of minimizing relative error in CSFs should be preferentially used to determine the optimal parameters for complexity measures.

4. Future Directions

4.1. Improving Brain Blood-Oxygen Signal Complexity Measurement

A set of precise and reliable analytical tools and methods are very important for a field of research. However, at present, studies aiming to improve methodology in complexity measurement are still lacking. Therefore, it is important to develop analytical techniques and research methodology for brain blood-oxygen signal complexity. Based on the above analysis, this paper presents the following suggestions.
First, it is critical to develop a novel analytical method that is suitable for brain complexity. Current complexity algorithms are mostly univariate based; when calculating brain complexity in a certain location, the influences from adjacent locations have not been duly considered. The current way does not take full advantage of the high spatial resolution of the BOLD signals. Besides, some analytical methods that consider BOLD signals in adjacent location have been successfully applied, such as regional homogeneity (ReHo) and multi-voxel pattern analysis (MVPA), which is an analytical approach based on spatial pattern formed by multiple voxels, and has recently been widely used because it can overcome the limitation of low signal-to-noise ratio and stringent multiple testing corrections brought by conventional voxel-wise analysis to some extent [57]. Therefore, a new complexity analytical method that consider multi-voxel blood-oxygen signal patterns is promising.
Second, the latent variable analysis can be used to describe complexity. On one hand, in previous studies, brain entropy values were often seen as direct representations of brain complexity. However, as mentioned in Section 2, the complexity of BOLD signals is more like a latent trait that cannot be directly measured through certain algorithms. Thus, it is more appropriate to take brain BOLD complexity as a latent variable and the entropy value calculated from various algorithms as corresponding manifest variables. On the other hand, to examine the intricate relation between the brain and individual differences, more flexible analytical methods are required, and the psychometric quality should be carefully assessed in the interpretation of brain-traits relationship. With latent variable analytics, researchers are allowed to incorporate known sources of between-subject variance (e.g., demographic characteristics, distinct metrics of latent traits, measured behavioral data, and brain complexity) into simple [58], theoretically-specified models, ultimately forming a comprehensive understanding of the relation between BOLD complexity and individual traits.

4.2. Accurate Trait Classification Methods

One of the core objectives of complexity studies is to distinguish patient groups with different traits based on the patterns of brain complexity. So far, only a limited number of studies have addressed the issue of prediction and classification. A recent study used SampEns of brain as features, to build a machine-learning classifier to differentiate patients with ASD from typical children [40]. This study represents a future development trend applying machine-learning techniques to classify complexity patterns of brain blood-oxygen signals from different patient populations. Moreover, because the human brain is a highly complex system, no single metric can provide comprehensive information of the brain. Also, previous studies have shown that brain entropy provides unique information that has little overlap with other potential biomarkers (e.g., ReHo, fALFF) [31,38]. Therefore, in future research, various metrics such as brain complexity, ReHo, and fALFF could be combined to generate a multidimensional feature and make the classification more reliable and precise.

4.3. The Dynamics of Blood Oxygen Signals Complexity

As mentioned above, the whole-brain distribution patterns of BOLD complexity in rest and task states are different. However, how the distribution patterns change dynamically between these two states remains unexplored. Future studies may build upon analytics of dynamical functional connectivity [59] to investigate the dynamics of BOLD complexity. In order to give a better description of the dynamic process, the blood-oxygen signal data should have sufficient time points. Therefore, the blood-oxygen signals of high temporal resolution, such as signals obtained by fNIRs, could be an ideal choice.

5. Conclusions

For various neurophysiological diseases, a reliable and subjective biomarker is of great importance. Blood-oxygen signal complexity has the potential to become an ideal biomarker. However, as there are some misuses of complexity analysis in previous studies, blood-oxygen signals complexity measurements still need a set of standardized guidelines for the optimal selection of complexity algorithms as well as corresponding parameters. With future improvements in the approaches to complexity calculations, we believe such an issue can be solved and a comprehensive understanding of the relation between brain blood-oxygen signal complexity and related neurophysiological traits can be gained.

Author Contributions

Conceptualization, X.X. and X.G.; methodology, X.X. and X.G.; data curation, X.X. and S.L.; writing—original draft preparation, X.X. and S.L.; writing—review and editing, S.L., M.S. and X.G.; supervision, X.G.; funding acquisition, X.G. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Fundamental Research Funds for the Central Universities of China with Project Code: 2019QN81013, Zhejiang University Global Partnership Fund (188170-11103), and a Zhejiang University Startup Fund to X.G.

Data Availability Statement

The R code for task-activated BOLD signals simulation and the Matlab code for further complexity analysis are available upon request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Bassett, D.S.; Gazzaniga, M.S. Understanding complexity in the human brain. Trends Cogn. Sci. 2011, 15, 200–209. [Google Scholar] [CrossRef] [Green Version]
  2. Freud, S. Introductory Lectures on Psychoanalysis; WW Norton & Company: New York, NY, USA, 1977. [Google Scholar]
  3. Paulus, M.P.; Geyer, M.A.; Braff, D.L. Use of methods from chaos theory to quantify a fundamental dysfunction in the behavioral organization of schizophrenic patients. Am. J. Psychiatry 1996, 153, 714–717. [Google Scholar] [PubMed] [Green Version]
  4. Hausdorff, J.M.; Mitchell, S.L.; Firtion, R.; Peng, C.K.; Cudkowicz, M.E.; Wei, J.Y.; Goldberger, A.L. Altered fractal dynamics of gait: Reduced stride-interval correlations with aging and Huntington’s disease. J. Appl. Physiol. 1997, 82, 262–269. [Google Scholar] [CrossRef] [PubMed]
  5. Lipsitz, L.A.; Goldberger, A.L. Loss of ‘complexity’ and aging: Potential applications of fractals and chaos theory to senescence. JAMA 1992, 267, 1806–1809. [Google Scholar] [CrossRef] [PubMed]
  6. Goldberger, A.L.; Peng, C.K.; Lipsitz, L.A. What is physiologic complexity and how does it change with aging and disease? Neurobiol. Aging 2002, 23, 23–26. [Google Scholar] [CrossRef]
  7. Simon, H.A. The architecture of complexity. In Facets of Systems Science; Springer: Boston, MA, USA, 1991; pp. 457–476. [Google Scholar]
  8. Singer, W. The Brain, a Complex Self-organizing System. Eur. Rev. 2009, 17, 321–329. [Google Scholar] [CrossRef] [Green Version]
  9. Başar, E. Oscillations in “brain-body-mind”—A holistic view including the autonomous system. Brain Res. 2008, 1235, 2–11. [Google Scholar] [CrossRef]
  10. Sporns, O. Neural Complexity. In Networks of the Brain; MIT Press: Cambridge, MA, USA, 2011; pp. 277–304. [Google Scholar]
  11. Hager, B.; Yang, A.C.; Brady, R.; Meda, S.; Clementz, B.; Pearlson, G.D.; Sweeney, J.A.; Tamminga, C.; Keshavan, M. Neural complexity as a potential translational biomarker for psychosis. J. Affect. Disord. 2017, 216, 89–99. [Google Scholar] [CrossRef]
  12. Goldberger, A.L. Non-linear dynamics for clinicians: Chaos theory, fractals, and complexity at the bedside. Lancet 1996, 347, 1312–1314. [Google Scholar] [CrossRef]
  13. Goldberger, A.L. Fractal variability versus pathologic periodicity: Complexity loss and stereotypy in disease. Perspect. Biol. Med. 1997, 40, 543–561. [Google Scholar] [CrossRef]
  14. Goldberger, A.L.; Amaral, L.A.; Hausdorff, J.M.; Ivanov, P.C.; Peng, C.K.; Stanley, H.E. Fractal dynamics in physiology: Alterations with disease and aging. Proc. Natl. Acad. Sci. USA 2002, 99, 2466–2472. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Sokunbi, M.O.; Fung, W.; Sawlani, V.; Choppin, S.; Linden, D.E.J.; Thome, J. Resting state fMRI entropy probes complexity of brain activity in adults with ADHD. Psychiatry Res. 2013, 214, 341–348. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Sokunbi, M.O. Sample entropy reveals high discriminative power between young and elderly adults in short fMRI data sets. Front. Neuroinform. 2014, 8, 69. [Google Scholar] [CrossRef]
  17. Yang, A.C.; Huang, C.-C.; Yeh, H.-L.; Liu, M.-E.; Hong, C.-J.; Tu, P.-C.; Chen, J.-F.; Huang, N.E.; Peng, C.-K.; Lin, C.-P.; et al. Complexity of spontaneous BOLD activity in default mode network is correlated with cognitive function in normal male elderly: A multiscale entropy analysis. Neurobiol. Aging 2013, 34, 428–438. [Google Scholar] [CrossRef]
  18. Liu, C.Y.; Krishnan, A.P.; Yan, L.; Smith, R.X.; Kilroy, E.; Alger, J.R.; Ringman, J.M.; Wang, D.J.J. Complexity and synchronicity of resting state blood oxygenation level-dependent (BOLD) functional MRI in normal aging and cognitive decline. J. Magn. Reson. Imaging 2013, 38, 36–45. [Google Scholar] [CrossRef] [Green Version]
  19. Sokunbi, M.O.; Gradin, V.B.; Waiter, G.D.; Cameron, G.G.; Ahearn, T.S.; Murray, A.D.; Steele, D.J.; Staff, R.T. Nonlinear complexity analysis of brain FMRI signals in schizophrenia. PLoS ONE 2014, 9, e95146. [Google Scholar] [CrossRef] [Green Version]
  20. Gu, Y.; Miao, S.; Han, J.; Zeng, K.; Ouyang, G.; Yang, J.; Li, X. Complexity analysis of fNIRS signals in ADHD children during working memory task. Sci. Rep. 2017, 7, 829. [Google Scholar] [CrossRef] [Green Version]
  21. Shan, Z.Y.; Finegan, K.; Bhuta, S.; Ireland, T.; Staines, D.R.; Marshall-Gradisnik, S.M.; Barnden, L.R. Decreased Connectivity and Increased Blood Oxygenation Level Dependent Complexity in the Default Mode Network in Individuals with Chronic Fatigue Syndrome. Brain Connect. 2018, 8, 33–39. [Google Scholar] [CrossRef] [PubMed]
  22. Sokunbi, M.O.; Staff, R.T.; Waiter, G.D.; Ahearn, T.S.; Fox, H.C.; Deary, I.J.; Starr, J.M.; Whalley, L.J.; Murray, A.D. Inter-individual differences in fMRI entropy measurements in old age. IEEE Trans. Biomed. Eng. 2011, 58, 3206–3214. [Google Scholar] [CrossRef]
  23. Smith, R.X.; Yan, L.; Wang, D.J.J. Multiple time scale complexity analysis of resting state FMRI. Brain Imaging Behav. 2014, 8, 284–291. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Wang, Z.; Li, Y.; Childress, A.R.; Detre, J.A. Brain entropy mapping using fMRI. PLoS ONE 2014, 9, e89948. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. McDonough, I.M.; Nashiro, K. Network complexity as a measure of information processing across resting-state networks: Evidence from the Human Connectome Project. Front. Hum. Neurosci. 2014, 8, 409. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Yang, A.C.; Hong, C.-J.; Liou, Y.-J.; Huang, K.-L.; Huang, C.-C.; Liu, M.-E.; Lo, M.-T.; Huang, N.E.; Peng, C.-K.; Lin, C.-P.; et al. Decreased resting-state brain activity complexity in schizophrenia characterized by both increased regularity and randomness. Hum. Brain Mapp. 2015, 36, 2174–2186. [Google Scholar] [CrossRef]
  27. Sokunbi, M.O.; Cameron, G.G.; Ahearn, T.S.; Murray, A.D.; Staff, R.T. Fuzzy approximate entropy analysis of resting state fMRI signal complexity across the adult life span. Med. Eng. Phys. 2015, 37, 1082–1090. [Google Scholar] [CrossRef]
  28. Zhou, F.; Huang, S.; Gao, L.; Zhuang, Y.; Ding, S.; Gong, H. Temporal regularity of intrinsic cerebral activity in patients with chronic primary insomnia: A brain entropy study using resting-state fMRI. Brain Behav. 2016, 6, e00529. [Google Scholar] [CrossRef]
  29. Zhou, F.; Zhuang, Y.; Gong, H.; Zhan, J.; Grossman, M.; Wang, Z. Resting State Brain Entropy Alterations in Relapsing Remitting Multiple Sclerosis. PLoS ONE 2016, 11, e0146080. [Google Scholar] [CrossRef]
  30. Wang, N.; Wu, H.; Xu, M.; Yang, Y.; Chang, C.; Zeng, W.; Yan, H. Occupational functional plasticity revealed by brain entropy: A resting-state fMRI study of seafarers. Hum. Brain Mapp. 2018, 39, 2997–3004. [Google Scholar] [CrossRef] [Green Version]
  31. Wang, B.; Niu, Y.; Miao, L.; Cao, R.; Yan, P.; Guo, H.; Li, D.; Guo, Y.; Yan, T.; Wu, J.; et al. Decreased Complexity in Alzheimer’s Disease: Resting-State fMRI Evidence of Brain Entropy Mapping. Front. Aging Neurosci. 2017, 9, 378. [Google Scholar] [CrossRef] [Green Version]
  32. Yang, A.C.; Tsai, S.-J.; Lin, C.-P.; Peng, C.-K. A Strategy to Reduce Bias of Entropy Estimates in Resting-State fMRI Signals. Front. Neurosci. 2018, 12, 398. [Google Scholar] [CrossRef] [PubMed]
  33. Shan, Z.Y.; Finegan, K.; Bhuta, S.; Ireland, T.; Staines, D.R.; Marshall-Gradisnik, S.M.; Barnden, L.R. Brain function characteristics of chronic fatigue syndrome: A task fMRI study. Neuroimage Clin. 2018, 19, 279–286. [Google Scholar] [CrossRef] [PubMed]
  34. Saxe, G.N.; Calderone, D.; Morales, L.J. Brain entropy and human intelligence: A resting-state fMRI study. PLoS ONE 2018, 13, e0191582. [Google Scholar] [CrossRef]
  35. Niu, Y.; Wang, B.; Zhou, M.; Xue, J.; Shapour, H.; Cao, R.; Cui, X.; Wu, J.; Xiang, J. Dynamic Complexity of Spontaneous BOLD Activity in Alzheimer’s Disease and Mild Cognitive Impairment Using Multiscale Entropy Analysis. Front. Neurosci. 2018, 12, 677. [Google Scholar] [CrossRef]
  36. Li, X.; Zhu, Z.; Zhao, W.; Sun, Y.; Wen, D.; Xie, Y.; Liu, X.; Niu, H.; Han, Y. Decreased resting-state brain signal complexity in patients with mild cognitive impairment and Alzheimer’s disease: A multiscale entropy analysis. Biomed. Opt. Express 2018, 9, 1916–1929. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Perpetuini, D.; Bucco, R.; Zito, M.; Merla, A. Study of memory deficit in Alzheimer’s disease by means of complexity analysis of fNIRS signal. Neurophotonics 2018, 5, 011010. [Google Scholar] [CrossRef] [PubMed]
  38. Song, D.; Chang, D.; Zhang, J.; Ge, Q.; Zang, Y.-F.; Wang, Z. Associations of brain entropy (BEN) to cerebral blood flow and fractional amplitude of low-frequency fluctuations in the resting brain. Brain Imaging Behav. 2019, 13, 1486–1495. [Google Scholar] [CrossRef] [PubMed]
  39. Easson, A.K.; McIntosh, A.R. BOLD signal variability and complexity in children and adolescents with and without autism spectrum disorder. Dev. Cogn. Neurosci. 2019, 36, 100630. [Google Scholar] [CrossRef] [PubMed]
  40. Xue, S.-W.; Yu, Q.; Guo, Y.; Song, D.; Wang, Z. Resting-state brain entropy in schizophrenia. Compr. Psychiatry 2019, 89, 16–21. [Google Scholar] [CrossRef]
  41. Perpetuini, D.; Chiarelli, A.M.; Cardone, D.; Filippini, C.; Bucco, R.; Zito, M.; Merla, A. Complexity of Frontal Cortex fNIRS Can Support Alzheimer Disease Diagnosis in Memory and Visuo-Spatial Tests. Entropy 2019, 21, 26. [Google Scholar] [CrossRef] [Green Version]
  42. Liang, L.; Hu, R.; Luo, X.; Feng, B.; Long, W.; Song, R. Reduced Complexity in Stroke with Motor Deficits: A Resting-State fMRI Study. Neuroscience 2020, 434, 35–43. [Google Scholar] [CrossRef]
  43. Zheng, H.; Onoda, K.; Nagai, A.; Yamaguchi, S. Reduced Dynamic Complexity of BOLD Signals Differentiates Mild Cognitive Impairment from Normal Aging. Front. Aging Neurosci. 2020, 12, 90. [Google Scholar] [CrossRef] [Green Version]
  44. Angsuwatanakul, T.; O’Reilly, J.; Ounjai, K.; Kaewkamnerdpong, B.; Iramina, K. Multiscale Entropy as a New Feature for EEG and fNIRS Analysis. Entropy 2020, 22, 189. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  45. Xu, L.; Hua, Q.; Yu, J.; Li, J. Classification of autism spectrum disorder based on sample entropy of spontaneous functional near infra-red spectroscopy signal. Clin. Neurophysiol. 2020, 131, 1365–1374. [Google Scholar] [CrossRef]
  46. Lin, C.; Lee, S.-H.; Huang, C.-M.; Chen, G.-Y.; Ho, P.-S.; Liu, H.-L.; Chen, Y.-L.; Lee, T.M.-C.; Wu, S.-C. Increased brain entropy of resting-state fMRI mediates the relationship between depression severity and mental health-related quality of life in late-life depressed elderly. J. Affect. Disord. 2019, 250, 270–277. [Google Scholar] [CrossRef] [PubMed]
  47. Zou, Q.-H.; Zhu, C.-Z.; Yang, Y.; Zuo, X.-N.; Long, X.-Y.; Cao, Q.-J.; Wang, Y.-F.; Zang, Y.-F. An improved approach to detection of amplitude of low-frequency fluctuation (ALFF) for resting-state fMRI: Fractional ALFF. J. Neurosci. Methods 2008, 172, 137–141. [Google Scholar] [CrossRef] [Green Version]
  48. Zang, Y.F.; Jiang, T.Z.; Lu, Y.L.; He, Y.; Tian, L.X. Regional homogeneity approach to fMRI data analysis. NeuroImage 2004, 22, 394–400. [Google Scholar] [CrossRef]
  49. Yang, A.C.; Tsai, S.-J. Is mental illness complex? From behavior to brain. Prog. Neuropsychopharmacol. Biol. Psychiatry 2013, 45, 253–257. [Google Scholar] [CrossRef]
  50. Welvaert, M.; Durnez, J.; Moerkerke, B.; Verdoolaege, G.; Rosseel, Y. neuRosim: An R package for generating fMRI data. J. Stat. Softw. 2011, 44, 1–18. [Google Scholar] [CrossRef] [Green Version]
  51. Pincus, S.M. Approximate entropy as a measure of system complexity. Proc. Natl. Acad. Sci. USA 1991, 88, 2297–2301. [Google Scholar] [CrossRef] [Green Version]
  52. Delgado-Bonal, A.; Marshak, A. Approximate Entropy and Sample Entropy: A Comprehensive Tutorial. Entropy 2019, 21, 541. [Google Scholar] [CrossRef] [Green Version]
  53. Richman, J.S.; Moorman, J.R. Physiological time-series analysis using approximate entropy and sample entropy. Am. J. Physiol. Heart Circ. Physiol. 2000, 278, H2039–H2049. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  54. Zanin, M.; Zunino, L.; Rosso, O.A.; Papo, D. Permutation entropy and its main biomedical and econophysics applications: A review. Entropy 2012, 14, 1553–1577. [Google Scholar] [CrossRef]
  55. Costa, M.; Goldberger, A.L.; Peng, C.-K. Multiscale entropy analysis of complex physiologic time series. Phys. Rev. Lett. 2002, 89, 068102. [Google Scholar] [CrossRef] [Green Version]
  56. Bandt, C.; Pompe, B. Permutation entropy: A natural complexity measure for time series. Phys. Rev. Lett. 2002, 88, 174102. [Google Scholar] [CrossRef] [PubMed]
  57. Lei, W.; Yang, Z.; Zhan, M.Y.; Li, H.; Weng, X.C. Decoding the Representation of Cognition: The principles and applications of MVPA. Adv. Psychol. Sci. 2010, 18, 1934–1941. [Google Scholar]
  58. Cooper, S.R.; Jackson, J.J.; Barch, D.M.; Braver, T.S. Neuroimaging of individual differences: A latent variable modeling perspective. Neurosci. Biobehav. Rev. 2019, 98, 29–46. [Google Scholar] [CrossRef]
  59. Hutchison, R.M.; Womelsdorf, T.; Allen, E.A.; Bandettini, P.A.; Calhoun, V.D.; Corbetta, M.; Della Penna, S.; Duyn, J.H.; Glover, G.H.; Gonzalez-Castillo, J.; et al. Dynamic functional connectivity: Promise, issues, and interpretations. Neuroimage 2013, 80, 360–378. [Google Scholar] [CrossRef] [Green Version]
Figure 1. The relationship between randomness and complexity. Reprinted with permission from ref. [10]. Copyright 2015 John Wiley and Sons.
Figure 1. The relationship between randomness and complexity. Reprinted with permission from ref. [10]. Copyright 2015 John Wiley and Sons.
Brainsci 11 01415 g001
Figure 2. The relation between level of randomness and conventional entropy measure (a) and expected complexity (b). Reprinted with permission from ref. [49]. Copyright 2021 Elsevier.
Figure 2. The relation between level of randomness and conventional entropy measure (a) and expected complexity (b). Reprinted with permission from ref. [49]. Copyright 2021 Elsevier.
Brainsci 11 01415 g002
Figure 3. Simulated task-activated BOLD signals and multiscale entropy measures. (a) flow chart of stimulation task; (b) stimulated low activation signals; (c) simulated high activation signals; (d) entropy of the simulated signals over a range of scale factors; (e) the slopes of entropy measures against scale factors.
Figure 3. Simulated task-activated BOLD signals and multiscale entropy measures. (a) flow chart of stimulation task; (b) stimulated low activation signals; (c) simulated high activation signals; (d) entropy of the simulated signals over a range of scale factors; (e) the slopes of entropy measures against scale factors.
Brainsci 11 01415 g003
Figure 4. Schematic illustration of quantifying complexity of resting-state fMRI signal using multiscale entropy: (a) differences of MSE patterns across scale factors among the signals of uncorrelated randomness, HC, and regularity; (b) increased complexity as entropy increased in TG compared to HC across all scale factors; (c) decreased complexity toward regularity as reduced entropy in TG compared to HC across all scale factors; (d) decreased complexity toward randomness as entropy increased in fine time scale in TG compared to HC, and the entropy decayed as the scale factor increased. Reprinted with permission from ref. [11,26]. Copyright 2021 Elsevier.
Figure 4. Schematic illustration of quantifying complexity of resting-state fMRI signal using multiscale entropy: (a) differences of MSE patterns across scale factors among the signals of uncorrelated randomness, HC, and regularity; (b) increased complexity as entropy increased in TG compared to HC across all scale factors; (c) decreased complexity toward regularity as reduced entropy in TG compared to HC across all scale factors; (d) decreased complexity toward randomness as entropy increased in fine time scale in TG compared to HC, and the entropy decayed as the scale factor increased. Reprinted with permission from ref. [11,26]. Copyright 2021 Elsevier.
Brainsci 11 01415 g004
Table 2. Main entropy algorithms applied in the analysis of BOLD complexity.
Table 2. Main entropy algorithms applied in the analysis of BOLD complexity.
CategoryRefParametersRecommended Range
ApEn[51]m, pattern length;
r, tolerance value
10 m < N < 20 m
0.1 S D < r < 0.6 S D
SampEn[53]m, pattern length;
r, tolerance value
0.1 S D < r < 0.6 S D
MSE[55]m, pattern length;
r, tolerance value;
l, scale factor
l 10 m < N < l 20 m
0.1 S D < r < 0.6 S D
PE[56]m, pattern length ( m + 1 ) ! < N
Note: m is a positive integer; N specifies the data length and is a positive integer; l is a positive integer larger than 1; SD is the standard deviation of signals.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Xin, X.; Long, S.; Sun, M.; Gao, X. The Application of Complexity Analysis in Brain Blood-Oxygen Signal. Brain Sci. 2021, 11, 1415. https://doi.org/10.3390/brainsci11111415

AMA Style

Xin X, Long S, Sun M, Gao X. The Application of Complexity Analysis in Brain Blood-Oxygen Signal. Brain Sciences. 2021; 11(11):1415. https://doi.org/10.3390/brainsci11111415

Chicago/Turabian Style

Xin, Xiaoyang, Shuyang Long, Mengdan Sun, and Xiaoqing Gao. 2021. "The Application of Complexity Analysis in Brain Blood-Oxygen Signal" Brain Sciences 11, no. 11: 1415. https://doi.org/10.3390/brainsci11111415

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop