Next Article in Journal
Biological Scaffolds for Congenital Heart Disease
Next Article in Special Issue
Machine Learning for Biomedical Applications
Previous Article in Journal
Special Issue “Recent Advances in Biomaterials and Dental Disease” Part I
Previous Article in Special Issue
Artificial Intelligence for Detecting and Quantifying Fatty Liver in Ultrasound Images: A Systematic Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Understanding the Role of Connectivity Dynamics of Resting-State Functional MRI in the Diagnosis of Autism Spectrum Disorder: A Comprehensive Study

1
Bioengineering Department, University of Louisville, Louisville, KY 40292, USA
2
Department of Neurology, Pediatric Research Institute, University of Louisville, Louisville, KY 40202, USA
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Bioengineering 2023, 10(1), 56; https://doi.org/10.3390/bioengineering10010056
Submission received: 10 November 2022 / Revised: 22 December 2022 / Accepted: 27 December 2022 / Published: 2 January 2023
(This article belongs to the Special Issue Machine Learning for Biomedical Applications)

Abstract

:
In addition to the standard observational assessment for autism spectrum disorder (ASD), recent advancements in neuroimaging and machine learning (ML) suggest a rapid and objective alternative using brain imaging. This work presents a pipelined framework, using functional magnetic resonance imaging (fMRI) that allows not only an accurate ASD diagnosis but also the identification of the brain regions contributing to the diagnosis decision. The proposed framework includes several processing stages: preprocessing, brain parcellation, feature representation, feature selection, and ML classification. For feature representation, the proposed framework uses both a conventional feature representation and a novel dynamic connectivity representation to assist in the accurate classification of an autistic individual. Based on a large publicly available dataset, this extensive research highlights different decisions along the proposed pipeline and their impact on diagnostic accuracy. A large publicly available dataset of 884 subjects from the Autism Brain Imaging Data Exchange I (ABIDE-I) initiative is used to validate our proposed framework, achieving a global balanced accuracy of 98.8% with five-fold cross-validation and proving the potential of the proposed feature representation. As a result of this comprehensive study, we achieve state-of-the-art accuracy, confirming the benefits of the proposed feature representation and feature engineering in extracting useful information as well as the potential benefits of utilizing ML and neuroimaging in the diagnosis and understanding of autism.
Keywords:
MRI; rs-fMRI; CAD; ML; autism; ASD

1. Introduction

Autism spectrum disorder (ASD) is a neurodevelopmental disorder characterized by three primary characteristics: functioning difficulties with social interaction, communication barriers, and behavioral restrictions and repetitive patterns [1,2,3,4]. Despite the lack of a comprehensive understanding of ASD causes, numerous hypotheses and theories have been proposed concerning the etiology of its underlying mechanism. These hypotheses and theories suggest that genes and environmental factors play a significant role in determining ASD severity. Anatomical abnormalities of the brain [5], functioning of the brain during rest or while performing different tasks [6], or abnormal connectivity of the white matter [7,8] are hypothesized to be responsible for ASD symptoms. Several magnetic resonance imaging (MRI)-based imaging methods have been utilized to study a variety of abnormalities correlated with ASD, including: (i) structural magnetic resonance imaging (sMRI) for anatomical anomalies; (ii) functional magnetic resonance imaging (fMRI), either at rest or while performing a task, for abnormalities in brain activity; (iii) diffusion tensor imaging (DTI) for abnormalities in connectivity. In this study, we utilize fMRI to provide an understanding of assessing autism.
There are two major types of experiments used to analyze the fMRI modality in order to study functional activation anomalies in the brain: (i) resting state fMRI (rs-fMRI) and (ii) task-based fMRI [9]. In task-based functional MRI, the subject performs a particular task, such as: (1) figures [10], (2) facial expressions [11], (3) rewards [12], or (4) other specific tasks, and then, the brain activity is analyzed. In rs-fMRI, brain activity is captured, in terms of blood-oxygen-level-dependent (BOLD) signals, while the subject is at rest. Since connectivity patterns reveal the resting state, they have proven to be beneficial in diagnosing mental disorders, such as schizophrenia [13] and Alzheimer’s disease [14]. For instance, a high degree of accuracy was achieved in diagnosing schizophrenia using deep neural networks [13]. In addition, another deep-learning approach used rs-fMRI and ResNet to achieve an effective multi-class classification of Alzheimer’s disease [14]. There is evidence that the functional connectivity between major networks, as well as the functional connectivity within individual networks, is altered in ASD, as demonstrated by numerous studies [15,16]. Based on a multivariate autoregressive model, an algorithm based on a machine learning algorithm for analyzing functional connectivity in ASD subjects was used in a previous study [17]. In this study, it was found that people with ASDs have reduced functional connectivity, which supports the hypothesis that autism is characterized by a deficit in functional connectivity, or ’underconnectivity’. In accordance with the underconnectivity theory [18], cognitive disorders manifest themselves in reduced synchronized brain activity during integrative processing tasks, such as the synthesis of a sentence from a set of words. There is evidence in previous literature [17,19] for the hypothesis of underconnectivity. Similarly, there was lower functional connectivity in the superior parietal and visuospatial regions of ASD when compared to TD [10]. In another study by Tyszka et al. [20], there was reduced connectivity between the temporal and frontal cortex, but no global abnormalities were found. In a study by Plitt et al. [21], abnormalities were reported in functional networks, which were more evident in networks related to social information processing.
Nevertheless, brain networks associated with ASDs exhibit both under-connectivity and over-connectivity [21,22]. Unlike previous studies, ASD has not only reported results that indicated brain underconnectivity but also increased brain connectivity in some areas when compared to healthy controls [22]. In the latter study, functional connectivity patterns were analyzed, specifically interhemispheric connectivity analysis, and it was found that ASD subjects had both under- and over-connectivity. Furthermore, the presence of altered connectivity was verified in Di Martino et al. work [23]. The subjects with ASD displayed both under- and over-connectivity between different brain regions. Furthermore, a study by Supekar et al. [24] identified hyperconnectivity in severely socially challenged autistic children.
Providing the appropriate reduction technique is another major component of our proposed work. Bellman [25] introduced the term ‘curse of dimensionality’ to describe the problem of exponential complexity resulting from the addition of new dimensions to feature space, commonly defined as the p > > n problem. MRI imaging research and medical data are commonly affected by this phenomenon, resulting in over-fitting. There are several ways to reduce the number of features, such as principal component analysis, linear discriminant analysis, or autoencoders [26,27,28]. Due to the fact that these methods do not preserve the semantics of the original feature space, it is typically difficult to identify what clinical findings underlie such classification results. This, in turn, makes them less useful for actual use by physicians to provide them with more information or to better understand the pathological abnormalities underlying each autistic brain and, thus, are less attractive and less practical.
Due to autism’s heterogeneous nature, brain connectivity can vary widely among individuals with the disorder, making classification of the condition difficult. The design of a less-sensitive functional connectivity feature that is less affected by age, sex, and designs of the resting-state scan and studying its correlation with autism is a hot research area [29], emerging into two popular brain connectivity representations: the conventional, more popular, static functional connectivity (FC), and the newer dynamic functional connectivity (dFC) representations. Those functional connectivity metrics are believed to capture different internal states of the brain while at rest [30]. The static FC is a matrix obtained by calculating the Pearson cross-correlation coefficient of the BOLD signals across pairs of pre-defined brain areas. Following statistical analysis and depending on whether one examines local or global networks, there is evidence of both under- and over-connectivity in autism in the majority of the literature [29]. As most of the literature implies temporally stationary functional networks in resting state, dynamic or time-varying changes to functional connectivity that occur during brain scanning are not sufficiently considered by static FC. Newer studies suggest periodically changing spatial patterns of functional networks. To capture those dynamic connectivity patterns, multiple computational strategies were used to find dFC that consider such temporal fluctuations of functional connectivity [31]. dFC analyses allow identifying not only common brain states but also transitions between them. The most commonly used approach for dFC computation is sliding window techniques [32], while other approaches include clustering methods, dynamic connectivity regression, time–frequency analysis, wavelet transforms [33], dynamic connectivity detection, and time series models [31,34].
The main limitation of the previous works is that each only gives a limited perspective on the bolts of an efficient CAD system. As the characteristics of autism vary from individual to individual in terms of symptoms and severity, a more personalized approach to predicting and analyzing the behavior and functional capabilities of each autistic subject has become increasingly necessary. Consequently, we can create a treatment plan that is tailored specifically to the needs of each autistic individual. This work uses both a static FC matrix, as well as a novel dFC approach, to investigate the role of rs-fMRI in the diagnosis of autism in a large cohort of 884 subjects, testing different processing and machine learning pipelines. It allows not only an accurate diagnosis but also the identification of the brain regions contributing to this decision. More importantly, it quantifies the effect of different choices along the neuroimaging machine learning pipeline on diagnostic accuracy, including the use of dynamic over static connectivity, which is important for future research. This work presents a unified framework that addresses the following:
  • The impact of using different atlases, including the automated anatomical labeling (AAL) and Talaraich and Tournoux (TT) atlases.
  • The effect of using different preprocessing strategies.
  • The effect of using our novel dFC, in comparison to using conventional static FC.
  • The dimensionality reduction problem, using two-stage feature selection, with four types of kernels.
  • The role of the classification strategy, investigating six different classifiers.
  • The ability to highlight the importance of each of the previous choices on the overall performance.
The remainder of this paper is organized as follows: Section 2 describes the entire methodology of feature representation, preprocessing, and diagnostic classification. We present the various results on the ABIDE-I rs-fMRI in Section 3. Section 4 provides an overall discussion of the presented work. Finally, the conclusions are presented in Section 5.

2. Materials and Methods

2.1. Dataset

In this work, the Autism Brain Imaging Data Exchange I (ABIDE I) dataset is used [35], which is a publicly available repository collected from 17 different sites, with rs-fMRI, sMRI imaging modalities (http://fcon_1000.projects.nitrc.org/indi/abide/abide_I.html, accessed on 1 July 2022). The database includes 884 subjects with rs-fMRI data from the 17 sites of the dataset. All of the 884 rs-fMRI data, are used in our experiments. Table 1 provides the summary of the 884 subjects’ demographics: age in years, label, full-scale IQ, and gender. Supplementary Table S1 provides the full demographics of the subjects: subject IDs, along with age, label, IQ, and gender, while the scanning parameters of the functional MRI data for each of the 17 sites are available on the dataset website http://fcon_1000.projects.nitrc.org/indi/abide/abide_I.html, accessed on 1 July 2022. The parameters include the type of scanner, the scanning protocol, repetition time (TR), echo time (TE), flipping angle, and experiment duration for resting state fMRI.

2.2. Proposed Framework

Figure 1 illustrates the proposed framework, which starts with data preprocessing, brain parcellation to local areas, feature engineering, feature selection, and machine learning toward final diagnosis. Our proposed quantitative research model includes the identification of the effects of feature representation, prepossessing strategy, and atlas on diagnostic accuracy.

2.3. Preprocessing

Functional MRI data are preprocessed according to the standard configurable pipeline for the analysis of connectomes (C-PAC) [36]. Preprocessing pipeline includes performing slice timing correction, motion realignment, skull stripping, and intensity normalization in this order. Twenty-four motion parameters were used as regressors to overcome the subject’s motion-related confounding variables. Additionally, five more from white matter and CSF mean levels were regressed to eliminate their effects. Then, one of four different preprocessing strategies is applied for filtration and signal correction. The main differences between those strategies are whether global signal correction (inclusion of global mean signal in nuisance regression) is made and whether filtration (band-pass filtering after global signal correction) is performed. Those four strategies are denoted as: filt_global, filt_noglobal, nofilt_global, and filt_noglobal. Lastly, structural MRI data, after skull stripping, segmentation, normalization, and registration to the standard MNI-152 space, is used for registration of the corresponding fMRI volumes to the same space after those preprocessing steps. For each of the four strategies, we will have different outputs.
Different brain regions are identified on the registered data using a standard atlas parcellation. The use of a standard atlas is to localize the fMRI features (time-series BOLD signals) to different brain regions, as defined by each atlas. Two atlases are investigated in this work: automated anatomical labeling (AAL) atlas, defining 116 brain regions, and Talaraich and Tournoux (TT) atlas, defining 97 different regions using Brodmann area labeling. In this work, all brain regions defined by each of the two used brain atlases are analyzed. For each atlas, mean BOLD signals for each parcellated brain region are extracted.
After preprocessing, each subject is now represented by an average BOLD signal (time series, length varying by site based on total scanning time) for each brain region, and we have eight datasets, one for each (strategy/atlas). The next step is to convert it to a more meaningful representation that captures functional connectivity and is less dependent on the subjects’ differences.

2.4. Feature Representation

For the purpose of studying the coherence between different areas of the brain, two different feature representations were used to examine functional connectivity. First, the most famous and commonly used static FC matrix, where the correlation between the full duration of the activation courses is used as a measure of functional connectivity. The reason behind this selection is that it captures the intrinsic functional network of the brain.
The static functional connectivity matrix F C is constructed as the Pearson correlation coefficient ( ρ ) between each pair of the ( A = 116 | 97 ) areas in the atlas. The effective output feature size is ( A × ( A 1 ) ÷ 2 ) , because of symmetry, resulting in a total of 884 × 6670 for AAL, or  884 × 4656 for TT, feature matrices. Figure 2 illustrates the pipeline of this adopted feature representation.
The second feature representation introduced in this work is an enhanced version of dynamic functional connectivity, d F C , where temporal dynamics are considered in the correlation calculation. The calculation starts by multiplying a shorter Gaussian sliding window with width w with each time signal, to calculate pair correlation, with an overlapping step size s. Following previous literature [34], a Gaussian window of size w = 21 T R , σ = 3 T R , and a step size of s = 1 are used, where TR is the fMRI repetition time, typically 1500–2000 ms depending on the scanning site. Hence, for each pair of brain regions of length L, M correlations are calculated, where M = | | ( L w ) / s | | . Following the hypotheses of under-connectivity and over-connectivity differences between the functional activation of an autistic and typically developed brain, a quantification using both the percentage of strong correlations n s t and the percentage of weak/no correlation n w k are used to represent over- and under-connectivity between each brain area, where n s t = 1 M M 1 : i f ρ i j 0.8 , and  n w k = 1 M M 1 : i f ρ i j 0.25 . This creates two metrics for each pair of regions identifying the existence of under- and over-connectivities, yielding double size d F C feature matrices in comparison to the F C representation.  Figure 3 illustrates the pipeline of the second proposed feature representation in this study. At this step, we have 16 different inputs, one for each (strategy/atlas/feature representation) combination.

2.5. Feature Selection

Since the feature space for both representations is large, there is an urge for the employment of a feature reduction technique to address the curse of the dimensionality problem. Since the employed feature reduction shall preserve the semantics of original features, many famous techniques such as principal component analysis (PCA), factor analysis (FA), or linear discriminant analysis (LDA) may not be suitable, as it creates a newly transformed feature space that makes it hard to extrapolate the meaning of any following clinical classification, or underlying functional abnormalities of autistic individuals. Two cascaded feature selection stages are used to select the best subset of features: a simple univariate selector followed by a more sophisticated recursive feature elimination (RFE) with cross-validation (RFE-CV).
The univariate selector is a fast method that aims to initially reduce the feature space to make the second stage computationally efficient. It computes the ANOVA F-value score for each feature to select the top proportion accordingly. Following this, an RFE eliminates weak features until a specified number of features is reached by fitting a kernel classifier and removing the weakest features. By eliminating dependencies and collinearities, RFE attempts to achieve a better understanding of the model. Cross-validation aims to score the strength of features on the test subset, other than the training folds data used in training the kernel, to mitigate over-fitting. The step of the eliminated features, scoring metric, kernel type, and the number of folds are all parameters of choice. Here, a step size of 2 features (for faster elimination, yet small enough for a good performance), k = 5 folds (common 5-fold cross-validation), and balanced accuracy were chosen. Four different classifiers were tested as a feature selection kernel, namely linear support vector machine (lsvm), logistic regression (lr), random forest (rf), and light gradient boost machine (lgbm) [37,38], to investigate different feature-relationships. The two-stage feature selection is applied to each dataset/feature representation to find the best n features that provided the best cross-validated score. Next, the performance of the sixteen models was evaluated on a set of machine learning classifiers to select which model to use for further processing. The code for all of the previous steps, starting from data download, processing, and feature calculations, is publicly available on reference [39].

2.6. Machine Learning

In order to learn how to classify autistic brains, we set up a system of different machine learning classifiers from the set of n features selected for each of the 16 data representations. We evaluated six different classifier types and optimized their hyperparameters in order to establish the most accurate parameter classifier model. Those classifiers, including linear and non-linear ones, are: (i) lsvm; (ii) lr; (iii) rf; (iv) lgbm; (v) neural networks (nn); and (vi) radial-basis function SVM (svm). The different types would test different relations between the two feature classes, with the first two being linear estimators. The cross-validated random search is used for hyper-parameter optimization for each of the six classifiers, with k = 5 folds, optimizing for a balanced accuracy score on each test fold to obtain the best parameters on the hyper-search space. Accordingly, these steps are followed for each classifier, for each dataset using only the selected features: split data into k-folds, train four and test one each round, and record the performance of the classifier for each round on the test subset for each parameter configuration. The classifier with the best performance is selected, together with hyperparameters and its maximum average cross-validated score, as well as the standard deviation over folds. A detailed step-by-step guide to the full implementation of the algorithm is provided in Algorithm 1.
Algorithm1 Step-by-step rs-fMRI diagnosis algorithm
1:
rs-fMRI BOLD signal data:
2:
      1 . ∀ preprocessing strategies:
3:
           (i) with/without global signal correction.
4:
           (ii) with/without band-pass filtering.
5:
      2 . Use ∀ atlas ∈ {AAL, TT}, ∀ preprocessing strategy:
6:
           (i) AAL atlas with 116 brain regions
7:
           (ii) TT atlas with 97 brain regions
8:
      3 . Calculate the two feature representations for each atlas/strategy:
9:
            (i) Static functional connectivity matrix F C
10:
          (ii) Dynamic functional connectivity d F C
11:
               (I) Use a Gaussian smoothed sliding window over each pair of brain regions to calculate pair-wise dynamic correlations.
12:
               (II) ∀ pair of brain regions, calculate the fraction of no correlation as n w k , and the fraction of strong correlation as n s t .
13:
               (III) Use these aggregations for each region pair as the new dynamic functional connectivity feature to create the feature matrix d F C .
14:
Feature Selection:
15:
      For each feature representation, run a univariate selector to reduce feature space
16:
      For each of the four RFE-CV kernels, find the n features that provide the highest cross-validated balanced accuracy to be used for each of the kernels.
17:
Classification:
18:
      ∀ classifier, for each configuration of hyper-parameters, for each reduced feature representation:
19:
       (i) Split reduced X s e l e c t , with n selected features, into k folds, along with labels y.
20:
       (ii) Calculate the cross-validated score for each hyper-parameters’ configuration.
21:
      (iii) Determine the best hyper-parameters configuration in terms of score for each classifier.
22:
      (iv) Output the best classifier/parameters, along with its used n features.

2.7. Performance Metrics

To measure the performance of machine learning components, different metrics are used to evaluate autism diagnosis, especially when classes are imbalanced on the original dataset or on the output labels. Let TP indicate true positive, TN indicate true negative, FN denote false negative, and FP denote false positive. The following performance metrics are used in this work and defined as follows:
  • Specificity: T N F P + T N
  • Sensitivity (recall): T P T P + F N
  • Accuracy: T P + T N T P + T N + F P + F N
  • Balanced accuracy: average of true positive rate (sensitivity) and true negative rate (specificity).

3. Results

Running the explained experimental pipeline on a cluster of 16 high-performance computers, we were able to collect detailed results. Supplementary Material Table S2 provides 16 sub-tables of cross-validated test scores, one table for each feature_representation/atlas/strategy, with mean ± standard deviation across folds for each best hyper-parameters for each feature selection kernel (row) and machine learning classifier (column). Here, we highlight what was the best choice for each stage, in addition to the power of this choice, and the best accuracy achieved accordingly.

3.1. Significance of Data Representation

In order to test the significance of the configuration of choice, we logged all model scores for each of the five test stages, labeled as (1) feat: (two) FC or dFC, (2) atls: (two) TT or AAL, (3) preprocessing strategy: (four) filt_global, etc., (4) feature selection kernel of the RFE-CV: (four), and (5) machine learning classifier (six). Thus, the labeled table contains up to 1920 results. Three-factor ANOVA, with the calculation of the sum of squares (SS) for the factors, is used to test the effect of the three major factors pre-machine learning: (1) feature representation, (2) atlas, and (3) preprocessing. Full interactions are tested (Table 2), before removing non-significant interactions of p > 0.001 and rerunning the test (Table 3). The sum of squares that each factor accounted for did not change greatly due to the nature of the type III sum of squares. In the following part, the effect of each factor is discussed. It is important to note that all configurations (for feature selection, classifier, etc.) are considered here, not only high-performing ones, which would be seen as having lower mean accuracy. For each factor, we aim here to study the effect of it comparatively, not just quantify its performance, especially as the experiments are paired: less-performing configurations would appear in both groups.

3.1.1. Preprocessing Pipeline

The choice of the preprocessing strategy (whether to perform global signal correction, and whether to apply band-pass filtering) has a significant effect on the classification performance ( p 10 6 ). From Table 3, with F = 10 , we can see that the effect of this factor, although significant, is less important than the other factors. While the difference between the overall mean accuracy for (filt_noglobal, nofilt_global, nofilt_noglobal) is less than 0.2 % , the mean filt_global accuracy is higher than 2.5 % . See Supplementary Material Table S3 for the summarized results across strategy selection. Another important aspect when analyzing the full results listed in Supplementary Material Table S2 is that although the max performance is not accompanied by the filt_global strategy, the scores are slightly higher across other models of the strategy.

3.1.2. Atlas Use

In the second level of importance comes the used atlas in brain parcellation (TT or AAL), with F = 25.5 . The choice of the atlas also has a significant effect on the classification performance ( p 4 × 10 7 ) as we can see in the ANOVA tables. The mean average performance is 2 % higher in favor of the A A L atlas. This gives an important indication that the more granular the atlas is (116 areas in comparison to 97 areas), the more informative the features we have (the mean BOLD signal), which leads to better accuracy results. See Supplementary Material Table S3 for the summarized results across atlas use.

3.1.3. Dynamic Connectivity

As clearly seen in Table 2 and Table 3, the proposed new feature representation has the biggest effect on the target (accuracy score). This is demonstrated with a high f_value of F 160 and a highly significant probability of p 2 × 10 35 . On average, the dynamic functional connectivity representation we proposed scored an accuracy 5 % higher than the conventional functional connectivity. The results represent a key finding of the body of the presented comprehensive experiments in this work.

3.2. Model Results

In Supplementary Material Table S2, the file contains four tabs, each for an atlas/feature representation combination, in addition to a summary tab. We can see a trend in performance, with (dFC/AAL) being the best performing in general, then (dFC/TT), (FC/AAL), and (FC/TT) having the least scores. In terms of average scores, as shown in the Supplementary Table S2, lsvm kernel of the feature selection is the best performing, and rf is the worst. Both lsvm and lrclassifiers perform the best on average, while rf and lgbm scores come at the end. The top achieved balanced accuracy is 98.8% for lsvm feature selection, lsvm classifier, nofilt_global preprocessing, AAL atlas, and dFC feature representation. This model configuration (preprocessing, feature representation, atlas, feature selection, classifier, and found best parameters) is elected as the best classifier and is investigated more in the following subsections. The original dFC input is composed of 13,340 features, from which the lsvm-based feature selection elects 840 features, which are used in further processing. The best model is cloned, and five-fold cross-validation using a new random split is made to ensure that the results are not specific to the previous k-fold run. Table 4 shows the results of the best configuration model in terms of the accuracy, sensitivity, specificity, and balanced accuracy ± standard deviations.

Identified Brain Areas

Supplementary Table S4 provides the selected features that lead to the best model performance. An especially interesting finding is that identifying the weak/under-connectivity between brain areas is far more important than the very strong correlations, with a percentage of w k features = 81.9%, and strong correlations contributing only to the remaining 18.1 % of the selected features. We highlight the first 10 used features, as well as the top frequent brain regions in this selected list in Table 5, while the full list is available in the Supplementary Materials.

4. Discussion

We found a striking overlap between the top brain regions associated with ASD in our study with those identified in other fMRI studies. For example, left sup temporal (Temporal_Sup_L) was identified among regions of great contribution to ASD classification [40]. Boddaert et al. [41] also reported superior temporal cortex activation in autistic patients. Several regions of the cingulum have been associated with social cognition and language [42], which is a common deficiency in autistic subjects. Effective Connectivity of areas Postcentral_L, Frontal_Sup_Medial_R, Precuneus_R, SupraMarginal_R, Supp_Motor_Area_L, and Hippocampus_R, were identified as playing an important role in distinguishing between individuals with autism and controls [43]. Regions Temporal_Sup_L, Postcentral_R, Frontal_Sup_Medial_R, Precuneus_R, Cingulum_Ant_R, and Hippocampus_R were among ASD-related regions highlighted by Chen et al. [44]. Children with ASD also showed decreased functional connectivity in the right angular gyrus [45] as part of the cognition network. The same overlap with the selected brain regions can be seen in many other studies [46,47,48,49]. While this work only identifies such disrupted connectivity, an explanation of the impaired development of underlying connectivity can be linked to the same etiology of autism. Spotting those differences in brain connectivity is an important step toward a better understanding of autism.
A comparison of the experimental results of some other existing classification systems in the last five years can be found in Table 6. Our results are clearly higher than most of the literature for the ABIDE-I dataset, taking into consideration that some are only on part of the dataset (not all sites). The added value of this work not only establishes better accuracy on a large dataset but also shows comprehensive experimentation of different blocks along the pipeline. Moreover, the ‘average’ performance across our novel dynamic connectivity feature d F C across all configurations, including other atlas and inferior strategies, is still greater than most of the literature (78.09% average accuracy, see Supplementary S3). This is a powerful indication of the potential of our proposed work.
We would emphasize, however, that the promising results were obtained and validated on one dataset only, and adding more data should ensure the generalizability of our proposed framework, an intriguing avenue for future research. In conjunction with fMRI, incorporating other modalities such as sMRI or DTI is believed to provide more accurate and specific results, thus improving diagnostic sensitivity, accuracy, and specificity.

5. Conclusions

In this paper, a pipelined framework for ASD diagnosis is investigated, based on the analysis of brain rs-fMRI, incorporating the advantages of new dynamic feature representation and machine learning prospects. As a result of the framework presented, a number of objectives were achieved. In addition to providing an accurate state-of-the-art diagnosis of ASD based on a public dataset, it can also be used for identifying the brain regions contributing to such diagnosis. In conjunction with the framework’s diagnosis, these spotted brain areas can be reported to the physician early on so that he or she may make a more informed decision in the future. Having a better understanding of the brain abnormalities associated with autism is one of the key aspects of this study. Moreover, the comprehensive experiments made in this work pave the way for the next researchers to understand the effect of different choices along the neuroimaging machine learning pipeline on diagnostic accuracy, filling an important gap in knowledge that would help to speed the development of such CAD solutions. A further advantage of the system is that it easily scales up: more subjects can be preprocessed and their features calculated independently, and the addition of an additional mode of imaging over the same subject, such as structural MRI, can be incorporated into the feature selection stages.
It is anticipated that further development of MRI imaging-based AI approaches will enhance subjectivity in the clinical information available for ASD diagnosis in the future, enabling more accurate and expedient diagnoses to be made, enhancing our understanding of the underlying diagnoses of autism and moving us towards an automated system for an autism assessment.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/bioengineering10010056/s1, Table S1: Subjects Demographics; Table S2: Accuracies across the 5 folds of each best-model for each feature selection—classifier pair, for each feature representation/Atlas; Table S3: Accuracies averaged per each configuration; Table S4: Selected features of the best model.

Author Contributions

Conceptualization, Y.E., M.T.A., A.E., A.S. (Ahmed Shalaby), A.S. (Ahmed Soliman), A.M., G.N.B. and A.E.-B.; methodology, Y.E., M.T.A., A.E., A.S. (Ahmed Shalaby), A.S. (Ahmed Soliman), A.M., G.N.B. and A.E.-B.; project administration, A.E.-B.; software, Y.E. and M.T.A.; supervision, G.N.B. and A.E.-B.; validation, G.N.B.; visualization, Y.E. and A.S. (Ahmed Shalaby); writing—original draft, Y.E.; writing—review and editing, Y.E., M.T.A., A.E., A.S. (Ahmed Shalaby), A.S. (Ahmed Soliman), A.M., G.N.B. and A.E.-B. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported in part by the U.S. National Science Foundation (NSF) under grant PFI-TT2213985.

Institutional Review Board Statement

Ethical review and approval were waived for this study due to being previously approved by local IRBs for each site, and the de-identified data are used.

Informed Consent Statement

Not applicable.

Data Availability Statement

This work uses rs-fMRI data from the ABIDE-I preprocessed dataset, publicly available at http://fcon_1000.projects.nitrc.org/indi/abide/abide_I.html, accessed on 1 July 2022. The website also contains demographic information and scanning parameters that were used.

Acknowledgments

This research was supported in part by the U.S. National Science Foundation (NSF) under grant CNS1828521 and the University of Louisville’s Research Computing team.

Conflicts of Interest

The authors declare no conflict of interest.

Sample Availability

The code used for feature creation is available at https://github.com/ynakieb/rs-fMRI-paper, accessed on 15 December 2022 [39].

Abbreviations

The following abbreviations are used in this manuscript:
ABIDEautism brain imaging data exchange
MRImagnetic resonance imaging
sMRIstructural MRI
fMRIfunctional MRI
rs-fMRIresting-state functional MRI
ASDautism spectrum disorder
CADcomputer-aided diagnosis
MLmachine learning

References

  1. Frith, U.; Happé, F. Autism spectrum disorder. Curr. Biol. 2005, 15, R786–R790. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders, 5th ed.; (DSM-5); American Psychiatric Association: Arlington, VA, USA, 2013. [Google Scholar]
  3. Casanova, M.F.; El-Baz, A.; Suri, J.S. Autism Imaging and Devices; CRC Press: Boca Raton, FL, USA, 2017. [Google Scholar]
  4. Ismail, M.M.; Keynton, R.S.; Mostapha, M.M.; ElTanboly, A.H.; Casanova, M.F.; Gimel’farb, G.L.; El-Baz, A. Studying autism spectrum disorder with structural and diffusion magnetic resonance imaging: A survey. Front. Hum. Neurosci. 2016, 10, 211. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Brieber, S.; Neufang, S.; Bruning, N.; Kamp-Becker, I.; Remschmidt, H.; Herpertz-Dahlmann, B.; Fink, G.R.; Konrad, K. Structural brain abnormalities in adolescents with autism spectrum disorder and patients with attention deficit/hyperactivity disorder. J. Child Psychol. Psychiatry 2007, 48, 1251–1258. [Google Scholar] [CrossRef]
  6. Dekhil, O.; Ali, M.; Haweel, R.; Elnakib, Y.; Ghazal, M.; Hajjdiab, H.; Fraiwan, L.; Shalaby, A.; Soliman, A.; Mahmoud, A.; et al. A Comprehensive Framework for Differentiating Autism Spectrum Disorder from Neurotypicals by Fusing Structural MRI and Resting State Functional MRI. Semin. Pediatr. Neurol. 2020, 34, 100805. [Google Scholar] [CrossRef] [PubMed]
  7. Noriuchi, M.; Kikuchi, Y.; Yoshiura, T.; Kira, R.; Shigeto, H.; Hara, T.; Tobimatsu, S.; Kamio, Y. Altered white matter fractional anisotropy and social impairment in children with autism spectrum disorder. Brain Res. 2010, 1362, 141–149. [Google Scholar] [CrossRef]
  8. ElNakieb, Y.; Ali, M.T.; Elnakib, A.; Shalaby, A.; Soliman, A.; Mahmoud, A.; Ghazal, M.; Barnes, G.N.; El-Baz, A. The Role of Diffusion Tensor MR Imaging (DTI) of the Brain in Diagnosing Autism Spectrum Disorder: Promising Results. Sensors 2021, 21, 8171. [Google Scholar] [CrossRef]
  9. Cherkassky, V.L.; Kana, R.K.; Keller, T.A.; Just, M.A. Functional connectivity in a baseline resting-state network in autism. Neuroreport 2006, 17, 1687–1690. [Google Scholar] [CrossRef] [PubMed]
  10. Rausch, A.; Zhang, W.; Haak, K.V.; Mennes, M.; Hermans, E.J.; van Oort, E.; van Wingen, G.; Beckmann, C.F.; Buitelaar, J.K.; Groen, W.B. Altered functional connectivity of the amygdaloid input nuclei in adolescents and young adults with autism spectrum disorder: A resting state fMRI study. Mol. Autism 2016, 7, 13. [Google Scholar] [CrossRef] [Green Version]
  11. Weng, S.J.; Carrasco, M.; Swartz, J.R.; Wiggins, J.L.; Kurapati, N.; Liberzon, I.; Risi, S.; Lord, C.; Monk, C.S. Neural activation to emotional faces in adolescents with autism spectrum disorders. J. Child Psychol. Psychiatry 2011, 52, 296–305. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Dekhil, O.; Ismail, M.; Shalaby, A.; Switala, A.; Elmaghraby, A.; Keynton, R.; Gimel’farb, G.; Barnes, G.; El-Baz, A. A novel CAD system for autism diagnosis using structural and functional MRI. In Proceedings of the Biomedical Imaging (ISBI 2017), Melbourne, Australia, 18–21 April 2017. [Google Scholar]
  13. Kim, J.; Calhoun, V.D.; Shim, E.; Lee, J.H. Deep neural network with weight sparsity control and pre-training extracts hierarchical features and enhances classification performance: Evidence from whole-brain resting-state functional connectivity patterns of schizophrenia. Neuroimage 2016, 124, 127–146. [Google Scholar] [CrossRef]
  14. Ramzan, F.; Khan, M.U.G.; Rehmat, A.; Iqbal, S.; Saba, T.; Rehman, A.; Mehmood, Z. A deep learning approach for automated diagnosis and multi-class classification of Alzheimer’s disease stages using resting-state fMRI and residual neural networks. J. Med. Syst. 2020, 44, 37. [Google Scholar] [CrossRef] [PubMed]
  15. Rudie, J.D.; Brown, J.A.; Beck-Pancer, D.; Hernandez, L.M.; Dennis, E.L.; Thompson, P.M.; Bookheimer, S.Y.; Dapretto, M. Altered functional and structural brain network organization in autism. Neuroimage Clin. 2013, 2, 79–94. [Google Scholar] [CrossRef] [Green Version]
  16. Deshpande, G.; Libero, L.E.; Sreenivasan, K.R.; Deshpande, H.D.; Kana, R.K. Identification of neural connectivity signatures of autism using machine learning. Front. Hum. Neurosci. 2013, 7, 670. [Google Scholar] [CrossRef] [Green Version]
  17. Itahashi, T.; Yamada, T.; Watanabe, H.; Nakamura, M.; Jimbo, D.; Shioda, S.; Toriizuka, K.; Kato, N.; Hashimoto, R. Altered network topologies and hub organization in adults with autism: A resting-state fMRI study. PLoS ONE 2014, 9, e94115. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Just, M.A.; Cherkassky, V.L.; Keller, T.A.; Minshew, N.J. Cortical activation and synchronization during sentence comprehension in high-functioning autism: Evidence of underconnectivity. Brain 2004, 127, 1811–1821. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Alaerts, K.; Swinnen, S.P.; Wenderoth, N. Sex differences in autism: A resting-state fMRI investigation of functional brain connectivity in males and females. Soc. Cogn. Affect. Neurosci. 2016, 11, 1002–1016. [Google Scholar] [CrossRef] [Green Version]
  20. Tyszka, J.M.; Kennedy, D.P.; Paul, L.K.; Adolphs, R. Largely typical patterns of resting-state functional connectivity in high-functioning adults with autism. Cereb. Cortex 2013, 24, 1894–1905. [Google Scholar] [CrossRef] [Green Version]
  21. Plitt, M.; Barnes, K.A.; Martin, A. Functional connectivity classification of autism identifies highly predictive brain features but falls short of biomarker standards. Neuroimage Clin. 2015, 7, 359–366. [Google Scholar] [CrossRef] [Green Version]
  22. Hahamy, A.; Behrmann, M.; Malach, R. The idiosyncratic brain: Distortion of spontaneous connectivity patterns in autism spectrum disorder. Nat. Neurosci. 2015, 18, 302. [Google Scholar] [CrossRef]
  23. Di Martino, A.; Yan, C.G.; Li, Q.; Denio, E.; Castellanos, F.X.; Alaerts, K.; Anderson, J.S.; Assaf, M.; Bookheimer, S.Y.; Dapretto, M.; et al. The autism brain imaging data exchange: Towards a large-scale evaluation of the intrinsic brain architecture in autism. Mol. Psychiatry 2014, 19, 659. [Google Scholar] [CrossRef]
  24. Supekar, K.; Uddin, L.Q.; Khouzam, A.; Phillips, J.; Gaillard, W.D.; Kenworthy, L.E.; Yerys, B.E.; Vaidya, C.J.; Menon, V. Brain hyperconnectivity in children with autism and its links to social deficits. Cell Rep. 2013, 5, 738–747. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Bellman, R. Dynamic programming. Science 1966, 153, 34–37. [Google Scholar] [CrossRef] [PubMed]
  26. Sen, B.; Borle, N.C.; Greiner, R.; Brown, M.R. A general prediction model for the detection of ADHD and Autism using structural and functional MRI. PLoS ONE 2018, 13, e0194856. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Haar, S.; Berman, S.; Behrmann, M.; Dinstein, I. Anatomical abnormalities in autism? Cereb. Cortex 2016, 26, 1440–1452. [Google Scholar] [CrossRef] [Green Version]
  28. Heinsfeld, A.S.; Franco, A.R.; Craddock, R.C.; Buchweitz, A.; Meneguzzi, F. Identification of autism spectrum disorder using deep learning and the ABIDE dataset. Neuroimage Clin. 2018, 17, 16–23. [Google Scholar] [CrossRef] [PubMed]
  29. Hull, J.V.; Dokovna, L.B.; Jacokes, Z.J.; Torgerson, C.M.; Irimia, A.; Van Horn, J.D. Resting-state functional connectivity in autism spectrum disorders: A review. Front. Psychiatry 2017, 7, 205. [Google Scholar] [CrossRef] [Green Version]
  30. Zhou, Q.; Zhang, L.; Feng, J.; Lo, C.Y.Z. Tracking the main states of dynamic functional connectivity in resting state. Front. Neurosci. 2019, 13, 685. [Google Scholar] [CrossRef]
  31. Filippi, M.; Spinelli, E.G.; Cividini, C.; Agosta, F. Resting state dynamic functional connectivity in neurodegenerative conditions: A review of magnetic resonance imaging findings. Front. Neurosci. 2019, 13, 657. [Google Scholar] [CrossRef]
  32. Hindriks, R.; Adhikari, M.H.; Murayama, Y.; Ganzetti, M.; Mantini, D.; Logothetis, N.K.; Deco, G. Can sliding-window correlations reveal dynamic functional connectivity in resting-state fMRI? Neuroimage 2016, 127, 242–256. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  33. Chang, C.; Glover, G.H. Time–frequency dynamics of resting-state brain connectivity measured with fMRI. Neuroimage 2010, 50, 81–98. [Google Scholar] [CrossRef]
  34. Lindquist, M.A.; Xu, Y.; Nebel, M.B.; Caffo, B.S. Evaluating dynamic bivariate correlations in resting-state fMRI: A comparison study and a new approach. NeuroImage 2014, 101, 531–546. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Craddock, C.; Benhajali, Y.; Chu, C.; Chouinard, F.; Evans, A.; Jakab, A.; Khundrakpam, B.S.; Lewis, J.D.; Li, Q.; Milham, M.; et al. The neuro bureau preprocessing initiative: Open sharing of preprocessed neuroimaging data and derivatives. Front. Neuroinform. 2013, 7, 27. [Google Scholar]
  36. Craddock, C.; Sikka, S.; Cheung, B.; Khanuja, R.; Ghosh, S.S.; Yan, C.; Li, Q.; Lurie, D.; Vogelstein, J.; Burns, R.; et al. Towards automated analysis of connectomes: The configurable pipeline for the analysis of connectomes (c-pac). Front. Neuroinform. 2013, 42, 10–3389. [Google Scholar]
  37. Guyon, I.; Weston, J.; Barnhill, S.; Vapnik, V. Gene selection for cancer classification using support vector machines. Mach. Learn. 2002, 46, 389–422. [Google Scholar] [CrossRef]
  38. Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; et al. Scikit-learn: Machine learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar]
  39. ElNakieb, Y.; Ali, M. rs-fMRI-Paper-Code. Available online: https://github.com/ynakieb/rs-fMRI-paper (accessed on 15 December 2022).
  40. Chen, H.; Duan, X.; Liu, F.; Lu, F.; Ma, X.; Zhang, Y.; Uddin, L.Q.; Chen, H. Multivariate classification of autism spectrum disorder using frequency-specific resting-state functional connectivity—A multi-center study. Prog.-Neuro-Psychopharmacol. Biol. Psychiatry 2016, 64, 1–9. [Google Scholar] [CrossRef]
  41. Boddaert, N.; Belin, P.; Chabane, N.; Poline, J.B.; Barthélémy, C.; Mouren-Simeoni, M.C.; Brunelle, F.; Samson, Y.; Zilbovicius, M. Perception of complex sounds: Abnormal pattern of cortical activation in autism. Am. J. Psychiatry 2003, 160, 2057–2060. [Google Scholar] [CrossRef] [PubMed]
  42. Blakemore, S.J. The social brain in adolescence. Nat. Rev. Neurosci. 2008, 9, 267–277. [Google Scholar] [CrossRef] [PubMed]
  43. Rolls, E.T.; Zhou, Y.; Cheng, W.; Gilson, M.; Deco, G.; Feng, J. Effective connectivity in autism. Autism Res. 2020, 13, 32–44. [Google Scholar] [CrossRef] [Green Version]
  44. Chen, T.; Chen, Y.; Yuan, M.; Gerstein, M.; Li, T.; Liang, H.; Froehlich, T.; Lu, L. The development of a practical artificial intelligence tool for diagnosing and evaluating autism spectrum disorder: Multicenter study. JMIR Med Informa. 2020, 8, e15767. [Google Scholar] [CrossRef]
  45. Xu, S.; Li, M.; Yang, C.; Fang, X.; Ye, M.; Wei, L.; Liu, J.; Li, B.; Gan, Y.; Yang, B.; et al. Altered functional connectivity in children with low-function autism spectrum disorders. Front. Neurosci. 2019, 13, 806. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  46. Philip, R.C.; Dauvermann, M.R.; Whalley, H.C.; Baynham, K.; Lawrie, S.M.; Stanfield, A.C. A systematic review and meta-analysis of the fMRI investigation of autism spectrum disorders. Neurosci. Biobehav. Rev. 2012, 36, 901–942. [Google Scholar] [CrossRef] [PubMed]
  47. Schulte-Rüther, M.; Greimel, E.; Markowitsch, H.J.; Kamp-Becker, I.; Remschmidt, H.; Fink, G.R.; Piefke, M. Dysfunctions in brain networks supporting empathy: An fMRI study in adults with autism spectrum disorders. Soc. Neurosci. 2011, 6, 1–21. [Google Scholar] [CrossRef] [PubMed]
  48. Kim, S.Y.; Choi, U.S.; Park, S.Y.; Oh, S.H.; Yoon, H.W.; Koh, Y.J.; Im, W.Y.; Park, J.I.; Song, D.H.; Cheon, K.A.; et al. Abnormal activation of the social brain network in children with autism spectrum disorder: An FMRI study. Psychiatry Investig. 2015, 12, 37. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  49. Rakić, M.; Cabezas, M.; Kushibar, K.; Oliver, A.; Lladó, X. Improving the detection of autism spectrum disorder by combining structural and functional MRI information. Neuroimage Clin. 2020, 25, 102181. [Google Scholar] [CrossRef] [PubMed]
  50. Abraham, A.; Milham, M.P.; Di Martino, A.; Craddock, R.C.; Samaras, D.; Thirion, B.; Varoquaux, G. Deriving reproducible biomarkers from multi-site resting-state data: An Autism-based example. NeuroImage 2017, 147, 736–745. [Google Scholar] [CrossRef] [Green Version]
  51. Guo, X.; Dominick, K.C.; Minai, A.A.; Li, H.; Erickson, C.A.; Lu, L.J. Diagnosing autism spectrum disorder from brain resting-state functional connectivity patterns using a deep neural network with a novel feature selection method. Front. Neurosci. 2017, 11, 460. [Google Scholar] [CrossRef] [Green Version]
  52. Kam, T.E.; Suk, H.I.; Lee, S.W. Multiple functional networks modeling for autism spectrum disorder diagnosis. Hum. Brain Mapp. 2017, 38, 5804–5821. [Google Scholar] [CrossRef] [Green Version]
  53. Sadeghi, M.; Khosrowabadi, R.; Bakouie, F.; Mahdavi, H.; Eslahchi, C.; Pouretemad, H. Screening of autism based on task-free fmri using graph theoretical approach. Psychiatry Res. Neuroimaging 2017, 263, 48–56. [Google Scholar] [CrossRef]
  54. Spera, G.; Retico, A.; Bosco, P.; Ferrari, E.; Palumbo, L.; Oliva, P.; Muratori, F.; Calderoni, S. Evaluation of altered functional connections in male children with autism spectrum disorders on multiple-site data optimized with machine learning. Front. Psychiatry 2019, 10, 620. [Google Scholar] [CrossRef] [Green Version]
  55. Tang, L.; Mostafa, S.; Liao, B.; Wu, F.X. A network clustering based feature selection strategy for classifying autism spectrum disorder. BMC Med. Genom. 2019, 12, 153. [Google Scholar] [CrossRef] [Green Version]
  56. Wang, Y.; Wang, J.; Wu, F.X.; Hayrat, R.; Liu, J. AIMAFE: Autism spectrum disorder identification with multi-atlas deep feature representation and ensemble learning. J. Neurosci. Methods 2020, 343, 108840. [Google Scholar] [CrossRef]
  57. Subah, F.Z.; Deb, K.; Dhar, P.K.; Koshiba, T. A deep learning approach to predict autism spectrum disorder using multisite resting-state fMRI. Appl. Sci. 2021, 11, 3636. [Google Scholar] [CrossRef]
  58. Al-Hiyali, M.I.; Yahya, N.; Faye, I.; Khan, Z.; Alsaih, K. Classification of BOLD FMRI signals using wavelet transform and transfer learning for detection of autism spectrum disorder. In Proceedings of the 2020 IEEE-EMBS Conference on Biomedical Engineering and Sciences (IECBES), Langkawi Island, Malaysia, 1–3 March 2021; pp. 94–98. [Google Scholar]
  59. Yin, W.; Mostafa, S.; Wu, F.X. Diagnosis of autism spectrum disorder based on functional brain networks with deep learning. J. Comput. Biol. 2021, 28, 146–165. [Google Scholar] [CrossRef] [PubMed]
  60. Chu, Y.; Wang, G.; Cao, L.; Qiao, L.; Liu, M. Multi-Scale Graph Representation Learning for Autism Identification With Functional MRI. Front. Neuroinform. 2022, 15, 802305. [Google Scholar] [CrossRef] [PubMed]
  61. Yang, X.; Zhang, N.; Schrader, P. A study of brain networks for autism spectrum disorder classification using resting-state functional connectivity. Mach. Learn. Appl. 2022, 8, 100290. [Google Scholar] [CrossRef]
  62. Ding, J.; Wang, L.; Yu, L.; Xue, M.; Mei, X.; Wang, X. Low-rank Domain Adaptive Method with Inter-class difference Constraint for Multi-site Autism Spectrum Disorder Identification. In Proceedings of the 2022 7th International Conference on Computational Intelligence and Applications (ICCIA), Nanjing, China, 24–26 June 2022; pp. 237–242. [Google Scholar]
Figure 1. Illustration of the full steps of the adopted framework, including preprocessing, brain parcellation, feature representation, feature selection, and machine learning (ML) classification.
Figure 1. Illustration of the full steps of the adopted framework, including preprocessing, brain parcellation, feature representation, feature selection, and machine learning (ML) classification.
Bioengineering 10 00056 g001
Figure 2. Visual diagram of the calculations of the static functional connectivity F C representation, extracted from two different brain areas.
Figure 2. Visual diagram of the calculations of the static functional connectivity F C representation, extracted from two different brain areas.
Bioengineering 10 00056 g002
Figure 3. Visual diagram of the calculations of the dynamic functional connectivity d F C representation, extracted from two different brain areas.
Figure 3. Visual diagram of the calculations of the dynamic functional connectivity d F C representation, extracted from two different brain areas.
Bioengineering 10 00056 g003
Table 1. Demographics summary of the 884 subjects used in this study, showing sex counts (M: male, F: female), age at scan in years, and full-scale IQ (FIQ).
Table 1. Demographics summary of the 884 subjects used in this study, showing sex counts (M: male, F: female), age at scan in years, and full-scale IQ (FIQ).
ASD Group (n = 408)TD Group (n = 476)
M = 358, F = 50M = 388, F = 88
AGEFIQAGEFIQ
count408379476442
mean17.69106.1916.79111.28
std8.9317.017.3512.48
min7416.4773
max6414856.2146
Table 2. Multifactorial (3-way) ANOVA results. Feat denotes feature representation, Atls denotes the used atlas, and Strat is one of the four preprocessing strategies. sum_sq, df, F, PR are standard result names of sum of squares, degree of freedom, F_score, and p_value of this F_score, for each factor.
Table 2. Multifactorial (3-way) ANOVA results. Feat denotes feature representation, Atls denotes the used atlas, and Strat is one of the four preprocessing strategies. sum_sq, df, F, PR are standard result names of sum of squares, degree of freedom, F_score, and p_value of this F_score, for each factor.
sum_sqdfFPR (>F)
C(Feat, Sum)0.9418521.0163.004715 7.364232 × 10 36
C(Strat, Sum)0.1779573.010.266230 1.053597 × 10 06
C(Atls, Sum)0.1491641.025.815521 4.129224 × 10 07
C(Feat, Sum):C(Strat, Sum)0.1174333.06.774646 1.528091 × 10 04
C(Feat, Sum):C(Atls, Sum)0.0137841.02.385576 1.226282 × 10 01
C(Strat, Sum):C(Atls, Sum)0.0349623.02.016924 1.095533 × 10 01
C(Feat, Sum):C(Strat, Sum):C(Atls, Sum)0.0845633.04.878417 2.210611 × 10 03
Table 3. Multifactorial (3-way) ANOVA test results after removing insignificant interactions.
Table 3. Multifactorial (3-way) ANOVA test results after removing insignificant interactions.
sum_sqdfFPR (>F)
C(Feat, Sum)0.9363161.0160.682470 2.134089 × 10 35
C(Filt, Sum)0.1791723.010.249322 1.078933 × 10 06
C(Atls, Sum)0.1481051.025.416432 5.062110 × 10 07
C(Feat, Sum):C(Filt, Sum)0.1172083.06.704737 1.686921 × 10 04
Table 4. Cross-validated test results of the best configuration model.
Table 4. Cross-validated test results of the best configuration model.
MetricAccuracySensitivitySpecificityBalanced Accuracy
5-fold value0.988 ± 0.0040.987 ± 0.0080.989 ± 0.0070.988 ± 0.004
Table 5. Summary of first 10 selected features as well as the top frequent brain regions in this list.
Table 5. Summary of first 10 selected features as well as the top frequent brain regions in this list.
IndexFirst Selected FeaturesTop Frequent Region NamesFrequency
1Precentral_L__Rolandic_Oper_R_wkTemporal_Sup_L24
2Precentral_L__Supp_Motor_Area_L_stPostcentral_R23
3Precentral_L__Fusiform_L_wkFrontal_Sup_Medial_R22
4Precentral_L__Parietal_Inf_L_wkPrecuneus_R22
5Precentral_L__SupraMarginal_R_stSupraMarginal_R21
6Precentral_L__Precuneus_R_wkFrontal_Sup_R21
7Precentral_L__Temporal_Sup_L_wkCingulum_Ant_R21
8Precentral_L__Temporal_Pole_Sup_R_wkSupp_Motor_Area_L21
9Precentral_L__Cerebelum_Crus2_R_wkAngular_R21
10Precentral_R__Frontal_Inf_Tri_L_wkHippocampus_R21
Table 6. Comparison of results of some existing ASD classification methods using the ABIDE-I dataset.
Table 6. Comparison of results of some existing ASD classification methods using the ABIDE-I dataset.
ArticleUsed ClassifierAchieved Accuracy
Abraham et al., 2017 [50]SVM67.0%
Guo et al., 2017 [51]Deep neural networks with feature
selection (DNN-FS)
86.4%
Kam et al., 2017 [52]Discriminative restricted Boltzmann
machines (DRBM)
80.8%
Sadeghi et al., 2017 [53]SVM92%
Spera et al., 2019 [54]SVM71.0%
Tang et al., 2019 [55]SVM62.6%
Wang et al., 2020 [56]MLP and a voting strategy74.5%
Rakić et al., 2020 [49]Ensemble of classifiers85.0%
Subah et al., 2021 [57]DNN87.0%
Al-Hiyali et al., 2021 [58]SVM, K-nearest neighbors (KNN)85.9%
Yin et al., 2021 [59]Autoencoders, CNN, DNN79.2%
Chu et al., 2022 [60]Multi-scale graph convolutional network (GCN)79.5%
Yang et al., 2022 [61]LR, SVM, DNN, supervised learning classifier69.4%
Ding et al., 2022 [62]low-rank domain adaptive method with inter-class difference constraint75.5%
Proposed WorkBest: LSVM98.8%
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

ElNakieb, Y.; Ali, M.T.; Elnakib, A.; Shalaby, A.; Mahmoud, A.; Soliman, A.; Barnes, G.N.; El-Baz, A. Understanding the Role of Connectivity Dynamics of Resting-State Functional MRI in the Diagnosis of Autism Spectrum Disorder: A Comprehensive Study. Bioengineering 2023, 10, 56. https://doi.org/10.3390/bioengineering10010056

AMA Style

ElNakieb Y, Ali MT, Elnakib A, Shalaby A, Mahmoud A, Soliman A, Barnes GN, El-Baz A. Understanding the Role of Connectivity Dynamics of Resting-State Functional MRI in the Diagnosis of Autism Spectrum Disorder: A Comprehensive Study. Bioengineering. 2023; 10(1):56. https://doi.org/10.3390/bioengineering10010056

Chicago/Turabian Style

ElNakieb, Yaser, Mohamed T. Ali, Ahmed Elnakib, Ahmed Shalaby, Ali Mahmoud, Ahmed Soliman, Gregory Neal Barnes, and Ayman El-Baz. 2023. "Understanding the Role of Connectivity Dynamics of Resting-State Functional MRI in the Diagnosis of Autism Spectrum Disorder: A Comprehensive Study" Bioengineering 10, no. 1: 56. https://doi.org/10.3390/bioengineering10010056

APA Style

ElNakieb, Y., Ali, M. T., Elnakib, A., Shalaby, A., Mahmoud, A., Soliman, A., Barnes, G. N., & El-Baz, A. (2023). Understanding the Role of Connectivity Dynamics of Resting-State Functional MRI in the Diagnosis of Autism Spectrum Disorder: A Comprehensive Study. Bioengineering, 10(1), 56. https://doi.org/10.3390/bioengineering10010056

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop