Next Article in Journal
Qualitative Perturbation Analysis and Machine Learning: Elucidating Bacterial Optimization of Tryptophan Production
Previous Article in Journal
LungVision: X-ray Imagery Classification for On-Edge Diagnosis Applications
Previous Article in Special Issue
Inertial Sensors-Based Assessment of Human Breathing Pattern: A Systematic Literature Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Optimizing Automated Brain Extraction for Moderate to Severe Traumatic Brain Injury Patients: The Role of Intensity Normalization and Bias-Field Correction

by
Patrick Carbone
*,
Celina Alba
,
Alexis Bennett
,
Kseniia Kriukova
and
Dominique Duncan
*
USC Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA
*
Authors to whom correspondence should be addressed.
Algorithms 2024, 17(7), 281; https://doi.org/10.3390/a17070281
Submission received: 27 May 2024 / Revised: 22 June 2024 / Accepted: 25 June 2024 / Published: 27 June 2024
(This article belongs to the Special Issue Algorithms for Computer Aided Diagnosis)

Abstract

:
Accurate brain extraction is crucial for the validity of MRI analyses, particularly in the context of traumatic brain injury (TBI), where conventional automated methods frequently fall short. This study investigates the interplay between intensity normalization, bias-field correction (also called intensity inhomogeneity correction), and automated brain extraction in MRIs of individuals with TBI. We analyzed 125 T1-weighted Magnetization-Prepared Rapid Gradient-Echo (T1-MPRAGE) and 72 T2-weighted Fluid-Attenuated Inversion Recovery (T2-FLAIR) MRI sequences from a cohort of 143 patients with moderate to severe TBI. Our study combined 14 different intensity processing procedures, each using a configuration of N3 inhomogeneity correction, Z-score normalization, KDE-based normalization, or WhiteStripe intensity normalization, with 10 different configurations of the Brain Extraction Tool (BET) and the Optimized Brain Extraction Tool (optiBET). Our results demonstrate that optiBET with N3 inhomogeneity correction produces the most accurate brain extractions, specifically with one iteration of N3 for T1-MPRAGE and four iterations for T2-FLAIR, and pipelines incorporating N3 inhomogeneity correction significantly improved the accuracy of BET as well. Conversely, intensity normalization demonstrated a complex relationship with brain extraction, with effects varying by the normalization algorithm and BET parameter configuration combination. This study elucidates the interactions between intensity processing and the accuracy of brain extraction. Understanding these relationships is essential to the effective and efficient preprocessing of TBI MRI data, laying the groundwork for the development of robust preprocessing pipelines optimized for multi-site TBI MRI data.

1. Introduction

Traumatic brain injury (TBI) is a significant public health challenge, hospitalizing approximately 230,000 people annually in the United States alone and leading to a wide range of long-term cognitive and physiological impairments [1,2,3]. Among the most common and most debilitating sequelae of TBI is the development of post-traumatic epilepsy (PTE), a condition characterized by recurrent seizures persisting for more than one week after a traumatic insult to the brain [4]. Epidemiological studies have shown that TBI is a major risk factor for epilepsy, with the likelihood of seizure development increasing with the severity of the injury [5]. The pathophysiological mechanisms underlying PTE are complex and involve changes in brain architecture, neuroinflammation, and alterations in neuronal network excitability [6]. Research in this area is ongoing, with studies employing advanced neuroimaging techniques, animal models, and clinical trials to unravel the intricacies of PTE and improve health outcomes for patients who suffer from it [4]. Previous work has shown that the development of PTE typically follows a period of latency, extending from several months to years after the initial insult [7]. As of now, there are no established preventive measures available to counteract the emergence of seizures during this critical period, largely because substantive biomarkers allowing for the early detection of patients at risk for PTE have not yet been identified. Pioneering the search for these biomarkers, the Epilepsy Bioinformatics Study for Antiepileptogenic Therapy (EpiBioS4Rx) is an international, multidisciplinary study dedicated to the detection of the biomarkers of PTE to identify at-risk patients before seizures emerge, thus providing the prerequisite foundation necessary to launch large-scale clinical trials aimed at the development of antiepileptogenic drugs capable of preventing PTE [8]. Through EpiBioS4Rx, we have acquired substantial amounts of neuroimaging (MRI), electrophysiological (EEG), and molecular data. The focus of this current investigation is MRI, which is a key data modality for PTE biomarker identification because it provides the granular spatial resolution necessary for the precise quantitative characterization of the heterogeneous brain lesions resulting from TBI.
Heterogeneity, from patient presentations to the pathophysiology of brain lesions, has been acknowledged as a hallmark of TBI [9]. However, the same heterogeneity that grants MRI relevance in the search for PTE biomarkers also introduces significant limitations and technical challenges to its analysis [9,10]. TBI may present with extensive lesions, deformations, edema, and skull fractures [11,12,13]. TBI can also induce the displacement of brain ventricles and complicate the intensity distributions of MRIs as well [14]. Each case of TBI manifests a unique set of morphometric abnormalities, precipitating substantive alterations in brain architecture that can obscure the anatomical landmarks typically prominent in healthy brains. The complexity and variability of traumatic brain injuries is a major issue for automated methods of processing TBI MRI data [11,15]. Bennett et al. [16] demonstrate the necessity for modified automated lesion segmentation methods within the EpiBioS4Rx framework. Their work highlights that existing segmentation algorithms struggle with deformities introduced by TBI, thus necessitating manual segmentation in the absence of reliable automated TBI lesion segmentation methods.

Challenges to Preprocessing of Multi-Site TBI MRI Data

Automated brain extraction is a critical step in MRI preprocessing where TBI-related challenges manifest. Brain extraction, or skull stripping, refers to the separation of brain tissue from non-brain components, such as the skull, scalp, and dura mater, and is often one of the first and most critical preprocessing steps in MRI analysis. While manual brain extraction is often more accurate than automated brain extraction for TBI MRI data due to the limitations of contemporary automated methods, manual extractions are susceptible to human error and are plagued with inter-rater reliability issues. Moreover, manual methods are far more logistically complex and labor-intensive, taking from weeks to months to accomplish what an automated method can in seconds. A pivotal development in the domain of brain extraction has been the automated Brain Extraction Tool (BET) from the FMRIB Software Library (FSL) [17,18]. BET utilizes a deformable model guided by Bayesian priors to generate an outline of the brain’s surface. In the healthy brain, this strategy is overwhelmingly effective and has made the tool very popular, with over 8000+ studies citing it to date [19].
While BET performs extractions effectively in the healthy brain, its reliance on Bayesian priors severely reduces its accuracy in brains with pathology (see Figure 1c). This is because Bayesian priors rely on predefined assumptions of what a “typical” brain should look like. In brains with TBI, these assumptions are often broken, ultimately resulting in inaccurate brain extractions [20]. Inaccurate brain extraction is a critical misstep in MRI analyses. The precision of brain extraction directly influences the accuracy of all volume-based brain analyses. However, because brain extraction is one of the first steps in MRI preprocessing pipelines, inaccurate brain extraction is also detrimental to the accuracy of subsequent preprocessing steps, such as tissue segmentation and registration. Thus, poor-quality brain extraction prompts a cascade of errors that fundamentally compromise the validity of findings with these data, obscuring true insights into brain anatomy and function and potentially leading to misinterpretations of neural substrates underlying cognitive processes and disease mechanisms.
Several methods that improve brain extraction for patient data have been proposed. These techniques aim to overcome the shortcomings of conventional automated methods in extracting the brain. ROBEX from Iglesias et al. [21], SPECTRE from Carass et al. [22], BEaST from Eskildsen et al. [23], optiBET from Lutkenhoff et al. [20], and MONSTR from [24] have shown improved performance in TBI data compared to conventional techniques like BET. Of these, optiBET is particularly notable for its outstanding performance in 74 human MRIs with TBI—outperforming machine learning-based algorithms such as ROBEX [20]. OptiBET is a brain extraction script optimized for brains with pathology that, in addition to its robust testing on TBI data, also stands out from other extraction tools in being entirely composed of freely available and near-universally employed neuroimaging software. These strengths have made OptiBET a widely adopted tool for TBI brain extraction. To perform brain extraction, the optiBET script first employs BET to make the initial brain outline estimate, then it performs linear and non-linear registration to the MNI template space, and finally, an MNI brain mask is back-projected to the original subject space to mask out non-brain tissue from the original image [20]. While optiBET demonstrates significantly improved performance in TBI brain extractions, it is unreliable, requiring extensive manual correction in some cases—shown in Figure 1d. OptiBET especially shows a decline in performance on T2-FLAIR MRIs, which is a specialized MRI sequence crucial for the detailed visualization and segmentation of TBI-induced brain lesions [16,24,25].
Intensity normalization and intensity inhomogeneity correction are also two essential steps in the preprocessing of multi-site TBI MRI data. While intensity inhomogeneity correction and intensity normalization represent two distinct preprocessing techniques, for simplicity, they are often collectively referred to as “intensity processing” in later sections. Intensity inhomogeneity correction mitigates spatial variations in signal intensity that are not inherent to the anatomical structure but rather result from the variations in the MRI scanner’s magnetic field, called the bias field [26,27]. Conversely, intensity normalization aims to standardize the distribution of intensity values. Normalizing the intensity distribution across different images allows for inter-scan and inter-scanner comparisons [28,29]. In raw MRI data, variations in intensity can be attributed both to tissue properties and to the MRI scanner settings used during acquisition. Due to this dependency on scanner settings, comparing intensities across MRIs is problematic, especially when different settings or scanners are involved [28]. Variability persists among all scans, even when using identical scan and scanner settings, making intensity normalization essential for meaningful comparisons across MRI scans [28,29]. Intensity normalization and intensity inhomogeneity correction are critical for the accuracy and consistency of MRI data analysis and, thus, are essential components of MRI preprocessing pipelines [26,27].
Considering the limitations of contemporary automated techniques in performing brain extractions in the presence of TBI, the fundamental importance of accurate brain extraction to the validity of MRI analyses, and the necessity for intensity processing for multi-site MRI data sets, there is an urgent need for the development of more reliable and efficient automated brain extraction methods and a greater understanding of the interplay of different preprocessing steps in general to create an optimized MRI preprocessing pipeline for TBI data. To address these challenges, the current investigation examines the utility of N3 bias-field correction from Sled et al. [30] and three different intensity normalization algorithms from Reinhold et al. [31] in refining the precision and reliability of T1-weighted Magnetization-Prepared Rapid Gradient-Echo (T1-MPRAGE) and T2-weighted Fluid-Attenuated Inversion Recovery (T2-FLAIR) TBI MRI brain extractions with optiBET and BET.
This study offers several critical contributions to the field of neuroimaging preprocessing, specifically addressing challenges in the automated extraction of patient brains. Our primary objective is to develop and validate optimized preprocessing techniques for automated brain extraction in patients with moderate to severe TBI, addressing a critical need in the analysis of large-scale, multi-site TBI MRI data. We provide a comprehensive evaluation of the effects of intensity normalization and bias-field correction on the performance of automated brain extraction tools (BET and optiBET) using a large, multi-site dataset of patients with TBI. This systematic analysis across 154 preprocessing pipelines and two MRI sequence types (T1-MPRAGE and T2-FLAIR) allows for robust comparisons and far-reaching insights. We identify specific parameter configurations of N3 bias-field correction that significantly improve brain extraction accuracy for TBI data, with notable differences between T1-MPRAGE and T2-FLAIR images. These findings can directly guide the optimization of preprocessing pipelines for TBI MRI analysis. We find that alternative BET configurations (BET|R and BET|B,f0.2,g0.3) outperform the widely used BET|B,f0.1 setting for TBI data. This highlights the need for TBI-specific validation of preprocessing techniques and suggests avenues for improving tools like optiBET. We demonstrate the nuanced effects of multiple intensity normalization methods (Z-score, WhiteStripe, KDE-based) on brain extraction performance, providing a basis for further research. Collectively, our results delineate the complex interplay between intensity processing and brain extraction in the presence of TBI, offering valuable insights for the development of robust, optimized preprocessing pipelines tailored to the challenges of TBI MRI data. The detailed analysis of technique interactions and TBI-specific effects informs both the refinement of existing methods and the creation of new, specialized tools for TBI neuroimaging research.

2. Materials and Methods

In this section, we describe the dataset used in the experiment, the different automated brain extraction pipelines we compared, the inhomogeneity correction, normalization, and brain extraction configurations that form the basis of these pipelines, and the method of extraction quality assessment.

2.1. Participants

This research received approval from the Institutional Review Board of the University of California, Los Angeles, and the local ethics committees of all participating institutions within the EpiBioS4Rx Study Group. EpiBioS4Rx successfully enrolled 250 participants from 13 international locations with advanced clinical TBI programs. The demographic data and enrollment criteria of the participants in the EpiBioS4Rx study have been thoroughly described in previous work [16]. In brief, the full EpiBioS4Rx cohort has an average age of 44.28 years (SD = 21.2) and consists of 192 males and 58 females, with an average arrival Glasgow Coma Scale (GCS) score of 7.89 (SD = 3.91), and the MRI post-injury was taken, on average, 12.16 days (SD = 12.54) after the injury. Regarding the enrollment criteria, subjects were admitted within 72 h of experiencing a moderate to severe TBI. The inclusion criteria specified patients between 6 and 100 years old with acute TBI evident from intracranial, cortical, and/or subcortical bleeding on CT imaging, a GCS score ranging from 3 to 13 upon emergency department arrival, and the capability of undergoing continuous EEG monitoring for seven days post-injury, as well as MRI scanning within 18 days of the injury. The exclusion criteria ruled out individuals with diffuse axonal injury without hemorrhagic contusions; known cases of HIV/AIDS or Hepatitis B or C; those who are pregnant; those with pre-existing neurological diseases, CNS malignancies, epilepsy/seizure disorders, or dementia; cases of isolated anoxic brain injury, severe cervical spine injuries, or brain death; those in situations of current or impending incarceration; and those with positive tests for COVID-19.
Here, we report analyses performed on T1-MPRAGE and T2-FLAIR MRIs from EpiBioS4Rx subjects who had gold-standard manually corrected brain extractions available. A total of 131 subjects had T1-MPRAGE, and 83 subjects had T2-FLAIR gold-standard extractions available. Six T1-MPRAGE and eleven T2-FLAIR sequences were determined to be unusable. Therefore, the total number of subjects with a manually corrected, gold-standard brain extraction available was 125 T1-MPRAGE and 72 T2-FLAIR images. The cohort has an average age of 42.52 years (SD = 20.67) and consists of 77.62% males and 22.38% females, with an average arrival Glasgow Coma Scale (GCS) score of 7.58 (SD = 3.79), and the MRI post-injury was taken, on average, 11.99 days (SD = 7.31) after the injury.

2.2. MRI Acquisition

Structural MRI scans were obtained using 3-Tesla or 1.5-Tesla scanners following the EpiBioS4Rx protocol described in [8]. Approximately two weeks post-injury, 3D T2-FLAIR images were captured (average = 11.81, standard deviation = 7.74), with settings as follows: slice thickness of 1 mm, a field of view of 256 mm, a frequency of 256 Hz, a flip angle of 90° or greater than 120°, a repetition time (TR) exceeding 5000 ms, an echo time (TE) between 80 and 140 ms, an inversion time (TI) of 2000 to 2500 ms, no inter-slice gap, an isotropic resolution of 1 mm, and an excitation number (NEX) of at least 1, employing up to 2x parallel imaging. For the acquisition of 3D T1-weighted images, a Magnetization-Prepared Rapid Gradient-Echo (MPRAGE) sequence was utilized. The imaging parameters included a slice thickness of 1 mm, a field of view of 256 mm, a frequency of 256 Hz, flip angles ranging from 8° to 15°, a TR of 1500 to 2500 ms, the smallest possible TE, an inversion time of 1100 to 1500 ms, no inter-slice gap, an isotropic resolution of 1 mm, a minimum NEX of 1, and the use of up to 2x parallel imaging.

2.3. Gold-Standard Brain Extraction Protocol

Manual brain extractions are needed to validate and assess the accuracy of automated brain extraction methods because manual extraction is currently the most accurate method of brain extraction for TBI cohorts. These images serve as a definitive reference for the accuracy of the automated extraction, enabling the assessment of pipeline performance. The protocol used to create our “gold-standard” brain extractions is as follows. First, reorientation was carried out with FSL’s fslreorient2std, and, following this, two different brain extraction techniques were employed: BET with options B and f = 0.4 (Figure 1c) and optiBET (Figure 1d) [32]. Two trained researchers were assigned to independently review the extraction quality for the same subject. The extractions were visually examined using graphical user interfaces (GUIs) such as MRIcron, FSLEYES, or ITK-SNAP [33,34,35]. Both researchers reviewed the BET and optiBET images and selected the superior brain extraction for further refinement. For any subject where there were conflicting ratings, a staff researcher reviewed the images and made the final decision.
Then, several techniques were attempted to refine brain extraction quality. Initially, various methods were used to try to improve extraction quality, such as adjustments to BET option “f” and dilation and erosion with fslmaths. If the extraction was still of unacceptable quality, manual correction was performed as a last resort to fill in or remove voxels as necessary. Manual corrections were performed by a group of trained researchers using fsleyes [35]. The change in extraction quality from Figure 1c,d to Figure 1b exemplifies the degree of corrections made during this part of the procedure. After completing the manual corrections, a final dual-review process was carried out to ensure the quality of the corrected brain extractions. A staff researcher and a trained volunteer researcher with three years of neuroimaging experience independently reviewed each manually corrected image. In instances where the quality of the corrected brain extraction was uncertain or poor, a final evaluation was performed by a medical doctor with extensive neuroimaging experience, who made final decisions regarding extraction quality and the need for further corrections.

2.4. Brain Extraction Pipelines

We ran 154 brain extraction pipelines on each of the 125 T1-MPRAGE and 72 T2-FLAIR images for a total of 30,338 extractions. A brain extraction pipeline comprises one of the extraction configurations (listed in Table 1) and one of the intensity processing procedures (listed in Table 2). The intensity processing procedure refers to the first step of each pipeline and is executed prior to the actual brain extraction. The extraction configuration refers to the second step of each pipeline, which executes the actual brain extraction via BET or optiBET. Of the 154 pipelines tested, 140 performed brain extraction with BET, and 14 used optiBET. These two steps together make up the full brain extraction pipeline. For each extraction configuration, one pipeline had no intensity processing procedure, which is referred to as the extraction configuration’s control pipeline.

Extraction Configurations

One hundred forty pipelines performed brain extraction with one of the ten BET configurations described in Table 1. These ten BET configurations differ in their specific parameters or “options” set in the BET command. BET option “B” incorporates intensity inhomogeneity correction, also called bias-field correction. BET option “R” robustly locates the brain’s center of gravity more accurately by performing multiple iterations of BET to refine the center-of-gravity estimation. Options “B” and “R” are mutually exclusive and optional. BET option “f” adjusts the fractional intensity threshold, which adjusts the size of the brain outline estimation, with values closer to 0 yielding larger outlines and values closer to 1 yielding smaller outlines. BET option “g” adjusts the vertical gradient in the fractional intensity threshold, modifying brain outline estimations along the vertical axis such that positive values increase the outline size at the brain’s bottom and decrease it at the top, while negative values do the opposite. Unless different options are specified, BET runs with options f = 0.5 and g = 0 by default. The ten BET configurations we tested utilize one or none of the mutually exclusive primary options, “B” and “R”, along with a combination of “f” and/or “g” option values.
Fourteen pipelines performed brain extraction with the default configuration of optiBET from Lutkenhoff et al. [20]. The difference between optiBET and BET is that optiBET is a shell script designed to perform brain extractions even in brains with significant pathology. The first step of the optiBET script is performing a preliminary brain outline estimate using BET with options “B” and “f = 0.1” (BET|B,f0.1 in Table 1). This specific configuration of BET was found by Popescu et al. [36] to generate the most accurate BET extractions in MRIs with multiple sclerosis. BET|B,f0.1 was further shown to improve brain extractions over default BET in T1-MPRAGE MRIs with TBI by Lutkenhoff et al. [20]. Following the initial BET extraction, optiBET uses both linear and non-linear registration to map the extraction onto the MNI template space. Third, it inverts the projection of a standard MNI brain-only mask from the template space back to the subject’s original space. Finally, this brain mask is applied to the input image to mask out non-brain tissue, generating the final brain. The configuration of optiBET we tested was the default, which uses an MNI152 T1 1 mm brain-only mask for masking and performs the initial extraction with FSL using the described BET configuration [20].

2.5. Intensity Processing Procedures

For each of the 10 BET configurations, plus optiBET, 14 different intensity processing procedures (see Table 2) were implemented prior to extraction with the BET configuration. One inhomogeneity correction technique, Nonparametric Nonuniform Intensity Normalization (N3), and three intensity normalization techniques, Z-score, KDE-based, and WhiteStripe normalization, were compared. KDE-based and WhiteStripe intensity normalization both work exclusively with images of the brain and thus require an initial mask prior to the final brain extraction. For Z-score, KDE-based, and WhiteStripe normalization, we varied the pre-normalization mask by the fractional intensity threshold at the values f = 0.1, f = 0.5 (default), and f = 0.8. Additionally, we tested N3 inhomogeneity correction and Z-score normalization at one and four iterations. FreeSurfer performs N3 normalization through the MINC tool mri_nu_correct, which runs four iterations of N3 by default. These configurations are described in Table 2. The intensity-normalization package from Reinhold et al. [31] was used to execute the intensity normalization techniques. For N3, we utilized the MINC tool mri_nu_correct from Sled et al. [30].

2.5.1. N3 Inhomogeneity Correction

Nonparametric Nonuniform Intensity Normalization (N3), from Sled et al. [30], is a widely used technique for addressing intensity inhomogeneity in MRI images. N3 has been extensively employed in various neuroimaging studies and is often considered a standard preprocessing step in many MRI analysis pipelines. For instance, N3 is the default inhomogeneity correction method in popular neuroimaging software packages such as FreeSurfer [37] and is commonly used in large-scale, multi-site neuroimaging studies like the Alzheimer’s Disease Neuroimaging Initiative (ADNI) [38]. Moreover, N3 has been shown to effectively reduce intensity inhomogeneity in MRI images of various patient populations, including those with multiple sclerosis [39], Alzheimer’s disease [40], and brain tumors [41].
N3 addresses intensity inhomogeneity using a nonparametric approach without presupposing specific tissue distribution models or necessitating initial segmentation. Central to this method is the principle that a uniform tissue’s intensity histogram, unaffected by inhomogeneity, should ideally manifest as unimodal. Through iterative refinement, N3 enhances the sharpness of this histogram, targeting the elimination of the bias field distorting the true signal. Initially, N3 operates under the presumption that deviations from the expected unimodal distribution stem primarily from an underlying, smoothly varying bias field, attributing intensity variations to this inhomogeneity. The correction process unfolds iteratively, alternating between estimating the true tissue intensity distribution, assuming that the bias field is known, and estimating the bias field, assuming that the true tissue intensity distribution is known. Key to N3 is the deconvolution step, which separates the true signal from the bias field by conceptualizing the observed image intensities as the multiplication of the true signal by the bias field and then solving for the bias field in the frequency domain, where convolution simplifies to multiplication. This process is accompanied by the histogram sharpening of the image, aiming to counteract the bias field’s blurring effect by iteratively adjusting the image to achieve a more pronounced unimodal histogram. Notably, the N3 method is designed to be independent of the MRI pulse sequence and is robust to pathological data that might otherwise compromise model-based assumptions. The iterative process is designed to continue until subsequent adjustments yield negligible changes in histogram sharpness, indicating successful compensation for the bias field and the restoration of the true tissue intensities. This automated, minimal-assumption approach renders N3 a versatile and effective tool for enhancing tissue appearance uniformity across an MRI image.

2.5.2. Z-Score Intensity Normalization

Z-score (ZS) normalization is a technique designed to standardize the intensity values of MR images to a set range, making images from different subjects or scanning sessions comparable. By calculating the mean μ zs and standard deviation σ zs of the intensities within the image, Z-score normalization adjusts each voxel value I ( x ) as follows:
I zs ( x ) = I ( x ) μ zs σ zs
This formula ensures that the resulting image I zs has a mean intensity and a standard deviation set to one [31]. However, because Z-score normalization can generate an intensity distribution with negative intensity values, which violates image requirements for some brain extraction procedures, the distribution was shifted with fslmaths to have a minimum intensity value of zero after normalization [18].

2.5.3. KDE Intensity Normalization

Kernel Density Estimate (KDE)-based normalization advances the concept of intensity normalization by estimating the probability density function of the intensities within the brain mask using kernel density estimation with a Gaussian kernel. This method smooths the intensity histogram, allowing for the precise identification of peaks corresponding to different tissue types. The process is delineated as follows:
I kde ( x ) = c 3 · I ( x ) ρ ,
where ρ represents the intensity peak associated with white matter, and c 3 = 1000 sets this peak to a standardized value post-normalization [31]. The KDE method not only smooths out fluctuations in the histogram but also enables the identification of tissue-specific intensity peaks. This capacity for detailed peak identification makes KDE-based normalization particularly effective in images with complex intensity distributions.

2.5.4. WhiteStripe Intensity Normalization

WhiteStripe (WS) normalization specifically targets the normalization of intensities of normal-appearing white matter (NAWM). This method isolates a band of intensities (the “white stripe”) centered around the peak intensity of NAWM, determined by analyzing the smoothed histogram of the image [39]. The normalization is applied as follows:
I ws ( x ) = I ( x ) μ ws σ ws ,
where μ ws is the mean intensity of the white stripe, and σ ws is its standard deviation [31]. Like Z-score normalization, WhiteStripe normalization can generate an intensity distribution with negative intensity values, so the distribution was shifted with fslmaths to have a minimum intensity value of zero after normalization as well.

2.6. Quality Assessment

To evaluate the efficacy of the automatic brain extraction pipelines, the brain-extracted image generated by these techniques can be compared to the manually corrected brain extraction of the same image. We employed the dice similarity coefficient (DSC) as our primary metric for comparison. The DSC is a statistical tool that can quantify the degree of similarity or overlap between two MRIs. A DSC score close to 1 indicates a high overlap between two images, while a score closer to 0 indicates very little overlap. Thus, the automated extraction method that produces the highest DSC on average with the gold-standard image is the most similar to it and, therefore, is considered the more accurate automated brain extraction technique. The dice similarity coefficient is calculated as follows:
D S C = 2 | X Y | | X | + | Y | ,
where X and Y are two sets representing a binary brain-extracted MRI. Fslmaths was used to execute the calculations of the dice similarity coefficients [18].

3. Results

Table 3 ranks and summarizes the performance of the 14 optiBET and 140 BET brain extraction pipelines with T1-MPRAGE and T2-FLAIR MRIs in terms of the mean DSC. Referencing the DSC scores of the brain extractions in Figure 1 can be helpful for imagining the degree of inaccuracies in a brain extraction based on the mean DSC scores reported in Table 3. There was significant variability in performance across extraction configurations, intensity processing procedures, and MRI sequences. Pipelines using optiBET generated more accurate extractions than pipelines extracting with a configuration of BET for all intensity processing procedures and both MRI types. Of these top pipelines, the highest-performing pipelines for both image sequences were those employing optiBET with either one iteration of N3 inhomogeneity correction (denoted as N3 iter = 1) or four iterations (denoted as N3 iter = 4). Specifically, optiBET–N3 iter = 1 generated the most accurate extractions for T1-MPRAGE MRIs, with a mean DSC score of 0.9780. Similarly, for the T2-FLAIR images, optiBET–N3 iter = 4 was the highest-performing pipeline (mean DSC = 0.9557). These results are reflected in the first row of Table 3. It should further be noted that for T1-MPRAGE, the optiBET control pipeline was the second-highest-performing pipeline, barely falling short of optiBET–N3 iter = 1 (mean DSC = 0.9779), while, in T2-FLAIRs, optiBET–N3 iter = 4 showed a more substantial increase from the performance of its control pipeline (mean DSC = 0.9471).
While Table 3 generally exhibits a smooth, continuous decline in mean DSC between pipelines, there are notable points of discontinuity where a pronounced decrease in mean DSC is observed between two neighboring pipelines in the table. For the T1-MPRAGE MRI, the first discontinuity is observed between the poorest-performing optiBET pipeline, optiBET – WS m = BET|f0.1, which produced a mean DSC score of 0.9690, and the highest-performing BET pipeline, BET|B – N3 iter = 1, which produced a mean DSC score of 0.9391 (p < 0.001). In T2-FLAIR images, this gap between optiBET and BET performance was not observed. The lowest-performing optiBET pipeline in T2-FLAIR images was OptiBET – ZS m = BET|f0.5 with a mean DSC of 0.9404, and the highest-performing BET pipeline was BET|B,f0.2,g0.3 – N3 iter = 4 with a mean DSC of 0.9384. Figure 2 and Figure 3 visualize the results summarized in Table 3, displaying pipeline performance based on DSC scores by percentile rank for T1-MPRAGE and T2-FLAIR MRIs, respectively, with an emphasis on the lower end of the DSC score distribution. Subfigures (a) through (k) are ranked from lowest to highest by the mean DSC score of all pipelines with the same extraction configuration.

3.1. Effect of BET Parameter Configurations

The best-performing BET pipeline in terms of the mean DSC was BET|B – N3 iter = 1 for T1-MPRAGE and BET|B,f0.2,g0.3 – N3 iter = 4 for T2-FLAIR images. While previous investigations into BET parameter optimization have found that BET|B,f0.1 has outstanding performance in the presence of other kinds of pathology, as shown in Figure 2, we found that BET|B,f0.1 performs worse than BET|B, BET|R, and BET|B,f0.2,g0.3 for T1-MPRAGE MRIs, regardless of the intensity processing procedure [36]. The top BET|B pipeline (BET|B – N3 iter = 1) resulted in a mean DSC score of 0.9391, the mean DSC score of the top BET|R pipeline (BET|R – N3 iter = 4) was 0.9383, and the top BET|B,f0.2,g0.3 pipeline (BET|B,f0.2,g0.3 – N3 iter = 1) resulted in a mean DSC score of 0.9262, while the top BET|B,f0.1 pipeline (BET|B,f0.1 – N3 iter = 1) had a mean DSC of 0.9142 (differences were p < 0.001). In contrast, BET|B,f0.1 performed markedly better in T2-FLAIR. The top BET|B,f0.1 pipeline, BET|B,f0.1 – N3 iter = 4, produced the third highest DSC score among all BET pipelines for T2-FLAIR images, with a mean DSC = 0.9342. However, BET|B,f0.2,g0.3 – N3 iter = 4 and BET|R – N3 iter = 1 both still perform marginally better, producing DSC scores of 0.9384 and 0.9343, respectively.
Another notable difference in pipeline performance between T1MPRAGE and T2FLAIR is seen in BET|B, which performs significantly worse with T2-FLAIR images. As Figure 3 shows, BET|B is the only BET configuration with a primary option (“B” or “R”) to perform worse than pipelines without a primary option. Specifically, the top default BET pipeline (BET – ZS m = BET|f0.8) and the top BET|g−0.3 pipeline (BET|g−0.3 – KDE m = BET|f0.1) had mean DSC scores of 0.9197 and 0.9051, respectively, while the highest-performing BET|B pipeline (BET|B – ZS iter = 1) had a mean DSC score of only 0.8963.
For both MRI types, default BET and BET|g−0.3 had distinctly better performance relative to other BET configurations with no primary option—namely, BET|g0.3, BET|f0.8, and BET|f0.2,g0.3. The highest-performing pipelines using default BET were BET – N3 iter = 4 for T1-MPRAGE images, with a mean DSC of 0.9097, and BET – ZS iter = 4 for T2-FLAIR images, with a mean DSC of 0.9193. For BET|g−0.3, the highest-performing pipelines were BET|g−0.3 – N3 iter = 4 for T1-MPRAGE images and BET|g−0.3 – KDE m = BET|f0.1 for T2-FLAIR images, which had mean DSC scores of 0.9029 and 0.9051, respectively. On the other hand, BET|g0.3, BET|f0.8, and BET|f0.2,g0.3 exhibited worse performance. In Table 3, the top BET|f0.2 marks the second point of discontinuity for T1-MPRAGE images and the first major point of discontinuity for T2-FLAIR MRIs, representing a drastic decrease in pipeline performance from the preceding pipelines for both MRI sequences. For T1-MPRAGE, the poorest-performing default BET pipeline, BET – KDE m=BET|f0.8, has a mean DSC score of 0.8964 and precedes the top BET|f0.2 pipeline, BET|f0.2 – ZS iter = 4, in which the mean DSC plummets to 0.7776. This discontinuity can also be observed in the difference between the slopes of the pipelines for each extraction configuration in Figure 2.
An analogous but less drastic drop in mean DSC scores occurs at this point for T2-FLAIR images as well, where the lowest-performing BET|B pipeline (BET|B – KDE m = BET|f0.8) precedes the top BET|f0.2 pipeline (BET|f0.2 – ZS iter = 4), with the mean DSC decreasing from 0.8604 to 0.8361. In contrast to the T1-MPRAGE results, this was not the largest point of discontinuity for the T2-FLAIR images. Rather, the largest singular differential for T2-FLAIR images was observed between the two lowest-scoring pipelines in Table 3, dropping from 0.7421 to 0.6920 between BET|f0.2,g0.3 – N3 iter = 1 and BET|f0.2,g0.3 – N3 iter = 4. These two pipelines also have the lowest performance for the T1-MPRAGE images; however, the mean DSC only decreased from 0.7027 to 0.6948 between them.

3.2. Effect of Intensity Processing Procedures

While there was generally greater variability between extraction configurations, intensity processing procedures had varying effects between extraction configurations and other IP procedures, especially at the lower end of the DSC score distribution, as shown in Figure 2 and Figure 3. In this regard, N3 intensity inhomogeneity correction had a markedly different impact on brain extraction than KDE-based, WhiteStripe, and Z-score intensity normalization, which had more idiosyncratic and less significant effects. Figure 4 and Figure 5 show the impact of the intensity inhomogeneity correction and intensity normalization techniques on the mean DSC score of each extraction configuration relative to the control pipeline. For T1-MPRAGE images, BET|B,f0.2,g0.3, BET|B,f0.1, BET|g−0.3, BET|f0.2, BET|f0.8, and BET|f0.2,g0.3 cluster around similar mean DSC values regardless of intensity processing, while other BET configurations, like BET|B, BET|R, and BET, show larger changes in mean DSC depending on the intensity processing procedure.

3.2.1. Intensity Inhomogeneity Correction

N3 intensity homogeneity correction had a notable effect on the variance of the pipelines into which it was incorporated. While N3 offered virtually no improvement in the mean DSC of optiBET in T1-MPRAGE images, it did reduce the standard deviation by roughly half, decreasing it from 0.0455 to 0.0258 for N3 iter = 1 and 0.0265 for N3 iter = 4. This effect is also represented in Figure 2, which shows that pipelines with N3 have higher DSC scores in the bottom 10th percentile of DSC scores relative to control pipelines and other IP procedures for optiBET and several BET extraction configurations. Specifically, this effect is observed in the BET, BET|R, BET|B, BET|B,f0.2,g0.3, and BET|B,f0.1 extraction configurations (Figure 2g–k). For these configurations, N3 iter = 1 showed a robust decrease in the standard deviation relative to the control pipeline, while N3 iter = 4 showed a smaller reduction in the standard deviation (Table 3). However, N3 does not have this effect in the five lowest-performing BET configurations in Figure 2.
In addition to the differences in variance shown in Table 3 and Figure 2, pipelines incorporating N3 homogeneity correction had the largest effect on the mean DSC from their respective control pipelines for T1-MPRAGE MRIs. As Figure 4 shows, N3 iter = 1 and N3 iter = 4 both significantly increased DSC relative to the control pipeline across the default BET, BET|R, and BET|B configurations (p < 0.001). Notably, N3 iter = 4 had a significantly larger positive effect than N3 iter = 1 on default BET (p < 0.02) and BET|R (p < 0.001). For BET|g(-0.3), both N3 iterations showed significant improvements, with p-values < 0.02 for N3 iter = 1 and p < 0.05 for N3 iter = 4. Similarly, both iterations increased the DSC for BET|B,f0.1, with N3 iter = 1 outperforming N3 iter = 4 (p < 0.01). In the case of BET|B,f0.2,g0.3, N3 iter = 1 had a more substantial positive effect compared to N3 iter = 4 (p < 0.05). Conversely, for optiBET, N3 iter = 1 exhibited a significant positive effect, whereas N3 iter = 4 had a slight negative impact (p < 0.001). Similarly, for BET|f0.2, BET|f0.2,g0.3, and BET|f0.8, N3 iter = 4 demonstrated a significant decrease in DSC relative to the control pipelines and showed a larger decrease in DSC compared to N3 iter = 1 (p < 0.001 for BET|f0.2 and BET|f0.2,g0.3; p < 0.001 for BET|f0.8). Lastly, for the BET|g0.3 configuration, N3 iter = 1 had a significant negative effect, and so did N3 iter = 4 (p < 0.001), with N3 iter = 4 having a significantly larger negative effect than N3 iter = 1 (p < 0.001) (Figure 4).
For T2-FLAIR images, N3 shows a pattern similar to but distinct from its effects on T1-MPRAGE images (represented in Figure 5). The decreasing effect of N3 on the standard deviation is similarly observed with T2-FLAIR images (Figure 5), with N3 reducing the standard deviations of BET|B, BET|B,f0.1, BET|B,f0.2,g0.3, and optiBET by over 50 percent in some cases. However, opposite to the results for T1-MPRAGE images, reductions in the SDs of these configurations were larger with N3 iter = 4 than with N3 iter = 1. Moreover, the addition of N3|iter = 4 to default BET and BET|R (Figure 5f,j) resulted in increases in SDs from 0.0531 and 0.0467 to 0.0793 and 0.0616, respectively, rather than decreases, as was the case for the T1-MPRAGE MRIs.
For BET|B and BET|B,f0.2,g0.3, both iterations significantly increased the DSC relative to the control pipeline (p < 0.05). However, for BET|B,f0.1 and optiBET, the increases produced by both iterations were not statistically significant. Interestingly, in the BET|R configuration, N3 iter = 1 demonstrated a non-significant increase in DSC, while N3 iter = 4 showed a non-significant decrease; these were the highest- and lowest-performing pipelines, respectively, for BET|R. For BET configurations without a primary option, N3 iter = 4 consistently showed a larger negative effect than N3 iter = 1. Default BET, BET|f0.2, BET|f0.2,g0.3, BET|f0.8, BET|g(-0.3), and BET|g0.3 resulted in significant decreases in DSC relative to the control pipeline. For default BET and BET|g(-0.3), only N3 iter = 4 led to significant declines (p < 0.01), while N3 iter = 1 showed non-significant decreases. Conversely, in BET|f0.2, BET|f0.2,g0.3, BET|f0.8, and BET|g0.3, both iterations resulted in significant decreases, with each configuration having p-values less than 0.01 for N3 iter = 1 and less than 0.001 for N3 iter = 4. Across these configurations, the negative impact of N3 iter = 4 on the DSC was notably larger than that of N3 iter = 1 (p < 0.001 for each).

3.2.2. Intensity Normalization

In comparison to N3 inhomogeneity correction, Z-score, KDE-based, and WhiteStripe intensity normalization demonstrated more idiosyncratic effects on the pipelines for T1-MPRAGE MRIs. However, significant positive differences were also observed. KDE-based normalization with m = BET|f0.5 increased the DSC for BET|f0.2,g0.3, BET|f0.2, and BET|g-0.3 configurations (p < 0.05) (Figure 4). Additionally, KDE m = BET|f0.8 increased the DSC for BET|f0.2,g0.3 (p < 0.05). WhiteStripe normalization with m = BET|f0.1 increased the DSC for BET|B and BET|f0.2,g0.3 (p < 0.001 and p < 0.05, respectively). WS m = BET|f0.5 increased the DSC for BET|f0.2,g0.3, BET|f0.2, BET|R, and BET, with significance ranging from p < 0.05 to p < 0.01. WS m = BET|f0.8 increased the DSC for BET|f0.2 and BET|f0.8 (p < 0.05). Z-score normalization with ZS iter = 1 increased the DSC for BET|g-0.3 (p < 0.05). ZS iter = 4 increased the DSC for BET|f0.2,g0.3, p < 0.05. ZS m = BET|f0.1 increased the DSC for BET|f0.8, BET|B, and BET|f0.2,g0.3, with significance from p < 0.05 to p < 0.01. Lastly, ZS m = BET|f0.8 increased the DSC for BET|B and BET|f0.2,g0.3, with p < 0.01 and p < 0.05, respectively (Figure 4).
Negative effects were also observed with different normalization procedures in T1-MPRAGE MRIs. KDE m = BET|f0.1 resulted in a decrease in DSC for BET|B (p < 0.001), BET|B,f0.2,g0.3 (p < 0.01), and optiBET (p < 0.05). Additionally, KDE m = BET|f0.5 led to a decrease in DSC for BET|B (p < 0.01) and optiBET (p < 0.02), while KDE m = BET|f0.8 caused a decrease in DSC for BET (p < 0.001), BET|B (p < 0.01), and optiBET (p < 0.02) (Figure 4). WhiteStripe normalization also showed detrimental effects; WS m = BET|f0.1 resulted in a decrease in DSC for optiBET (p < 0.001) and BET|B (p < 0.001). WS m = BET|f0.5 led to a decrease in DSC for BET|B (p < 0.001), optiBET (p < 0.001), BET|B,f0.1 (p < 0.01), and BET|g0.3 (p < 0.05). Z-score normalization was not exempt from negative impacts either; ZS iter = 1 resulted in a decrease in DSC for optiBET (p < 0.001) and BET|B,f0.2,g0.3 (p < 0.01). ZS iter = 4 led to a decrease in DSC for optiBET (p < 0.001) and BET|g0.3 (p < 0.05). Additionally, ZS m = BET|f0.1 caused a decrease in DSC for optiBET (p < 0.001), BET|B,f0.2,g0.3 (p < 0.01), and BET (p < 0.05), while ZS m = BET|f0.5 and ZS m = BET|f0.8 each led to a decrease in DSC for BET|g0.3 (p < 0.05) (Figure 4).
For T2-FLAIR MRIs, there were fewer significant positive effects. KDE m = BET|f0.8 demonstrated an increase in DSC with a p-value of less than 0.05. For the BET|g-0.3 configuration, an increase was also observed with KDE m = BET|f0.1, showing a significant improvement (p < 0.001) (Figure 5). In the BET|B configuration, several normalization techniques resulted in notable increases in DSC: WS m = BET|f0.1 and WS m = BET|f0.5 both achieved increases with p < 0.001 and WS m = BET|f0.8 with p < 0.01. Additionally, ZS iter = 1 and ZS iter = 4 in the BET|B configuration led to significant increases in DSC, both p < 0.001. Further enhancements in the same configuration were seen with ZS m = BET|f0.8, ZS m = BET|f0.5, and ZS m = BET|f0.1 (all p < 0.01) (Figure 5).
Negative effects were also observed across different procedures for the T2-FLAIR images. In the BET|B configuration, KDE m = BET|f0.8 and KDE m = BET|f0.5 both led to a decrease in DSC, each with (p < 0.05) (Figure 5). Similarly, in the BET|f0.2,g0.3 configuration, KDE m = BET|f0.1 and KDE m = BET|f0.5 resulted in decreases in DSC with p < 0.01 and p < 0.05, respectively. Moreover, KDE m = BET|f0.5 in the BET|g-0.3 configuration showed a significant decrease in DSC (p < 0.001). WhiteStripe normalization also demonstrated detrimental effects; in the BET|B,f0.2,g0.3 configuration, WS m = BET|f0.1 and WS m = BET|f0.5 both resulted in decreases in DSC, with p < 0.01 and p < 0.05, respectively. Additionally, WS m = BET|f0.8 in the BET|f0.2 configuration and WS m = BET|f0.5 in the BET|f0.8 configuration each led to decreases in DSC with p < 0.05. WS m = BET|f0.1 and WS m = BET|f0.5 in the BET|f0.2,g0.3 configuration and WS m = BET|f0.5 in the BET|g-0.3 configuration also showed significant decreases (both p < 0.001). Z-score normalization exhibited similar negative trends; in the BET|B,f0.2,g0.3 configuration, ZS m = BET|f0.1 and ZS m = BET|f0.5 led to decreases in DSC with p < 0.02 and p < 0.05, respectively. Further, ZS procedures with the BET|f0.2 and BET|f0.2,g0.3 configurations showed decreases in mean DSC, with p-values ranging from p < 0.05 to p < 0.02. In the BET|g-0.3 configuration, ZS iter = 4, ZS m = BET|f0.1, ZS m = BET|f0.5, and ZS iter = 1 each resulted in decreases in DSC (all p < 0.01) (Figure 5).

4. Discussion

This study investigated the impact of different intensity processing procedures and brain extraction configurations on the efficacy of automated brain extraction from MRI images of human subjects suffering from traumatic brain injury. In our analyses, we primarily use the mean dice similarity coefficient to evaluate the accuracy of brain extraction pipelines. While other studies evaluating automated brain extraction methods generally report the median, we deliberately report the mean. The frequency distribution of DSC scores across a set of images typically exhibits a left skew, particularly in high-performing brain extraction pipelines. The performance of these pipelines does not decrease linearly but rather tends to drop sharply. Thus, a portion of the data consist of outliers, where the extraction results are exceptionally poor. These very poor extractions have an outsized impact on preprocessing efficiency, as they require extensive manual corrections. Extensive manual corrections, even if only for a few dozen images, necessitate the recruitment of significant auxiliary resources. Large datasets, such as EpiBios4Rx’s, can require the recruitment and training of volunteer researchers. Thus, the poorest extractions introduce the most significant logistical complexities and, in turn, are the greatest burden on the efficiency of the TBI preprocessing pipeline. Reporting the median would obscure these critical outliers, providing a less complete picture of the pipeline’s overall performance. On the other hand, using the mean ensures that these critical cases are represented in our results.
Our comparison of brain extraction pipelines with optiBET and BET configurations on T1-MPRAGE and T2-FLAIR MRIs produces several critical findings with significant implications for the analysis of patient MRI data, particularly for the precise and efficient preprocessing of subjects with traumatic brain injury. As expected, we found that optiBET performed superior to BET in all pipelines for both MRI types. We found notable differences among the ten different BET configurations, with several results contradicting and significantly adding to previous findings. For both sequence types, we found that BET configurations with a primary option (“B” or “R”) almost always outperformed configurations without a primary option. For T1-MPRAGE specifically, we found that BET|B was the most accurate BET pipeline, followed by BET|R and BET|B,f0.2,g0.3. This contrasts with Popescu et al. [36], who found that BET|B,f0.1 was the highest-performing pipeline for 3D T1 images in multiple sclerosis. Possible reasons for this discrepancy include differences in pathology, the MRI acquisition protocol, procedures for generating gold-standard extractions, and evaluation with the mean vs. median (however, using the median would not change the relative performance of the pipelines for our data). Additionally, because Popescu et al. [36] did not evaluate BET configurations with alterations to option “g”, BET|B,f0.2,g0.3 would not be accounted for. The divergence in optimal pipeline performance underscores the potential need for tailored preprocessing approaches for TBI data. These findings further prompt a reevaluation of assumptions on the efficacy of preprocessing techniques, which are often based on their performance on datasets with different pathologies. This suggests that a “one-size-fits-all” approach to preprocessing patient MRI data may be inappropriate, particularly in complex cases such as TBI, where a technique’s effectiveness should be rigorously validated against the specific challenges presented by the pathology. Alternatively, generalizations about technique performance on patient data may be viable, but these assumptions can only be made when they are sourced from investigations on pathologies of equal or greater complexity. Given that TBI is regarded as one of the most complex brain pathologies, the development of TBI-optimized MRI preprocessing methods could be key to highly efficient and effective generalized preprocessing pipelines for patient MRI data on the whole.
Concerning the effect of the intensity processing techniques, N3 inhomogeneity correction stands out as a significantly beneficial technique for improving the accuracy of brain extractions—especially in the more accurate configurations incorporating options “B” or “R”. This is evidenced by the higher mean DSCs and reduced standard deviations observed in pipelines using N3 relative to their controls. OptiBET combined with N3 inhomogeneity correction achieved the highest DSC scores for the BET and optiBET pipelines, specifically optiBET – N3 iter = 1 for T1-MPRAGE and optiBET – N3 iter = 4 for T2-FLAIR. While the optiBET pipeline with one iteration of N3 showed only a slight advantage over its control, for T2-FLAIR, optiBET with four iterations of N3 significantly outperformed the control. Similarly, the BET pipelines with option “B” (BET|B, BET|B,f0.1, and BET|B,f0.2,g0.3) showed greater accuracy with one iteration of N3 relative to four iterations for the T1-MPRAGE MRIs but showed greater accuracy with four iterations of N3 for T2-FLAIR images. This suggests that small, precise adjustments to the bias field can significantly influence the accuracy of brain extractions, potentially enhancing the reliability of TBI-related morphometric analyses if applied appropriately. The relevance of these findings could extend to various aspects of TBI processing and analysis research. A detailed understanding of how different inhomogeneity correction iterations affect extraction outcomes can guide researchers in selecting the most appropriate settings for their specific needs. This is particularly valuable in TBI cases, where brain morphology can be drastically altered, and conventional methods are less effective.

4.1. Limitations

A potential limitation of this investigation’s findings is the manually corrected, gold-standard brain extractions. As previously described, these brain extractions are a benchmark used to evaluate the accuracy of automated brain extraction pipelines. Our gold-standard extractions were generated from an initial extraction by optiBET or BET|B,f0.4 and then manually corrected using various techniques until they were of sufficient quality. Therefore, DSC scores could be skewed in favor of pipelines that are more similar to the optiBET and BET|B,f0.4 control pipelines. However, because subsequent manual corrections were made for all images, the impact of this bias on our results should be negligible. Regardless, we would like to acknowledge the potential for this bias and address its two consequences on the interpretation of this study’s findings. First, as evidenced by the inter-rater reliability issues associated with manual tracings of the brain, specific brain structures, and brain lesions from TBI, there is no single “correct” brain extraction [16,42]. Rather, there is a range of acceptable brain extractions that can all be considered correct. Consequently, any change in the extracted brain resulting from the addition of an intensity processing procedure could be interpreted as a decrease in accuracy, while in actuality, it could simply reflect a difference in brain extraction that is not decidedly better or worse. Second, significant increases in a pipeline’s accuracy from the addition of an intensity processing procedure are especially noteworthy. This is because the pipeline is showing enhanced accuracy despite bias possibly favoring its control, suggesting that improvements in accuracy from the added intensity processing were precisely in line with the manual corrections or were robust enough to transcend the inherent bias potentially in the gold-standard extractions.

4.2. Future Work

This analysis sets the groundwork for many potential future investigations. Our results suggest that N3 intensity inhomogeneity correction can significantly influence the accuracy and reliability of brain extraction outcomes; however, these effects are highly dependent on the specific procedure of N3 implemented, the MRI sequence, and the brain extraction configuration. While this exploration limited N3 to one and four iterations, it revealed a complex relationship between intensity inhomogeneity correction and brain extraction. This relationship is particularly pronounced in the contrast in outcomes between T1-MPRAGE and T2-FLAIR MRIs and BET configurations. Given this variability, future work should delve into a more granular investigation of intensity inhomogeneity correction beyond the current scope. This could include expanded testing of different N3 iterations using an initial brain mask with N3 (like those required for WS and KDE normalization) or performing intensity normalization after intensity inhomogeneity correction and vice versa. These approaches could enhance the uniformity and contrast of MRI images, potentially improving the accuracy of the subsequent brain extraction. Furthermore, BET|B,f0.1 has long been accepted as the best-performing BET configuration for patient data, such that BET|B,f0.1 is the configuration for the initial extraction in the optiBET script [20]. However, our results suggest that other configurations, namely, BET|R and BET|B,f0.2,g0.3, are better suited for TBI data. This could warrant a more systematic investigation into the optimal BET parameters for TBI data and how incorporating these different configurations into the optiBET script affects brain extraction.
Altogether, the current and proposed investigations contribute to the creation of TBI-optimized brain extraction methods and, ultimately, TBI-optimized MRI preprocessing pipelines, ultimately enhancing the accuracy and efficiency of TBI MRI data analysis. This study has yielded new insights into the interplay between intensity normalization, inhomogeneity correction, and brain extraction. Our findings offer TBI researchers critical guidance for constructing MRI preprocessing pipelines that are better equipped to handle the complex and challenging nature of TBI data. By understanding these interactions, researchers can enhance the accuracy and reliability of brain extraction outcomes, ultimately improving the quality of data available for further TBI-related analyses.

Author Contributions

Conceptualization, P.C.; methodology, P.C.; software, P.C.; validation, P.C., C.A., A.B. and D.D.; formal analysis, P.C.; investigation, P.C.; resources, D.D.; data curation, P.C., C.A. and K.K.; writing—original draft preparation, P.C.; writing—review and editing, P.C., C.A., A.B., K.K. and D.D.; visualization, P.C.; supervision, C.A., A.B. and D.D.; project administration, P.C. and D.D.; funding acquisition, D.D. All authors have read and agreed to the published version of the manuscript.

Funding

This study was conducted with the support of the National Institute of Neurological Disorders and Stroke (NINDS) of the National Institutes of Health (NIH) under award numbers U54 NS100064 (EpiBioS4Rx) and R01NS111744.

Institutional Review Board Statement

The studies involving human participants were reviewed and approved by the UCLA Institutional Review Board (IRB# 16-001 576) and the local review boards at each EpiBioS4Rx Study Group Institution.

Informed Consent Statement

Written informed consent to participate in this study was provided by the participant’s legal guardian/next of kin.

Data Availability Statement

The datasets presented in this article are not readily available because the data described in this study are subject to the following licenses/restrictions: access to data must be requested and approved by the EpiBioS4Rx Steering Committee. Requests to access the datasets should be directed to [email protected].

Acknowledgments

The authors would like to acknowledge the following EpiBioS4Rx site collaborators: Vespa, Paul, University of California Los Angeles; O’Brien, Terrance, The Alfred Hospital/Monash University; Bell, Michael, Children’s National Hospital; Claassen, Jan, Columbia University; Rosenthal, Eric, Massachusetts General Hospital; Willyerd, Frederick, Phoenix Children’s Hospital; Morokoff, Andrew, Royal Melbourne Hospital/University of Melbourne; Zimmermann, Lara, University of California Davis; Foreman, Brandon, University of Cincinnati; O’Phelan, Kristine, University of Miami; and Gilmore, Emily, Yale University.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

The following abbreviations are used in this manuscript:
ADNI  Alzheimer’s Disease Neuroimaging Initiative
AIDS  Acquired Immunodeficiency Syndrome
ANTS  Advanced Normalization Tools
BET  Brain Extraction Tool
CNS  Central Nervous System
CT  Computed Tomography
COVID-19  Coronavirus Disease 2019
DSC  Dice similarity coefficient
DOAJ  Directory of Open Access Journals
EEG  Electroencephalography
Ex. Config.  Extraction configuration
FLIRT  FMRIB’s Linear Image Registration Tool
FNIRT  FMRIB’s Non-linear Image Registration Tool
FSLFMRIB Software Library
GCSGlasgow Coma Scale
HIVHuman Immunodeficiency Virus
IPIntensity processing
Iter.Iteration(s)
KDEKernel density estimation
MINCMedical Imaging NetCDF
MNIMontreal Neurological Institute
MRIMagnetic Resonance Imaging
MDPIMultidisciplinary Digital Publishing Institute
N3Nonparametric Nonuniform Intensity Normalization
OptiBETOptimized Brain Extraction Tool
PTEPost-traumatic epilepsy
T1-MPRAGET1-weighted Magnetization-Prepared Rapid Gradient Echo
T2-FLAIRT2-weighted Fluid-Attenuated Inversion Recovery
TBITraumatic brain injury
WSWhiteStripe
ZSZ-score

References

  1. Georges, A.; Das, J.M. Traumatic Brain Injury; StatPearls Publishing: Treasure Island, FL, USA, 2023. [Google Scholar]
  2. Asikainen, I.; Kaste, M.; Sarna, S. Early and late posttraumatic seizures in traumatic brain injury rehabilitation patients: Brain injury factors causing late seizures and influence of seizures on long-term outcome. Epilepsia 1999, 40, 584–589. [Google Scholar] [CrossRef] [PubMed]
  3. Englander, J.; Bushnik, T.; Wright, J.M.; Jamison, L.; Duong, T.T. Mortality in late post-traumatic seizures. J. Neurotrauma 2009, 26, 1471–1477. [Google Scholar] [CrossRef] [PubMed]
  4. Lowenstein, D.H. Epilepsy after head injury: An overview. Epilepsia 2009, 50 (Suppl. S2), 4–9. [Google Scholar] [CrossRef]
  5. Christensen, J.; Pedersen, M.G.; Pedersen, C.B.; Sidenius, P.; Olsen, J.; Vestergaard, M. Long-term risk of epilepsy after traumatic brain injury in children and young adults: A population-based cohort study. Lancet 2009, 373, 1105–1110. [Google Scholar] [CrossRef] [PubMed]
  6. Bolkvadze, T.; Pitkänen, A. Development of post-traumatic epilepsy after controlled cortical impact and lateral fluid-percussion-induced brain injury in the mouse. J. Neurotrauma 2012, 29, 789–812. [Google Scholar] [CrossRef] [PubMed]
  7. Garner, R.; La Rocca, M.; Vespa, P.; Jones, N.; Monti, M.M.; Toga, A.W.; Duncan, D. Imaging biomarkers of posttraumatic epileptogenesis. Epilepsia 2019, 60, 2151–2162. [Google Scholar] [CrossRef]
  8. Vespa, P.M.; Shrestha, V.; Abend, N.; Agoston, D.; Au, A.; Bell, M.J.; Bleck, T.P.; Blanco, M.B.; Claassen, J.; Diaz-Arrastia, R.; et al. The epilepsy bioinformatics study for anti-epileptogenic therapy (EpiBioS4Rx) clinical biomarker: Study design and protocol. Neurobiol. Dis. 2019, 123, 110–114. [Google Scholar] [CrossRef] [PubMed]
  9. Covington, N.V.; Duff, M.C. Heterogeneity is a hallmark of traumatic brain injury, not a limitation: A new perspective on study design in rehabilitation research. Am. J. Speech. Lang. Pathol. 2021, 30, 974–985. [Google Scholar] [CrossRef] [PubMed]
  10. Maas, A.I.R.; Menon, D.K.; Manley, G.T.; Abrams, M.; Åkerlund, C.; Andelic, N.; Aries, M.; Bashford, T.; Bell, M.J.; Bodien, Y.G.; et al. Traumatic brain injury: Progress and challenges in prevention, clinical care, and research. Lancet Neurol. 2022, 21, 1004–1060. [Google Scholar] [CrossRef]
  11. Bigler, E.D. The lesion(s) in traumatic brain injury: Implications for clinical neuropsychology. Arch. Clin. Neuropsychol. 2001, 16, 95–131. [Google Scholar] [CrossRef]
  12. Huisman, T.A.G.M.; Schwamm, L.H.; Schaefer, P.W.; Koroshetz, W.J.; Shetty-Alva, N.; Ozsunar, Y.; Wu, O.; Sorensen, A.G. Diffusion tensor imaging as potential biomarker of white matter injury in diffuse axonal injury. AJNR Am. J. Neuroradiol. 2004, 25, 370–376. [Google Scholar]
  13. Nasrallah, F.; Bellapart, J.; Walsham, J.; Jacobson, E.; To, X.V.; Manzanero, S.; Brown, N.; Meyer, J.; Stuart, J.; Evans, T.; et al. PREdiction and Diagnosis using Imaging and Clinical biomarkers Trial in Traumatic Brain Injury (PREDICT-TBI) study protocol: An observational, prospective, multicentre cohort study for the prediction of outcome in moderate-to-severe TBI. BMJ Open 2023, 13, e067740. [Google Scholar] [CrossRef] [PubMed]
  14. Warner, M.A.; Marquez de la Plata, C.; Spence, J.; Wang, J.Y.; Harper, C.; Moore, C.; Devous, M.; Diaz-Arrastia, R. Assessing spatial relationships between axonal integrity, regional brain volumes, and neuropsychological outcomes after traumatic axonal injury. J. Neurotrauma 2010, 27, 2121–2130. [Google Scholar] [CrossRef] [PubMed]
  15. Zhang, K.; Johnson, B.; Pennell, D.; Ray, W.; Sebastianelli, W.; Slobounov, S. Are functional deficits in concussed individuals consistent with white matter structural alterations: Combined FMRI & DTI study. Exp. Brain Res. 2010, 204, 57–70. [Google Scholar] [CrossRef] [PubMed]
  16. Bennett, A.; Garner, R.; Morris, M.D.; La Rocca, M.; Barisano, G.; Cua, R.; Loon, J.; Alba, C.; Carbone, P.; Gao, S.; et al. Manual lesion segmentations for traumatic brain injury characterization. Front. Neuroimaging 2023, 2, 1068591. [Google Scholar] [CrossRef]
  17. Smith, S.M. Fast robust automated brain extraction. Hum. Brain Mapp. 2002, 17, 143–155. [Google Scholar] [CrossRef]
  18. Smith, S.M.; Jenkinson, M.; Woolrich, M.W.; Beckmann, C.F.; Behrens, T.E.J.; Johansen-Berg, H.; Bannister, P.R.; De Luca, M.; Drobnjak, I.; Flitney, D.E.; et al. Advances in functional and structural MR image analysis and implementation as FSL. Neuroimage 2004, 23 (Suppl. S1), S208–S219. [Google Scholar] [CrossRef]
  19. Scopus. 8342 Documents Have Cited: Fast Robust Automated Brain Extraction Smith S.M. (2002) Human Brain Mapping, 17 (3), pp. 143–155. Available online: https://www.scopus.com/results/citedbyresults.uri?sort=plf-f&cite=2-s2.0-0036828879&src=s&imp=t&sid=8fa0fec092d5bcc0661e21ce7b2e1e9e&sot=cite&sdt=a&sl=0&origin=resultslist&editSaveSearch=&txGid=b816cbfcb73daa270492f0a967f89de4 (accessed on 16 March 2024).
  20. Lutkenhoff, E.S.; Rosenberg, M.; Chiang, J.; Zhang, K.; Pickard, J.D.; Owen, A.M.; Monti, M.M. Optimized brain extraction for pathological brains (optiBET). PLoS ONE 2014, 9, e115551. [Google Scholar] [CrossRef]
  21. Iglesias, J.E.; Liu, C.Y.; Thompson, P.M.; Tu, Z. Robust brain extraction across datasets and comparison with publicly available methods. IEEE Trans. Med. Imaging 2011, 30, 1617–1634. [Google Scholar] [CrossRef]
  22. Carass, A.; Cuzzocreo, J.; Wheeler, M.B.; Bazin, P.L.; Resnick, S.M.; Prince, J.L. Simple paradigm for extra-cerebral tissue removal: Algorithm and analysis. Neuroimage 2011, 56, 1982–1992. [Google Scholar] [CrossRef]
  23. Eskildsen, S.F.; Coupé, P.; Fonov, V.; Manjón, J.V.; Leung, K.K.; Guizard, N.; Wassef, S.N.; Østergaard, L.R.; Collins, D.L.; Alzheimer’s Disease Neuroimaging Initiative. BEaST: Brain extraction based on nonlocal segmentation technique. Neuroimage 2012, 59, 2362–2373. [Google Scholar] [CrossRef] [PubMed]
  24. Roy, S.; Butman, J.A.; Pham, D.L.; Alzheimers Disease Neuroimaging Initiative. Robust skull stripping using multiple MR image contrasts insensitive to pathology. Neuroimage 2017, 146, 132–147. [Google Scholar] [CrossRef] [PubMed]
  25. Hajnal, J.V.; Bryant, D.J.; Kasuboski, L.; Pattany, P.M.; De Coene, B.; Lewis, P.D.; Pennock, J.M.; Oatridge, A.; Young, I.R.; Bydder, G.M. Use of fluid attenuated inversion recovery (FLAIR) pulse sequences in MRI of the brain. J. Comput. Assist. Tomogr. 1992, 16, 841–844. [Google Scholar] [CrossRef]
  26. Ganzetti, M.; Wenderoth, N.; Mantini, D. Intensity inhomogeneity correction of structural MR images: A data-driven approach to define input algorithm parameters. Front. Neuroinform. 2016, 10, 10. [Google Scholar] [CrossRef] [PubMed]
  27. Chua, Z.Y.; Zheng, W.; Chee, M.W.L.; Zagorodnov, V. Evaluation of performance metrics for bias field correction in MR brain images. J. Magn. Reson. Imaging 2009, 29, 1271–1279. [Google Scholar] [CrossRef] [PubMed]
  28. Nyúl, L.G.; Udupa, J.K.; Zhang, X. New variants of a method of MRI scale standardization. IEEE Trans. Med. Imaging 2000, 19, 143–150. [Google Scholar] [CrossRef] [PubMed]
  29. Zhuge, Y.; Udupa, J.K.; Liu, J.; Saha, P.K. Image background inhomogeneity correction in MRI via intensity standardization. Comput. Med. Imaging Graph. 2009, 33, 7–16. [Google Scholar] [CrossRef]
  30. Sled, J.G.; Zijdenbos, A.P.; Evans, A.C. A nonparametric method for automatic correction of intensity nonuniformity in MRI data. IEEE Trans. Med. Imaging 1998, 17, 87–97. [Google Scholar] [CrossRef] [PubMed]
  31. Reinhold, J.C.; Dewey, B.E.; Carass, A.; Prince, J.L. Evaluating the impact of intensity normalization on MR image synthesis. Proc. SPIE Int. Soc. Opt. Eng. 2019, 10949. [Google Scholar] [CrossRef]
  32. Jenkinson, M.; Beckmann, C.F.; Behrens, T.E.J.; Woolrich, M.W.; Smith, S.M. FSL. Neuroimage 2012, 62, 782–790. [Google Scholar] [CrossRef]
  33. Rorden, C.; Brett, M. Stereotaxic display of brain lesions. Behav. Neurol. 2000, 12, 191–200. [Google Scholar] [CrossRef] [PubMed]
  34. Yushkevich, P.A.; Piven, J.; Hazlett, H.C.; Smith, R.G.; Ho, S.; Gee, J.C.; Gerig, G. User-guided 3D active contour segmentation of anatomical structures: Significantly improved efficiency and reliability. Neuroimage 2006, 31, 1116–1128. [Google Scholar] [CrossRef] [PubMed]
  35. McCarthy, P. FSLeyes. Available online: https://zenodo.org/records/10122614 (accessed on 18 March 2024).
  36. Popescu, V.; Battaglini, M.; Hoogstrate, W.S.; Verfaillie, S.C.J.; Sluimer, I.C.; van Schijndel, R.A.; van Dijk, B.W.; Cover, K.S.; Knol, D.L.; Jenkinson, M.; et al. Optimizing parameter choice for FSL-Brain Extraction Tool (BET) on 3D T1 images in multiple sclerosis. Neuroimage 2012, 61, 1484–1494. [Google Scholar] [CrossRef] [PubMed]
  37. Fischl, B. FreeSurfer. Neuroimage 2012, 62, 774–781. [Google Scholar] [CrossRef] [PubMed]
  38. Jack, R.C., Jr.; Bernstein, M.A.; Fox, N.C.; Thompson, P.; Alexander, G.; Harvey, D.; Borowski, B.; Britson, P.J.; Whitwell, J.L.; Ward, C.; et al. The Alzheimer’s Disease Neuroimaging Initiative (ADNI): MRI methods. J. Magn. Reson. Imaging 2008, 27, 685–691. [Google Scholar] [CrossRef]
  39. Shinohara, R.T.; Sweeney, E.M.; Goldsmith, J.; Shiee, N.; Mateen, F.J.; Calabresi, P.A.; Jarso, S.; Pham, D.L.; Reich, D.S.; Crainiceanu, C.M.; et al. Statistical normalization techniques for magnetic resonance imaging. Neuroimage Clin. 2014, 6, 9–19. [Google Scholar] [CrossRef] [PubMed]
  40. Boyes, R.G.; Gunter, J.L.; Frost, C.; Janke, A.L.; Yeatman, T.; Hill, D.L.G.; Bernstein, M.A.; Thompson, P.M.; Weiner, M.W.; Schuff, N.; et al. Intensity non-uniformity correction using N3 on 3-T scanners with multichannel phased array coils. Neuroimage 2008, 39, 1752–1762. [Google Scholar] [CrossRef] [PubMed]
  41. Belaroussi, B.; Milles, J.; Carme, S.; Zhu, Y.M.; Benoit-Cattin, H. Intensity non-uniformity correction in MRI: Existing methods and their validation. Med. Image Anal. 2006, 10, 234–246. [Google Scholar] [CrossRef]
  42. Monereo-Sánchez, J.; de Jong, J.J.A.; Drenthen, G.S.; Beran, M.; Backes, W.H.; Stehouwer, C.D.A.; Schram, M.T.; Linden, D.E.J.; Jansen, J.F.A. Quality control strategies for brain MRI segmentation and parcellation: Practical approaches and recommendations-insights from the Maastricht study. Neuroimage 2021, 237, 118174. [Google Scholar] [CrossRef]
Figure 1. Examples of brain extractions. (a) through (d) are of the same T2-FLAIR MRI brain image slice. Image (a) is the brain image before any extraction processes, (b) depicts an accurately extracted brain image with clear boundaries and minimal extraneous tissue, (c) shows a poorly extracted brain image using BET with options B and f = 0.4, and (d) depicts a poorly extracted brain image using optiBET. Images (c,d) exhibit noticeable artifacts and incorrect boundaries, with (d) also showing substantial internal holes. See Section 2.6 for details on dice similarity coefficients (DSCs).
Figure 1. Examples of brain extractions. (a) through (d) are of the same T2-FLAIR MRI brain image slice. Image (a) is the brain image before any extraction processes, (b) depicts an accurately extracted brain image with clear boundaries and minimal extraneous tissue, (c) shows a poorly extracted brain image using BET with options B and f = 0.4, and (d) depicts a poorly extracted brain image using optiBET. Images (c,d) exhibit noticeable artifacts and incorrect boundaries, with (d) also showing substantial internal holes. See Section 2.6 for details on dice similarity coefficients (DSCs).
Algorithms 17 00281 g001
Figure 2. A comparison of brain extraction pipeline performance for T1-MPRAGE MRIs. For each subplot, the Y-axis represents the DSC score of an extraction, and the X-axis indicates the percentile rank of the score within its pipeline. Subfigures (ak) are sequenced from the lowest-performing extraction configuration (BET|f0.2,g0.3 on the top left) to the highest-performing extraction configuration (optiBET on the bottom right) according to the mean DSC score for each subplot.
Figure 2. A comparison of brain extraction pipeline performance for T1-MPRAGE MRIs. For each subplot, the Y-axis represents the DSC score of an extraction, and the X-axis indicates the percentile rank of the score within its pipeline. Subfigures (ak) are sequenced from the lowest-performing extraction configuration (BET|f0.2,g0.3 on the top left) to the highest-performing extraction configuration (optiBET on the bottom right) according to the mean DSC score for each subplot.
Algorithms 17 00281 g002
Figure 3. A comparison of brain extraction pipeline performance for T2-FLAIR MRIs. For each subplot, the Y-axis represents the DSC score of an extraction, and the X-axis indicates the percentile rank of the score within its pipeline. Subfigures (ak) are sequenced from the lowest-performing extraction configuration (BET|f0.2,g0.3 on the top left) to the highest-performing extraction configuration (optiBET on the bottom right) according to the mean DSC score for each subplot.
Figure 3. A comparison of brain extraction pipeline performance for T2-FLAIR MRIs. For each subplot, the Y-axis represents the DSC score of an extraction, and the X-axis indicates the percentile rank of the score within its pipeline. Subfigures (ak) are sequenced from the lowest-performing extraction configuration (BET|f0.2,g0.3 on the top left) to the highest-performing extraction configuration (optiBET on the bottom right) according to the mean DSC score for each subplot.
Algorithms 17 00281 g003
Figure 4. The impact of intensity processing procedures on brain extraction performance as the percent difference in mean DSC for T1-MPRAGE MRIs. The bars in the subplots represent the variation in mean DSC associated with each IP procedure/extraction configuration relative to the mean DSC of the control pipeline. Subplots (a) through (k) show the effect of the IP Procedures on the accuracy of the following configurations: BET (a), BET|B (b), BET|B,f0.1 (c), BET|B,f0.2,g0.3 (d), BET|R (e), BET|f0.2 (f), BET|f0.2,g0.3 (g), BET|f0.8 (h), BET|g-0.3 (i), BET|g0.3 (j), and optiBET (k). Error bars indicate the standard error. Bars deflecting upward indicate an increase in mean DSC, and bars deflecting downward indicate a reduction in DSC.
Figure 4. The impact of intensity processing procedures on brain extraction performance as the percent difference in mean DSC for T1-MPRAGE MRIs. The bars in the subplots represent the variation in mean DSC associated with each IP procedure/extraction configuration relative to the mean DSC of the control pipeline. Subplots (a) through (k) show the effect of the IP Procedures on the accuracy of the following configurations: BET (a), BET|B (b), BET|B,f0.1 (c), BET|B,f0.2,g0.3 (d), BET|R (e), BET|f0.2 (f), BET|f0.2,g0.3 (g), BET|f0.8 (h), BET|g-0.3 (i), BET|g0.3 (j), and optiBET (k). Error bars indicate the standard error. Bars deflecting upward indicate an increase in mean DSC, and bars deflecting downward indicate a reduction in DSC.
Algorithms 17 00281 g004
Figure 5. The impact of intensity processing procedures on brain extraction performance as the percent difference in mean DSC for T2-FLAIR MRIs. The bars in the subplots represent the variation in mean DSC associated with each IP procedure/extraction configuration relative to the mean DSC of the control pipeline. Subplots (a) through (k) show the effect of the IP Procedures on the accuracy of the following configurations: BET (a), BET|B (b), BET|B,f0.1 (c), BET|B,f0.2,g0.3 (d), BET|R (e), BET|f0.2 (f), BET|f0.2,g0.3 (g), BET|f0.8 (h), BET|g-0.3 (i), BET|g0.3 (j), and optiBET (k). Error bars indicate the standard error. Bars deflecting upward indicate an increase in mean DSC, and bars deflecting downward indicate a reduction in DSC.
Figure 5. The impact of intensity processing procedures on brain extraction performance as the percent difference in mean DSC for T2-FLAIR MRIs. The bars in the subplots represent the variation in mean DSC associated with each IP procedure/extraction configuration relative to the mean DSC of the control pipeline. Subplots (a) through (k) show the effect of the IP Procedures on the accuracy of the following configurations: BET (a), BET|B (b), BET|B,f0.1 (c), BET|B,f0.2,g0.3 (d), BET|R (e), BET|f0.2 (f), BET|f0.2,g0.3 (g), BET|f0.8 (h), BET|g-0.3 (i), BET|g0.3 (j), and optiBET (k). Error bars indicate the standard error. Bars deflecting upward indicate an increase in mean DSC, and bars deflecting downward indicate a reduction in DSC.
Algorithms 17 00281 g005
Table 1. A description of the BET and optiBET brain extraction configurations. The Primary Option column contains the brain extraction tool used (BET or optiBET) and the primary BET option, “B” or “R”, if applicable. The Option “f” and “g” Value columns contain the fractional intensity threshold (“f”) and the vertical gradient in the fractional intensity threshold (“g”) values if they differed from their respective defaults of f = 0.5 and g = 0. The Label column contains the short-hand notation used when referencing the extraction configuration. The Description column provides a brief description of how the configuration’s specified options affect the brain extraction.
Table 1. A description of the BET and optiBET brain extraction configurations. The Primary Option column contains the brain extraction tool used (BET or optiBET) and the primary BET option, “B” or “R”, if applicable. The Option “f” and “g” Value columns contain the fractional intensity threshold (“f”) and the vertical gradient in the fractional intensity threshold (“g”) values if they differed from their respective defaults of f = 0.5 and g = 0. The Label column contains the short-hand notation used when referencing the extraction configuration. The Description column provides a brief description of how the configuration’s specified options affect the brain extraction.
Primary
Option
Option “f” and
“g” Values
LabelDescription
BET--BETDefault BET configuration (f = 0.5 and g = 0).
f 0.2-BET|f0.2Generates larger brain outline estimates.
f 0.8-BET|f0.8Generates smaller brain outline estimates.
-g -0.3BET|g-0.3Generates smaller brain outline estimates at the bottom of the image and a larger outline at the top.
-g 0.3BET|g0.3Generates a larger outline at the bottom of the image and a smaller outline at the top.
f 0.2g 0.3BET|f0.2,g0.3Generates a larger brain outline estimate, with the bottom of the image having a larger estimate relative to the top.
BET|B--BET|BPerforms FAST bias-field correction and standard-space masking for image bias-field reduction and neck voxel cleanup.
f 0.1-BET|B,f0.1Performs bias-field correction and generates a larger brain outline estimate.
f 0.2g 0.3BET|B,f0.2,g0.3Performs bias-field correction and generates a larger brain outline estimate, with the bottom of the image having a larger estimate relative to the top.
BET|R--BET|RRuns BET iteratively for robust brain center estimation.
optiBETf 0.1-optiBETPerforms BET|B,f0.1 for the initial extraction and then FLIRT and FNIRT to generate the final extraction by masking the input image with a back-projected standard brain mask.
Table 2. A description of the intensity processing procedures. IP procedures were executed prior to brain extraction with one of the configurations detailed in Table 1. The IP (intensity processing) column contains the intensity processing technique used. The Iter. (iterations) and Mask columns contain the number of iterations that a technique was run for and the brain extraction configuration used to generate the brain mask that was applied during intensity processing, if applicable. The Label column contains the short-hand notation used when referencing the IP procedure. The Description column provides a short description of each IP procedure.
Table 2. A description of the intensity processing procedures. IP procedures were executed prior to brain extraction with one of the configurations detailed in Table 1. The IP (intensity processing) column contains the intensity processing technique used. The Iter. (iterations) and Mask columns contain the number of iterations that a technique was run for and the brain extraction configuration used to generate the brain mask that was applied during intensity processing, if applicable. The Label column contains the short-hand notation used when referencing the IP procedure. The Description column provides a short description of each IP procedure.
IPIter.MaskLabelDescription
N31-N3 iter = 11 iteration of N3 inhomogeneity correction without a mask.
4-N3 iter = 44 iterations of N3 without a mask (FreeSurfer default).
ZS1-ZS iter = 11 iteration of Z-score intensity normalization without a mask.
4-ZS iter = 44 iterations of Z-score int. norm. without a mask.
1BETf0.1ZS m = BETf0.11 iteration of Z-score with a BETf0.1-extracted mask.
1BETf0.5ZS m = BETf0.51 iteration of Z-score with a BETf0.5-extracted mask.
1BETf0.8ZS m = BETf0.81 iteration of Z-score with a BETf0.8-extracted mask.
KDE1BETf0.1KDE m = BETf0.11 iteration of KDE-based intensity normalization with a BETf0.1-extracted mask.
1BETf0.5KDE m = BETf0.51 iteration of KDE with a BETf0.5-extracted mask.
1BETf0.8KDE m = BETf0.81 iteration of KDE with a BETf0.8-extracted mask.
WS1BETf0.1WS m = BETf0.11 iteration of WhiteStripe intensity normalization with a BETf0.1-extracted mask.
1BETf0.5WS m = BETf0.51 iteration of WhiteStripe with a BETf0.5-extracted mask.
1BETf0.8WS m = BETf0.81 iteration of WhiteStripe with a BETf0.8-extracted mask.
----No intensity processing procedure (control).
Table 3. A ranked table of all 154 brain extraction pipelines by mean DSC scores for T1-MPRAGE and T2-FLAIR MRIs. Pipelines consist of an IP procedure from Table 2 and an Ex. Config. (extraction configuration) from Table 1. Pipelines at the top of the table are closer to DSC = 1, meaning they exhibit higher overlap with the gold standard and are considered more accurate. The SD columns report the standard deviation in DSC scores for each pipeline. Additionally, Figure 1 can be used to help visualize and compare brain extraction quality represented by different DSC scores.
Table 3. A ranked table of all 154 brain extraction pipelines by mean DSC scores for T1-MPRAGE and T2-FLAIR MRIs. Pipelines consist of an IP procedure from Table 2 and an Ex. Config. (extraction configuration) from Table 1. Pipelines at the top of the table are closer to DSC = 1, meaning they exhibit higher overlap with the gold standard and are considered more accurate. The SD columns report the standard deviation in DSC scores for each pipeline. Additionally, Figure 1 can be used to help visualize and compare brain extraction quality represented by different DSC scores.
T1-MPRAGET2-FLAIR
Brain Extraction PipelineDSCBrain Extraction PipelineDSC
Ex. Config.IP ProcedureMeanSDEx. Config.IP ProcedureMeanSD
optiBETN3 iter = 10.97800.0259optiBETN3 iter = 40.95570.0544
optiBET-0.97790.0455optiBETN3 iter = 10.95250.0676
optiBETWS m = BET|f0.80.97690.0488optiBETZS iter = 40.94750.0845
optiBETZS iter = 10.97660.0447optiBET-0.94710.0882
optiBETZS m = BET|f0.80.97660.0471optiBETZS iter = 10.94700.0874
optiBETWS m = BET|f0.50.97660.0454optiBETWS m = BET|f0.10.94380.0926
optiBETZS iter = 40.97630.0462optiBETZS m = BET|f0.80.94270.0944
optiBETZS m = BET|f0.10.97620.0450optiBETWS m = BET|f0.50.94100.1025
optiBETKDE m = BET|f0.50.97610.0459optiBETKDE m = BET|f0.50.94090.1049
optiBETN3 iter = 40.97590.0265optiBETWS m = BET|f0.80.94090.1030
optiBETKDE m = BET|f0.10.97590.0460optiBETKDE m = BET|f0.80.94080.1052
optiBETZS m = BET|f0.50.97390.0545optiBETZS m = BET|f0.10.94080.1025
optiBETKDE m = BET|f0.80.97110.0668optiBETKDE m = BET|f0.10.94070.1057
optiBETWS m = BET|f0.10.96900.0988optiBETZS m = BET|f0.50.94040.1040
BET|BN3 iter = 10.93910.0299BET|B,f0.2,g0.3N3 iter = 40.93840.0249
BET|RN3 iter = 40.93830.0466BET|RN3 iter = 10.93430.0493
BET|BN3 iter = 40.93820.0314BET|B,f0.1N3 iter = 40.93420.0293
BET|BWS m = BET|f0.10.93680.0363BET|B,f0.2,g0.3N3 iter = 10.93330.0474
BET|RN3 iter = 10.93520.0480BET|RKDE m = BET|f0.10.93240.0458
BET|BWS m = BET|f0.80.93250.0652BET|RKDE m = BET|f0.50.93220.0460
BET|BZS m = BET|f0.80.93170.0389BET|RKDE m = BET|f0.80.93200.0464
BET|BZS m = BET|f0.10.93110.0381BET|RZS iter = 10.93180.0463
BET|B-0.93060.0403BET|RZS iter = 40.93180.0458
BET|BZS iter = 40.92940.0409BET|RZS m = BET|f0.80.93170.0466
BET|BZS m = BET|f0.50.92920.0419BET|RZS m = BET|f0.10.93160.0458
BET|BZS iter = 10.92860.0405BET|RZS m = BET|f0.50.93150.0466
BET|B,f0.2,g0.3N3 iter = 10.92620.0234BET|RWS m = BET|f0.50.93150.0464
BET|B,f0.2,g0.3N3 iter = 40.92490.0256BET|RWS m = BET|f0.10.93140.0467
BET|B,f0.2,g0.3-0.92260.0330BET|R-0.93120.0467
BET|B,f0.2,g0.3ZS m = BET|f0.80.92230.0343BET|RWS m = BET|f0.80.93090.0461
BET|B,f0.2,g0.3WS m = BET|f0.10.92230.0335BET|B,f0.1N3 iter = 10.92940.0491
BET|B,f0.2,g0.3ZS m = BET|f0.50.92220.0341BET|B,f0.2,g0.3ZS iter = 40.92800.0510
BET|B,f0.2,g0.3ZS m = BET|f0.10.92210.0342BET|B,f0.2,g0.3ZS iter = 10.92740.0518
BET|B,f0.2,g0.3ZS iter = 40.92200.0340BET|RN3 iter = 40.92730.0616
BET|B,f0.2,g0.3ZS iter = 10.92180.0343BET|B,f0.1ZS iter = 40.92550.0523
BET|B,f0.2,g0.3KDE m = BET|f0.10.92070.0382BET|B,f0.1ZS iter = 10.92490.0527
BET|B,f0.2,g0.3KDE m = BET|f0.50.92060.0378BET|B,f0.2,g0.3-0.92470.0615
BET|BWS m = BET|f0.50.92050.0810BET|B,f0.2,g0.3WS m = BET|f0.10.92440.0615
BET|BKDE m = BET|f0.10.91930.0513BET|B,f0.2,g0.3ZS m = BET|f0.80.92350.0614
BET|BKDE m = BET|f0.50.91820.0519BET|B,f0.1-0.92270.0621
BET|B,f0.2,g0.3WS m = BET|f0.80.91810.0622BET|B,f0.2,g0.3WS m = BET|f0.50.92200.0693
BET|RWS m = BET|f0.50.91790.0694BET|B,f0.1WS m = BET|f0.10.92130.0620
BET|B,f0.2,g0.3KDE m = BET|f0.80.91740.0502BET|B,f0.2,g0.3ZS m = BET|f0.50.92110.0694
BET|RZS iter = 40.91580.0729BET|B,f0.2,g0.3ZS m = BET|f0.10.92070.0694
BET|RKDE m = BET|f0.10.91570.0731BET|B,f0.1ZS m = BET|f0.80.92060.0621
BET|RZS m = BET|f0.50.91560.0731BET|B,f0.2,g0.3KDE m = BET|f0.10.92030.0676
BET|RZS m = BET|f0.80.91550.0732BET|B,f0.2,g0.3KDE m = BET|f0.80.92020.0673
BET|RZS m = BET|f0.10.91550.0731BET|B,f0.1KDE m = BET|f0.10.92020.0676
BET|BKDE m = BET|f0.80.91540.0625BET|B,f0.2,g0.3KDE m = BET|f0.50.91990.0672
BET|RZS iter = 10.91540.0732BETZS m = BET|f0.80.91970.0518
BET|B,f0.2,g0.3WS m = BET|f0.50.91520.0570BETKDE m = BET|f0.80.91960.0523
BET|RKDE m = BET|f0.80.91500.0734BET|B,f0.2,g0.3WS m = BET|f0.80.91950.0709
BET|B,f0.1N3 iter = 10.91420.0280BET|B,f0.1KDE m = BET|f0.80.91950.0673
BET|R-0.91330.0768BET|B,f0.1KDE m = BET|f0.50.91950.0673
BET|RKDE m = BET|f0.50.91330.0769BETZS iter = 40.91930.0525
BET|RWS m = BET|f0.80.91320.0793BETKDE m = BET|f0.10.91930.0527
BET|RWS m = BET|f0.10.91310.0771BET-0.91930.0531
BET|B,f0.1N3 iter = 40.91220.0301BETKDE m = BET|f0.50.91930.0534
BET|B,f0.1ZS m = BET|f0.80.91210.0339BETZS iter = 10.91910.0524
BET|B,f0.1-0.91210.0339BETWS m = BET|f0.80.91900.0538
BET|B,f0.1KDE m = BET|f0.50.91210.0369BETZS m = BET|f0.10.91900.0522
BET|B,f0.1ZS m = BET|f0.50.91200.0344BET|B,f0.1WS m = BET|f0.50.91880.0696
BET|B,f0.1KDE m = BET|f0.10.91200.0372BETWS m = BET|f0.50.91880.0536
BET|B,f0.1ZS iter = 40.91190.0339BETWS m = BET|f0.10.91870.0535
BET|B,f0.1ZS iter = 10.91180.0348BET|B,f0.1ZS m = BET|f0.10.91860.0700
BET|B,f0.1ZS m = BET|f0.10.91170.0350BET|B,f0.1ZS m = BET|f0.50.91840.0700
BET|B,f0.1WS m = BET|f0.10.91130.0348BETZS m = BET|f0.50.91840.0537
BETN3 iter = 40.90970.0639BETN3 iter = 10.91810.0549
BET|B,f0.1KDE m = BET|f0.80.90900.0485BET|B,f0.1WS m = BET|f0.80.91590.0710
BETN3 iter = 10.90750.0653BET|g-0.3KDE m = BET|f0.10.90510.0672
BET|B,f0.1WS m = BET|f0.80.90730.0620BET|g-0.3-0.90500.0672
BET|B,f0.1WS m = BET|f0.50.90520.0533BET|g-0.3KDE m = BET|f0.50.90480.0678
BET|g-0.3N3 iter = 40.90290.0537BET|g-0.3ZS iter = 40.90420.0680
BET|g-0.3N3 iter = 10.90250.0560BET|g-0.3ZS m = BET|f0.10.90420.0683
BETWS m = BET|f0.50.90000.0711BET|g-0.3WS m = BET|f0.50.90400.0682
BET|g-0.3KDE m = BET|f0.50.89910.0527BET|g-0.3ZS m = BET|f0.80.90400.0685
BET|g-0.3ZS m = BET|f0.80.89900.0527BET|g-0.3ZS iter = 10.90390.0683
BET|g-0.3ZS iter = 10.89900.0530BET|g-0.3ZS m = BET|f0.50.90380.0678
BET|g-0.3WS m = BET|f0.80.89890.0530BET|g-0.3WS m = BET|f0.10.90310.0698
BET|g-0.3WS m = BET|f0.10.89890.0528BET|g-0.3N3 iter = 10.90200.0654
BET|g-0.3-0.89880.0538BET|g-0.3WS m = BET|f0.80.90110.0691
BET|g-0.3ZS iter = 40.89870.0536BETN3 iter = 40.89800.0793
BET|g-0.3ZS m = BET|f0.10.89860.0534BET|BZS iter = 10.89630.0823
BETWS m = BET|f0.80.89840.0759BET|g-0.3KDE m = BET|f0.80.89170.1263
BET|g-0.3KDE m = BET|f0.10.89840.0531BET|BWS m = BET|f0.10.89170.1156
BETZS m = BET|f0.80.89830.0766BET|BWS m = BET|f0.50.89160.1048
BETWS m = BET|f0.10.89790.0763BET|BWS m = BET|f0.80.89040.1098
BET|g-0.3ZS m = BET|f0.50.89790.0536BET|BZS iter = 40.88950.1030
BETZS iter = 10.89780.0769BET|g-0.3N3 iter = 40.88830.0736
BET-0.89780.0762BET|BN3 iter = 40.88700.1142
BETZS m = BET|f0.50.89770.0758BET|BZS m = BET|f0.80.88570.1128
BETKDE m = BET|f0.50.89770.0769BET|BZS m = BET|f0.50.88440.1073
BET|g-0.3KDE m = BET|f0.80.89760.0544BET|BN3 iter = 10.88150.1148
BETZS iter = 40.89760.0767BET|BZS m = BET|f0.10.88110.1076
BETZS m = BET|f0.10.89750.0755BET|B-0.87240.1211
BETKDE m = BET|f0.10.89710.0766BET|BKDE m = BET|f0.50.86090.1182
BET|g-0.3WS m = BET|f0.50.89700.0533BET|BKDE m = BET|f0.10.86090.1207
BETKDE m = BET|f0.80.89640.0769BET|BKDE m = BET|f0.80.86040.1174
BET|f0.2WS m = BET|f0.50.77760.1711BET|f0.2ZS iter = 40.83610.1394
BET|f0.2WS m = BET|f0.80.77320.1702BET|f0.2KDE m = BET|f0.10.83610.1397
BET|f0.2KDE m = BET|f0.50.77320.1704BET|f0.2-0.83610.1398
BET|f0.2WS m = BET|f0.10.77300.1704BET|f0.2KDE m = BET|f0.80.83590.1398
BET|f0.2ZS iter = 40.77300.1703BET|f0.2WS m = BET|f0.10.83530.1400
BET|f0.2ZS iter = 10.77290.1705BET|f0.2WS m = BET|f0.80.83520.1398
BET|f0.2-0.77270.1709BET|f0.2ZS m = BET|f0.80.83480.1406
BET|f0.2KDE m = BET|f0.10.77260.1707BET|f0.2KDE m = BET|f0.50.83460.1412
BET|f0.2ZS m = BET|f0.80.77240.1709BET|f0.2ZS m = BET|f0.10.83450.1410
BET|f0.2ZS m = BET|f0.50.77170.1715BET|f0.2ZS m = BET|f0.50.83440.1420
BET|f0.2KDE m = BET|f0.80.77150.1696BET|f0.2ZS iter = 10.83410.1421
BET|f0.2ZS m = BET|f0.10.77040.1719BET|f0.2WS m = BET|f0.50.83410.1411
BET|f0.2N3 iter = 10.76990.1724BET|f0.8KDE m = BET|f0.80.83330.0999
BET|f0.2N3 iter = 40.76180.1700BET|f0.8WS m = BET|f0.10.83330.0995
BET|f0.8WS m = BET|f0.80.75360.1135BET|f0.8KDE m = BET|f0.10.83320.1001
BET|f0.8ZS m = BET|f0.10.75360.1136BET|f0.8-0.83320.1001
BET|f0.8ZS iter = 10.75320.1138BET|f0.8ZS m = BET|f0.50.83310.0997
BET|f0.8-0.75310.1138BET|f0.8KDE m = BET|f0.50.83310.1000
BET|f0.8ZS iter = 40.75310.1142BET|f0.8ZS m = BET|f0.80.83300.1002
BET|f0.8KDE m = BET|f0.50.75290.1146BET|f0.8WS m = BET|f0.80.83300.1002
BET|f0.8KDE m = BET|f0.10.75290.1146BET|f0.8ZS m = BET|f0.10.83290.1002
BET|f0.8WS m = BET|f0.10.75290.1145BET|f0.8WS m = BET|f0.50.83290.1003
BET|f0.8ZS m = BET|f0.80.75280.1144BET|f0.8ZS iter = 10.83270.1003
BET|f0.8ZS m = BET|f0.50.75280.1146BET|f0.8ZS iter = 40.83270.1002
BET|f0.8KDE m = BET|f0.80.74950.1181BET|g0.3KDE m = BET|f0.80.82370.1029
BET|g0.3WS m = BET|f0.50.74460.1794BET|g0.3KDE m = BET|f0.50.82360.1028
BET|g0.3ZS m = BET|f0.10.74320.1819BET|g0.3KDE m = BET|f0.10.82350.1032
BET|g0.3-0.74300.1822BET|g0.3ZS m = BET|f0.10.82340.1032
BET|g0.3ZS iter = 10.74290.1821BET|g0.3-0.82330.1032
BET|g0.3KDE m = BET|f0.10.74290.1823BET|g0.3ZS iter = 40.82320.1033
BET|g0.3ZS m = BET|f0.80.74270.1824BET|g0.3WS m = BET|f0.10.82310.1032
BET|g0.3WS m = BET|f0.10.74250.1822BET|g0.3ZS iter = 10.82310.1032
BET|g0.3WS m = BET|f0.80.74250.1824BET|g0.3ZS m = BET|f0.50.82300.1034
BET|g0.3ZS m = BET|f0.50.74250.1826BET|g0.3WS m = BET|f0.50.82300.1048
BET|g0.3ZS iter = 40.74210.1829BET|g0.3ZS m = BET|f0.80.82270.1048
BET|g0.3KDE m = BET|f0.50.74190.1831BET|g0.3WS m = BET|f0.80.82130.1046
BET|g0.3KDE m = BET|f0.80.74140.1818BET|f0.2N3 iter = 10.82080.1508
BET|f0.8WS m = BET|f0.50.74010.1229BET|f0.8N3 iter = 10.81940.1049
BET|g0.3N3 iter = 10.73950.1810BET|g0.3N3 iter = 10.80940.1158
BET|f0.8N3 iter = 10.73750.1203BET|f0.8N3 iter = 40.78880.1093
BET|f0.8N3 iter = 40.72830.1145BET|f0.2N3 iter = 40.77940.1773
BET|g0.3N3 iter = 40.72650.1782BET|f0.2,g0.3WS m = BET|f0.80.76720.1780
BET|f0.2,g0.3WS m = BET|f0.50.71280.1612BET|f0.2,g0.3WS m = BET|f0.50.76700.1761
BET|f0.2,g0.3KDE m = BET|f0.80.70770.1545BET|f0.2,g0.3-0.76690.1770
BET|f0.2,g0.3ZS iter = 40.70740.1552BET|f0.2,g0.3KDE m = BET|f0.80.76630.1765
BET|f0.2,g0.3KDE m = BET|f0.50.70590.1565BET|f0.2,g0.3KDE m = BET|f0.50.76600.1773
BET|f0.2,g0.3ZS m = BET|f0.10.70570.1562BET|f0.2,g0.3ZS iter = 40.76580.1773
BET|f0.2,g0.3WS m = BET|f0.10.70570.1560BET|f0.2,g0.3KDE m = BET|f0.10.76570.1768
BET|f0.2,g0.3ZS m = BET|f0.80.70540.1562BET|f0.2,g0.3ZS m = BET|f0.10.76540.1772
BET|f0.2,g0.3ZS iter = 10.70450.1560BET|f0.2,g0.3WS m = BET|f0.10.76530.1777
BET|f0.2,g0.3WS m = BET|f0.80.70430.1567BET|f0.2,g0.3ZS m = BET|f0.80.76510.1775
BET|f0.2,g0.3-0.70420.1560BET|f0.2,g0.3ZS iter = 10.76450.1774
BET|f0.2,g0.3ZS m = BET|f0.50.70420.1561BET|f0.2,g0.3ZS m = BET|f0.50.76320.1784
BET|f0.2,g0.3KDE m = BET|f0.10.70340.1562BET|g0.3N3 iter = 40.76310.1424
BET|f0.2,g0.3N3 iter = 10.70270.1523BET|f0.2,g0.3N3 iter = 10.74210.1943
BET|f0.2,g0.3N3 iter = 40.69480.1470BET|f0.2,g0.3N3 iter = 40.69200.2104
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Carbone, P.; Alba, C.; Bennett, A.; Kriukova, K.; Duncan, D. Optimizing Automated Brain Extraction for Moderate to Severe Traumatic Brain Injury Patients: The Role of Intensity Normalization and Bias-Field Correction. Algorithms 2024, 17, 281. https://doi.org/10.3390/a17070281

AMA Style

Carbone P, Alba C, Bennett A, Kriukova K, Duncan D. Optimizing Automated Brain Extraction for Moderate to Severe Traumatic Brain Injury Patients: The Role of Intensity Normalization and Bias-Field Correction. Algorithms. 2024; 17(7):281. https://doi.org/10.3390/a17070281

Chicago/Turabian Style

Carbone, Patrick, Celina Alba, Alexis Bennett, Kseniia Kriukova, and Dominique Duncan. 2024. "Optimizing Automated Brain Extraction for Moderate to Severe Traumatic Brain Injury Patients: The Role of Intensity Normalization and Bias-Field Correction" Algorithms 17, no. 7: 281. https://doi.org/10.3390/a17070281

APA Style

Carbone, P., Alba, C., Bennett, A., Kriukova, K., & Duncan, D. (2024). Optimizing Automated Brain Extraction for Moderate to Severe Traumatic Brain Injury Patients: The Role of Intensity Normalization and Bias-Field Correction. Algorithms, 17(7), 281. https://doi.org/10.3390/a17070281

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop