Next Article in Journal
Grade Progression and Intrapatient Tumor Heterogeneity as Potential Contributors to Resistance in Gastroenteropancreatic Neuroendocrine Tumors
Next Article in Special Issue
Tracking Therapy Response in Glioblastoma Using 1D Convolutional Neural Networks
Previous Article in Journal
Current Challenges and Future Advances in Lung Cancer: Genetics, Instrumental Diagnosis and Treatment
Previous Article in Special Issue
Clinical Decision Support Systems for Brain Tumour Diagnosis and Prognosis: A Systematic Review
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Using Single-Voxel Magnetic Resonance Spectroscopy Data Acquired at 1.5T to Classify Multivoxel Data at 3T: A Proof-of-Concept Study

1
Centro de Investigación Biomédica en Red (CIBER), 28029 Madrid, Spain
2
Departament de Bioquímica i Biologia Molecular and Institut de Biotecnologia i Biomedicina (IBB), Universitat Autònoma de Barcelona (UAB), 08193 Barcelona, Spain
3
Group de Neuro-Oncologia, Institut d’Investigació Biomèdica de Bellvitge (IDIBELL), Hospital Universitari de Bellvitge, 08908 Barcelona, Spain
4
IDEAI-UPC Research Center, UPC BarcelonaTech, 08034 Barcelona, Spain
*
Author to whom correspondence should be addressed.
Cancers 2023, 15(14), 3709; https://doi.org/10.3390/cancers15143709
Submission received: 22 April 2023 / Revised: 26 June 2023 / Accepted: 13 July 2023 / Published: 21 July 2023
(This article belongs to the Special Issue Decision-Support Systems for Cancer Diagnosis and Prognosis)

Abstract

:

Simple Summary

One of the main applications of in vivo magnetic resonance spectroscopy (MRS) is in the non-invasive monitoring of the metabolic pattern of brain tumors. MRS comes in two basic modalities, single-voxel (SV), from which the signal is obtained, and multivoxel (MV), in which one or more contiguous grids of SVs are acquired. The purpose of our proof-of-concept study was to test whether it would be possible to train machine learning models using SV data at 1.5T, and test them with MV 3T data from independent patients, obtaining color-coded images of pathology (nosological images) to help radiologists in their preoperative evaluation of patients. With sequential forward feature selection followed by linear discriminant analysis, we obtained AUCs = 0.95 (meningioma), 0.89 (aggressive), 0.82 (low-grade glioma), and 0.82 (normal brain) in the MV test set.

Abstract

In vivo magnetic resonance spectroscopy (MRS) has two modalities, single-voxel (SV) and multivoxel (MV), in which one or more contiguous grids of SVs are acquired. Purpose: To test whether MV grids can be classified with models trained with SV. Methods: Retrospective study. Training dataset: Multicenter multiformat SV INTERPRET, 1.5T. Testing dataset: MV eTumour, 3T. Two classification tasks were completed: 3-class (meningioma vs. aggressive vs. normal) and 4-class (meningioma vs. low-grade glioma vs. aggressive vs. normal). Five different methods were tested for feature selection. The classification was implemented using linear discriminant analysis (LDA), random forest, and support vector machines. The evaluation was completed with balanced error rate (BER) and area under the curve (AUC) on both sets. The accuracy in class prediction was calculated by developing a solid tumor index (STI) and segmentation accuracy with the Dice score. Results: The best method was sequential forward feature selection combined with LDA, with AUCs = 0.95 (meningioma), 0.89 (aggressive), 0.82 (low-grade glioma), and 0.82 (normal). STI was 66% (4-class task) and 71% (3-class task) because two cases failed completely and two more had suboptimal STI as defined by us. Discussion: The reasons for failure in the classification of the MV test set were related to the presence of artifacts.

Graphical Abstract

1. Introduction

In vivo magnetic resonance spectroscopy (MRS) can non-invasively capture biochemical information from free metabolites in the millimolar (mM) range of concentration from living organisms such as humans. It does not use ionizing radiation and the only inconveniences for patients, at the magnetic fields normally used in the clinic (1.5T or 3T), are possible claustrophobia and the long acquisition times inside a noisy scanner. MRS comes in two main modalities, single-voxel (SV) and multivoxel (MV). In SV, one volume (basically a cube with edges of 1–2 cm) is excited to obtain the signal from the MR-visible metabolites. In MV, one or more grids of contiguous SVs are acquired. MV is also known as “spectroscopic imaging” or, sometimes, as chemical shift imaging (CSI).
The MRS technique has been used for about 30 years and is still considered to be a promising one, but clinicians scarcely use it in their daily practice. Reasons for this are mainly related to the lack of a “killer app” that offers a distinctive advantage over alternatives. MRS is best suited for magnetically homogeneous tissues, such as brain tissue, and indeed a great deal of MRS applications concern brain diseases. In brain tumors, for example, the spectral pattern undergoes drastic changes depending on the tumor type and grade [1]; therefore, it has been the target for landmark studies that have shown its value in terms of prediction of type [2,3,4], infiltration [5,6,7,8], or relationship of the pattern with prognosis [9,10,11]. Despite this, clinicians still struggle with the export of MRS data from scanners, while scientists struggle with the access to data and hidden proprietary DICOM tags, as data sharing has never been customary in the MRS area. Only recently has the MRS community engaged in efforts to establish a consensus for acquisition, processing parameters and reporting [12,13,14,15], or to share datasets through the recently created MRShub platform [16]. Other factors influencing the advancement of applications based on in vivo MRS are related to the progress of the technique itself, in terms of technical capabilities, the increase in magnetic field that allows for better resolution, and the development of improved sequences, such as semi-Laser [12,17], which provide better data quality. In the early period of MRS, a magnetic field of 1.5T was the norm, while nowadays the clinical routine involves 3T scanners in many centers, with 7T scanners becoming more and more common in top institutions. Apparently, such heterogeneity is not a problem, because MRS data are not routinely shared. This creates a difficult challenge: how do we train machine learning models to analyze these data, if it will take years to recruit the necessary patients to feed data into prediction models? Should we throw away all the previous data and knowledge gained throughout the years with SV acquired at lower fields? Recently, deep learning has begun to be used in MRS to develop automated quality control procedures to detect artifactual patterns in MRS. As deep learning is very data-intensive and there are no easily accessible MRS datasets with a sufficient amount of data to appropriately train these models, one frequent solution has been to resort to synthetically generated sets [18,19,20].
The work we present here is a proof of concept for the feasibility of stored MRS data reuse for machine learning, as applied to brain tumor diagnosis. Our hypothesis is that it is possible to train machine learning models using 20–30-year-old 1.5T SV data and apply the best model to classify and color-code these data in the form of nosological images’ “not-so-old” MV data (from 2006 to 2009) to achieve metabolic-based segmentations of the most common brain tumor types that match the solid tumor region and identify whether the tumor is infiltrative or not.
For this, we have used retrospective, multicenter curated MRS data from the largest existing SV database to train a machine learning model that will help us classify new MV data. Each voxel in each MV (single- or multi-slice) will be classified and assigned a color according to the probability of belonging to each of the classes of our classifier (e.g., normal brain in blue, malignant tumors in red, etc.). Then, a color-coded image of the limits of the tumor, as well as the tumor type, will be generated, just as a mosaic image is the aggregate result of thousands of tiles of different colors.
We will demonstrate that this is indeed possible, not only using multicenter SV data to train and to test MV data, but also changing the magnetic field, as the SV were acquired at 1.5T, whereas the MV that we used were acquired at 3T, and with a different sequence (PRESS and STEAM for SV and semi-Laser for MV) and at a different clinical center. We will also show that, when our classifier failed on the MV data, it was due to the presence of artifacts.
This work has been possible with the reuse of two databases that our research group has been curating after the end of the funding period, namely the INTERPRET and the eTUMOUR databases.
INTERPRET was a European multicenter study carried out twenty years ago (IST-1999-10310, from January 2000 to December 2002) that collected MRS data from eight magnetic resonance centers in five countries [21,22]: CDP (Centre Diagnòstic Pedralbes-CETIR, Units: Pedralbes, Barcelona and Esplugues del Llobregat, Spain), IDI (Institut de Diagnòstic per la Imatge-Unitat Bellvitge, L’Hospitalet del Llobregat, Spain), SGUL (St George’s University of London, United Kingdom), UMCN (Universitair Medisch Centrum Nijmegen, The Netherlands), UJF (Unité Mixte Université Joseph Fourier/INSERM U594, Grenoble, France), FLENI (Fundación para la Lucha contra las Enfermedades Neurológicas de la Infancia, Buenos Aires, Argentina), and MUL (Uniwersytet Medycznyw Lodzi, Lodz, Poland). The second database was obtained from the eTUMOUR project (Web Accessible MR Decision Support System for Brain Tumour Diagnosis and Prognosis, incorporating in vivo and ex vivo Genomic and Metabolomic Data), an EU-funded effort (FP6-2002-LIFESCIHEALTH 503094), carried out in the 2004–2009 period, that involved 21 partners across Europe and Argentina. One of its results was the eTumour database (eTDB) [23].

2. Materials and Methods

A summary figure of the pipeline used in the methodology is displayed in Figure 1.

2.1. Datasets

The study was retrospective. Two short TE datasets were used, one for SV and one for MV. The SV one was the INTERPRET-validated dataset. For the current study, we used the short TE dataset only from the so-called INTERPRET-validated database [21,22,24], which is composed of 304 single-voxel (SV) spectra acquired from three different brands of 1.5T MR scanners, namely GE Signa Advantage and LX CV/i 1.5T, Philips NT and ACS NT 1.5T, and Siemens Vision 1.5T, from the most common tumor types and from 22 normal volunteers, as has been described previously [21,22,24]. Each spectrum belonged to one patient, and was validated at multiple levels, ensuring that the spectral quality was good, that each spectrum had been acquired from the cellular part of the tumor avoiding cysts or edematous regions and from the same region where the diagnostic biopsy sample had been taken, and that the histopathological diagnosis had been agreed upon among a panel of expert pathologists. All studies were performed in accordance with the medical ethics and regulations of the countries concerned and all patients or their legal representatives signed informed consent forms, agreeing to the study or the use of anonymized data for research. This dataset had been acquired between the years 2000–2002; therefore, the version of the histopathological classification used by pathologists was the reference one at the time, namely the WHO classification of brain tumors of the year 2000 [25,26]. This dataset has been extensively used in independent studies during the last 20 years, for machine learning applications to MRS (e.g., in [24,27,28,29,30,31,32,33,34,35,36]). Table 1 summarizes the acquisition conditions for the SV dataset. For the current study, only the short TE data from the INTERPRET database are used.
In the in vivo MRS field, it is necessary to process the raw data in the time domain as it comes from the MR scanner. Steps involve applying signal processing algorithms such as the Fourier transform to convert the signal into the frequency domain, water signal suppression, and phasing and/or apodization, which are among the most common steps [12,37]. The processing tool and parameters used for this work were those used in the INTERPRET project and the Data Manipulation Software (DMS) [21,24,38,39], which provides a 512-point spectrum in the [−2.7, 7.1] ppm frequency interval, normalized to unit length (UL2), and with the [4.2, 5.1] ppm region zeroed so that any remnant unsuppressed water does not interfere with the UL2 peak heights of the relevant metabolite signals. Otherwise, the INTERPRET parameters involved water suppression with Hankel Lanczos Singular Value Decomposition (HLSVD) using 10 Lorentzians in the [4.31, 5.11] ppm region. This specific parametrization has the advantage of unifying different spectral ranges and number of points found from slightly different acquisition conditions [12], in particular during the late 1990s and early 2000s, in which the DICOM standard did not exist for MRS data. The so-called 1.5T SV short TE dataset, then, was processed exactly using the INTERPRET parameters with manual realignment. This exact data matrix has been used in several studies [24,27,36] and in all versions of the INTERPRET decision support system [39]. The SV data were converted into XML files using SpectraClassifier version 1.0 [28].
The 304 spectra data matrix contains 35 low-grade glial tumors (lgg) comprising 22 astrocytomas (a2), 6 oligoastrocytomas (oa), and 7 oligodendrogliomas (od) of WHO 2000 Grade II; 123 aggressive tumors (agg) comprising 85 glioblastoma (gb), 38 metastasis (me), and 62 low-grade meningiomas (mm), including WHO 2000 Grades I and II. The rest of the cases in the dataset correspond to 22 normal (no) volunteers (normal-appearing white matter, NAWM), 10 malignant brain lymphomas (ly), 8 abscesses (ab), and 44 other cases from 17 different pathologies and/or grades.
eTDB: The eTUMOUR data used for this study are multivoxel (MV). Since no previously processed MV data matrix from the eTDB exists, the database was queried with the following inclusion criteria:
  • The MV is stored as a valid experiment in the eTDB (not marked as test case).
  • Acquisition was done using PRESS or semi-Laser sequences.
  • Echo time (TE) is short TE (30–32 ms).
  • The diagnosis of the case is mm, gb, me, lgg (a2, od or oa).
  • The MRI study must be fully loaded into the eTDB, i.e., the whole set of images must be uploaded; therefore, the number of MRI slices could not be lower than the number of MRS slices.
  • For multi-slice MV acquisitions, the number of MRS slices had to be the same as the available MRI slices.
  • The data format should allow for the extraction of the parameters for MV grid localization over the corresponding MRI slice.
MV data fulfilling the inclusion criteria were downloaded and processed in the same way as the SV data, as it was crucial for this work to have the MV data processed in the same way, with the same normalization, spectral range, and number of points. To this end, processing was completed using the jMRUI2XML [40] plugin of jMRUI version 6.0 [41], which can output data exactly in the same format as the SV INTERPRET processed the data. For this, the plugin was run with the INTERPRET parameters, except that the order of priority in the alignment correction was 2.01 ppm first, then 3.21 ppm, and then 3.03 ppm. Given that, at the time of processing, it was noticed that MV grids had individual spectra that were flipped downwards (requiring 180 degree zero order correction), the person processing the data (GU) also performed an additional phase correction with the jMRUI menu on each individual spectrum that was visually observed to be flipped down before exporting. After performing these final corrections, each grid composed of n x m 512-point spectra on the [−2.7, 7.1] ppm range were exported as XML files with the above-mentioned jMRUI plugin.
Both SV and MV data were processed offline with Excel (version 2021) to only extract the [0, 4.2] ppm range, to account for the remaining effects of the incomplete water suppression processing pipeline, and to renormalize UL2 in that range and re-export it as XML for all classification experiments.

2.2. MRI Processing of the eTDB Data

From the available reference MR images of the eTDB cases, patches corresponding to the same location as the MV grid were extracted using Gannet [42], obtaining one MRI patch per MV slice.
These patches were used for two different purposes: first, to label the anatomical regions detected such as ventricles, oedema, cysts, and unaffected brain tissue; second, to overlay the nosological images (the color maps obtained after classification of each individual voxel) onto the anatomical patches.

2.3. MV Voxel Labelling

The multivoxel grid was co-registered to morphological MR images for each patient. Then, a neuroradiologist with 10 years of experience in neuro-oncology (A.P.) classified each individual voxel as: solid tumor region, abnormal tumor region (oedema or cysts), normal tissue, or ventricles. This voxel classification was carried out manually and was based on the expert neuroradiological evaluation of the underlying T2WI, FLAIR, or CE-T1WI available for each patient. The voxels labelled as ventricle were excluded from the analysis.

2.4. Quality Control

SV data were considered as good quality because the data matrix was the same one that had been used in multiple previous studies, with the spectra having passed all the quality controls that have already been mentioned. Therefore, no additional quality control steps were applied.
MV-processed data still contained a variety of artifacts, such as low signal-to-noise (SNR) ratio, flipped-down spectra, or poor water suppression. Individual spectra with SNR values lower than 10 in the [−2.7, 7.1] ppm range were discarded. Afterwards, an approach based on extracting artifactual patterns using convex non-negative matrix factorization (cNMF) was applied [43]. We extracted from 2 to 5 sources to identify artifactual patterns, and if the highest contribution was from an artifactual pattern, then the individual spectrum was discarded from the analysis.

2.5. Classification Tasks

Classifiers were trained with the SV data (training set) and tested with the MV data (test set). Two classification tasks were performed:
  • 4-class task: mm vs. lgg vs. agg vs. no
  • 3-class task: mm vs. agg vs. no.

2.6. Feature Selection

Feature selection was performed on the SV data. Five different algorithms from three different methods were used to extract from 3 to 20 features:
  • Filter methods: Chi [44].
  • Wrapper methods: Sequential Forward Feature Selection (SFFS) [45], Boruta Feature Selection [46], and Select k-best [47].
  • Embedded methods: Lasso Feature Selection [48].
For each feature selection algorithm, mutually correlated features were discarded using Pearson’s correlation [49], with the additional criterion of discarding the left (higher ppm value) feature if the correlation between the left and the right features was >80%. For Boruta feature selection, we applied Pearson’s correlation with different threshold values as 50%, 60%, 70%, 80%, and 90%.
Shapley values were used to explain the global importance of each feature in the model and were calculated for LDA by using the Shap library [50].

2.7. Classification

The following classification methods were used: Linear Discriminant Analysis (LDA) as implemented in SpectraClassifier [28], Random Forest (RF) [51], and Support Vector Machines (SVM) [52] implemented in Python version 3.7.9.

2.8. Classifier Evaluation

Classifier evaluation was completed on the training and test sets. Each classification process was repeated 1000 times with bootstrapping on the training data set. Balanced error rate (BER) and area under the ROC curve (AUC) were calculated for the training and test sets. The test set validation was completed using the MV spectra from the solid tumor and the normal regions because the class labels (the tumor type) were the same as in the training set. The solid tumor regions of the MV set corresponded to the SV solid tumor regions. The normal regions of the MV dataset corresponded to the no class in the SV training set—these SV were acquired over the white matter of normal volunteers.
The criteria for choosing the best classifier were that the AUCtrain and the AUCtest should be as close to 1 as possible, and that the AUCtest/AUCtrain ratio should be closest to 1. Furthermore, the BER, BERtrain, and BERtest values should be as close to 0 as possible, while the BERtest/BERtrain ratio should be closest to 1.

2.9. Visualization of the Test Set Classification: Nosological Maps

After obtaining the best classifier, we used it to obtain the nosological images of each MV case with the SpectraClassifier 3.0 tool [28]. Briefly, SpectraClassifier MV tab plots each individual voxel in a color chosen by the user, whose intensity represents the probability of the winning class. The colors chosen for each of the classes were: blue for normal brain (no), red for the aggressive class (gb and me), green for the lgg, and yellow for mm. A Power-BI tool was implemented for the nosological image representation. The excluded voxels were shown as black voxels with 0.5 transparency. As mentioned previously, two types of voxels were excluded: those that were in the ventricle areas as marked by the radiologist, and the ones discarded after cNMF analysis for being artifactual. A third step for nosological image display and analysis was taken, in which the SNR <10 spectra were also excluded.

2.10. Nosological Image Evaluation

The following aspects were evaluated:
  • Whether the class of the solid tumor region corresponded to the diagnosis of the patient.
  • Whether the localization of the solid tumor region agreed with the MRI segmentation performed by the radiologist.
  • Whether it agreed with the MRI segmentation (in cases where the radiologist marked a surrounding, abnormal area).
The evaluation measures were: BER for each grid and AUC for each class of each grid. It was noted that, for patients with a multi-slice acquisition, each grid had a different distribution of classes according to the radiologist’s segmentations. The Dice score was also calculated for each class of each grid, to see how well MV segmentation matched the radiologist’s segmentations.
The accuracy in the prediction of the class of the solid tumor region was computed for the test set using AUC and with the following Solid Tumor Index (STI):
STI = number   of   correctly   classified   voxels total   number   of   voxels   in   the   solid   tumor   region     excluded   voxels   by   low   quality

3. Results

3.1. Available Data

A total of 85 cases in the eTDB fulfilled inclusion criteria 1–4 (valid experiment, PRESS or similar, short echo time, and belonging to the tumor classes). Applying criterion 5, there were 44 cases. Applying 6 and 7 resulted in a final set of 17 usable cases (Supplementary Materials A). There were 4 mm, 8 gb, 2 me, 1 lgg, and 2 anaplastic glial (oligodendroglioma and oligoastrocytoma) (Supplementary Materials A). Then, the total number of cases used for the classification tasks was 15 (4-class task) and 14 (3-class task) as the anaplastic intermediate malignancy grades (WHO Grade III in the 2000 and 2007 classifications) do not belong to any of the classes of the tasks that we established.
Causes for the exclusion of cases were mainly due to the old formats of data, e.g., 3 cases from Universidad de Valencia were in Philips old Gyroscan format (SDAT/SPAR), in which the grid localization was not possible with the available parameters and current software programs; 29 cases from St. Georges University of London (SGUL) with GE format Probe 8x or SAGE IDL whose parameters could not be read for co-registration; 1 case from Medizinicz Lodz that did not have a companion MRI; and 2 cases from University Center Nijmegen (UMCN) and 5 cases from Cambridge University that, although they were in Siemens Numaris 4 RDA format, had an uneven number of MRI slices with respect to the number of MV slices in the eTDB. A final set of 17 cases from UMCN were included in the study, of which the most prominent characteristics were that they had been acquired using the semi-Laser sequence [53,54] at a TE of 30 ms on a 3T scanner. The rest of relevant characteristics are shown in Table 2. In total, 6 of the 17 cases were multi-slice with a z dimension = 8, with a range of four different VOI geometries, while the other 11 were single-slice, with a range of 10 different VOI dimensions, from 18 to 25 for the x dimension and 14 to 24 for the y dimension (Table 2 and Supplementary Materials A).
In total, 59 MV slices were included in the analysis, containing 8452 individual voxels inside the VOI, of which 812 (2.5%) were discarded by the radiologist because they were placed inside the brain ventricles, making a final total of 7640 voxels available for further analysis.
All 17 cases (including the two anaplastic ones) were used for the visualization with nosological images.
With respect to the QC procedure, Figure 2 shows the sources obtained after performing cNMF. Source 1 represents a typical necrotic pattern, with high lipids at 0.9 and 1.28 ppm; source 3 represents a typical normal brain pattern, with NAA-containing compounds at 2.01 ppm being the highest peak; and source 5 can be considered partly artifactual (high baseline and inverted peaks around 1.5 ppm, presumably due to low homogeneity or other causes, but still interpretable, with a low 2.01 ppm peak, attributable to areas of neuronal loss). The other two sources (2 and 4) were considered artifactual by the expert spectroscopists (CA and MJS). As can be observed, the so-called sources 2 and 4 correspond to flipped-down spectra. The explanation for finding this type of artifact was that the member of the team conducting the visual inspection of the 8452 spectra, the class labelling, and the manual correction of the flipped-down spectra (GU) missed part of them due to eyestrain. Therefore, an important proportion of the flipped-down spectra were still present in the testing dataset. Nevertheless, the team decided to be conservative and only exclude the clearly flipped down spectra, which was when the winning source contribution was either number 2 or number 4. From the 7640 spectra inside the VOI, but not on ventricles, the winning source was number 1 in 1245, number 2 in 273, number 3 in 3685, number 4 in 623, and number 5 in 1814 spectra; therefore, 896 individual spectra were discarded through this procedure. The quality control procedure discarded entire slices from the multi-slice cases.

3.2. Feature Selection and Classification Results

For both classification tasks, the best results were obtained with the combination of SFFS and LDA (Table 3 and Table 4), therefore we used these results for nosological image visualization.
Regarding the performance of the different feature selection and classification methodologies, as expected, the BER for the MV test set was higher than for the SV training set.
For the 4-class task (Table 3), all methods performed similarly in the training set, except Chi feature selection with any classification method (mean BER ranging from 0.21 to 0.33). Chi failed particularly between six and eight features; also, SFFS combined with RF, the worst classifier with six features. K-best also did not perform well at a low number of features (three features), combined with LDA and SVM classifiers. In the test set, the best results were obtained for LDA classification, combined with SFFS, K-best, or Boruta.
For the 3-class task (Table 4) in the SV training set, again, SFFS had the lowest performance with SVM and RF below six features. Chi also performed poorly with any classifier, particularly at five features both with the SV training and the MV test set, no matter the classification method. In the MV test set, the best combinations were again LDA with SFFS, Lasso, and Boruta, according to the maximum, minimum, and mean BER values obtained.
Therefore, given the criteria set for choosing the best classifier, the best combination was SFFS followed by LDA both for the 4-class task and the 3-class task, using eight and nine features, respectively.
In Table 5, a summary of the main classifier performance values of the chosen combination of feature selection and classifier is shown. Figure 3 and Figure 4 show the feature importance for each of the two tasks, in the SFFS/LDA combination, where the most important feature in both tasks was 2.382 ppm, which could be consistent with Glx, macromolecules, or mobile lipids.

3.3. Visualization Results

Detailed results on all the measures were taken, case by case, for each of the 49 grids, and the two classification tasks are shown in Supplementary Materials B and C.
Figure 5 displays three characteristic cases. The most relevant finding upon qualitative evaluation of the whole test set was that, for most cases, the solid tumor region belonged to the same class of the tumor the patient had. Also, in gb, the surrounding abnormal region identified by the radiologist was classified as lgg when the 4-class task was applied, and in some cases extended further (Figure 5, case et2997). When the 3-class task was applied, areas that had been classified as lgg were classified either as gb (Figure 5, case et2997) or as mm. We can explain that as follows: the classifier would predict the closest label to the data, depending on the classes it was trained to recognize. Not surprisingly, lgg predictions for the abnormal surrounding area of a gb are in line with the knowledge on this kind of tumor, which is infiltrative. In contrast, for me and mm, the edematous regions surrounding the solid tumor region are predicted as no, again in agreement with the non-infiltrative nature of these tumors. In several cases/slices, a “dual” tumor type was predicted: the already-mentioned lgg for the solid tumor surrounding areas and a second type of tumor (again, see the example in Figure 5, case et2997). The nosological image of this glioblastoma marks the upper anatomically abnormal area as mm instead of the expected lgg or even gb, both for the 4-class task and the 3-class task. As can be noted, it is not possible that the patient has a gb and a mm at the same time, and the “yellow” color is due to the misclassification of these voxels, with the classifier assigning the mm class to an infiltrating pattern not properly recognized by the gb or lgg patterns, or a region with artifactual MV data.
With respect to the aspects evaluated:
The STI index showed whether the class of the solid tumor region corresponded to the diagnosis of the patient. This was so in 66% (10 out of 15) of cases for the 4-class task and in 71.4% (10 out of 14) of cases for the 3-class task, taking a threshold of STI > 0.50 as an indication of success (Figure 6). In the 4-class task, there are three failed gb, et3038 with STI < 0.3, et3043 (multi-slice) with STI = 0, and et3403 (multi-slice) with STI = 0.5. From the four mm, two failed: et2948 with STI = 0.42 and et3109 (multi-slice), completely failing (STI = 0). The cases passing the STI threshold had a mean value of 0.89 overall. In the 3-class task, the failing cases were the same as for the 4-class task, and the mean STI of the successful cases was 0.84.
The Dice score showed whether the localization of the solid tumor region agreed with the MRI segmentation performed by the radiologist. Figure 7 shows the Dice scores for all included slices and cases, for the 4-class task and the 3-class task. As expected, the results were similar to those of the STI, but some aspects must be highlighted. Beginning with the 4-class task, the multi-slice gb et3043 and the single-slice et3038 failed (no predicted agg region matched the anatomical solid tumor region). The multi-slice et3403 gb also failed in most slices except the central one (number 4). The remaining gb had Dice values for agg that were above 0.50. The single-slice me (et3001) had an excellent Dice value for agg, while in the multi-slice me (et3115) the prediction of the solid tumor region failed in the last two slices (7 and 8). In three out of four mm, the segmentation of the solid tumor region had a Dice value > 0.50 and again the prediction of this region for the multi-slice mm et3109 failed. For the lgg, the Dice value of the solid tumor region was > 0.50. With respect to the 3-class task, the Dice values were lower for the gb and me that had good results in the 4-class task, which were higher for the multi-slice cases et3043 and et3403. As expected, in general terms, the external slices of the multi-slice cases had lower Dice scores for the solid tumor region.
The Dice scores also showed whether or not the surrounding abnormal areas agreed with the radiologist’s segmentation. This can also be examined in Figure 7 by looking at the no (blue) and the abnormal (green). Regarding the normal brain, it can be seen in the 4-class task that, in all cases, the Dice score for no (blue) was above 0.70, except for the two previously discussed multi-slice gb (et3043 and et3403), and that in the 3-class counterpart, there is a general decrease in Dice values for the normal region. With respect to the surrounding anatomically abnormal region that was identified by the radiologist, the first relevant finding was that the 4-class task captured it better than the 3-class task. This is shown graphically in Supplementary Materials B and C, case-by-case and slice-by-slice. Looking at the 4-class task in Figure 7, it can be observed that gb have variable Dice scores (green) for the peritumoral area depending on case and slice. It can be noted that the Dice scores for “green” regions are higher at the external slices (1…8) and the highest “red” Dice score is for the central slices, as expected (cases et3043 and et3403): gb normally have a necrotic core, surrounded by more infiltrative, lgg-like regions. Here, the Dice score is calculated between the anatomically abnormal region segmented by the radiologist and the area predicted as lgg-class. Therefore, it is to be expected that there is a certain degree of infiltration that is captured by the classifier in the form of lgg prediction. Interestingly, the case et3043 that failed in the solid tumor region delimitation had Dice scores ranging between 0.40 and 0.67. From the me, et3001 had a Dice score of 0.30 and et3115 had a Dice score < 0.20 in three out of eight slices. Of the three mm that were successful with STI, the Dice score for the surrounding area was even lower, as expected due to the non-infiltrative nature of these tumors, not reaching 0.10 in two out of three cases.
With respect to the failed MV test set cases, some illustrative examples are shown in Figure 8. Case et3038 is a gb located inside the ventricles. This is a poor area for obtaining good homogeneity in the magnetic field, and indeed it can be observed in the last four columns of Figure 8 that a great proportion of flipped-down spectra (clearly artifactual) are distributed among the four classes. In addition, as the lipid features (0.886 ppm and 1.289/1.270 ppm on Figure 4) do not have high relevance in the chosen model (4-class task, Figure 4, left), some necrotic lipid areas also appear classified as normal (it is also noteworthy that most blue spectra from this case have a choline/creatine ratio close to 1 and higher NAA than creatine, which is characteristic of the normal brain; therefore, these possible necrotic lipids might even be due to voxel bleeding due to the already-mentioned poor homogeneity). As for case et3043, it is noteworthy that the anatomical segmentation in slices 4, 5, and 6 is clearly different, with the main area of necrosis on slice 5, which is to be expected if the tumor is studied in the three directions of space. Therefore, even this case is a gb, and one should not expect that all the anatomical regions of the tumor are colored in red, like agg. Spectroscopically, in slices 4, 5, and 6, the blue area would be correct, with no lipids, NAA 2–3 times higher than choline and creatine, and a choline/creatine ratio of 1. The green area would also be reasonable in metabolic terms, if we assume the proliferating area surrounding the necrotic core, either with a similar pattern to the normal plus mobile lipids or again due to the voxel bleeding effect from the necrotic areas. Regarding the yellow area, it is indeed the most contradictory, as it gb cannot be a gb and an mm at the same time. However, from the spectroscopic point of view, it is noteworthy that the spectral pattern of the yellow nosological areas is visually very much like the green nosological areas, only that there is a slight difference in the macromolecule region (higher in the yellow ones), precisely covering the region where the most important feature is located (2.382 ppm, see the Shapley values in the 4-class task, Figure 4, left). In short, the mm label would simply be due to the coded voxels displaying an abnormal pattern for which the mm classifier is the closest one, with the available classifiers.
There are other very important reasons for the misclassification of some areas in the different slices that can be seen in Supplementary Materials B and C. One of the main ones is that there are spectra with a low SNR value (see, for example, eT3043 slices 1, 2, 6, and 7 for the 3-class task in Supplementary Materials and also the flat lines on the baseline, as well as the green spectra in Figure 8), as well as the already-mentioned flipped-down spectra, and other artifacts such as bad water suppression, shifted data (misaligned), and/or ghosting, as can be seen in the noisy region between 3.5–4 ppm in the overlaid spectra in the bottom row of Figure 8.

4. Discussion

In this proof-of-concept study, we have shown that it is possible to successfully apply a classifier developed on multicenter SV MRS data acquired preoperatively at 1.5T from brain tumor patients to another set of similar patients that were studied with an improved MV MRS protocol based on the semi-Laser sequence, and in some cases also with multi-slice acquisitions and also at a double strength in the magnetic field (3T). Indeed, the system is not perfect as the classification failed in specific MV cases, but we also demonstrated that the failure was mostly due to the presence of artifactual data in the MV set.
To our knowledge, this is the first study ever to attempt a SV–MV train–test machine learning experiment, although there is previous literature on the compatibility between 1.5T and 3T using machine learning techniques, only focusing on SV [34], or using MV datasets and treating them like SV data [55]. In particular, the study by Kounelakis et al. [55] is the most similar to ours, as the authors used data from 21 glioma patients from UMCN acquired with MV at 1.5T and 43 glioma patients from another hospital (LUH) with MV at 3T, using voxels in the solid tumor region. They also mention a “core 1.5T dataset” comprising 303 patients, which is very similar to the INTERPRET set, although the details are not specified. The authors made classifiers with SVM, obtaining better results for the 1.5T set than for the 3T set. They discussed the limitations of their results based on the different acquisition conditions and the low number of voxels on the LUH dataset, mainly due to the different shimming. However, there were other reasons that would have a greater influence in the classification performance, such as the data from UMCN being from a STEAM sequence at short TE (20 ms), while the LUH data were long TE (144 ms). As an example, in gliomas, the lactate doublet is inverted (flipped-down) at a TE of 144 ms, whereas at a TE of 20 ms it is pointing up, e.g., the TE is one parameter that should be compatible between different sets. Another limitation of that study was that the authors attempted a classification between different grades of glial tumors (WHO Grade II, II, and IV), and this has been known to be problematic due to the heterogeneity of the Grade III on the one hand, and on the other, due to the known differences in the histological classification of gliomas depending on the pathologist and the region sampled, before the current WHO classifications [56,57] based on genetic features. We have considered that the subsequent changes that happened in the WHO (e.g., the 2021 classification [56]) do not affect the purpose of our study, and we use these labels to distinguish among broad tumor super-classes, as will be discussed later. In our study, we did not use the two intermediate Grade III gliomas for this reason. Instead, we used a classification problem that has been successfully tested in many studies [21,24,38], i.e., the agg vs. lgg vs. mm distinction, to which we added the no class, which can also be distinguished without problems [29,35]. Another work with more traceable data is one that focused on SV data [34], taking the same INTERPRET dataset that we used for training and an eTDB SV dataset for testing. Fuster-García et al. in [34] trained classifiers on the bilateral task of agg vs. lgg, using SV data from the INTERPRET project, and tested them with a set of 37 SV spectra acquired with two different scanners from two centers: 21 of them were acquired with a GE Signa 3T with a TR of 2000–5000 ms, a TE of 30 ms, an SW of 1000 Hz, and 2048 data points, and the other 16 spectra were acquired with a Philips 3T scanner using a TR of 1800–2000 ms, a TE of 32ms, a spectral width of 2000 Hz, and 1024 data points. In [34], the processing procedure was also the same as that of our study. The feature selection methods were SFFS and peak integration. The classifiers were LDA, k-nearest neighbors (KNN), and artificial neural networks (ANN). Average test accuracies in the ranges of 86–87% were found, which are comparable to our reported AUCs.
Other studies using SV MRS at 3T report results in the same range as ours. For example, Zarinabad et al. [58] report balanced accuracy rates (BAR) of 0.81 with LDA, 0.86 with SVM, and 0.89 with RF on a cohort of 41 child brain tumors, SV MRS at 3T, after 100 runs of over-sampling. It is noteworthy that BAR= 1-BER and the cohort size is ca. 1/6 of ours. Also, in children brain tumors, Zhao et al. [59] report a maximum performance achieved with LOO cross-validation of BAR = 0.85 at 1.5T with 116 SV from three different child tumor cases using SVM and a BAR = 0.75 at 3T with 73 child tumor cases, using LDA after over-sampling the minority class.
Another study by Tsolakis et al. [60] using the combination of data acquired at 3T with MV PRESS and DSC-MR from 35 gb and 14 me patients, achieved 0.98 accuracy for the peritumoral area using the NAA/ Cr ratio and rCBV followed by Naïve Bayes.
Pedrosa de Barros et al. [61] conducted a study on 41 training (7624 spectra) and 17 testing (3276 spectra) cases, acquired at long TE 1.5T with MV MRS, to distinguish between edema, healthy brain without Glx, active tumor, and necrosis. In gliomas, cNMF was used to determine the signal sources in the healthy brain and glioma and were compared with the ground truth as determined via the automated segmentation of the anatomy with the BraTumIA software. In that study, Dice scores or similar are not reported and a pairwise Pearson correlation table is provided between the MRI classes and the MRS classes, making a comparison with our study difficult. In that study, the authors also provide the segmentation images as demonstration. For spectral quality control, they used their in-house methodology based on machine learning (RF) [62], similarly to us.
Our classification results are not only comparable to previous studies on similar datasets, but in most instances achieve better results on the independent test set, which is the most independent of all the ones reviewed above. Our independent test set is from several years afterwards (2006–2009 vs. 1994–2002), from a different center (UMCN vs. the INTERPRET partners), a partially different manufacturer (Siemens vs. Philips or GE), a different sequence (semi-Laser vs. PRESS or STEAM), and a different magnetic field (3T vs. 1.5T).
In our study, we used a variety of techniques for dimensionality reduction: filter, wrapper, and embedded methods. In the filter or univariate methods, the relationship between features and class labels is considered, but not redundancy. In the wrapper or multivariate methods, features are selected iteratively by maximizing the prediction accuracy of the classifier. The embedded methods are very similar to the wrapper techniques since they are likewise used to streamline the target capacity or execution of a learning calculation or model. The distinction of wrapper strategies is that a natural model structure metric is utilized amid learning. In our study, we found that the wrapper method used (SFFS) worked better. We attribute this to the fact that cross-validation was used to evaluate feature selection. All methods tested performed similarly in the training phase but were prone to overfitting. In addition, SFFS selected a low number of features that corresponded to the maximum intensities of the most prominent peaks in the spectra, whereas other methods did not. The results are nevertheless not surprising, as it was also consistently found in previous studies with the same dataset that SFFS performed well [24,63], and the features we found are the same that were found previously [39]. Regarding the classification algorithms, LDA out-performed RF and SVM, in agreement with previous studies on the same dataset [35]. Although RF classifiers are one of the best and most robust techniques, it has been shown that when the dataset’s noise increases, RF performs worst [64]. Although RF performs as well as LDA in the training phase, LDA handled the noisy data better than RF.
Importantly, the results from our study can be replicated, as the SFFS/LDA classifier we used is included in an MRS classifier software SpectraClassifier [28], which has demonstrated good performance in other studies [39,63,65].
The main limitation of our results is the low spectral quality of the MV dataset. Despite several steps (SNR thresholding, manual phase correction, renormalization to minimize incomplete water suppression at the processing stage, and the additional cNMF approach for identifying the artifactual patterns), many artifactual spectra still remained. We could have applied more complete quality control measures, such as the FWHM measure to detect poor water suppression or other methodologies, but this was not the purpose of our study, and in addition, our MV spectra did not have an accompanying unsuppressed water file. When it had, it had a different dimension than the metabolite file, and therefore it was not possible to perform a FWHM measurement to discard spectra with poor homogeneity [66,67]. In fact, automatic quality control is nowadays a hot topic in the MRS arena. Currently, no single automated method exists for filtering out poor-quality spectra, neither for SV nor MV, and expert-based routine checking of each individual spectrum of every MV MRS acquired in a clinical setting is simply not feasible. The existing literature puts forward several promising approaches for quality-control-based machine learning, as discussed in the introduction [13,20,68], but sometimes the data used to train are synthetic, and in others the systems are trained to detect only one artifact and none of these approaches has been tested in a real-world scenario, taking into account hardware and software from multiple scanner vendors and acquisition parameters, etc. One important problem with our dataset was the phase correction, which we had to correct individually with suboptimal results. In this respect, future studies could incorporate new approaches that are being developed, for example, as in [19], where the authors used an unsupervised deep-learning approach for phase and frequency correction.
A possible limitation of our approach with MV PRESS data is what is known as chemical shift displacement artifact (CSDA), in which there is a displacement in the localization of the VOI caused by the differences in the chemical shift, with an artifactual decrease in the intensity of the NAA peak in the normal brain, which could fool the classifier. Sequences such as semi-Laser [12,15,53] offer an effective solution for this artifact and in this case our nosological images did not encounter the CSDA. However, it remains to be shown whether, in a more standard clinical scenario without the availability of the semi-Laser, comparable results to the present ones would have been achieved.
Another possible limitation concerns the individual voxel neuroradiological labelling, as all morphological MR sequences were not always available for all patients. Nevertheless, the detailed evaluation by an expert neuroradiologist ensures the ground truth. Further studies should rely on the whole set of images for the exact delimitation of the anatomical abnormality regions and also on the evaluation of adjacent voxels, as in [6].
Another aspect that could be seen as a limitation is the ground truth based on the radiologist, in particular for the Dice scores we obtain that do not necessarily match the radiologist’s segmentations in the peritumoral area. It is not feasible or ethical in human patients to systematically validate the infiltration with a biopsy. In some instances it could be performed with some limitations; for example, in a recent work [69], the authors report that for some patients (not all), they validated possible infiltration by taking three targets from the tumor core, the peri-tumor region, and the margins via stereotactic biopsy. Even so, it is impossible to sample the entire brain. It has already been known that the metabolic abnormality does not exactly match the anatomical abnormality [70], although the surrounding abnormality is a well-accepted characteristic of gliomas [71,72]. However, the radiologist’s segmentations continue to be used as the ground truth in many MRS studies due to such ethical limitations [73].
With respect to the implications of our study in the development of decision support systems for brain tumors, based on MV MRS, we foresee that they could be used to obtain a prediction of the degree of malignancy (Grade IV or not) and the broad tumor type (glial, meningeal). They could also be used to predict whether the tumor is infiltrative (if the solid tumor region is surrounded by a tumoral low-grade glial-like area), which is important in distinguishing between glioblastoma and solitary metastasis.
In the case that additional curated SV datasets from other pathologies become available, it could be possible to extend such an approach to different or more specific clinical differential diagnoses. One limitation of our approach, for example, is the availability of only one lgg case.
Our initial purpose was to train with SV and test with MV, but given the data available, we ended up training with 1.5T and testing with 3T. Therefore, another question for future studies would be how far, in terms of magnetic field strength (e.g., 7T), such an approach can go: in our case, data were made compatible by down-sampling at a spectral resolution of ca. 0.014 ppm/point.
Another issue related to resolution that affects the range of potential applications is the voxel size of MV, with most centers acquiring in the 0.5–1cm3 range, which is insufficient for some applications such as radiotherapy planning. However, a scenario in which MRS datasets increase their spatial resolution with specialized sequences [74] could also be the ground for extending the range of applications, provided that first it is demonstrated that the data are compatible in machine learning terms.
The fact that, despite the above-mentioned limitations, and even with many artifactual spectra, we obtained reasonable and informative segmentations in most of the investigated cases, failing cases with poor spectral quality, points towards the elephant in the room for any future clinical applications of MRS. Clinicians should trust their datasets, and for this, scanner manufacturers or post-processing programs should provide reliable artifact detection. If the data is of good quality, class and segmentation predictions based on machine learning will be reliable as we showed; otherwise, the results will not be reliable.

5. Conclusions

We have shown that it is possible to train machine learning models on the SV data of brain tumors, at low field (1.5T), and apply these classifiers to metabolically segment MV data obtained from double the magnetic field (3T) from independent centers, scanner manufacturers, formats, and acquisition conditions. This was possible due to a processing pipeline that unified the number of points and the frequency range and normalized unit length, as well as using similar echo times (short TE).
We have also shown that the predictions fail in the test set mainly because of the presence of artifactual spectra that were not properly filtered out at the processing stage.
Our work opens the door for future studies in which the compatibility between different magnetic fields and acquisition conditions can be tested, as well the influence of the different types of artifacts that can affect the newest MRS acquisitions. Finally, we demonstrate the value of working, curating, and sharing old SV datasets for training machine learning models applicable to advanced MRS datasets, which is not the norm nowadays.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/cancers15143709/s1. Supplementary Materials A: Supplementary Table S1 for: Using Single Voxel Magnetic Resonance Spectroscopy Data Acquired at 1.5T to Classify Multivoxel data at 3T: a Proof of Concept for Brain Tumour Diagnosis; Supplementary Materials B: SUPPLEMENTARY MATERIALS “B” Using Single Voxel Magnetic Resonance Spectroscopy Data Acquired at 1.5T To Classify Multivoxel Data at 3T: A Proof-of-Concept Study; Supplementary Materials C: SUPPLEMENTARY MATERIALS “C”: Using Single Voxel Magnetic Resonance Spectroscopy Data Acquired at 1.5T to Classify Multivoxel Data at 3T: A Proof-of-Concept Study.

Author Contributions

Conceptualization, M.J.-S., A.V. and C.A.; methodology, G.U., A.P.-E., A.V. and M.J.-S.; software, G.U. and D.U.; validation, A.P.-E.; formal analysis, G.U., A.V., C.A. and M.J.-S.; data curation, M.J.-S.; writing—original draft preparation, M.J.-S. and G.U.; writing—review and editing, all co-authors; funding acquisition, M.J.-S., A.V. and C.A. All authors have read and agreed to the published version of the manuscript.

Funding

H2020-EU.1.3.—EXCELLENT SCIENCE—Marie Skłodowska-Curie Actions, grant number H2020-MSCA-ITN-2018-813120. Proyectos de investigación en salud 2020, grant numbers PI20/00064 and PI20/00360. Spanish Ministerio de Economía y Competitividad SAF2014-52332-R. Centro de Investigación Biomédica en Red en Bioingeniería, Biomateriales y Nanomedicina (CIBER-BBN [http://www.ciber-bbn.es/en, accessed on 12 January 2023], CB06/01/0010), an initiative of the Instituto de Salud Carlos III (Spain) co-funded by the EU Fondo Europeo de Desarrollo Regional (FEDER). Spanish AEI PID2019-104551RB-I00 grant. Xartecsalut, 2018 XARDI 00,016 and 2021 XARDI 00021. eTUMOUR: FP6-2002-LIFESCIHEALTH- 503094. INTERPRET: FP5-IST-1999-10310.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Available on request.

Acknowledgments

Data acquisition for the MV eTDB data: Jannie W. Wijnen, and Arend Heerschap from UMCN. This project has received funding from the European Union’s Horizon 2020 research and innovation program under the Marie Sklodowska-Curie grant agreement No 813120.

Conflicts of Interest

The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as potential conflicts of interest.

Abbreviations

LDA: linear discriminant analysis; lgg: low-grade glioma; me: metastasis; mm: meningioma; MRS: magnetic resonance spectroscopy; no: normal; RF: random forest; SFFS: sequential forward feature selection; SV: single-voxel; TE: echo time; WM: white matter; gb: glioblastoma multiforme; STI: Solid Tumor Index; SVM: Support Vector Machine.

References

  1. Negendank, W. Studies of human tumors by MRS: A review. NMR Biomed. 1992, 5, 303–324. [Google Scholar] [CrossRef]
  2. Preul, M.C.; Caramanos, Z.; Collins, D.L.; Villemure, J.G.; Leblanc, R.; Olivier, A.; Pokrupa, R.; Arnold, D.L. Accurate, noninvasive diagnosis of human brain tumors by using proton magnetic resonance spectroscopy. Nat. Med. 1996, 2, 323–325. [Google Scholar] [CrossRef] [PubMed]
  3. Arias-Mendoza, F.; Payne, G.S.; Zakian, K.L.; Schwarz, A.J.; Stubbs, M.; Stoyanova, R.; Ballon, D.; Howe, F.A.; Koutcher, J.A.; Leach, M.O.; et al. In vivo 31P MR spectral patterns and reproducibility in cancer patients studied in a multi-institutional trial. NMR Biomed. 2006, 19, 504–512. [Google Scholar] [CrossRef] [PubMed]
  4. Tate, A.R.; Griffiths, J.R.; Martinez-Perez, I.; Moreno, A.; Barba, I.; Cabanas, M.E.; Watson, D.; Alonso, J.; Bartumeus, F.; Isamat, F.; et al. Towards a method for automated classification of 1H MRS spectra from brain tumours. NMR Biomed. 1998, 11, 177–191. [Google Scholar] [CrossRef]
  5. McKnight, T.R.; von dem Bussche, M.H.; Vigneron, D.B.; Lu, Y.; Berger, M.S.; McDermott, M.W.; Dillon, W.P.; Graves, E.E.; Pirzkall, A.; Nelson, S.J. Histopathological validation of a three-dimensional magnetic resonance spectroscopy index as a predictor of tumor presence. J. Neurosurg. 2002, 97, 794–802. [Google Scholar] [CrossRef] [PubMed]
  6. De Vos, M.; Laudadio, T.; Simonetti, A.W.; Heerschap, A.; Van Huffel, S.; Laudadio, T.; Heerschap, A.; De Vos, M.; Laudadio, T.; Simonetti, A.W.; et al. Fast nosologic imaging of the brain. J. Magn. Reson. 2007, 184, 292–301. [Google Scholar] [CrossRef]
  7. Simonetti, A.W.; Melsse, W.J.; van der Graaf, M.; Heerschap, A.; Buydens, L.M.C.; Melssen, W.J.; van der Graaf, M.; Postma, G.J.; Heerschap, A.; Buydens, L.M.C. A new chemometric approach for brain tumor classification using magnetic resonance imaging ad spectroscopy. Anal. Chem. 2003, 75, 5352–5361. [Google Scholar] [CrossRef] [Green Version]
  8. Hangel, G.; Cadrien, C.; Lazen, P.; Furtner, J.; Lipka, A.; Hečková, E.; Hingerl, L.; Motyka, S.; Gruber, S.; Strasser, B.; et al. High-resolution metabolic imaging of high-grade gliomas using 7T-CRT-FID-MRSI. Neuroimage Clin. 2020, 28, 102433. [Google Scholar] [CrossRef]
  9. Majos, C.; Bruna, J.; Julia-Sape, M.; Cos, M.; Camins, A.; Gil, M.; Acebes, J.J.J.; Aguilera, C.; Arus, C.; Majós, C.; et al. Proton MR spectroscopy provides relevant prognostic information in high-grade astrocytomas. Am. J. Neuroradiol. 2011, 32, 74–80. [Google Scholar] [CrossRef] [Green Version]
  10. Li, X.; Jin, H.; Lu, Y.; Oh, J.; Chang, S.; Nelson, S.J. Identification of MRI and 1H MRSI parameters that may predict survival for patients with malignant gliomas. NMR Biomed. 2004, 17, 10–20. [Google Scholar] [CrossRef]
  11. Hattingen, E.; Raab, P.; Franz, K.; Lanfermann, H.; Setzer, M.; Gerlach, R.; Zanella, F.; Pilatus, U. Prognostic value of choline and creatine in WHO grade II gliomas. Neuroradiology 2008, 50, 759–767. [Google Scholar] [CrossRef]
  12. Wilson, M.; Andronesi, O.; Barker, P.B.; Bartha, R.; Bizzi, A.; Bolan, P.J.; Brindle, K.M.; Choi, I.-Y.; Cudalbu, C.; Dydak, U.; et al. Methodological consensus on clinical proton MRS of the brain: Review and recommendations. Magn. Reson. Med. 2019, 82, 527–550. [Google Scholar] [CrossRef] [Green Version]
  13. Tkáč, I.; Deelchand, D.; Dreher, W.; Hetherington, H.; Kreis, R.; Kumaragamage, C.; Považan, M.; Spielman, D.M.; Strasser, B.; de Graaf, R.A. Water and lipid suppression techniques for advanced 1H MRS and MRSI of the human brain: Experts’ consensus recommendations. NMR Biomed. 2021, 34, e4459. [Google Scholar] [CrossRef] [PubMed]
  14. Kreis, R.; Boer, V.; Choi, I.-Y.; Cudalbu, C.; de Graaf, R.A.; Gasparovic, C.; Heerschap, A.; Krššák, M.; Lanz, B.; Maudsley, A.A.; et al. Terminology and concepts for the characterization of in vivo MR spectroscopy methods and MR spectra: Background and experts’ consensus recommendations. NMR Biomed. 2021, 34, e4347. [Google Scholar] [CrossRef] [PubMed]
  15. Öz, G.; Deelchand, D.K.; Wijnen, J.P.; Mlynárik, V.; Xin, L.; Mekle, R.; Noeske, R.; Scheenen, T.W.J.; Tkáč, I.; Andronesi, O.; et al. Advanced single voxel 1H magnetic resonance spectroscopy techniques in humans: Experts’ consensus recommendations. NMR Biomed. 2021, 34, e4236. [Google Scholar] [CrossRef] [PubMed]
  16. Oeltzschner, G. MRSHub. Available online: https://mrshub.netlify.com/ (accessed on 20 July 2023).
  17. Scheenen, T.J.; Heerschap, A.; Klomp, D.J. Towards 1H-MRSI of the human brain at 7T with slice-selective adiabatic refocusing pulses. Magn. Reason. Mater. Phys. 2008, 21, 95–101. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  18. Zarinabad, N.; Wilson, M.; Gill, S.K.; Manias, K.A.; Davies, N.P.; Peet, A.C. Multiclass imbalance learning: Improving classification of pediatric brain tumors from magnetic resonance spectroscopy. Magn. Reson. Med. 2017, 77, 2114–2124. [Google Scholar] [CrossRef]
  19. Shamaei, A.; Starcukova, J.; Pavlova, I.; Starcuk, Z. Model-informed unsupervised deep learning approaches to frequency and phase correction of MRS signals. Magn. Reason. Med. 2023, 89, 1221–1236. [Google Scholar] [CrossRef]
  20. Kyathanahally, S.P.; Döring, A.; Kreis, R. Deep learning approaches for detection and removal of ghosting artifacts in MR spectroscopy. Magn. Reson. Med. 2018, 80, 851–863. [Google Scholar] [CrossRef] [Green Version]
  21. Tate, A.R.; Underwood, J.; Acosta, D.M.; Julia-Sape, M.; Majos, C.; Moreno-Torres, A.; Howe, F.A.; van der Graaf, M.; Lefournier, V.; Murphy, M.M.; et al. Development of a decision support system for diagnosis and grading of brain tumours using in vivo magnetic resonance single voxel spectra. NMR Biomed. 2006, 19, 411–434. [Google Scholar] [CrossRef]
  22. Julià-Sapé, M.; Acosta, D.; Mier, M.; Arùs, C.; Watson, D. A multi-centre, web-accessible and quality control-checked database of in vivo MR spectra of brain tumour patients. Magn. Reson. Mater. Phys. Biol. Med. 2006, 19, 22–33. [Google Scholar] [CrossRef] [PubMed]
  23. Julià-Sapé, M.; Lurgi, M.; Mier, M.; Estanyol, F.; Rafael, X.; Candiota, A.P.; Barceló, A.; García, A.; Martínez-Bisbal, M.C.; Ferrer-Luna, R.; et al. Strategies for annotation and curation of translational databases: The eTUMOUR project. Database J. Biol. Databases Curation 2012, 2012, bas035. [Google Scholar] [CrossRef] [PubMed]
  24. Julià-Sapé, M.; Griffiths, J.R.; Tate, R.A.; Howe, F.A.; Acosta, D.; Postma, G.; Underwood, J.; Majós, C.; Arús, C. Classification of brain tumours from MR spectra: The INTERPRET collaboration and its outcomes. NMR Biomed. 2015, 28, 1772–1787. [Google Scholar] [CrossRef] [PubMed]
  25. Kleihues, P.; Cavenee, W.K. Pathology and Genetics of Tumours of the Nervous System, New ed.; IARC Press: Lyon, France, 2000. [Google Scholar]
  26. Kleihues, P.; Louis, D.N.; Scheithauer, B.W.; Rorke, L.B.; Reifenberger, G.; Burger, P.C.; Cavenee, W.K. The WHO Classification of Tumors of the Nervous System. J. Neuropathol. Exp. Neurol. 2002, 61, 215–225. [Google Scholar] [CrossRef]
  27. Ortega-Martorell, S.; Julia-Sapé, M.; Lisboa, P.; Arús, C. Pattern recognition analysis of MR spectra. eMagRes 2016, 5, 945–958. [Google Scholar] [CrossRef] [Green Version]
  28. Ortega-Martorell, S.; Olier, I.; Julià-Sapé, M.; Arús, C. SpectraClassifier 1.0: A user friendly, automated MRS-based classifier-development system. BMC Bioinform. 2010, 11, 106. [Google Scholar] [CrossRef] [Green Version]
  29. Ortega-Martorell, S.; Lisboa, P.J.G.; Vellido, A.; Julià-Sapé, M.; Arús, C. Non-negative matrix factorisation methods for the spectral decomposition of MRS data from human brain tumours. BMC Bioinform. 2012, 13, 38. [Google Scholar] [CrossRef] [Green Version]
  30. Vellido, A.; Romero, E.; Julià-Sapé, M.; Majós, C.; Moreno-Torres, À.; Pujol, J.; Arús, C. Robust discrimination of glioblastomas from metastatic brain tumors on the basis of single-voxel 1H MRS. NMR Biomed. 2012, 25, 819–828. [Google Scholar] [CrossRef]
  31. Vellido, A.; Romero, E.; González-Navarro, F.F.; Belanche-Muñoz, L.A.; Juliá-Sapé, M.; Arús, C. Outlier exploration and diagnostic classification of a multi-centre 1H-MRS brain tumour database. Neurocomputing 2009, 72, 3085–3097. [Google Scholar] [CrossRef]
  32. Fuster-Garcia, E.; Tortajada, S.; Vicente, J.; Robles, M.; García-Gómez, J.M. Extracting MRS discriminant functional features of brain tumors. NMR Biomed. 2013, 26, 578–592. [Google Scholar] [CrossRef]
  33. Tortajada, S.; Fuster-Garcia, E.; Vicente, J.; Wesseling, P.; Howe, F.A.; Julia-Sape, M.; Candiota, A.P.A.-P.P.; Monleon, D.; Moreno-Torres, A.; Pujol, J.; et al. Incremental Gaussian Discriminant Analysis based on Graybill and Deal weighted combination of estimators for brain tumour diagnosis. J. Biomed. Inform. 2011, 44, 677–687. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Fuster-Garcia, E.; Navarro, C.; Vicente, J.; Tortajada, S.; García-Gómez, J.M.; Sáez, C.; Calvar, J.; Griffiths, J.; Julià-Sapé, M.; Howe, F.A.; et al. Compatibility between 3T 1H SV-MRS data and automatic brain tumour diagnosis support systems based on databases of 1.5T 1H SV-MRS spectra. Magn. Reson. Mater. Phys. Biol. Med. 2011, 24, 35–42. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. García-Gómez, J.M.; Luts, J.; Julià-Sapé, M.; Krooshof, P.; Tortajada, S.; Robledo, J.V.; Melssen, W.; Fuster-García, E.; Olier, I.; Postma, G.; et al. Multiproject-multicenter evaluation of automatic brain tumor classification by magnetic resonance spectroscopy. Magn. Reson. Mater. Phys. Biol. Med. 2009, 22, 5–18. [Google Scholar] [CrossRef] [Green Version]
  36. García-Gómez, J.M.; Tortajada, S.; Vidal, C.; Julià-Sape, M.; Luts, J.; Moreno-Torres, A.; Van Huffel, S.; Arús, C.; Robles, M. The effect of combining two echo times in automatic brain tumor classification by MRS. NMR Biomed. 2008, 21, 1112–1125. [Google Scholar] [CrossRef] [PubMed]
  37. Zandt, H.I.; van Der Graaf, M.; Heerschap, A. Common processing of in vivo MR spectra. NMR Biomed. 2001, 14, 224–232. [Google Scholar] [CrossRef]
  38. Julia-Sape, M.; Arias-Mendoza, F.; Griffiths, J.R. Clinical trials of MRS methods. eMagRes 2015, 4, 779–788. [Google Scholar] [CrossRef] [Green Version]
  39. Pérez-Ruiz, A.; Julià-Sapé, M.; Mercadal, G.; Olier, I.; Majós, C.; Arús, C. The INTERPRET Decision-Support System version 3.0 for evaluation of Magnetic Resonance Spectroscopy data from human brain tumours and other abnormal brain masses. BMC Bioinform. 2010, 11, 581. [Google Scholar] [CrossRef] [Green Version]
  40. Mocioiu, V.; Ortega-Martorell, S.; Olier, I.; Jablonski, M.; Starcukova, J.; Lisboa, P.; Arús, C.; Julià-Sapé, M. From raw data to data-analysis for magnetic resonance spectroscopy—The missing link: jMRUI2XML. BMC Bioinform. 2015, 16, 378. [Google Scholar] [CrossRef] [Green Version]
  41. Stefan, D.; Cesare, F.D.; Andrasescu, A.; Popa, E.; Lazariev, A.; Vescovo, E.; Strbak, O.; Williams, S.; Starcuk, Z.; Cabanas, M.; et al. Quantitation of magnetic resonance spectroscopy signals: The jMRUI software package. Meas. Sci. Technol. 2009, 20, 104035. [Google Scholar] [CrossRef]
  42. Edden, R.A.E.; Puts, N.A.J.; Harris, A.D.; Barker, P.B.; Evans, C.J. Gannet: A batch-processing tool for the quantitative analysis of gamma-aminobutyric acid–edited MR spectroscopy spectra. J. Magn. Reson. Imaging 2014, 40, 1445–1452. [Google Scholar] [CrossRef]
  43. Hernández-Villegas, Y.; Ortega-Martorell, S.; Arús, C.; Vellido, A.; Julià-Sapé, M. Extraction of artefactual MRS patterns from a large database using non-negative matrix factorization. NMR Biomed. 2022, 35, e4193. [Google Scholar] [CrossRef] [PubMed]
  44. Sklearn.Feature_Selection.chi2—Scikit-Learn 1.2.0 Documentation. Available online: https://scikit-learn.org/stable/modules/generated/sklearn.feature_selection.chi2.html (accessed on 12 July 2023).
  45. Sklearn.Feature_Selection.SequentialFeatureSelector, Scikit-Learn. Available online: https://scikit-learn/stable/modules/generated/sklearn.feature_selection.SequentialFeatureSelector.html (accessed on 12 July 2023).
  46. Boruta · PyPI. Available online: https://pypi.org/project/Boruta/ (accessed on 12 July 2023).
  47. Sklearn.Feature_Selection.SelectKBest, Scikit-Learn. Available online: https://scikit-learn/stable/modules/generated/sklearn.feature_selection.SelectKBest.html (accessed on 12 July 2023).
  48. Sklearn.Linear_Model.Lasso, Scikit-Learn. Available online: https://scikit-learn/stable/modules/generated/sklearn.linear_model.Lasso.html (accessed on 20 July 2023).
  49. Numpy.Corrcoef—NumPy v1.24 Manual. Available online: https://numpy.org/doc/stable/reference/generated/numpy.corrcoef.html (accessed on 12 July 2023).
  50. Gillies, S.; van der Wel, C.; Van den Bossche, J.; Taves, M.W.; Arnott, J.; Ward, B.C.; others. Shapely; GitHub: San Francisco, CA, USA, 2022. [Google Scholar] [CrossRef]
  51. Ho, T.K. Random decision forests. In Proceedings of the Third International Conference on Document Analysis and Recognition, Montreal, QC, Canada, 14–16 August 1995; IEEE Computer Society: Washington, DC, USA, 1995; Volume 1, p. 278. [Google Scholar]
  52. Cortes, C.; Vapnik, V. Support-Vector Networks. Mach. Learn. 1995, 20, 273–297. [Google Scholar] [CrossRef]
  53. Scheenen, T.W.; Klomp, D.W.; Wijnen, J.P.; Heerschap, A. Short echo time 1H-MRSI of the human brain at 3T with minimal chemical shift displacement errors using adiabatic refocusing pulses. Magn. Reason. Med. 2008, 59, 1–6. [Google Scholar] [CrossRef]
  54. Wijnen, J.P.; Idema, A.J.S.; Stawicki, M.; Lagemaat, M.W.; Wesseling, P.; Wright, A.J.; Scheenen, T.W.J.; Heerschap, A. Quantitative short echo time 1H MRSI of the peripheral edematous region of human brain tumors in the differentiation between glioblastoma, metastasis, and meningioma. J. Magn. Reson. Imaging 2012, 36, 1072–1082. [Google Scholar] [CrossRef] [PubMed]
  55. Kounelakis, M.G.; Dimou, I.N.; Zervakis, M.E.; Tsougos, I.; Tsolaki, E.; Kousi, E.; Kapsalaki, E.; Theodorou, K. Strengths and Weaknesses of 1.5T and 3T MRS Data in Brain Glioma Classification. IEEE Trans. Inf. Technol. Biomed. 2011, 15, 647–654. [Google Scholar] [CrossRef] [PubMed]
  56. Louis, D.N.; Perry, A.; Wesseling, P.; Brat, D.J.; Cree, I.A.; Figarella-Branger, D.; Hawkins, C.; Ng, H.K.; Pfister, S.M.; Reifenberger, G.; et al. The 2021 WHO Classification of Tumors of the Central Nervous System: A summary. Neuro-Oncology 2021, 23, 1231–1251. [Google Scholar] [CrossRef] [PubMed]
  57. Acquarelli, J.; van Laarhoven, T.; Postma, G.J.; Jansen, J.J.; Rijpma, A.; van Asten, S.; Heerschap, A.; Buydens, L.M.C.; Marchiori, E. Convolutional neural networks to predict brain tumor grades and Alzheimer’s disease with MR spectroscopic imaging data. PLoS ONE 2022, 17, e0268881. [Google Scholar] [CrossRef] [PubMed]
  58. Zarinabad, N.; Abernethy, L.J.; Avula, S.; Davies, N.P.; Rodriguez Gutierrez, D.; Jaspan, T.; MacPherson, L.; Mitra, D.; Rose, H.E.L.; Wilson, M.; et al. Application of pattern recognition techniques for classification of pediatric brain tumors by in vivo 3T 1H-MR spectroscopy—A multi-center study. Magn. Reson. Med. 2018, 79, 2359–2366. [Google Scholar] [CrossRef] [Green Version]
  59. Zhao, D.; Grist, J.T.; Rose, H.E.L.; Davies, N.P.; Wilson, M.; MacPherson, L.; Abernethy, L.J.; Avula, S.; Pizer, B.; Gutierrez, D.R.; et al. Metabolite selection for machine learning in childhood brain tumour classification. NMR Biomed. 2022, 35, e4673. [Google Scholar] [CrossRef]
  60. Tsolaki, E.; Svolos, P.; Kousi, E.; Kapsalaki, E.; Fountas, K.; Theodorou, K.; Tsougos, I. Automated differentiation of glioblastomas from intracranial metastases using 3T MR spectroscopic and perfusion data. Int. J. Comput. Assist. Radiol. Surg. 2013, 8, 751–761. [Google Scholar] [CrossRef]
  61. De Barros, N.P.; Meier, R.; Pletscher, M.; Stettler, S.; Knecht, U.; Reyes, M.; Gralla, J.; Wiest, R.; Slotboom, J. Analysis of metabolic abnormalities in high-grade glioma using MRSI and convex NMF. NMR Biomed. 2019, 32, e4109. [Google Scholar] [CrossRef] [PubMed]
  62. De Barros, N.P.; McKinley, R.; Knecht, U.; Wiest, R.; Slotboom, J. Automatic quality control in clinical 1H MRSI of brain cancer. NMR Biomed. 2016, 29, 563–575. [Google Scholar] [CrossRef] [PubMed]
  63. Raschke, F.; Fuster-Garcia, E.; Opstad, K.S.; Howe, F.A. Classification of single-voxel 1H spectra of brain tumours using LCModel. NMR Biomed. 2012, 25, 322–331. [Google Scholar] [CrossRef] [PubMed]
  64. Kirasich, K.; Smith, T.; Sadler, B. Random Forest vs. Logistic Regression: Binary Classification for Heterogeneous Datasets. SMU Data Sci. Rev. 2018, 1, 9. Available online: https://scholar.smu.edu/datasciencereview/vol1/iss3/9 (accessed on 12 July 2023).
  65. Emir, U.E.; Larkin, S.J.; de Pennington, N.; Voets, N.; Plaha, P.; Stacey, R.; Al-Qahtani, K.; Mccullagh, J.; Schofield, C.J.; Clare, S.; et al. Non-invasive quantification of 2-hydroxyglutarate in human gliomas with IDH1 and IDH2 mutations. Cancer Res 2016, 76, 43–49. [Google Scholar] [CrossRef] [Green Version]
  66. Near, J.; Harris, A.D.; Juchem, C.; Kreis, R.; Marjańska, M.; Öz, G.; Slotboom, J.; Wilson, M.; Gasparovic, C. Preprocessing, analysis and quantification in single-voxel magnetic resonance spectroscopy: Experts’ consensus recommendations. NMR Biomed. 2021, 34, e4257. [Google Scholar] [CrossRef]
  67. Maudsley, A.A.; Andronesi, O.C.; Barker, P.B.; Bizzi, A.; Bogner, W.; Henning, A.; Nelson, S.J.; Posse, S.; Shungu, D.C.; Soher, B.J. Advanced magnetic resonance spectroscopic neuroimaging: Experts’ consensus recommendations. NMR Biomed. 2021, 34, e4309. [Google Scholar] [CrossRef]
  68. Gurbani, S.S.; Schreibmann, E.; Maudsley, A.A.; Cordova, J.S.; Soher, B.J.; Poptani, H.; Verma, G.; Barker, P.B.; Shim, H.; Cooper, L.A.D. A convolutional neural network to filter artifacts in spectroscopic MRI. Magn. Reson. Med. 2018, 80, 1765–1775. [Google Scholar] [CrossRef]
  69. Yuan, Y.; Yu, Y.; Guo, Y.; Chu, Y.; Chang, J.; Hsu, Y.; Liebig, P.A.; Xiong, J.; Yu, W.; Feng, D.; et al. Noninvasive Delineation of Glioma Infiltration with Combined 7T Chemical Exchange Saturation Transfer Imaging and MR Spectroscopy: A Diagnostic Accuracy Study. Metabolites 2022, 12, 901. [Google Scholar] [CrossRef]
  70. Nelson, S.J.; Graves, E.; Pirzkall, A.; Li, X.; Antiniw Chan, A.; Vigneron, D.B.; McKnight, T.R. In vivo molecular imaging for planning radiation therapy of gliomas: An application of 1H MRSI. J. Magn. Reason. Imaging 2002, 16, 464–476. [Google Scholar] [CrossRef]
  71. Raschke, F.; Barrick, T.R.; Jones, T.L.; Yang, G.; Ye, X.; Howe, F.A. Tissue-type mapping of gliomas. NeuroImage Clin. 2019, 21, 101648. [Google Scholar] [CrossRef] [PubMed]
  72. Maudsley, A.A.; Gupta, R.K.; Stoyanova, R.; Parra, N.A.; Roy, B.; Sheriff, S.; Hussain, N.; Behari, S. Mapping of Glycine Distributions in Gliomas. Am. J. Neuroradiol. 2014, 35, S31–S36. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  73. Li, Y.; Sima, D.M.; Cauter, S.V.; Croitor Sava, A.R.; Himmelreich, U.; Pi, Y.; Van Huffel, S. Hierarchical non-negative matrix factorization (hNMF): A tissue pattern differentiation method for glioblastoma multiforme diagnosis using MRSI. NMR Biomed. 2013, 26, 307–319. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  74. Maudsley, A.A.; Domenig, C.; Sheriff, S. Reproducibility of serial whole-brain MR spectroscopic imaging. NMR Biomed. 2010, 23, 251–256. [Google Scholar] [CrossRef]
Figure 1. Summary of the pipeline.
Figure 1. Summary of the pipeline.
Cancers 15 03709 g001
Figure 2. Sources obtained via cNMF on MV data. First row, left to right: source 1, source 2, and source 3. Second row, left to right: source 4 and source 5. Source 1 was the majority contribution in 1245 spectra, source 2 (considered artifactual) in 273 spectra, source 3 in 3685 spectra, source 4 (considered artifactual) in 623 spectra, and source 5 in 1814 spectra.
Figure 2. Sources obtained via cNMF on MV data. First row, left to right: source 1, source 2, and source 3. Second row, left to right: source 4 and source 5. Source 1 was the majority contribution in 1245 spectra, source 2 (considered artifactual) in 273 spectra, source 3 in 3685 spectra, source 4 (considered artifactual) in 623 spectra, and source 5 in 1814 spectra.
Cancers 15 03709 g002
Figure 3. Mean and standard deviation of the different classes (mm, lgg, no, gb, me, and the superclass agg) in the training set (SV), as well as features selected with the SFFS method, for the 4-class task (continuous vertical lines), the 3-class task (dashed vertical lines), and for both tasks (thick continuous vertical line).
Figure 3. Mean and standard deviation of the different classes (mm, lgg, no, gb, me, and the superclass agg) in the training set (SV), as well as features selected with the SFFS method, for the 4-class task (continuous vertical lines), the 3-class task (dashed vertical lines), and for both tasks (thick continuous vertical line).
Cancers 15 03709 g003
Figure 4. Shapley values of the better combinations for 4 and 3 classes. Left, 4 classes; right, 3 classes. X-axis is the selected feature’s ppm values and Y-axis is the Shapley values.
Figure 4. Shapley values of the better combinations for 4 and 3 classes. Left, 4 classes; right, 3 classes. X-axis is the selected feature’s ppm values and Y-axis is the Shapley values.
Cancers 15 03709 g004
Figure 5. Three example cases. Rows: cases. Columns: MRI patch or MRI that corresponds to the same location as the MV MRS slice. Ground truth is the segmentation carried out by the radiologist: blue, normal brain; red, solid tumor region in gb or me; yellow, solid tumor region in mn; green, abnormal region (oedema, other). In the nosological image on the third column, the color codes are the same, except that the green represents lgg. The fourth column shows the bilateral AUC values for each case. The keys on the right side indicate the classification tasks.
Figure 5. Three example cases. Rows: cases. Columns: MRI patch or MRI that corresponds to the same location as the MV MRS slice. Ground truth is the segmentation carried out by the radiologist: blue, normal brain; red, solid tumor region in gb or me; yellow, solid tumor region in mn; green, abnormal region (oedema, other). In the nosological image on the third column, the color codes are the same, except that the green represents lgg. The fourth column shows the bilateral AUC values for each case. The keys on the right side indicate the classification tasks.
Cancers 15 03709 g005
Figure 6. STI per case: top, 4-class task; bottom, 3-class task.
Figure 6. STI per case: top, 4-class task; bottom, 3-class task.
Cancers 15 03709 g006
Figure 7. Dice score case-by-case and slice-by-slice for the multi-slice acquisitions. Top, 4-class task; bottom, 3-class task. Blue, normal brain; red, solid tumor region in gb or me; yellow, solid tumor region in mm; green, abnormal region (oedema, other).
Figure 7. Dice score case-by-case and slice-by-slice for the multi-slice acquisitions. Top, 4-class task; bottom, 3-class task. Blue, normal brain; red, solid tumor region in gb or me; yellow, solid tumor region in mm; green, abnormal region (oedema, other).
Cancers 15 03709 g007
Figure 8. Four slices from three different cases in which the classifier predictions failed. All belong to the gb class. Rows: slices. Columns: MRI patch or MRI that corresponds to the same location as the MV MRS slice. Ground truth is the segmentation completed by the radiologist: blue, normal brain; red, solid tumor region in gb or me; yellow, solid tumor region in mm; green, abnormal region (oedema, other). In the nosological image on the third column, the color codes are the same, except that the green represents lgg. The fourth, fifth, sixth, and seventh columns show the overlaid individual spectra from the regions segmented in the nosological image.
Figure 8. Four slices from three different cases in which the classifier predictions failed. All belong to the gb class. Rows: slices. Columns: MRI patch or MRI that corresponds to the same location as the MV MRS slice. Ground truth is the segmentation completed by the radiologist: blue, normal brain; red, solid tumor region in gb or me; yellow, solid tumor region in mm; green, abnormal region (oedema, other). In the nosological image on the third column, the color codes are the same, except that the green represents lgg. The fourth, fifth, sixth, and seventh columns show the overlaid individual spectra from the regions segmented in the nosological image.
Cancers 15 03709 g008
Table 1. Summary of the acquisition parameters used in the SV short TE dataset.
Table 1. Summary of the acquisition parameters used in the SV short TE dataset.
ParameterSV STEAM SV PRESS
Magnetic field1.5T1.5T
TE20–32 ms30–32 ms
TR1600–2000 ms1600–2000 ms
Volume4–8 cm34–8 cm3
N averages metabolites256192–128
N averages water8–328–16
N points512 (Philips)512 (Philips)
1024 (Siemens)1024 (Siemens)
2048 (GE)2048 (GE)
Bandwidth1000 Hz (Philips)1000 Hz (Philips)
1000 Hz (Siemens)1000 Hz (Siemens)
2500 Hz (GE)2500 Hz (GE)
Dummy scans44
Table 2. Relevant parameters of the MV data after applying the case inclusion criteria.
Table 2. Relevant parameters of the MV data after applying the case inclusion criteria.
ParameterValue
Magnetic field3T
SequenceSemi-Laser
Model and scanner brandTrioTim Siemens
Software versionSyngo MR B13 4VB13A
TE30 ms
TR1000 ms
FOV16 × 16 × 8/32 × 16 × 8/
32 × 32 × 1
VOI8 × 18 × 8/10 × 6 × 8/10 × 8 × 8/10 × 10 × 8/18 × 14 × 1/18 × 15 × 1/18 × 20 × 1/18 × 21 × 1/20 × 14 × 1/20 × 16 × 1/20 × 20 × 1/20 × 24 × 1/22 × 20 × 1/25 × 16 × 1
Hanning filter100%
Slice thickness10 mm
N averages metabolites1–3
N averages water1
N points1024 or 4096
Bandwidth2404 or 4000 Hz
Table 3. BER results for the 4-class task, under the different combinations of feature selection methods and classifiers, for the SV training and the MV test sets. The results are depicted as a heatmap, where the most intense green corresponds to the best results (lowest BER). “Drop” in this context means the Pearson’s correlation-based threshold applied (i.e., “50 drop” means the threshold was set at 0.5 correlation, and we dropped those variables with a correlation higher than 0.5). “Full” means we used the whole set of features.
Table 3. BER results for the 4-class task, under the different combinations of feature selection methods and classifiers, for the SV training and the MV test sets. The results are depicted as a heatmap, where the most intense green corresponds to the best results (lowest BER). “Drop” in this context means the Pearson’s correlation-based threshold applied (i.e., “50 drop” means the threshold was set at 0.5 correlation, and we dropped those variables with a correlation higher than 0.5). “Full” means we used the whole set of features.
Training SetNumber of Features
Feature Selection Method34567891050 Drop60 Drop70 Drop80 Drop90 DropFullClassifier
SFFS0.120.100.100.100.100.080.080.06 LDA
SFFS0.380.280.300.650.200.370.390.36 SVM
SFFS0.090.080.040.040.030.040.020.03 RF
Chi0.240.170.130.540.530.490.060.51 LDA
Chi0.210.170.110.450.470.460.070.49 SVM
Chi0.140.120.100.360.390.380.070.11 RF
K-best0.340.200.170.190.140.110.140.11 LDA
K-best0.400.120.120.090.110.090.100.11 SVM
K-best0.050.050.060.040.110.090.100.11 RF
Lasso0.170.110.080.120.090.080.080.16 LDA
Lasso0.150.110.080.100.090.080.080.10 SVM
Lasso0.130.100.080.100.100.100.100.11 RF
Boruta 0.090.090.090.140.160.07LDA
Boruta 0.060.070.060.070.050.06SVM
Boruta 0.030.010.020.030.030.01RF
Test SetNumber of Features
Feature Selection Method34567891050 Drop60 Drop70 Drop80 Drop90 DropFullClassifier
SFFS0.380.340.350.340.330.270.330.41 LDA
SFFS0.680.600.600.390.640.640.640.40 SVM
SFFS0.530.420.460.590.560.570.440.47 RF
Chi0.710.680.310.660.680.680.490.66 LDA
Chi0.690.660.560.650.680.690.550.69 SVM
Chi0.680.670.550.630.640.700.560.70 RF
K-best0.430.430.430.340.230.210.360.23 LDA
K-best0.640.480.500.590.570.580.540.59 SVM
K-best0.520.470.550.590.570.580.540.59 RF
Lasso0.530.480.550.510.500.470.470.50 LDA
Lasso0.540.530.510.530.570.490.490.59 SVM
Lasso0.530.480.520.550.570.580.580.59 RF
Boruta 0.420.330.240.200.270.30LDA
Boruta 0.450.470.460.460.480.44SVM
Boruta 0.470.480.480.470.480.45RF
Table 4. BER results for the 3-class task, under the different combinations of feature selection methods and classifiers, for the SV training and the MV test sets. The results are depicted as a heatmap, where the most intense green corresponds to the best results (lowest BER). “Drop” in this context means the Pearson’s correlation-based threshold applied (i.e., “50 drop” means the threshold was set at 0.5 correlation, and we dropped those variables with a correlation higher than 0.5). “Full” means we used the whole set of features.
Table 4. BER results for the 3-class task, under the different combinations of feature selection methods and classifiers, for the SV training and the MV test sets. The results are depicted as a heatmap, where the most intense green corresponds to the best results (lowest BER). “Drop” in this context means the Pearson’s correlation-based threshold applied (i.e., “50 drop” means the threshold was set at 0.5 correlation, and we dropped those variables with a correlation higher than 0.5). “Full” means we used the whole set of features.
Training SetNumber of Features
Feature Selection Method34567891080 Drop90 DropFullClassifier
SFFS0.070.070.070.070.070.070.050.05 LDA
SFFS0.230.200.190.060.060.060.050.06 SVM
SFFS0.400.330.350.100.080.150.100.11 RF
Chi0.120.120.390.050.060.070.070.09 LDA
Chi0.100.110.360.050.050.060.050.07 SVM
Chi0.090.080.490.060.070.050.050.06 RF
K-best0.130.170.070.040.080.130.120.12 LDA
K-best0.150.120.100.070.060.110.100.10 SVM
K-best0.230.160.110.110.100.140.120.13 RF
Lasso0.080.080.050.050.050.050.030.04 LDA
Lasso0.090.040.060.080.070.060.060.03 SVM
Lasso0.080.060.070.060.070.060.070.06 RF
Boruta 0.230.100.06LDA
Boruta 0.090.120.10SVM
Boruta 0.090.100.04RF
Test SetNumber of Features
Feature Selection Method34567891080 Drop90 DropFullClassifier
SFFS0.250.250.260.260.270.260.190.25 LDA
SFFS0.380.380.380.270.290.280.320.33 SVM
SFFS0.440.440.430.330.320.350.330.33 RF
Chi0.420.410.610.320.330.330.320.45 LDA
Chi0.390.390.580.350.350.360.350.44 SVM
Chi0.390.410.670.330.340.360.340.40 RF
K-best0.500.400.400.350.300.380.320.27 LDA
K-best0.480.580.410.430.460.480.470.46 SVM
K-best0.440.530.380.410.440.500.480.48 RF
Lasso0.390.270.280.280.260.280.330.29 LDA
Lasso0.360.350.280.350.330.320.320.44 SVM
Lasso0.310.240.320.330.340.350.350.34 RF
Boruta 0.390.320.27LDA
Boruta 0.490.430.44SVM
Boruta 0.460.440.51RF
Table 5. Three- and four-class AUC using SFFS and LDA.
Table 5. Three- and four-class AUC using SFFS and LDA.
AUC
Setmmagglggno
4-class taskSV train0.990.970.980.99
MV test0.950.890.820.82
3-class taskSV train0.990.98-1.00
MV test0.900.83-0.82
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ungan, G.; Pons-Escoda, A.; Ulinic, D.; Arús, C.; Vellido, A.; Julià-Sapé, M. Using Single-Voxel Magnetic Resonance Spectroscopy Data Acquired at 1.5T to Classify Multivoxel Data at 3T: A Proof-of-Concept Study. Cancers 2023, 15, 3709. https://doi.org/10.3390/cancers15143709

AMA Style

Ungan G, Pons-Escoda A, Ulinic D, Arús C, Vellido A, Julià-Sapé M. Using Single-Voxel Magnetic Resonance Spectroscopy Data Acquired at 1.5T to Classify Multivoxel Data at 3T: A Proof-of-Concept Study. Cancers. 2023; 15(14):3709. https://doi.org/10.3390/cancers15143709

Chicago/Turabian Style

Ungan, Gülnur, Albert Pons-Escoda, Daniel Ulinic, Carles Arús, Alfredo Vellido, and Margarida Julià-Sapé. 2023. "Using Single-Voxel Magnetic Resonance Spectroscopy Data Acquired at 1.5T to Classify Multivoxel Data at 3T: A Proof-of-Concept Study" Cancers 15, no. 14: 3709. https://doi.org/10.3390/cancers15143709

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop