Next Article in Journal
Lack of Association between Chlamydophila psittaci and Ocular Adnexal MALT Lymphoma in Korean Patients—Is the Geographic or Genetic Difference Significant?
Previous Article in Journal / Special Issue
Intraoperative Guidance Using Hyperspectral Imaging: A Review for Surgeons
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Intraoperative Resting-State Functional Connectivity Based on RGB Imaging

1
INSA-Lyon, Univ Lyon, Université Claude Bernard Lyon 1, UJM-Saint Etienne, CNRS, Inserm, CREATIS UMR 5220, U1206, F69100 Lyon, France
2
Service de Radiologie, Centre Hospitalier Universitaire de Saint Etienne, TAPE EA7423, Université de Lyon, UJM, F42023 Saint Etienne, France
3
Service de Neurochirurgie D, Hospices Civils de Lyon, F69500 Bron, France
*
Authors to whom correspondence should be addressed.
Diagnostics 2021, 11(11), 2067; https://doi.org/10.3390/diagnostics11112067
Submission received: 16 September 2021 / Revised: 27 October 2021 / Accepted: 4 November 2021 / Published: 9 November 2021
(This article belongs to the Special Issue Surgical Applications of Hyperspectral Optical Imaging)

Abstract

:
RGB optical imaging is a marker-free, contactless, and non-invasive technique that is able to monitor hemodynamic brain response following neuronal activation using task-based and resting-state procedures. Magnetic resonance imaging (fMRI) and functional near infra-red spectroscopy (fNIRS) resting-state procedures cannot be used intraoperatively but RGB imaging provides an ideal solution to identify resting-state networks during a neurosurgical operation. We applied resting-state methodologies to intraoperative RGB imaging and evaluated their ability to identify resting-state networks. We adapted two resting-state methodologies from fMRI for the identification of resting-state networks using intraoperative RGB imaging. Measurements were performed in 3 patients who underwent resection of lesions adjacent to motor sites. The resting-state networks were compared to the identifications provided by RGB task-based imaging and electrical brain stimulation. Intraoperative RGB resting-state networks corresponded to RGB task-based imaging ( D I C E : 0.55 ± 0.29 ). Resting state procedures showed a strong correspondence between them ( D I C E : 0.66 ± 0.11 ) and with electrical brain stimulation. RGB imaging is a relevant technique for intraoperative resting-state networks identification. Intraoperative resting-state imaging has several advantages compared to functional task-based analyses: data acquisition is shorter, less complex, and less demanding for the patients, especially for those unable to perform the tasks.

1. Introduction

Non-invasive functional brain mapping is an imaging technique that allows the locating of functional areas of the patient’s brain. This technique is used during brain tumor resection surgery to indicate to the neurosurgeon the cortical tissues which should not be removed without cognitive impairment. Functional magnetic resonance imaging (fMRI) [1] is the preoperative gold standard for identifying the patient’s functional areas. However, after the patient’s craniotomy, a brain shift invalidates the relevance of neuronavigation to localize functional areas during surgery [2]. To avoid localization errors, intraoperative MRI has been suggested, but it complicates the surgical procedure and is, therefore, rarely used. For these reasons, electrical brain stimulation (EBS) [3] is preferred during neurosurgery, but this technique is mainly limited by its low spatial resolution (≈5 mm [4]) and has the potential risk to trigger epileptic seizures. Optical imaging provides an ideal solution for intraoperative functional brain mapping because the analysis of the light absorption allows to monitor the brain activity (motor or sensory tasks for example) with quantification of the concentration changes in oxy- ( Δ C H b O 2 ) and deoxygenated hemoglobin ( Δ C H b ) in brain cortex [5,6,7,8,9,10,11,12].
As opposed to functional task-based analyses, resting-state functional connectivity aims to identify the low frequency cortical hemodynamic fluctuations (<0.1 Hz) that reflect the patient neuronal activity at rest and that are linked to resting-state networks [13]. These fluctuations can occur in the absence of a task, and are often correlated between functionally related areas. Resting-state imaging has several advantages compared to functional task-based analyses: data acquisition is shorter, less complex, and less demanding for the patients, especially for those unable to perform the tasks. This technique is widely used in fMRI studies [14,15,16,17], could be used to plan tumor resection [15] when patients are under general anesthesia [18,19]. Using optical imaging, resting-state techniques have been adapted to functional near-infrared spectroscopy (fNIRS) devices [20,21] for continuous bedside monitoring and wide field devices for studying neurovascular coupling in mice brains [22,23]. To our knowledge, intraoperative implementation of optical resting-state has never been proposed in the literature. Main issues come from the partial access to the brain cortex, whereas the models of resting-state used whole brain imaging.
In these works, we demonstrate that intraoperative optical resting-state can be implemented intraoperatively using two standard fMRI resting state techniques (the seed correlation and the independent component analyses [13]). The cortical areas identified with optical resting-state maps correspond to those identified by optical functional task-based analysis and EBS [3] with patients who are awake or under general anesthesia. These results could help to guide the neurosurgeon surgical gesture, have the potential to reduce the duration of surgical operations while improving patient and neurosurgeon comfort.

2. Material and Methods

2.1. Intraoperative Procedure

The study was conducted at the neurological center of the Pierre Wertheimer hospital in Bron, France. Three patients presenting a tumor close to the motor cortex area were included in the study. All experiments were approved by the local ethics committee of Lyon University Hospital (France) and the participating patients signed written consent. The videos were acquired with the wide field optical device described in [7] after the patient’s craniotomy and before the brain tumor resection surgery. For each patient, resting-state and task-based data were acquired. For task-based data, motor cortex stimulation was performed by repetitive, alternating hand opening and closing at ≈1 Hz (successive periods of 20 s of rest followed by 20 s of stimulation). For resting-state data, patients stayed at rest and the acquisition duration was at least 1 min 40 s, which corresponds to the minimum acquisition time required to obtain accurate and stable mapping of brain connectivity network in children using fNIRS [24] and in adult using fMRI [25]. Information on patients and acquisitions is summarized in Table 1.
The neurosurgeon performed EBS after RGB imaging using a bipolar electrode (Nimbus Medtronic neurostimulator). A biphasic current was used (pulsating frequency: 60 Hz, pulse width: 1 ms). The current was first set to 1 mA, and increased to 6 mA. When a functional area was identified by EBS, the neurosurgeon placed a colored pastille on the patient cortex and a RGB image was acquired to store the position of the functional area in the RGB image.

2.2. Functional Analyses

Once the video was acquired, the quantitative model described in [7] was applied. A schematic overview of these processing steps is represented in Figure 1.
The first image of the video sequence was segmented into three classes: gray matter, surface blood vessel, and buried blood vessel. The objective is to use in the modified Beer–Lambert law, and this for each pixel of the camera, the appropriate mean path length of photons travelled in tissue. For this purpose Monte Carlo simulations were performed using MCX software [26]. For each frame of the video, the repetitive brain motion was compensated [27,28]. The slow drift of RGB intensities was corrected due to tissue desiccation [29] and a low-pass filtering was performed to isolate slow hemodynamic fluctuations (cut-off frequency: 0.08 Hz [13,20,21]). Then, Δ C H b O 2 and Δ C H b time curves were computed for each camera pixel using the modified Beer–Lambert law [7,8]. To compute these concentration changes time curves, a software developed in C++ was used. This software is based on the Qt framework ( v 5.9 . 4 ) and open source libraries (OpenCV ( v 3.2 . 0 ) [30] and FFTW ( v 3.3 . 7 ) [31]). Then, several analyses were performed to identify functional brain maps. A task-based (see Section 2.2.1) and resting-state analyses (see Section 2.2.2) were computed. The extent of functional brain areas was identified with a thresholding operation (see Section 2.2.3). Finally, the binary functional maps were compared to each other with the calculation of the DICE and overlap coefficients (see Section 2.2.3).

2.2.1. Task-Based Functional Analysis

The task-based analysis consisted in analyzing the correlation between measured and theoretical cortical hemodynamic changes. The theoretical hemodynamic time curve (H) was obtained by convolving the hemodynamic impulse response function [32] to a rectangular function that represented the patient’s physiological events (0: rest, 1: stimulation). Theoretical Δ C H b O 2 and Δ C H b time curves were obtained by multiplying H by 1 and 1 , respectively. The Pearson correlation coefficient was computed between the theoretical and measured Δ C H b O 2 and Δ C H b time curves to produce task-based maps. For this analysis, the C++ software was used.

2.2.2. Resting-State Analyses

The seed correlation [20] analysis and the independent component analysis (ICA) [33,34] are the main resting-state functional connectivity analyses.
The seed correlation analysis analyzes the correlation between measured Δ C H b O 2 and Δ C H b time curves and those measured at the level of a seed region. The seed was represented as a 20 pixels diameter disk ( 1.2 mm diameter) located on the motor area identified by EBS. Δ C H b O 2 and Δ C H b time curves measured at the level of the seed were averaged over its surface and were compared to the other time curves measured on the surface of the patient’s cortex using the Pearson correlation coefficient to produce two resting-state seed maps. For this analysis, the C++ software was used.
The ICA identifies original signals from a mixture of signals by assuming that the original signals are independent of each other. In our analysis, the original signal was Δ C n (n: H b O 2 or H b ) and had a dimension of P × T (with P the number pixels of the image and T the number of frames acquired). Input data were normalized as follow:
Δ C n ( p , t ) = Δ C n ( p , t ) μ n ( p ) σ n ( p ) ,
where μ n ( p ) and σ n ( p ) are the temporal mean and standard deviation of Δ C n measured for the pixel p respectively. The normalization transforms the temporal vector Δ C n ( p ) to Δ C n ( p ) which is zero-mean and has unit variance. The matrix Δ C n can be expressed as a linear combination of K sources:
Δ C n = A × S .
S is a matrix of dimension K × T and denotes the concentration changes sources in the patient brain. A is the mixing matrix of dimension P × K that express the spatial distribution of the sources. ICA decomposition leads to the estimation of the K sources:
S = W × Δ C n .
S is the estimated sources (dimension K × T ) and W is an unmixing matrix of dimension K × P . The spatial distribution of the sources A can be estimated by calculating the pseudo-inverse of the matrix W.
Using the FastICA algorithm [35] from the scikit-learn Python library ( v 0.18 . 1 ) [36], the normalized concentration changes matrix was decomposed into K independent sources. The number of independent components depends on the size of analyzed data. Between 10 and 20 independent components were used to analyze data acquired by a high-density diffuse optical tomography device [33]. Since our field of view was smaller and as only the sensorimotor function was exposed, we have chosen a smaller number of independent sources: K = 5 . The estimated matrix A ( A ˜ ) was reconstructed into 5 images to illustrate the spatial distribution of hemodynamics fluctuations sources. The 5 images were sorted by their variance (from the smallest to the largest value).

2.2.3. Comparison of Identified Functional Areas

The task-based maps were compared to the resting-state maps to evaluate the identification performance of cortical functional zones. For this purpose, the NumPy Python library ( v 1.19 . 4 ) [37] was used. Each task-based and resting-state image was thresholded to obtain a binary image. The threshold value T was applied to the images:
T = μ I + α . σ I if μ I 0 μ I α . σ I , otherwise
μ I is the mean value of the image I, σ I its standard deviation and α [ 0 ; 1 ] is the severity criterion of the thresholding operation equal to 0.75 . Morphological opening and closing operations were applied to the binary image to remove isolated pixels and to close holes. A 20 pixel wide circular structuring element was used.
The DICE coefficient [38] was computed between binary task-based (X in Equation (5)) and resting-state seed or ICA maps (Y in Equation (5)). We also computed this metric between binary resting-state seed (X in Equation (5)) and ICA maps (Y in Equation (5)):
D I C E ( X , Y ) = 2 | X Y | | X | + | Y | ,
where | X | and | Y | are the cardinalities of the two sets calculated after the thresholding operation (see Equation (4)).
Resting-state fMRI is likely to reveal the whole motor cortex, whereas a single body segment (e.g., face, hand) would be obtained with task-based fMRI. To evaluate this case, the overlap coefficient [15] was computed between binary task-based (X in Equation (6)) and resting-state seed or ICA maps (Y in Equation (6)).
O v e r l a p ( X , Y ) = | X Y | | X | ,
where | X | and | Y | are the cardinalities of the two sets calculated after the thresholding operation (see Equation (4)).
Finally, we tested if the functional brain areas identified by EBS corresponded to the identifications provided by the task-based and resting-state maps by testing if EBS results were included in the binary task-based and resting-state maps.

3. Results

The task-based and resting-state maps computed for the three patients are represented in Figure 2 and Figure 3. The seed and ICA analysis were used in Figure 2 and Figure 3, respectively. Each motor area identified by EBS was indicated by a white spot and the letter M. The white spot also indicated the seed area used for the resting-state seed analysis. The areas delimited by green contours indicated the contours of the binary task-based and resting-state maps obtained after the thresholding operations, see Equation (4). In Figure 2, the colorbar indicated the range of variation of Pearson correlation coefficients. In Figure 3, it illustrated the spatial distribution of hemodynamic fluctuations in ICA images. The values of the DICE and overlap coefficients computed between the task-based and resting-state seed maps are indicated in Table 2. The values of the DICE and overlap coefficients computed between the task-based and resting-state ICA binary maps and the DICE coefficients computed between the resting-state seed and ICA binary maps are indicated in Table 3.
For patient 1 and 2, the task-based maps corresponded to the resting-state seed maps ( 0.77 D I C E 0.85 ) but were not entirely included in the resting-state seed maps ( 0.64 O v e r l a p 0.89 ). For patient 3, the task-based masks did not match the resting-state seed maps ( D I C E 0.12 ) and were hardly included in the resting-state seed maps ( O v e r l a p 0.11 ).
For patient 1, on images A 1 ˜ ( H b O 2 and H b ), A 2 ˜ ( H b ), A 3 ˜ ( H b O 2 ), and A 4 ˜ ( H b O 2 ), the binary masks corresponded to those identified on the task-based maps ( 0.49 D I C E 0.74 and 0.46 O v e r l a p 0.70 ). When comparing resting-state seed and ICA images, the strongest DICE coefficients were obtained with the images A 4 ˜ for H b O 2 ( D I C E = 0.52 ) and A 2 ˜ for H b ( D I C E = 0.70 ). For patient 2, on images A 1 ˜ ( H b O 2 and H b ), A 2 ˜ ( H b O 2 ) and A 4 ˜ ( H b ), the binary masks corresponded to those identified on the task-based maps ( 0.47 D I C E 0.75 and 0.41 O v e r l a p 0.77 ). When comparing resting-state seed and ICA images, the strongest DICE coefficients were obtained with the images A 2 ˜ for H b O 2 ( D I C E = 0.60 ) and A 1 ˜ for H b ( D I C E = 0.77 ). For the patient 3, no ICA binary masks corresponded to those identified on the task-based maps. When comparing resting-state seed and ICA images, the strongest DICE coefficients were obtained with the images A 3 ˜ for H b O 2 ( D I C E = 0.60 ) and A 2 ˜ for H b ( D I C E = 0.57 ).

4. Discussion

The results of this study showed that seed correlation and ICA resting-state methods are capable of identifying functional brain areas using intraoperative RGB imaging. Three patients were included in this study, including two patients in awake surgery and one patient under general anesthesia. It is interesting to note that the resting-state methods allow the identification of functional areas for the patient under general anesthesia and for the two patients who underwent awake surgery. However, the robustness and performance of these methods need to be evaluated on a larger number of patients. Intraoperative resting-state imaging has several advantages compared to task-based analyses: data acquisition is shorter, less complex, and less demanding for the patients, especially for those unable to perform the tasks.
The functional areas identified by the resting-state analyses present a strong similarity with those obtained with the task-based analysis. When comparing H b O 2 and H b task-based maps to resting-state seed maps and resting-state ICA maps A 4 ˜ H b O 2 and A 2 ˜ H b for patient 1, A 2 ˜ H b O 2 and A 1 ˜ H b for patient 2 and A 1 ˜ H b O 2 and A 3 ˜ H b for patient 3, the mean and standard deviation of the DICE coefficient are 0.55 and 0.29 , respectively (this notation is indicated mean ± standard deviation in the rest of the manuscript). The large dispersion of the DICE coefficient is due to the low values computed for patient 3. For patients 1 and 2, the values of the DICE coefficient computed between the task-based maps and resting-state seed maps ( H b O 2 and H b maps) are included between 0.77 and 0.85 ( D I C E : 0.81 ± 0.03 ), which indicates a strong similarity between resting-state seed and task-based maps. These resting-state seed maps also present a strong overlap with the task-based maps ( O v e r l a p : 0.76 ± 0.11 ). For patient 3, the values of the DICE coefficient are very low (for H b O 2 and H b maps, D I C E ( t b , r s s e e d ) 0.12 ) which indicates that the resting-state seeds maps do not match the task-based maps. Although the resting-state seed analysis makes it possible to identify a cortical area close to the motor area, the low values of the DICE coefficient are mainly due to the incorrect functional identification provided by the task-based analysis, which was not due to improper image acquisition. In order to increase the robustness of the task-based analysis, the patient’s H b and H b O 2 response function to an impulse stimulus could be experimentally measured. These response functions are patient dependent and differ depending on the type of cortical tissue [39]. Moreover, the neurovascular system evolves with age, which implies a change in hemodynamic response [32] and the progression of gliomas over time implies a change in the hemodynamic response [23].
For patients 1 and 2, the resting-state ICA maps ( A 4 ˜ H b O 2 and A 2 ˜ H b for patient 1 and A 2 ˜ H b O 2 and A 1 ˜ H b for patient 2) present a strong similarity with the task-based maps ( D I C E : 0.69 ± 0.06 ). This mean value is 15 % lower than the one obtained with the resting-state seed maps, and the standard deviation is 133 % higher than the one obtained with the resting-state seed maps. These differences are due to the detection of several other cortical networks using the ICA method, see Figure 3. These resting-state ICA maps also present a strong overlap with the task-based maps ( O v e r l a p : 0.65 ± 0.09 ). This mean value is 14 % lower than the one obtained with the resting-state seed maps, and the standard deviation is 18 % lower than the one obtained with the resting-state seed maps. For patient 3, the values of the DICE coefficient are very low (for H b O 2 and H b maps, D I C E ( t b , r s I C A ) 0.21 ) which indicates that the resting-state seeds maps do not match the task-based maps. However, the resting-state ICA maps A 2 ˜ makes it possible to identify a cortical area close to the motor area. When comparing the resting-state seed and ICA analyses, we notice that the ICA maps A 4 ˜ H b O 2 and A 2 ˜ H b for patient 1, A 2 ˜ H b O 2 and A 1 ˜ Hb for patient 2 and A 3 ˜ H b O 2 and A 2 ˜ H b for patient 3 present a strong similarity with the resting-state seed maps ( D I C E : 0.66 ± 0.11 ). These results suggest that the resting-state seed and ICA analyses are more robust that the task-based analysis for identifying functional brain areas.
For the patient 2, the tumor is directly observable on the RGB image. The binary masks on images A 2 ˜ H b , A 3 ˜ H b O 2 and A 5 ˜ H b are connected to the tumor. In these images, the resting-state ICA analysis seems to highlight patterns of spatial hemodynamic fluctuations close to the tumor and is likely to indicate an abnormal functional connectivity provoked by the tumor. Indeed, a fMRI resting-state study showed that abnormal functional connectivity could be detected not only adjacent to the visible tumor but also in distant brain tissue, even in the contralesional hemisphere [40]. Montgomery et al. [23] also demonstrated that tumor growth in an awake mouse brain disrupts the synchrony of both neuronal activity and hemodynamics, but did not directly assess the coupling relationship between neuronal activity and hemodynamics.

5. Conclusions

The resting-state seed method could be roughly represented as a “digital EBS” in the sense that the neurosurgeon has to select a portion of the cortex (seed) to identify the connected portion of tissue. However, the neurosurgeon must have an idea of the position of the functional area. In case the tumor has strongly displaced the functional areas, this method can be put in default. This issue could be addressed by using preoperative fMRI maps to automatically place the resting-state seeds. Thresholding operations (see Equation (4)) can be automated by using a linear general model combined with random field theory [41]. The optical resting-state maps could be projected on a three dimension neuroanatomy atlas, which would help to obtain a better understanding of the extent of the seed correlation and ICA maps. This would also allow to establish a comparison between optical resting-state maps and fMRI pre-operative maps. As opposed to fMRI and fNIRS resting-state analyses [17,33], the spatial patterns expressed in the ICA method cannot be sorted by comparing the patterns in the images to neuroanatomy atlas. This issue will be addressed in a future study by comparing optical and fMRI resting-state maps. The ICA method was implemented with 5 independent components. Li et al. [42] proposed a method to estimate the number of independent components for fMRI data, this method could be adapted to our data in future studies. In this feasibility study, resting-state maps were compared to task-based maps using the DICE and Overlap coefficients. The objective was to show that fMRI resting-state methods can be used to retrieve intraoperative resting state maps using RGB imaging. In a future study, a threshold value of the DICE and overlap coefficients could be defined to validate intraoperative resting-state maps against task based maps. For this purpose, a validated database containing task-based and resting-state functional maps is needed, which implies a larger number of patients, as well as a suitable methodology to compare the measured data with the database.
In this study, we present the methodology for the identification of resting-state networks using RGB imaging during neurosurgery. The detection of functional brain areas using the resting-state seed and ICA analyses presented a strong similarity with those identified with a task-based analysis. These areas corresponded to the identification provided by EBS when patients are awake and under general anesthesia. This work demonstrates that RGB imaging combined with quantitative modeling of brain hemodynamic biomarkers can robustly assess functional brain areas during patient rest and before brain tumor resection surgery. This reinforces the relevance of using conventional RGB imaging for intraoperative functional brain imaging.

Author Contributions

Conceptualization: C.C., L.M.-W., F.C.S., B.M. Methodology: C.C., L.M.-W., R.S., M.S., F.C.S., B.M. Software: C.C., L.M.-W., M.S. Writing—Original Draft: C.C. Writing—Review and Editing: C.C., L.M.-W., R.S., M.S., F.C.S., J.G., B.M. Supervision: B.M. Funding acquisition: B.M. Investigation: J.G., F.C.S. Resources: J.G. Project administration: B.M. All authors have read and agreed to the published version of the manuscript.

Funding

These works were funded by LABEX PRIMES (ANR-11-LABX-0063) of Université de Lyon, within the program “Investissements d’Avenir” (ANR-11-IDEX-0007), operated by the French National Research Agency (ANR); Cancŕopôle Lyon Auvergne Rhône Alpes (CLARA) within the program “OncoStarter”, Infrastructures d’Avenir en Biologie Santé (ANR-11-INBS-000), within the program “Investissements d’Avenir” operated by the French National Research Agency (ANR) and France Life Imaging (ANR-11-INBS-0006).

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the local ethics committee of Lyon University Hospital (France, Gliospect: 69 HCL14-0270).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Acknowledgments

We want to acknowledge the PILoT facility for the support provided for the image acquisition.

Conflicts of Interest

No conflict of interest, financial or otherwise, are declared by the authors.

Abbreviations

The following abbreviations are used in this manuscript:
fMRIfunctional Magnetic Resonance Imaging
fNIRSfunctional Near Infra-Red Spectroscopy
EBSElectrical Brain Stimulation
H b O 2 oxy hemoglobin
H b deoxy hemoglobin
tbtask-based
rsresting-state
ICAIndependent Component Analysis

References

  1. Ogawa, S.; Lee, T.M.; Kay, A.R.; Tank, D.W. Brain magnetic resonance imaging with contrast dependent on blood oxygenation. Proc. Natl. Acad. Sci. USA 1990, 87, 9868–9872. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Gerard, I.J.; Kersten-Oertel, M.; Petrecca, K.; Sirhan, D.; Hall, J.A.; Collins, D.L. Brain shift in neuronavigation of brain tumors: A review. Med. Image Anal. 2017, 35, 403–420. [Google Scholar] [CrossRef]
  3. Penfield, W.; Boldrey, E. Somatic motor and sensory representation in the cerebral cortex of man as studied by electrical stimulation. Brain 1937, 60, 389–443. [Google Scholar] [CrossRef]
  4. Pallud, J.; Mandonnet, E.; Corns, R.; Dezamis, E.; Parraga, E.; Zanello, M.; Spena, G. Technical principles of direct bipolar electrostimulation for cortical and subcortical mapping in awake craniotomy. Neurochirurgie 2017, 63, 158–163. [Google Scholar] [CrossRef] [PubMed]
  5. Chance, B.; Zhuang, Z.; UnAh, C.; Alter, C.; Lipton, L. Cognition-activated low-frequency modulation of light absorption in human brain. Proc. Natl. Acad. Sci. USA 1993, 90, 3770–3774. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Oelschlägel, M.; Meyer, T.; Morgenstern, U.; Wahl, H.; Gerber, J.; Reiß, G.; Koch, E.; Steiner, G.; Kirsch, M.; Schackert, G.; et al. Mapping of language and motor function during awake neurosurgery with intraoperative optical imaging. Neurosurg. Focus FOC 2020, 48, E3. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Caredda, C.; Mahieu-Williame, L.; Sablong, R.; Sdika, M.; Alston, L.; Guyotat, J.; Montcel, B. Intraoperative quantitative functional brain mapping using an RGB camera. Neurophotonics 2019, 6, 1–14. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Caredda, C.; Mahieu-Williame, L.; Sablong, R.; Sdika, M.; Guyotat, J.; Montcel, B. Real Time Intraoperative Functional Brain Mapping Based on RGB Imaging. IRBM 2021, 42, 189–197. [Google Scholar] [CrossRef]
  9. Caredda, C.; Mahieu-Williame, L.; Sablong, R.; Sdika, M.; Guyotat, J.; Montcel, B. Optimal Spectral Combination of a Hyperspectral Camera for Intraoperative Hemodynamic and Metabolic Brain Mapping. Appl. Sci. 2020, 10, 5158. [Google Scholar] [CrossRef]
  10. Caredda, C.; Mahieu-Williame, L.; Sablong, R.; Sdika, M.; Guyotat, J.; Montcel, B. Pixel-wise modified Beer-Lambert model for intraoperative functional brain mapping. In Clinical and Preclinical Optical Diagnostics II; Brown, J.Q., van Leeuwen, T.G., Eds.; International Society for Optics and Photonics, SPIE: Bellingham, WA, USA, 2019; Volume 11073, pp. 148–152. [Google Scholar] [CrossRef]
  11. Caredda, C.; Mahieu-Williame, L.; Sablong, R.; Sdika, M.; Guyotat, J.; Montcel, B. Real time intraoperative functional brain mapping using a RGB camera. In Clinical and Preclinical Optical Diagnostics II; Brown, J.Q., van Leeuwen, T.G., Eds.; International Society for Optics and Photonics, SPIE: Bellingham, WA, USA, 2019; Volume 11073, pp. 17–21. [Google Scholar] [CrossRef] [Green Version]
  12. Caredda, C.; Mahieu-Williame, L.; Sablong, R.; Sdika, M.; Guyotat, J.; Montcel, B. Intraoperative functional and metabolic brain mapping using hyperspectral imaging. In Clinical and Translational Neurophotonics 2020; Madsen, S.J., Yang, V.X.D., Thakor, N.V., Eds.; International Society for Optics and Photonics, SPIE: Bellingham, WA, USA, 2020; Volume 11225, pp. 24–30. [Google Scholar] [CrossRef]
  13. Fox, M.D.; Raichle, M.E. Spontaneous fluctuations in brain activity observed with functional magnetic resonance imaging. Nat. Rev. Neurosci. 2007, 8, 700–711. [Google Scholar] [CrossRef] [PubMed]
  14. Biswal, B.; Zerrin Yetkin, F.; Haughton, V.M.; Hyde, J.S. Functional connectivity in the motor cortex of resting human brain using echo-planar mri. Magn. Reson. Med. 1995, 34, 537–541. [Google Scholar] [CrossRef] [PubMed]
  15. Schneider, F.; Pailler, M.; Faillenot, I.; Vassal, F.; Guyotat, J.; Barral, F.G.; Boutet, C. Presurgical Assessment of the Sensorimotor Cortex Using Resting-State fMRI. Am. J. Neuroradiol. 2016, 37, 101–107. [Google Scholar] [CrossRef] [Green Version]
  16. Signorelli, F.; Guyotat, J.; Schneider, F.; Isnard, J.; Bret, P. Technical Refinements for Validating Functional MRI-Based Neuronavigation Data by Electrical Stimulation during Cortical Language Mapping. Minim. Invasive Neurosurg. MIN 2003, 46, 265–268. [Google Scholar] [CrossRef] [PubMed]
  17. Damoiseaux, J.S.; Rombouts, S.A.R.B.; Barkhof, F.; Scheltens, P.; Stam, C.J.; Smith, S.M.; Beckmann, C.F. Consistent resting-state networks across healthy subjects. Proc. Natl. Acad. Sci. USA 2006, 103, 13848–13853. [Google Scholar] [CrossRef] [Green Version]
  18. Bisdas, S.; Charyasz-Leks, E.; Roder, C.; Tatagiba, M.S.; Ernemann, U.; Klose, U. Evidence of Resting-state Activity in Propofol-anesthetized Patients with Intracranial Tumors. Acad. Radiol. 2016, 23, 192–199. [Google Scholar] [CrossRef]
  19. Fukunaga, M.; Horovitz, S.G.; van Gelderen, P.; de Zwart, J.A.; Jansma, J.M.; Ikonomidou, V.N.; Chu, R.; Deckers, R.H.; Leopold, D.A.; Duyn, J.H. Large-amplitude, spatially correlated fluctuations in BOLD fMRI signals during extended rest and early sleep stages. Magn. Reson. Imaging 2006, 24, 979–992. [Google Scholar] [CrossRef]
  20. Mesquita, R.C.; Franceschini, M.A.; Boas, D.A. Resting state functional connectivity of the whole head with near-infrared spectroscopy. Biomed. Opt. Express 2010, 1, 324. [Google Scholar] [CrossRef] [PubMed]
  21. White, B.R.; Snyder, A.Z.; Cohen, A.L.; Petersen, S.E.; Raichle, M.E.; Schlaggar, B.L.; Culver, J.P. Resting-state functional connectivity in the human brain revealed with diffuse optical tomography. NeuroImage 2009, 47, 148–156. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Ma, Y.; Shaik, M.A.; Kozberg, M.G.; Kim, S.H.; Portes, J.P.; Timerman, D.; Hillman, E.M.C. Resting-state hemodynamics are spatiotemporally coupled to synchronized and symmetric neural activity in excitatory neurons. Proc. Natl. Acad. Sci. USA 2016, 113, E8463–E8471. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Montgomery, M.K.; Kim, S.H.; Dovas, A.; Zhao, H.T.; Goldberg, A.R.; Xu, W.; Yagielski, A.J.; Cambareri, M.K.; Patel, K.B.; Mela, A.; et al. Glioma-Induced Alterations in Neuronal Activity and Neurovascular Coupling during Disease Progression. Cell Rep. 2020, 31, 107500. [Google Scholar] [CrossRef] [PubMed]
  24. Wang, J.; Dong, Q.; Niu, H. The minimum resting-state fNIRS imaging duration for accurate and stable mapping of brain connectivity network in children. Sci. Rep. 2017, 7, 6461. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Whitlow, C.T.; Casanova, R.; Maldjian, J.A. Effect of Resting-State Functional MR Imaging Duration on Stability of Graph Theory Metrics of Brain Network Connectivity. Radiology 2011, 259, 516–524. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Fang, Q.; Boas, D.A. Monte Carlo simulation of photon migration in 3D turbid media accelerated by graphics processing units. Opt. Express 2009, 17, 20178–20190. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Sdika, M.; Alston, L.; Rousseau, D.; Guyotat, J.; Mahieu-Williame, L.; Montcel, B. Repetitive motion compensation for real time intraoperative video processing. Med. Image Anal. 2019, 53, 1–10. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Sdika, M.; Alston, L.; Mahieu-Williame, L.; Guyotat, J.; Rousseau, D.; Montcel, B. Robust real time motion compensation for intraoperative video processing during neurosurgery. In Proceedings of the 2016 IEEE 13th International Symposium on Biomedical Imaging (ISBI), Prague, Czech Republic, 13–16 April 2016; pp. 1046–1049. [Google Scholar] [CrossRef]
  29. Oelschlägel, M.; Meyer, T.; Wahl, H.; Sobottka, S.B.; Kirsch, M.; Schackert, G.; Morgenstern, U. Evaluation of intraoperative optical imaging analysis methods by phantom and patient measurements. Biomed. Technol. Eng. 2013, 58, 257–267. [Google Scholar] [CrossRef]
  30. Bradski, G. The OpenCV Library. Dr. Dobb’s J. Softw. Tools 2000, 25, 120–123. [Google Scholar]
  31. Frigo, M.; Johnson, S.G. The Design and Implementation of FFTW3. Proc. IEEE 2005, 93, 216–231. [Google Scholar] [CrossRef] [Green Version]
  32. Veldsman, M.; Cumming, T.; Brodtmann, A. Beyond BOLD: Optimizing functional imaging in stroke populations: Optimizing BOLD Imaging in Stroke. Hum. Brain Mapp. 2015, 36, 1620–1636. [Google Scholar] [CrossRef] [PubMed]
  33. White, B.R.; Liao, S.M.; Ferradal, S.L.; Inder, T.E.; Culver, J.P. Bedside optical imaging of occipital resting-state functional connectivity in neonates. NeuroImage 2012, 59, 2529–2538. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Comon, P.; Jutten, C. Handbook of Blind Source Separation: Independent Component Analysis and Applications, 1st ed.; Academic Press, Inc.: Cambridge, MA, USA, 2010. [Google Scholar]
  35. Hyvarinen, A. Fast and robust fixed-point algorithms for independent component analysis. IEEE Trans. Neural Netw. 1999, 10, 626–634. [Google Scholar] [CrossRef] [Green Version]
  36. Pedregosa, F.; Varoquaux, G.; Gramfort, A.; Michel, V.; Thirion, B.; Grisel, O.; Blondel, M.; Prettenhofer, P.; Weiss, R.; Dubourg, V.; et al. Scikit-learn: Machine Learning in Python. J. Mach. Learn. Res. 2011, 12, 2825–2830. [Google Scholar]
  37. Harris, C.R.; Millman, K.J.; van der Walt, S.J.; Gommers, R.; Virtanen, P.; Cournapeau, D.; Wieser, E.; Taylor, J.; Berg, S.; Smith, N.J.; et al. Array programming with NumPy. Nature 2020, 585, 357–362. [Google Scholar] [CrossRef] [PubMed]
  38. Dice, L.R. Measures of the Amount of Ecologic Association Between Species. Ecology 1945, 26, 297–302. [Google Scholar] [CrossRef]
  39. Bruyns-Haylett, M.; Zheng, Y.; Berwick, J.; Jones, M. Temporal coupling between stimulus-evoked neural activity and hemodynamic responses from individual cortical columns. Phys. Med. Biol. 2010, 55, 2203–2219. [Google Scholar] [CrossRef]
  40. Stoecklein, V.M.; Stoecklein, S.; Galiè, F.; Ren, J.; Schmutzer, M.; Unterrainer, M.; Albert, N.L.; Kreth, F.W.; Thon, N.; Liebig, T.; et al. Resting-state fMRI detects alterations in whole brain connectivity related to tumor biology in glioma patients. Neuro-Oncol. 2020, 22, 1388–1398. [Google Scholar] [CrossRef]
  41. Friston, K.J. (Ed.) Statistical Parametric Mapping: The Analysis of Funtional Brain Images, 1st ed.; Elsevier: Amsterdam, The Netherlands; Academic Press: Boston, MA, USA, 2007. [Google Scholar]
  42. Li, Y.O.; Adali, T.; Calhoun, V.D. Estimating the number of independent components for functional magnetic resonance imaging data. Hum. Brain Mapp. 2007, 28, 1251–1266. [Google Scholar] [CrossRef]
Figure 1. Overview of the algorithm [7] for the computation of concentration changes time curves, the calculation of functional maps (task-based and resting-state maps) and the comparison of functional areas identified by functional maps.
Figure 1. Overview of the algorithm [7] for the computation of concentration changes time curves, the calculation of functional maps (task-based and resting-state maps) and the comparison of functional areas identified by functional maps.
Diagnostics 11 02067 g001
Figure 2. In the first column, the first image of the video sequence acquired for the three patients was represented ( I ( 0 ) ). In the second and third columns, the H b O 2 and H b task-based maps were plotted, respectively. In the fourth and fifth columns, the H b O 2 and H b resting-state seed maps were plotted, respectively. The seeds used for the computation of the resting-state maps were indicated by white spots and were located at the level of the motor area identified by electrical brain stimulation (letter M). The colorbar indicated the Pearson correlation coefficient values computed for each pixel. The green contours plotted in task-based and resting-state maps delimited the extent of the thresholded images (see Equation (4)). For patient 2 maps, the dotted white circle delimited the patient’s tumor. For patients 1 and 3, tumors were not observable on optical images.
Figure 2. In the first column, the first image of the video sequence acquired for the three patients was represented ( I ( 0 ) ). In the second and third columns, the H b O 2 and H b task-based maps were plotted, respectively. In the fourth and fifth columns, the H b O 2 and H b resting-state seed maps were plotted, respectively. The seeds used for the computation of the resting-state maps were indicated by white spots and were located at the level of the motor area identified by electrical brain stimulation (letter M). The colorbar indicated the Pearson correlation coefficient values computed for each pixel. The green contours plotted in task-based and resting-state maps delimited the extent of the thresholded images (see Equation (4)). For patient 2 maps, the dotted white circle delimited the patient’s tumor. For patients 1 and 3, tumors were not observable on optical images.
Diagnostics 11 02067 g002
Figure 3. In the first column, the task-based maps were plotted. The spatial distribution of Δ C H b O 2 and Δ C H b fluctuations identified by ICA were represented in other columns. In columns 2 to 6, matrices A 1 ˜ to A 5 ˜ were represented for each chromophore and for each patient. Each motor area identified by electrical brain stimulation was indicated by a white spot and by the letter M. The colorbar indicated the range of variation of the Pearson correlation coefficient (task-based maps) and the range of variation of the ICA matrices. The resting-state ICA matrices were normalized with respect to the absolute value of their maximum, keeping zero in the center of the color scale. The green contours plotted in task-based and resting-state maps delimited the extent of the thresholded images (see Equation (4)). For patient 2 maps, the dotted white circle delimited the patient’s tumor. For patients 1 and 3, tumors were not observable on optical images.
Figure 3. In the first column, the task-based maps were plotted. The spatial distribution of Δ C H b O 2 and Δ C H b fluctuations identified by ICA were represented in other columns. In columns 2 to 6, matrices A 1 ˜ to A 5 ˜ were represented for each chromophore and for each patient. Each motor area identified by electrical brain stimulation was indicated by a white spot and by the letter M. The colorbar indicated the range of variation of the Pearson correlation coefficient (task-based maps) and the range of variation of the ICA matrices. The resting-state ICA matrices were normalized with respect to the absolute value of their maximum, keeping zero in the center of the color scale. The green contours plotted in task-based and resting-state maps delimited the extent of the thresholded images (see Equation (4)). For patient 2 maps, the dotted white circle delimited the patient’s tumor. For patients 1 and 3, tumors were not observable on optical images.
Diagnostics 11 02067 g003
Table 1. Information on patients and acquisitions.
Table 1. Information on patients and acquisitions.
Patient 1Patient 2Patient 3
GenderFemaleMaleFemale
Age375745
TumorLow grade gliomaLung cancer metastasisLow grade glioma
Surgical windowRight hemisphereRight hemisphereRight hemisphere
General statusAwakeGeneral anesthesiaAwake
Task-based analysisTaskLeft-hand movementLeft-hand movementLeft-hand movement
performed by the patientperformed by an external personperformed by the patient
Number of cycles233
Acquisition duration1 min2 min2 min
Resting-state analysisPatient statusLooked at a medical practitionerUnder general anesthesiaLooked at a medical practitioner
and did not make any movementsand did not make any movementsand did not make any movements
Acquisition duration1 min 40 s2 min 20 s2 min 20 s
Table 2. DICE and overlap coefficients computed between task-based ( t b ) and resting-state seed ( r s s e e d ) binary maps.
Table 2. DICE and overlap coefficients computed between task-based ( t b ) and resting-state seed ( r s s e e d ) binary maps.
Patient 1Patient 2Patient 3
H b O 2 D I C E ( t b , r s s e e d ) 0.85 0.77 0.12
O v e r l a p ( t b , r s s e e d ) 0.86 0.64 0.11
H b D I C E ( t b , r s s e e d ) 0.84 0.78 0.10
O v e r l a p ( t b , r s s e e d ) 0.89 0.65 0.09
Table 3. DICE and overlap coefficients computed between task-based ( t b ) and resting-state ICA ( r s I C A ) maps. The DICE coefficients computed between resting-state seed ( r s s e e d ) and ICA ( r s I C A ) maps are also indicated.
Table 3. DICE and overlap coefficients computed between task-based ( t b ) and resting-state ICA ( r s I C A ) maps. The DICE coefficients computed between resting-state seed ( r s s e e d ) and ICA ( r s I C A ) maps are also indicated.
Patient 1Patient 2Patient 3
A 1 ˜ A 2 ˜ A 3 ˜ A 4 ˜ A 5 ˜ A 1 ˜ A 2 ˜ A 3 ˜ A 4 ˜ A 5 ˜ A 1 ˜ A 2 ˜ A 3 ˜ A 4 ˜ A 5 ˜
H b O 2 D I C E ( t b , r s I C A ) 0.490.250.500.570.200.470.730.140.000.070.200.120.130.060.06
O v e r l a p ( t b , r s I C A ) 0.520.240.460.520.190.440.600.110.000.060.190.120.120.070.06
D I C E ( r s s e e d , r s I C A ) 0.460.310.490.520.200.550.870.150.000.030.460.350.600.100.23
H b D I C E ( t b , r s I C A ) 0.590.740.060.140.260.750.000.050.510.070.150.160.210.080.20
O v e r l a p ( t b , r s I C A ) 0.700.700.060.140.250.770.000.040.410.060.150.150.180.080.18
D I C E ( r s s e e d , r s I C A ) 0.600.700.160.230.170.690.000.000.650.070.140.570.030.410.12
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Caredda, C.; Mahieu-Williame, L.; Sablong, R.; Sdika, M.; Schneider, F.C.; Guyotat, J.; Montcel, B. Intraoperative Resting-State Functional Connectivity Based on RGB Imaging. Diagnostics 2021, 11, 2067. https://doi.org/10.3390/diagnostics11112067

AMA Style

Caredda C, Mahieu-Williame L, Sablong R, Sdika M, Schneider FC, Guyotat J, Montcel B. Intraoperative Resting-State Functional Connectivity Based on RGB Imaging. Diagnostics. 2021; 11(11):2067. https://doi.org/10.3390/diagnostics11112067

Chicago/Turabian Style

Caredda, Charly, Laurent Mahieu-Williame, Raphaël Sablong, Michaël Sdika, Fabien C. Schneider, Jacques Guyotat, and Bruno Montcel. 2021. "Intraoperative Resting-State Functional Connectivity Based on RGB Imaging" Diagnostics 11, no. 11: 2067. https://doi.org/10.3390/diagnostics11112067

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop