1. Introduction
Magnetic resonance imaging (MRI) and computed tomography (CT) are complementary imaging technologies, each with advantages and limitations for certain applications. One of the advantages of CT imaging is its relatively short scanning time, which renders it less sensitive to patient movement than MRI. MRI has a number of drawbacks; it is time-consuming, noisy, and one in six patients suffer from claustrophobia in MRI scanners [
1]. However, MR images often provide superior anatomical and functional information over CT images, in addition to the superior information richness of MRI over CT with various techniques for weighting imaging that can be performed in a combination with different MR sequence protocols. This variety of functions gives the MRI flexibility in the display of tissue anatomy, enabling it to focus on the particular information critical to a given clinical application. In fact, biological tissue is often heterogeneous and, therefore, has heterogeneous MR parameters, including proton density, Tl relaxation time, T2 relaxation time, diffusion coefficients, and others.
Accordingly, in many clinical settings, it would often be desirable to perform multiple MR acquisitions, each focusing on a different contrast mechanism to ensure that the clinician is provided with a broad spectrum of information to form, ideally, a comprehensive and accurate picture of the subject. Several studies have been dedicated to the generation of synthetic images from other real acquired images by different imaging modalities, including the generation of synthetic CT images from real MR images for the purpose of dose-calculation accuracy, or the generation of a pseudo-CT of the head from anatomical MR images using well-defined anatomical atlases, image registration, and fusion technique [
2].
A simple method of creating pseudo-CT images from MRI images for improving dose calculations involves the manual segmentation of some tissue classes and allocating a different CT# value to each class [
3]. Research works that have investigated the automatic mapping of MR images to electron density data have used either atlas-based [
4,
5,
6,
7,
8,
9] or data-based approaches [
10,
11,
12,
13,
14,
15].
The problem of mapping the relationship between the MR information and the corresponding CT information was addressed by many researchers and reported in many scientific papers in the interest of generating clinically relevant synthetic/pseudo-CT anatomical data from MRI images for the purpose of attenuation correction in PET imaging, dose delivery and treatment planning in radiotherapy, and patient positioning for integration of PET and MR modalities into a combined PET/MR scanner [
16]. For instance, Johansson et al. [
13] presented a method for generating a substitute CT image from a set of MR images for the head and neck regions using a Gaussian mixture regression model to link the voxel HU (relative electron density) values in CT images to the voxel values in T2-weighted MR images acquired using a 3D spin echo-based sequence and two dual-echo ultrashort echo time-pulse sequences with different echo times and flip angles. The relation between MRI intensity and electron density was derived from calibrated HU values by Kapanen et al. [
12]. Their proposed method enabled the generation of clinically relevant pseudo-CT images for the pelvic bones from T1/T2 *-weighted gradient echo MRI image series. Sjölund et al. [
17] proposed a method of atlas-based regression to generate a patient-specific, pseudo-CT image of the head from corresponding anatomical MR images. On the other hand, Andreasen et al. [
18] generated pseudo-CT images from T1-weighted MR images using the patch method instead of using the voxel- or atlas-based method, while Demol et al. [
19] generate pseudo-CT images from MR images for radiotherapy treatment dose-calculations purposes by combining an atlas-based method with MR intensity transformation.
Deep-learning methodology has also been used to generate CT images from MR images [
20,
21]. The method was fast and accurate and achieved better results than conventional methods, such as atlas-based or batch methods. However, the method mainly depended on the alignment between MR and CT images for the same patient. Therefore, J. M. Wolterink [
22] proposed a new model called generative adversarial network (GAN) with unpaired MR and CT images. The model consisted of two synthetic convolutional CNN models followed by two discriminator CNNs. The result was accurate and very close to real CT images.
On the other hand, most recent studies, including the study by Li Y et al. [
23], employed artificial intelligence techniques to produce a counterpart to pseudo-MR/CT. The approach of Li Y et al. mainly depended on supervised and unsupervised algorithms of CT generation from MR or even MR from CT. For the supervised method, they employed U-Net, while for the unsupervised method, they used cycle-consistent adversarial networks. Their results were subjective to the parameters of their model. Meanwhile, Groot Koerkamp et al. [
24] evaluated the dosimetric accuracy of dose calculations based on synthetic CT for breast radiotherapy, and investigated the required number of bulk-density levels.
Investigating the research work in the literature, including the aforementioned studies, indicated that literature is still lacking studies of the generation of synthetic MR images from real CT images. Therefore, the aim of this research study was to initiate a new approach to generating synthetic MR images from real CT images, and to investigate the validity of this new approach.
2. Materials and Methods
2.1. Phantom Imaging
CT images were acquired first, using a CT scanner (Optima CT660, GE Healthcare, Chicago, IL, USA) for a selected slice of a Triple-Modality 3D Abdominal Phantom (Model 057A, Computerized Imaging Reference Systems, Incorporated (CIRS), Norfolk, VA, USA).
Figure 1 illustrates the internal structure of the selected slice.
The CT acquisition parameters were 120 kVp/560 mAs, slice thickness = 2.5 mm, field of view (FOV) = 30 cm, and matrix size = 256 × 256 pixels. The acquisition was repeated 9 times, then the images were averaged to increase the signal-to-noise ratio (SNR).
After imaging the phantom with the CT scanner, the same slice was imaged with a clinical 1.5-T MRI system (Optima MR360, GE Healthcare, Chicago, IL, USA). The MRI system was equipped with a phased-array body coil to receive RF signals. All MR images were acquired using a spin echo (SE) pulse sequence with the following parameters: Slice thickness = 2.5 mm, FOV = 30 cm × 30 cm, matrix size = 256 × 256 pixels, bandwidth (BW) = 15.6 kHz.
For T1-map and ρ-map calculations, a series of MR images was acquired for the same slice as imaged by the CT, with echo time (TE) = 20 ms and repetition times (TR) = 100, 200, 400, 800, 1250, 2000, 4000, and 5000 ms. For T2-map calculation, another series of MR images was acquired with TE = 10, 15, 25, 40, 60, 90, 130, 180, and 240 ms; and TR = 2000 ms.
To test the validity of the approach used in this study, the generated synthetic MR images were compared to their corresponding real MR images (T1-weighted image with TR/TE = 500 ms/10 ms, T2-weighted image with TR/TE = 2000 ms/130 ms, and ρ-weighted image with TR/TE = 4000 ms/10 ms).
2.2. Knee Imaging
In order to confirm the applicability of the proposed approach to clinical imaging on human subjects, the procedure performed on the phantom was repeated on human subjects, whose right knee was firstly imaged by the CT scanner using the same parameters as described in
Section 2.1. Then, the same slice was imaged using the 1.5-T MRI scanner, and a volume birdcage RF coil was utilized to receive and detect the RF signal. The same pulse sequence was used for knee imaging as for the phantom imaging, as well as the same values of slice thickness, FOV, matrix size, and BW. However, the series of MR images that was acquired to calculate the T1- and ρ- maps used TR = 100, 200, 400, 800, 2000, 3000, and 4000 ms while keeping TE constant at 20 ms. Another series of images with TR = 2000 ms and TE = 10, 15, 40, 60, 90, 130, 180, and 240 ms was acquired to calculate the T2-map.
Two generated synthetic MR images were compared (Details in
Section 3.5) to the corresponding real MR images of the right knee of a volunteer subject (TR/TE = 1200 ms/20 ms, and TR/TE = 2000 ms/25 ms). Prior to scanning, the volunteer was asked to sign a consent form describing the purpose and procedure of the experiment, in addition to all associated risks.
2.3. Theory
2.3.1. Spin-Echo Pulse Sequence Steady State
The MR imaging spin-echo pulse sequence was selected for acquiring the real MR images and for simulating and generating the corresponding synthetic MR images. The amplitude of the spin-echo signal is given:
When TE
TR, Equation (1) can be simplified to:
The acquired CT and MR series images with T1, T2, and
ρ weightings were subjected to two main processes: registration and segmentation. The averaged CT image was considered as the reference image for registration purposes, while the 2D MR images were defined as the distorted images. Registration between the MR and the CT images was performed using a rigid transformation model with bicubic interpolation taking in consideration the optimization issues. On the other hand, the CT image was segmented using fuzzy C-means algorithm [
25] in order to extract the liver partition.
2.3.2. T1-Map Calculation
Equation (1) can be re-written as a function of TR:
where,
=
,
2.3.3. T2-Map Calculation
The simplified equation of MR image intensity (Equation (2)) can be manipulated as:
where
2.3.4. ρ-Map Calculation
The proton density map is derived from the series of
TR images using the linear equation:
where
.
2.3.5. CT# to MRI Contrast Parameter Mapping
Once the T1, T2, and ρ parameter maps for the selected slice were calculated from the acquired MR image series, where these parameters should be well-defined for each pixel of tissue-mimicking type, the mapping functions that related these contrast parameters to the corresponding pixel’s CT numbers (CT#) were obtained individually using a surface fitting model of piecewise linear interpolation. This model employed the MRI contrast parameter of each individual map as the dependent variable versus two independent variables, namely, the CT# mean and standard deviation, which were extracted from a 5 × 5 window around each CT liver pixel.
In order to generate variously weighted, simulated (synthetic) MR images of a new slice localized close in position to the former CT slice, MRI- T1, T2, and ρ maps from the new real CT image were calculated by applying the obtained mapping functions and calculating the signal intensity, assuming proper TE and TR times.
A new CT image was acquired for a different phantom slice location near the original slice. The acquisition was repeated 9 times for averaging purposes in order to enhance the SNR. The positions of the newly selected real slices imaged by CT were marked to avoid misalignment with the real MR images that were acquired in the validation stage. Real MR images of the same new slice were acquired using the same practical contrast parameters (TE and TR times) used in the simulation procedure for each weighted MR image. The resultant real MR differently weighted images were compared with the corresponding simulated images to investigate the validity of the proposed approach. The similarities between the generated synthetic MR images from the real CT image and the real MR images of the same slice were tested using two parameters. The first was the slope between the generated/synthetic MR image segment array (liver segment) and the real MR image segment array after they had been reshaped to vectors. The other similarity-testing parameter was the percentage root-mean-square difference (PRD) which is given by:
where the
real and
synthetic are the vectors with size
N of the real and the generated/synthetic MR image segments, respectively.
4. Discussion
The novelty of this research study lies in generating synthetic MR images with different weightings from a single real CT image using predefined mapping functions. Creating these mapping functions, which were used to find the relationship between CT#s in the CT image and MR values of T1, T2, and ρ for the same tissue type, is considered one of the biggest challenges of this study.
To overcome the limitation of producing the one to many mappings, which resulted from using the CT# values alone directly in creating the mapping functions, two independent features were used (mean value and standard deviation of CT#s of a 5 × 5 window around each pixel). The window size 5 × 5 was chosen to sufficiently represent the distribution of tissue type without overlapping with other surrounding tissue types that might result if a larger window size was used.
The regenerated maps using the mapping functions were plotted versus the original maps after both maps have been reshaped to vectors, then the slope and PRD values of the fitting line were calculated to quantitatively evaluate the similarities between the maps. For identical images, the slope value should ideally be equal to one and PRD should be 0%. The similarity values (represented by slope values) were very high (0.976, 0.999, and 0.914 for T1, T2, and ρ maps, respectively) with very small PRD (2.3%, 1.9%, and 1.4% for T1, T2, and ρ maps, respectively) which demonstrated the effectiveness and consistency of these mapping functions.
After the mapping functions were stored for the selected slice, they were used to generate different weighted MR images (by properly selecting the values of TR and TE) at different locations in the surrounding region. The new tested location was 10-mm away from the original slice in the axial plane. The quality of these generated weighted images was quantitatively evaluated by comparing them to real MR images acquired by an MRI scanner at the same location using the same TR and TE values. The results obtained for the similarity and PRD values confirmed the validity of the approach. The generated T2-weighted images showed the best matching upon the calculation of their similarities to the corresponding real images (slope value was 0.903 for the slice 10 mm away from the original slice). On the other hand, T1-weighted and ρ-weighted images showed similarity values that were poorer, but still satisfactory, when compared to their corresponding real images (slope values for the slice 10 mm away from the original slice were 0.731 and 0.232 for T1-weighted and ρ-weighted images, respectively).
The low slope values between the liver segment of the generated synthetic images and the real acquired ρ-weighted images could be attributed to various factors that ultimately formed the signal AE of Equation(1) in each pixel, such as the static magnetic field (B0) and the phantom temperature, where the acquired MRI signal was proportional to B0 and inversely proportional to absolute temperature, the RF-coil receiver amplifier gain which had the largest impact on signal scale, as well as other factors. However, these factors were the same for all pixels and considered as a constant scale multiplied with the proton density (ρ) of each tissue-mimicking pixel. The signal’s scale variety can be equalized by scale normalization.
The PRD values for the three MR weighting images were larger for the new location (10-mm away in the axial plane) compared to those for the original/reference slice. This increase in the PRD values could be related to the fact that mapping functions became less effective with increasing distance from the original slice, because new tissue types could be part of the new slice position, and therefore, different mapping parameters were required to describe the relatedness between the CT# and the T1, T2, and ρ parameters. It could also be related to the inhomogeneity of the synthetic tissue-mimicking materials caused by air bubbles that were noticed in the phantom during imaging, or to other manufacturing factors. This limitation can be avoided, and PRD values can be reduced by dividing the body volume into a number of slabs (regions) and creating a separate mapping function for each slab. Doing so will improve the quality of the generated weighted images because the variation in tissue properties and structures will be minimized. The contribution of more features (Entropy, energy, correlation, …etc.) extracted from the CT# pixel and its neighborhood should emphasize the identity of the CT tissue pixel, and therefore, could improve the mapping functions and consequently improve the quality of the generated synthetic MR images.
Figure 4 showed one to many mapping when the CT# was mapped with the corresponding parameters of T1, T2 and
ρ, which means that either the mapping was not unique or the inverse mapping did not occur. This was due to the relatively large span of CT# in human tissue and the overlapping ranges of CT# for different tissues. For example, the CT#s of the liver and spleen tissues span from 40–60 HU. Furthermore, taking into consideration that the voxel, depending on its thickness, may include more than one tissue type, the measured attenuation coefficient value, and consequently the CT#, is an average value of the voxel’s tissue composition. To obtain a unique mapping for each slice voxel (pixel), we must engage more tissue CT# statistical features, such as the CT# mean and standard deviation of a window centered at the voxel (pixel) coordinates, as employed in this study and shown in
Figure 5.
The human knee was chosen to clinically validate the effectiveness of the proposed approach because of the large diversity of its tissues (e.g., cartilage, tendons, ligaments, muscles, fat, bones with different density … etc.). In addition, the knee has no involuntarily moving parts, in contrast to the abdominal region, which would have caused motion artifacts if it had been chosen, especially as the acquisition of an MR image using the selected MRI sequence (spin-echo) takes several minutes. Another reason for choosing the knee is the availability of the knee external RF receive coil, which can provide MR images with high contrast to noise ratio and so minimize the need for averaging, consequently shortening image acquisition time.
The knee clinical preliminary results showed very good agreement with the results obtained from the phantom, where the generated synthetic pseudo-MR images obtained from CT-MRI mapping had high similarity to those actually acquired by the MRI scanner using the same TE and TR times. These promising results encourage more extensive study of the human knee in future using a larger subject dataset. Additionally, future work could include generating CT-MRI mapping functions for other organs to establish an atlas for a complete anatomical region.
Magnetic resonance imaging (MRI) relies on optimal scanning parameters to achieve maximal signal-to-noise ratio (SNR) and high contrast-to-noise ratio (CNR) between tissues, resulting in high quality images. The optimization of such parameters is often laborious, time consuming, and user-dependent, making harmonization of imaging parameters a difficult task. The clinical preliminary results of knee images suggest that the current study, in the context of the completion of the composition of atlases for certain regions of the body and further validation with a larger cohort, has many possible clinical applications, including generating synthetic MR images of these regions, for which radiologists can try different TE and TR values in a short time and at no cost, then decide which values produce the best synthetic weighted image (the optimal in vivo scanning parameters) to be used in the real acquisition. However, it is worth noting that the proposed approach is not in any way an alternative to the acquisition of real MR images for accurate and efficient diagnosis. The simulation program may also be used to harmonize MRI acquisition parameters across scanners from different vendors [
26]. Additionally, a potential objective of the current work that may be considered in future is the generation of another MRI image set using different MRI sequences, once the T1, T2 and
ρ maps have been obtained from the real CT image using the already built mapping models (gradient-echo (GRE) sequence, for example). However, the confirmation and validation of those applications require more analysis and experimentation.