Next Article in Journal
Improving Performance of the PRYSTINE Traffic Sign Classification by Using a Perturbation-Based Explainability Approach
Next Article in Special Issue
Cardiac Magnetic Resonance Imaging in Immune Check-Point Inhibitor Myocarditis: A Systematic Review
Previous Article in Journal
A Priori Information Based Time-Resolved 3D Analysis of the Trajectory and Spatial Orientation of Fast-Moving Objects Using High-Speed Flash X-ray Imaging
Previous Article in Special Issue
Dataset Growth in Medical Image Analysis Research
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Discrete Shearlets as a Sparsifying Transform in Low-Rank Plus Sparse Decomposition for Undersampled (k, t)-Space MR Data

by
Nicholas E. Protonotarios
1,*,
Evangelia Tzampazidou
2,3,
George A. Kastis
2 and
Nikolaos Dikaios
2
1
Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge CB3 0WA, UK
2
Mathematics Research Center, Academy of Athens, 11527 Athens, Greece
3
Department of Physics, National Kapodistrian University of Athens, 15771 Athens, Greece
*
Author to whom correspondence should be addressed.
J. Imaging 2022, 8(2), 29; https://doi.org/10.3390/jimaging8020029
Submission received: 26 November 2021 / Revised: 19 January 2022 / Accepted: 27 January 2022 / Published: 29 January 2022
(This article belongs to the Special Issue Intelligent Strategies for Medical Image Analysis)

Abstract

:
The discrete shearlet transformation accurately represents the discontinuities and edges occurring in magnetic resonance imaging, providing an excellent option of a sparsifying transform. In the present paper, we examine the use of discrete shearlets over other sparsifying transforms in a low-rank plus sparse decomposition problem, denoted by L + S . The proposed algorithm is evaluated on simulated dynamic contrast enhanced (DCE) and small bowel data. For the small bowel, eight subjects were scanned; the sequence was run first on breath-holding and subsequently on free-breathing, without changing the anatomical position of the subject. The reconstruction performance of the proposed algorithm was evaluated against k-t FOCUSS. L + S decomposition, using discrete shearlets as sparsifying transforms, successfully separated the low-rank (background and periodic motion) from the sparse component (enhancement or bowel motility) for both DCE and small bowel data. Motion estimated from low-rank of DCE data is closer to ground truth deformations than motion estimated from L and S. Motility metrics derived from the S component of free-breathing data were not significantly different from the ones from breath-holding data up to four-fold undersampling, indicating that bowel (rapid/random) motility is isolated in S. Our work strongly supports the use of discrete shearlets as a sparsifying transform in a L + S decomposition for undersampled MR data.

1. Introduction

Robust principal component analysis (RPCA) techniques [1,2] have been proposed to decompose dynamic MR images to a low-rank and a sparse component. The low-rank should ideally contain the background and periodic motion, whereas the sparse component should include rapid intensity changes including noise, signal enhancement, non-periodic deformations, etc. Reconstruction algorithms from undersampled data based on RPCA have been previously suggested in the literature [3,4,5,6], and were applied mainly to dynamic contrast enhanced (DCE) and cardiac perfusion data [7]. Previous studies involving RPCA-related medical imaging analysis were performed in order to isolate (i) noise from the signal [6], (ii) enhancement in DCE imaging from the background respiratory motion [4,5,8], and (iii) bowel motility from respiratory motion [9]. A potential benefit in DCE image registration involves the fact that motion will be estimated from the low-rank, where intensity changes due to enhancement are not present, leading to more accurate image registration [8]. Furthermore, RPCA is well-poised for small bowel data, since breathing is periodic (low-rank) and bowel motility is comparatively unperiodic (sparse), and the estimated bowel motility from the sparse component, isolated from respiratory motion, has the potential to serve as a useful biomarker in a range of gastrointestinal disorders [8]. Small bowel motility has already been shown to correlate with inflammatory activity [10,11]. If the signal is composed from a low-rank and a sparse component, RPCA has been proven to perform better on reconstruction from undersampled data than compressed sensing (CS) [12,13] and joint low-rank and sparsity constraint methods [6]. Increasing temporal resolution is crucial both in DCE imaging, for a better depiction of the pharmacokinetics, and in small bowel imaging, in order to allow for the observation of high frequency contractions. Alternatively, the aim of undersampling could be volumetric acquisitions that require longer scan times. Volumetric acquisitions may prove helpful for the improvement of physiological coherence [14].
This paper postulates that the use of discrete shearlets (DS) as a sparsifying transform can benefit RPCA decomposition/reconstruction. Choosing the appropriate sparsifying transform where our signal is sparse is expected to improve the reconstruction performance, especially for high undersampling factors. Discrete shearlets were introduced by Guo et al. [15] in order to accelerate and optimize the reconstruction process by applying shear transformations in various directions in two-dimensional objects with edges. Based on [15], Yi et al. [16] employed relevant algorithms for extracting and detecting details about edges, including junctions with added noise on the image. Furthermore, the numerical implementation applied by Hauser et al. in [17] established the shearlet transformation for several scales and directions. Recently, Yuan et al. [18] proposed a new reconstruction algorithm, utilizing the non-subsampled shearlet transform (NSST) sparsity prior in undersampled data for brain MR images, to promote sparser representations and higher directional sensitivity, thus eliminating artifacts and reconstructed errors. In addition, the shearlet transform has been employed in several recent studies, including the hybrid regularization method for CS MRI incorporating total variation [19], the CS algorithm for fast 3D cardiac MR imaging using iterative reweighting [20], and the shearlet-based CS technique combined with nonlocal total variation [21].
Our hypothesis is that discrete shearlets are the optimum sparsifying transform to represent edges in multi-dimensional data, such as DCE and small bowel imaging. To evaluate our hypothesis, we have compared different sparsifying transforms, including no transform, temporal Fourier transform, and discrete shearlets, in terms of decomposition/reconstruction performance. The developed RPCA reconstruction algorithm is evaluated (i) on simulated DCE data, and (ii) on eight different small bowel MR datasets, acquired during breath-holding and free-breathing modes (one after the other in a single scan). The reconstruction performance of the suggested RPCA reconstruction algorithm, using different sparsifying transforms, is compared to a widely used focal underdetermined system solver, namely, k-t FOCUSS [22]. In terms of decomposition, it is examined whether deriving deformations (i) from the low-rank of DCE data will be similar to the ground truth respiratory motion, and (ii) from the sparse component of the free-breathing data will be similar to the deformations from the sparse component of the breath-holding data, where less respiratory motion is assumed.

2. Theory

2.1. Focal Underdetermined System Solver (k-t FOCUSS)

Tsao et al. [23] suggested the broad-use linear acquisition speed-up technique, known as k-t BLAST, that employs a training low-resolution dataset to obtain signal correlations; then, k-t BLAST utilizes these signal correlations as prior information in order to recover spatio-frequency (x-f) images ρ without aliasing artifacts, namely:
ρ = ρ 0 + C F t H F t C F t H + λ I 1 ( y a l i a s F t ρ 0 ) ,
where ρ 0 is a complex value baseline image, C = W · W H is the covariance matrix of the signal deviation from the baseline ρ 0 , superscript H denotes Hermitian transpose, W is a weighting matrix, F t is the Fourier transform along the spatio-frequency direction, λ is a Lagrangian multiplier, and y a l i a s is the aliased signal, initially denoted by x, from the low resolution dataset, i.e.,
y a l i a s = F t x .
Gorodnitsky et al. [24] suggested a novel sparse reconstruction method based on k-t BLAST, called “focal underdetermined system solver” (k-t FOCUSS) [25]. k-t BLAST is considered the first iteration of k-t FOCUSS. The main novelty of k-t FOCUSS entails the fact that it updates the weighting matrix W iteratively. Jung et al. [22,25] modified k-t FOCUSS and made it suitable for dynamic MRI applications.

2.2. Robust Principal Component Analysis (RPCA)

The low-rank and sparse constraints can be applied simultaneously to promote sparsity and time coherence (such as in k-t SLR [26]), i.e.,
min M 1 2 F u M y 2 2 + λ L M * + λ S Φ M 1 ,
where M is the recovered image, considered as an approximately low-rank Casorati matrix, with spatio-temporal dimensions denoted by M x , M y , M t ; F u denotes the undersampled Fourier transform, · 2 is the L 2 -norm, · 1 is the L 1 -norm, | | · | | * is the nuclear norm, Φ ( · ) is a sparsifying transform, and λ L , λ S are trade-off parameters between the consistency term, and the nuclear-norm and L 1 -norm, respectively. The choice of sparsifying transform Φ is crucial to ensure S is not low-rank and that F u T y is incoherent to S.
The idea behind RPCA algorithms is to apply low-rank and sparsity constraints “sequentially”, aiming to decompose the low-rank L from the sparse component S of the reconstructed image M. By separating the background (L) from the sparse component (S), S will become sparser than M = L + S ; this will benefit the reconstructions compared to other schemes that use solely or simultaneously the low-rank and sparse constraints [12,26]. RPCA reconstruction ( L + S ) can be performed via the following unconstrained optimization problem:
min L , S 1 2 F u ( L + S ) y 2 2 + λ L L * + λ S Φ S 1 .
Equation (4) can be solved using split Bregman alternating direction methods [3,4,5,27]. To achieve separation between L and S, they need to be incoherent, whereas to reconstruct unbiased images from undersampled data, F u T y needs to be incoherent with L and S. The RPCA decomposition implemented in this work was the one suggested by Otazo et al. [6], where singular value thresholding for the low-rank, and a shrinkage for the sparsity constrain, are applied sequentially. The algorithm is summarized in Table 1 and Figure 1. Specifically, in Table 1, we use D τ ( X ) = U · S h r i n k τ ( Σ ) · V T , where Σ denotes the singular values, following a singular value decomposition of the form X = U · Σ · V T . Furthermore, we employ S h r i n k τ ( X ) = X · max ( X τ , 0 ) / X . If, instead of F u , we apply the identity matrix I, and instead of y the scanner reconstructed image, the above becomes an image decomposition problem.

2.3. Sparsifying Transforms

Two of the most common transforms used in CS and RPCA to promote sparsity are wavelets [28,29,30,31,32,33] and temporal Fourier [34]. Wavelets project a signal of finite energy on a frequency subband. This subband is generated by scaling and translating a function ψ L 2 ( R 2 ) , the so-called mother wavelet, i.e.,
ψ a , b = 1 a ψ t a b .
Temporal Fourier is a case of wavelet transform with e 2 π i t acting as a mother wavelet. Discontinuities and edges in multidimensional data require a large number of wavelet coefficients to be accurately represented; hence, wavelet representations are not sparse. Shearlets [15,16,18,35,36] utilize the framework of affine systems and are non-isotropic versions of the wavelet transformations that may provide an optimal sparse representation of images. Shearlets, ψ L 2 ( R 2 ) , are directional representation systems with composite dilations generated by:
ψ a , s , b = M a , s 1 2 ψ M a , s 1 ( t b ) , and M a , s = a s a 0 a ,
where s represents the shear parameter, as in [19]. The shearlet transform of any given image x L 2 ( R 2 ) can be defined as S h a , s , b ( x ) = x , ψ a , s , b . To reduce the computational time, discrete shearlet transforms were computed by the fast Fourier transform, as suggested by Hauser et al. [17].

2.4. Image Registration—Motility Metric

Following RPCA reconstruction and decomposition, images were registered with an intensity-based algorithm [10] that minimizes a joint cost function ( C F ) of the sum of squared differences ( S S D ) between a reference image x r e f and the transformed images T d x , d y x , including a transformation model of all intensity changes c = x r e f T d x , d y x and a regularization term R that ensures that the deformation fields d x , d y are adequately smooth [10], namely:
C F ( d x , d y , c ) = S S D ( d x , d y , c ) + R ( d x , d y , c ) .
The regularization term R is based on the second-order spatial derivatives of the displacements d x , d y , and c. The chosen algorithm was shown to be able to accurately estimate local displacements that occur during bowel motion.
To assess the motility, as suggested in the corresponding literature [10,11], we employed the Jacobian determinants (J) of the displacement fields obtained after registration. In this direction, the motility map, denoted by σ J , was calculated as the standard deviation over time of the following Jacobian determinant:
σ J i , j = σ J ( i , j , t ) t = 1 N t ,
where i, j are the spatial coordinates, summed over time t. The motility map σ J has been validated as a measure of local small bowel motion, and it is claimed to be insensitive to rigid transformation [10,37]. However, respiratory motion is non-rigid and is measured within the motility map. The mean of σ J , denoted by μ ( σ J ) , is used to provide a sense of magnitude of the bowel motility, referred to as the motility score. The motility score was calculated from appropriate regions of interest (ROI), drawn around the small bowel [38].

3. Materials and Methods

3.1. Small Bowel MR Acquisition

Eight subjects were scanned using a Philips Achieva 3T (Philips Healthcare, Eindhoven, The Netherlands) using the manufacturer’s torso coil (XL-TORSO). Subjects were healthy volunteers, 2 males and 6 females, with an age range of 19–42 years and a mean age of 28 years. Patients were imaged using a multi-slice balanced Turbo Field Echo (bTFE) motility sequence, coronal 2.5 × 2.5 × 5 mm 3 voxel size, FOV 420 × 420 × 30 mm 3 , FA = 20 degrees, TE = 1.85 ms, TR = 3.7 ms, with a temporal resolution of 1 volume per second. The first twenty (20) images were acquired on breath-holding; following a 10-s recovery period, the subject was instructed to “gently free-breathe” for a total of 60 images.

3.2. Simulated Abdominal DCE Data

A normal volunteer underwent a fast gradient echo DCE-MRI protocol (flip angle 10 , repetition time 2.3 ms). T1-weighted images were acquired in multiple time frames without contrast injection. The first time frame was manually segmented into: liver, bowel, right and left heart, aorta, and portal vein. This specific segmentation was used as a map to simulate contrast enhancement, using the extended Tofts model and a population arterial input function. T1 values and pharmacokinetic parameters for each organ were chosen in agreement with a previous study [39]. Fifty DCE images were generated from the ground truth kinetic parameters with temporal resolution of 3 s. More details about the DCE digital phantom can be found in [40].

3.3. Simulated Undersampled Acquisition

Original simulated DCE and scanner small bowel images were transformed to ( k , t ) -space with fast Fourier transformation, where normally distributed noise was added. The level of noise was decided so that the signal-to-noise ratio (SNR) was close to the SNR of DCE. For the undersampling pattern, phase encoding lines were randomly selected per volume and per time frame. The centre of k-space was more densely sampled. Cartesian undersampling patterns for 4- and 8-fold acceleration were generated using a Monte Carlo algorithm to generate a sampling pattern with minimum peak interference [12].

3.4. Quantitative Evaluation

The techniques described were implemented in MATLAB® R2019b (The Mathworks Inc., Natick, MA, USA). The proposed image processing procedures were conducted on a desktop personal computer with a 2.50 GHz Intel® CoreTM i7-4710HQ CPU processor and 16 GB RAM operating memory, running Windows 10 Professional Edition.
The parameter settings for k-t FOCUSS [22] were selected at 40 inner iterations, 2 outer iterations, weighting matrix power factor 0.5, and initial estimate corresponding to low frequency values. The RPCA reconstruction/decomposition used consistently the following parameter settings: λ L = 0.0025 , λ S = 0.00125 for separation of bowel motility from respiration, and λ L = 0.01 , λ S = 0.01 for separation of contrast enhancement from background. Similarly to Otazo et al. [6], the regularization parameters with the lowest root mean square error were selected.

3.5. Implementation Details

The RPCA reconstruction is evaluated based on the relative reconstruction error, denoted by r e , namely:
r e = y y e 2 2 y 2 2 ,
where y e is the estimated ( k , t ) -space for each method [10]. To evaluate how RPCA could enhance the registration of DCE and small bowel data, deformation fields and Jacobian determinants were estimated by the optical-flow registration algorithm [10]. The L, M = L + S of the DCE were registered to derive the deformation fields, and were compared to examine which was closer to the ground truth deformation fields. For the small bowel dataset, a previously validated approach for evaluating the deformation fields was used, namely, the motility score μ ( σ J ) [10]. In this work, motility scores, μ ( σ J ) , were derived from the S component of the free-breathing data, and were compared to the ones from the breath-holding data. The assumption is that motility scores, μ ( σ J ) estimated from the breath-holding data will be less biased from respiratory motion. Consequently, if the motility scores between the S component of the breath-holding and free-breathing data match, then there is a clear indication that we successfully isolated bowel motility in the sparse component.

4. Results

4.1. Low-Rank Plus Sparse Image Decomposition

In Figure 2, we compare different sparsifying transforms, i.e., the unity matrix I, the Fourier transformation along time (TF), and discrete shearlets. Discrete shearlets demonstrated increased sparsity over the other two transforms, for both small bowel and abdominal DCE images. To quantify the increased sparsity achieved with DS, the L 0 -norms of S, TF(S), and DS(S) were estimated. For the abdominal DCE images, the L 0 -norm of S, TF(S), and DS(S) was 1.69 × 10 6 , 0.88 × 10 6 , and 0.85 × 10 6 , respectively; similarly, for the small bowel images, the L 0 -norm was 1.2 × 10 6 , 0.93 × 10 6 , and 0.89 × 10 6 , respectively. The application of L + S using DS as a sparsifying transform in small bowel and abdominal DCE images is shown in Figure 3 and Figure 4, respectively. In both cases, L + S decomposition using DS resulted in low-rank L (rank = 2). The sparse component is not low-rank, capturing rapid intensity changes due to bowel motility or contrast enhancement, respectively.

4.2. Low-Rank Plus Sparse Image Decomposition from Undersampled ( k , t ) -Space Data

In Table 2 and Table 3, we compare different reconstruction techniques, namely, k-t FOCUSS, L + S using the identity matrix, TF, wavelet transform (WT), and DS as sparsifying transforms, in terms of relative reconstruction error ( r e ) of the simulated DCE dataset and of the eight different small bowel datasets for both four- and eight-fold undersampled ( k , t ) -space data. For the methods presented in Table 2, namely, k-t FOCUSS, L + S using I, L + S using TF, L + S using WT, and L + S using DS as sparsifying transforms, the average CPU time was 192 s, 450 s, 495 s, 487 s and 1123 s, respectively.
L + S using DS as sparsifying transform showed reduced median r e in the simulated DCE dataset and across the eight small bowel datasets compared to the other reconstructions. It is worth mentioning that in Table 3, the asterisk ( * ) appears when the median values between the L + S reconstructions and k-t FOCUSS are significantly different. In this direction, we employed the Mann–Whitney U-test, which compared if there was any difference between the independent samples when normality was violated [41]. The Mann–Whitney U-test was utilized in order to evaluate the differences between data samples, and the corresponding p-values were calculated.
Figure 5 illustrates the L + S using DS as sparsifying transform decomposition from four-fold and eight-fold undersampled ( k , t ) -space data. The magnitudes and the y-t profiles of the recovered components are presented to qualitatively show that high acceleration factors were achieved while preserving image quality.

4.3. Quantification of Motility in Low-Rank Plus Sparse Decomposition Using Discrete Shearlets as Sparsifying Transforms

Figure 6 illustrates deformation fields after registering the low-rank (L) and the recovered image of the form M = L + S , following the decomposition of the simulated DCE images. Table 4 shows that the relative error between the deformation fields estimated by registering L are closer to ground truth deformation fields than the deformation fields estimated by registering M = L + S . Registering M assigns intensity changes due to enhancement as deformations, and overestimates the deformations.
Figure 7 (median, interquartile range) compares, in boxplot format, the motility scores derived from the free-breathing versus the breath-holding data for scanner images, four-fold undersampled ( k , t ) -space data, and eight-fold undersampled ( k , t ) -space data, respectively, following L + S using DS as sparsifying transform decomposition/reconstruction. Motility scores were estimated for each component, namely, low-rank L, sparse S, and low-rank plus sparse M = L + S .
For the scanner images, the median motility scores derived from the sparse component (S) were not significantly different between the breath-holding and the free-breathing (median μ ( σ J ) equal to 0.044 and 0.049, respectively, p = 0.20). If the median motility scores are calculated from both L and S, then they are significantly different between the breath-holding and the free-breathing (median μ ( σ J ) equal to 0.036 and 0.047, respectively, p = 0.02).
For the four-fold undersampled data, the median motility scores derived from the sparse component (S) were not significantly different between the breath-holding and the free-breathing (median μ ( σ J ) equal to 0.039 and 0.045, respectively, p = 0.08). If the median motility scores are calculated from both L and S, then they are significantly different between the breath-holding and the free-breathing (median μ ( σ J ) equal to 0.034 and 0.043, respectively, p = 0.02). For the eight-fold undersampled data, the median motility scores derived from the sparse component (S) were significantly different between the breath-holding and the free-breathing (median μ ( σ J ) equal to 0.039 and 0.047, respectively, p = 0.04). Similarly, when the median motility scores were calculated from both L and S they were once again significantly different between the breath-holding and the free-breathing (median μ ( σ J ) equal to 0.035 and 0.043, respectively, p = 0.01). All calculations described above are summarized in Table 5. To evaluate the effect of undersampling in the value of the motility score, the median motility scores calculated from L, S and M of the free-breathing scanner images were compared to the ones from the four-fold undersampled data (L: p = 0.1, S: p = 0.27, M: p = 0.35) and from the eight-fold undersampled data (L: p = 0.01, S: p = 0.45, M: p = 0.49); for details, see Table 6.

5. Discussion

In this paper, we evaluated the benefits of L + S decomposition/reconstruction in deriving accurate deformation fields. RPCA, using discrete shearlets as sparsifying transform, attained less relative reconstruction errors than using other sparsifying transforms (identity matrix or TF) and k-t FOCUSS, see Table 2 and Table 3. This can be explained given that DS(S) was sparser than S and TF(S) themselves; hence, they were more incoherent with F u T y , see Figure 2. L + S using DS as sparsifying transform successfully separated the low-rank (background and periodic motion) from the sparse component (enhancement or bowel motility) for both DCE and small bowel data. This is clearly shown in the histograms and singular values in Figure 3 and Figure 4, and the temporal profiles of Figure 5.
For the simulated DCE dataset, it was shown that deformation fields estimated after registering the low-rank are closer to ground truth than the ones after registering M = L + S . The low-rank plus sparse reconstructed images incorporate the enhancement (sparse component) within themselves; hence, intensity changes due to enhancement are perceived as motility by the registration algorithm.
For the small bowel datasets, following the comparison between breath-holding and free-breathing data (scanner images and four-fold undersampled k-space data), it was shown that the motility scores calculated from the sparse component were not significantly different ( p > 0.05 ), whereas motility scores calculated from the low-rank plus sparse were significantly different ( p < 0.05 ), see Figure 7. This, in essence, means that when motility scores are calculated from the sparse component (that excludes low-rank periodic motion), the breath-holding motility scores are similar to the free-breathing ones. Furthermore, in terms of the effect of undersampling in the calculation of the motility scores, there were no significant differences between the ones calculated from the scanner images and the four-/eight-fold undersampled data.
This work suggests the use of discrete shearlets as the sparsifying transform of choice for low-rank plus sparse reconstruction/decomposition. Discrete shearlets accurately represent the discontinuities and edges occurring in MR imaging and, hence, will be sparser than other transforms. RPCA reconstructions are expected to reduce the bias due to undersampling, and to separate small bowel motility from respiration. The improved reconstruction performance of the proposed L + S using DS as sparsifying transform over other undersampling schemes, such as k-t FOCUSS, will allow us to either improve the temporal resolution or keep the same temporal resolution and improve the spatial resolution, thus separating the respiratory motion, corresponding to the low-rank component, from the enhancement or bowel motility, corresponding to the sparse component.

6. Conclusions

The choice of sparsifying transform in an RPCA decomposition/reconstruction algorithm is important to reconstruct unbiased images from undersampled data. Discrete shearlets provide an excellent representation of multi-dimensional MR data. In this paper, we utilized discrete shearlets as sparsifying transforms in low-rank rank plus sparse decomposition/reconstruction. In this direction, discrete shearlets were shown to reduce relative reconstruction errors, compared to other sparsifying transforms. Low-rank plus sparse decomposition using discrete shearlets was evaluated in DCE and small bowel data. Registering low-rank reconstructed DCE images accurately quantifies respiratory motion. Motility scores of small bowel images are not significantly affected by undersampling. When estimated from the sparse components, motility scores are not significantly different between the breath-holding and free-breathing data, thus indicating that the proposed algorithm was able to isolate respiratory motion in the low-rank component. In future studies, we intend to include learned priors and sparsifying operators, as well as machine-learning methods in the low-rank plus sparse decomposition approach. This study focused on dynamic 2D MRI acquisitions; hence, only 2D shearlets were applicable. However, we expect that, for 3D MRI acquisitions, the benefit of 3D shearlets would be more significant, compared to other 3D transformations, such as wavelets and Fourier.

Author Contributions

Conceptualization: N.D., N.E.P., E.T. and G.A.K.; methodology: N.D. and N.E.P.; software and validation: N.D. and E.T.; writing—original draft preparation: N.E.P. and E.T.; writing—review and editing: N.D. and G.A.K.; visualization: N.E.P., N.D. and E.T.; supervision: N.D. All authors have read and agreed to the published version of the manuscript.

Funding

This research was partially supported by the research programme No. 200/977 of the Research Committee of the Academy of Athens.

Institutional Review Board Statement

A local ethics committee approved the retrospective use of anonymized patient data.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The simulated data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Liu, Y.; Liu, T.; Liu, J.; Zhu, C. Smooth robust tensor principal component analysis for compressed sensing of dynamic MRI. Pattern Recognit. 2020, 102, 107252. [Google Scholar] [CrossRef]
  2. Candès, E.J.; Li, X.; Ma, Y.; Wright, J. Robust principal component analysis? J. ACM 2011, 58, 1–37. [Google Scholar] [CrossRef]
  3. Gao, H.; Cai, J.F.; Shen, Z.; Zhao, H. Robust principal component analysis-based four-dimensional computed tomography MRI. Phys. Med. Biol. 2011, 56, 3181. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Trémoulhéac, B.; Atkinson, D.; Arridge, S.R. Motion and contrast enhancement separation model reconstruction from partial measurements in dynamic MRI. In Proceedings of the MICCAI Workshop on Sparsity Techniques in Medical Imaging, Nice, France, 1–5 October 2012. [Google Scholar]
  5. Trémoulhéac, B.; Dikaios, N.; Atkinson, D.; Arridge, S.R. Dynamic MR Image reconstruction–separation from undersampled (k,t)-space via low-rank plus sparse prior. IEEE Trans. Med. Imaging 2014, 33, 1689–1701. [Google Scholar] [CrossRef] [PubMed]
  6. Otazo, R.; Candes, E.; Sodickson, D.K. Low-rank plus sparse matrix decomposition for accelerated dynamic MRI with separation of background and dynamic components. Magn. Reson. Med. 2015, 73, 1125–1136. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Mahapatra, D.; Li, Z.; Vos, F.; Buhmann, J. Joint segmentation and groupwise registration of cardiac DCE MRI using sparse data representations. In Proceedings of the 2015 IEEE 12th International Symposium on Biomedical Imaging (ISBI), Brooklyn, NY, USA, 16–19 April 2015; pp. 1312–1315. [Google Scholar] [CrossRef]
  8. Hamy, V.; Dikaios, N.; Punwani, S.; Melbourne, A.; Latifoltojar, A.; Makanyanga, J.; Chouhan, M.; Helbren, E.; Menys, A.; Taylor, S.; et al. Respiratory motion correction in dynamic MRI using robust data decomposition registration—Application to DCE-MRI. Med. Image Anal. 2014, 18, 301–313. [Google Scholar] [CrossRef] [PubMed]
  9. Menys, A.; Hamy, V.; Makanyanga, J.; Hoad, C.; Gowland, P.; Odille, F.; Taylor, S.; Atkinson, D. Dual registration of abdominal motion for motility assessment in free-breathing data sets acquired using dynamic MRI. Phys. Med. Biol. 2014, 59, 4603. [Google Scholar] [CrossRef]
  10. Odille, F.; Menys, A.; Ahmed, A.; Punwani, S.; Taylor, S.A.; Atkinson, D. Quantitative assessment of small bowel motility by nonrigid registration of dynamic MR images. Magn. Reson. Med. 2012, 68, 783–793. [Google Scholar] [CrossRef]
  11. Menys, A.; Taylor, S.A.; Emmanuel, A.; Ahmed, A.; Plumb, A.A.; Odille, F.; Alam, A.; Halligan, S.; Atkinson, D. Global small bowel motility: Assessment with dynamic MR imaging. Radiology 2013, 269, 443–450. [Google Scholar] [CrossRef]
  12. Lustig, M.; Donoho, D.; Pauly, J.M. Sparse MRI: The application of compressed sensing for rapid MR imaging. Magn. Reson. Med. 2007, 58, 1182–1195. [Google Scholar] [CrossRef]
  13. Donoho, D.L. Compressed sensing. IEEE Trans. Inf. Theory 2006, 52, 1289–1306. [Google Scholar] [CrossRef]
  14. Huizinga, J.D.; Chen, J.H.; Zhu, Y.F.; Pawelka, A.; McGinn, R.J.; Bardakjian, B.L.; Parsons, S.P.; Kunze, W.A.; Wu, R.Y.; Bercik, P.; et al. The origin of segmentation motor activity in the intestine. Nat. Commun. 2014, 5, 1–11. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Guo, K.; Kutyniok, G.; Labate, D. Sparse multidimensional representations using anisotropic dilation and shear operators. In Wavelets and Splines; Chen, G., Lai, M., Eds.; Nashboro Press: Nashville, TN, USA, 2006; pp. 189–201. [Google Scholar]
  16. Yi, S.; Labate, D.; Easley, G.R.; Krim, H. A shearlet approach to edge analysis and detection. IEEE Trans. Image Process. 2009, 18, 929–941. [Google Scholar] [CrossRef] [PubMed]
  17. Häuser, S.; Steidl, G. Fast Finite Shearlet Transform. arXiv 2014, arXiv:1202.1773. [Google Scholar]
  18. Yuan, M.; Yang, B.; Ma, Y.; Zhang, J.; Zhang, R.; Zhang, C. Compressed sensing MRI reconstruction from highly undersampled-space data using nonsubsampled shearlet transform sparsity prior. Math. Probl. Eng. 2015, 2015. [Google Scholar] [CrossRef] [Green Version]
  19. Liu, R.W.; Shi, L.; Simon, C.; Wang, D. Hybrid regularization for compressed sensing MRI: Exploiting shearlet transform and group-sparsity total variation. In Proceedings of the 2017 20th International Conference on Information Fusion (Fusion), Xi’an, China, 10–13 July 2017; pp. 1–8. [Google Scholar] [CrossRef]
  20. Ma, J.; März, M.; Funk, S.; Schulz-Menger, J.; Kutyniok, G.; Schaeffter, T.; Kolbitsch, C. Shearlet-based compressed sensing for fast 3D cardiac MR imaging using iterative reweighting. Phys. Med. Biol. 2018, 63, 235004. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  21. Yazdanpanah, A.P.; Regentova, E.E. Compressed sensing magnetic resonance imaging based on shearlet sparsity and nonlocal total variation. J. Med. Imaging 2017, 4, 026003. [Google Scholar] [CrossRef]
  22. Jung, H.; Ye, J.C.; Kim, E.Y. Improved k-t BLAST and k-t SENSE using FOCUSS. Phys. Med. Biol. 2007, 52, 3201–3226. [Google Scholar] [CrossRef]
  23. Tsao, J.; Boesiger, P.; Pruessmann, K.P. k-t BLAST and k-t SENSE: Dynamic MRI with high frame rate exploiting spatiotemporal correlations. Magn. Reson. Med. 2003, 50, 1031–1042. [Google Scholar] [CrossRef]
  24. Gorodnitsky, I.F.; George, J.S.; Rao, B.D. Neuromagnetic source imaging with FOCUSS: A recursive weighted minimum norm algorithm. Electroencephalogr. Clin. Neurophysiol. 1995, 95, 231–251. [Google Scholar] [CrossRef]
  25. Jung, H.; Sung, K.; Nayak, K.S.; Kim, E.Y.; Ye, J.C. k-t FOCUSS: A general compressed sensing framework for high resolution dynamic MRI. Magn. Reson. Med. 2009, 61, 103–116. [Google Scholar] [CrossRef] [PubMed]
  26. Lingala, S.G.; Hu, Y.; DiBella, E.; Jacob, M. Accelerated dynamic MRI exploiting sparsity and low-rank structure: k-t SLR. IEEE Trans. Med. Imag. 2011, 30, 1042–1054. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Dikaios, N.; Tremoulheac, B.; Menys, A.; Hamy, V.; Arridge, S.; Atkinson, D. Joint reconstruction of low-rank and sparse components from undersampled (k, t)-space small bowel data. In Proceedings of the 2013 IEEE Nuclear Science Symposium and Medical Imaging Conference (2013 NSS/MIC), Seoul, Korea, 27 October–2 November 2013; pp. 1–5. [Google Scholar] [CrossRef]
  28. Qu, X.; Guo, D.; Ning, B.; Hou, Y.; Lin, Y.; Cai, S.; Chen, Z. Undersampled MRI reconstruction with patch-based directional wavelets. Magn. Reson. Med. 2012, 30, 964–977. [Google Scholar] [CrossRef] [PubMed]
  29. Lai, Z.; Qu, X.; Liu, Y.; Guo, D.; Ye, J.; Zhan, Z.; Chen, Z. Image reconstruction of compressed sensing MRI using graph-based redundant wavelet transform. Med. Image Anal. 2016, 27, 93–104. [Google Scholar] [CrossRef] [PubMed]
  30. Deka, B.; Datta, S.; Handique, S. Wavelet tree support detection for compressed sensing MRI reconstruction. IEEE Signal Process. Lett. 2018, 25, 730–734. [Google Scholar] [CrossRef]
  31. Liu, R.W.; Ma, Q.; Yu, S.C.H.; Chui, K.T.; Xiong, N. Variational regularized tree-structured wavelet sparsity for CS-SENSE parallel imaging. IEEE Access 2018, 6, 61050–61064. [Google Scholar] [CrossRef]
  32. Islam, M.S.; Islam, R. Multiscale wavelet-based regularized reconstruction algorithm for three-dimensional compressed sensing magnetic resonance imaging. Signal Image Video Process. 2021, 1–9. [Google Scholar] [CrossRef]
  33. Chen, Y.; Firmin, D.; Yang, G. Wavelet improved GAN for MRI reconstruction. Medical Imaging 2021: Physics of Medical Imaging. Int. Soc. Opt. Photonics 2021, 11595, 1159513. [Google Scholar] [CrossRef]
  34. Wang, D.; Arlinghaus, L.R.; Yankeelov, T.E.; Yang, X.; Smith, D.S. Quantitative evaluation of temporal regularizers in compressed sensing dynamic contrast enhanced MRI of the breast. Int. J. Biomed. Imaging 2017, 2017. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  35. Wang, L.; Li, B.; Tian, L. Multimodal medical volumetric data fusion using 3-D discrete shearlet transform and global-to-local rule. IEEE Trans. Biomed. Eng. 2013, 61, 197–206. [Google Scholar] [CrossRef]
  36. Alinsaif, S.; Lang, J.; Alzheimer’s Disease Neuroimaging Initiative. 3D shearlet-based descriptors combined with deep features for the classification of Alzheimer’s disease based on MRI data. Comput. Biol. Med. 2021, 138, 104879. [Google Scholar] [CrossRef] [PubMed]
  37. Gollifer, R.M.; Menys, A.; Makanyanga, J.; Puylaert, C.A.; Vos, F.M.; Stoker, J.; Atkinson, D.; Taylor, S.A. Relationship between MRI quantified small bowel motility and abdominal symptoms in Crohn’s disease patients—A validation study. Br. J. Radiol. 2018, 91, 20170914. [Google Scholar] [CrossRef] [PubMed]
  38. Menys, A.; Plumb, A.; Atkinson, D.; Taylor, S. The challenge of segmental small bowel motility quantitation using MR enterography. Br. J. Radiol. 2014, 87, 20140330. [Google Scholar] [CrossRef] [PubMed]
  39. Dikaios, N.; Punwani, S.; Hamy, V.; Purpura, P.; Rice, S.; Forster, M.; Mendes, R.; Taylor, S.; Atkinson, D. Noise estimation from averaged diffusion weighted images: Can unbiased quantitative decay parameters assist cancer evaluation? Magn. Reson. Med. 2014, 71, 2105–2117. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Dikaios, N.; Arridge, S.; Hamy, V.; Punwani, S.; Atkinson, D. Direct parametric reconstruction from undersampled (k, t)-space data in dynamic contrast enhanced MRI. Med. Image Anal. 2014, 18, 989–1001. [Google Scholar] [CrossRef]
  41. Mann, H.B.; Whitney, D.R. On a test of whether one of two random variables is stochastically larger than the other. Ann. Math. Stat. 1947, 18, 50–60. [Google Scholar] [CrossRef]
Figure 1. Flowchart of L + S decomposition and reconstruction algorithm, as in [6].
Figure 1. Flowchart of L + S decomposition and reconstruction algorithm, as in [6].
Jimaging 08 00029 g001
Figure 2. L + S decomposition of: (a) 2D abdominal DCE images, and (b) 2D small bowel images. Temporal ( x t ) profiles along the dotted direction aim to capture the dynamic intensity changes. The low-rank (L) in both (a) and (b) includes the background (and periodic motion), whereas the sparse component captures rapid intensity changes either because of contrast enhancement (a), or because of bowel motility (b). Increased sparsity can be achieved using Fourier transformation along time (TF) and discrete shearlets. Histograms of the transformed S components with TF and DS are shown to illustrate the increased sparsity.
Figure 2. L + S decomposition of: (a) 2D abdominal DCE images, and (b) 2D small bowel images. Temporal ( x t ) profiles along the dotted direction aim to capture the dynamic intensity changes. The low-rank (L) in both (a) and (b) includes the background (and periodic motion), whereas the sparse component captures rapid intensity changes either because of contrast enhancement (a), or because of bowel motility (b). Increased sparsity can be achieved using Fourier transformation along time (TF) and discrete shearlets. Histograms of the transformed S components with TF and DS are shown to illustrate the increased sparsity.
Jimaging 08 00029 g002
Figure 3. L + S using DS as sparsifying transform decomposition using shearlets as sparsifying transform on small bowel images. Following decomposition, the rank of L was 2, whereas the rank of S equalled 50. It is clear from the L, S images and histograms that S is sparser than L. Consequently, L includes background, periodic motion, while S captures bowel motility (rapid intensity changes).
Figure 3. L + S using DS as sparsifying transform decomposition using shearlets as sparsifying transform on small bowel images. Following decomposition, the rank of L was 2, whereas the rank of S equalled 50. It is clear from the L, S images and histograms that S is sparser than L. Consequently, L includes background, periodic motion, while S captures bowel motility (rapid intensity changes).
Jimaging 08 00029 g003
Figure 4. L + S using DS as sparsifying transform decomposition using shearlets as sparsifying transform on abdominal DCE images. Following decomposition, the rank of L was 1, whereas S is not low-rank. It is clear from the L and S images and histograms that S is far more sparse than L. Consequently, L includes static background, while S captures contrast enhancement (rapid intensity changes).
Figure 4. L + S using DS as sparsifying transform decomposition using shearlets as sparsifying transform on abdominal DCE images. Following decomposition, the rank of L was 1, whereas S is not low-rank. It is clear from the L and S images and histograms that S is far more sparse than L. Consequently, L includes static background, while S captures contrast enhancement (rapid intensity changes).
Jimaging 08 00029 g004
Figure 5. L + S reconstruction using discrete shearlets as sparsifying transforms from small bowel 4-fold and 8-fold undersampled ( k , t ) -data. L, S, L + S recovered images, and time-cut representations, as in Figure 2, are illustrated for each undersampling.
Figure 5. L + S reconstruction using discrete shearlets as sparsifying transforms from small bowel 4-fold and 8-fold undersampled ( k , t ) -data. L, S, L + S recovered images, and time-cut representations, as in Figure 2, are illustrated for each undersampling.
Jimaging 08 00029 g005
Figure 6. Ground truth deformation fields of the original T1-weighted images (without enhancement) and deformation fields obtained after registration of the low-rank L, and M = L + S , following L + S , using DS as sparsifying transform decomposition of the simulated DCE images.
Figure 6. Ground truth deformation fields of the original T1-weighted images (without enhancement) and deformation fields obtained after registration of the low-rank L, and M = L + S , following L + S , using DS as sparsifying transform decomposition of the simulated DCE images.
Jimaging 08 00029 g006
Figure 7. Boxplots of the motility scores across the 8 subjects with range (line), interquartile range (box), and median (horizontal line) for breath-holding (BH) and free-breathing (FB) data. Motility scores were derived with L + S using DS as sparsifying transform decomposition/reconstruction of scanner images/undersampled data. The L, S, M = L + S components derived from the BH data were compared with the ones from the FB data.
Figure 7. Boxplots of the motility scores across the 8 subjects with range (line), interquartile range (box), and median (horizontal line) for breath-holding (BH) and free-breathing (FB) data. Motility scores were derived with L + S using DS as sparsifying transform decomposition/reconstruction of scanner images/undersampled data. The L, S, M = L + S components derived from the BH data were compared with the ones from the FB data.
Jimaging 08 00029 g007
Table 1. Synopsis of L + S decomposition and reconstruction algorithm, as in [6].
Table 1. Synopsis of L + S decomposition and reconstruction algorithm, as in [6].
L + Φ ( S ) decomposition and reconstruction algorithm
Input: ( k , t ) -space samples y, decomposition parameters λ L , λ S
Initialize: M 1 = F u T y and S 1 = 0 , iteration k=1;
while stopping criterion is not met, do
  Singular value thresholding
   L k + 1 = D λ L ( M k S k )
  Shrinkage operator
   S k + 1 = Φ 1 ( S h r i n k λ S ( Φ ( M k L k ) ) )
  Subtract aliasing artifacts from M = L + S
   M k + 1 = L k + 1 + S k + 1 F u T ( F u ( L k + 1 + S k + 1 ) y )
  Stopping criterion
   k > 50 or M k + 1 M k 2 M k 2 < 10 5
end while
Output: L = L k + 1 , S = S k + 1
Table 2. Relative reconstruction error ( r e ) of the L + S reconstructions, using the identity matrix I, TF, WT, and DS as sparsifying transforms and k-t FOCUSS for the simulated DCE datasets.
Table 2. Relative reconstruction error ( r e ) of the L + S reconstructions, using the identity matrix I, TF, WT, and DS as sparsifying transforms and k-t FOCUSS for the simulated DCE datasets.
Unders. Factor 4Unders. Factor 8
k-t FOCUSS0.1620.203
L + S using I as sparsifying transform0.1490.194
L + S using TF as sparsifying transform0.1470.189
L + S using WT as sparsifying transform0.1470.188
L + S using DS as sparsifying transform0.1440.187
Table 3. Median and interquartile range (iQR) of relative reconstruction error ( r e ) of the reconstructions k-t FOCUSS, L + S reconstructions (using identity matrix I, TF, WT, and DS as sparsifying transforms), across the 8 small bowel datasets.
Table 3. Median and interquartile range (iQR) of relative reconstruction error ( r e ) of the reconstructions k-t FOCUSS, L + S reconstructions (using identity matrix I, TF, WT, and DS as sparsifying transforms), across the 8 small bowel datasets.
Undersampling Factor 4MedianiQR
k-t FOCUSS0.0770.013
L + S using I as sparsifying transform0.0800.012
L + S using TF as sparsifying transform0.0790.012
L + S using WT as sparsifying transform0.0750.011
L + S using DS as sparsifying transform  0.064 *0.006
Undersampling Factor 8MedianiQR
k-t FOCUSS0.1200.025
L + S using I as sparsifying transform0.1190.018
L + S using TF as sparsifying transform0.1150.017
L + S using WT as sparsifying transform0.1120.021
L + S using DS as sparsifying transform0.1060.029
Table 4. Relative error between the ground truth deformation fields and the ones obtained after registration of the low-rank (L), and M = L + S following L + S using DS as sparsifying transform decomposition of the simulated DCE images and reconstruction from the 4/8-fold undersampled DCE ( k , t ) -space data (US4/US8).
Table 4. Relative error between the ground truth deformation fields and the ones obtained after registration of the low-rank (L), and M = L + S following L + S using DS as sparsifying transform decomposition of the simulated DCE images and reconstruction from the 4/8-fold undersampled DCE ( k , t ) -space data (US4/US8).
L M = L + S
DCE images0.0160.031
US40.0210.025
US80.0240.029
Table 5. Median motility scores μ ( σ J ) for S and L + S in the breath-holding and free-breathing data.
Table 5. Median motility scores μ ( σ J ) for S and L + S in the breath-holding and free-breathing data.
Scanner imagesBHFBp-value
S0.0440.0490.20
L + S 0.0360.0470.02
Four-foldBHFBp-value
S0.0390.0450.08
L + S 0.0340.0430.02
Eight-foldBHFBp-value
S0.0390.0470.04
L + S 0.0350.0430.01
Table 6. p-values measuring the effect of undersampling in the value of the motility score: median motility scores calculated from L, S, and M of the free-breathing scanner images, compared to the ones from the four-fold and eight-fold undersampled data, respectively.
Table 6. p-values measuring the effect of undersampling in the value of the motility score: median motility scores calculated from L, S, and M of the free-breathing scanner images, compared to the ones from the four-fold and eight-fold undersampled data, respectively.
LS M = L + S
Four-fold0.100.270.35
Eight-fold0.010.450.49
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Protonotarios, N.E.; Tzampazidou, E.; Kastis, G.A.; Dikaios, N. Discrete Shearlets as a Sparsifying Transform in Low-Rank Plus Sparse Decomposition for Undersampled (k, t)-Space MR Data. J. Imaging 2022, 8, 29. https://doi.org/10.3390/jimaging8020029

AMA Style

Protonotarios NE, Tzampazidou E, Kastis GA, Dikaios N. Discrete Shearlets as a Sparsifying Transform in Low-Rank Plus Sparse Decomposition for Undersampled (k, t)-Space MR Data. Journal of Imaging. 2022; 8(2):29. https://doi.org/10.3390/jimaging8020029

Chicago/Turabian Style

Protonotarios, Nicholas E., Evangelia Tzampazidou, George A. Kastis, and Nikolaos Dikaios. 2022. "Discrete Shearlets as a Sparsifying Transform in Low-Rank Plus Sparse Decomposition for Undersampled (k, t)-Space MR Data" Journal of Imaging 8, no. 2: 29. https://doi.org/10.3390/jimaging8020029

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop