Next Article in Journal
Acute on Chronic Thromboembolic Pulmonary Hypertension: Case Series and Review of Management
Next Article in Special Issue
Hemodynamic Performance of Two Current-Generation Transcatheter Heart Valve Prostheses in Severely Calcified Aortic Valve Stenosis
Previous Article in Journal
Understanding Client Difficulties in Transdiagnostic Internet-Delivered Cognitive Behaviour Therapy: A Qualitative Analysis of Homework Reflections
Previous Article in Special Issue
Comparison of PCWP and LVEDP Measurements in Patients with Severe Aortic Stenosis Undergoing TAVI—Same Same but Different?
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Multi-Center Comparison of Two Self-Expanding Transcatheter Heart Valves: A Propensity Matched Analysis

1
Department of Internal Medicine I, St.-Johannes-Hospital, 44137 Dortmund, Germany
2
Medical School, Carl von Ossietzky University, 26111 Oldenburg, Germany
3
Department of Cardiology, Kerckhoff Heart Center, 61231 Bad Nauheim, Germany
4
Department of Cardiac Surgery, Kerckhoff Heart Center, 61231 Bad Nauheim, Germany
5
Department of Cardiology, Justus-Liebig University of Giessen, 35390 Giessen, Germany
6
Department of Medicine 2-Cardiology and Angiology, Friedrich-Alexander University, 91054 Erlangen, Germany
7
Department of Cardiothoracic Surgery, St.-Johannes-Hospital, 11137 Dortmund, Germany
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
J. Clin. Med. 2022, 11(14), 4228; https://doi.org/10.3390/jcm11144228
Submission received: 3 June 2022 / Revised: 14 July 2022 / Accepted: 18 July 2022 / Published: 21 July 2022
(This article belongs to the Special Issue Transcatheter Aortic Valve Replacement in 2021 and Beyond)

Abstract

:
Background: During the last years, several transcatheter aortic heart valves entered the clinical market and are commercially available. The prostheses differ regarding several technical and functional aspects. However, little is known regarding head-to-head comparative data of the ACURATE neo and the PORTICO valve prostheses. Objectives: The aim of this study was to compare two self-expanding transcatheter aortic heart valves (THV), the ACURATE neo and the PORTICO, with regard to in-hospital and 30-day outcomes, as well as early device failures. Methods: A total of 1591 consecutive patients with severe native aortic valve stenosis from two centers were included in the analyses and matched by 1:1 nearest neighbor matching to identify one patient treated with PORTICO (n = 344) for each patient treated with ACURATE neo (n = 344). Results: In-hospital complications were comparable between both valves, including any kind of stroke (ACURATE neo = 3.5% vs. PORTICO = 3.8%; p = 1.0), major vascular complications (ACURATE neo = 4.5% vs. PORTICO = 5.4%; p = 0.99) or life-threatening bleeding (ACURATE neo = 1% vs. PORTICO = 2%; p = 0.68). The rate of device failure defined by the VARC-2 criteria were comparable, including elevated gradients and moderate-to-severe paravalvular leakage (ACURATE neo = 7.3% vs. PORTICO = 7.6%; p = 1.0). However, the need for permanent pacemaker implantation (PPI) was significantly more frequent after the use of PORTICO THV (9.5% vs. 18.7%; p = 0.002). Conclusions: In this two-center case-matched comparison, short-term clinical and hemodynamic outcomes showed comparable results between PORTICO and ACURATE neo prostheses. However, PORTICO was associated with a significant higher incidence of PPI.

1. Introduction

Transcatheter aortic valve replacement (TAVR) became a highly standardized procedure for the treatment of high, intermediate and even low-risk patients suffering from severe aortic stenosis [1,2,3,4,5,6,7]. While, in the beginning, only two different devices were available, nowadays, several different devices have entered the clinical market.
Both valve types, balloon-expandable and self-expanding, have revealed high clinical and procedural success rates at the first glance. However, the devices differ not only in regard to the stent and device design but also with respect to the mechanism of deployment, sizing range, hemodynamic performance and risk of atrioventricular conductance disturbances (CDs). Initially, the decision between the valve models was mainly driven by local expertise. With a growing number of procedures, comparative data from randomized, multicenter trials could demonstrate the effect of different valve prostheses properties on the clinical outcomes [8,9,10,11,12,13,14].
The ACURATE neo (Boston Scientific, Marlborough, MA, USA) and the PORTICO (Abbott Structural Heart, St. Paul, MN, USA) transcatheter heart valves are self-expanding TAVR prostheses associated with favorable outcomes in nonrandomized studies [15,16,17].
However, a direct head-to-head comparison of both valve types is lacking.
Therefore, the aim of this two-center, propensity-matched analysis was a direct comparison of the ACURATE neo vs. the PORTICO valve in terms of device success and early (30-day) outcomes according to the criteria of the Valve Academic Research Consortium.

2. Materials and Methods

2.1. Patient Population

A total of 1591 consecutive patients with severe and symptomatic stenosis of the native aortic valve in 2 centers in Germany underwent transfemoral TAVR using either ACURATE neo (n = 1247) or PORTICO (n = 344). All implanting interventionalists of both centers were highly experienced, with both valve types and both centers providing a balanced rate of patients, which were treated using a comparable standard (Bad Nauheim: ACURATE = 625; PORTICO = 145/Dortmund: ACURATE = 622; PORTICO = 199). All patients were discussed by a local interdisciplinary heart team and were selected for a transfemoral aortic valve implantation according to the existing guidelines [18,19]. Final decision of the valve type and size was left at the discretion of the implanting physician according to the suggestions of the manufacturer. All patients gave written consent for the procedures.

2.2. Multislice Computed Tomography Data Analysis

Multislice computed tomography (MSCT) was performed as part of the standard protocol for preprocedural screening. The aortic annulus measurements were evaluated after reconstruction on several levels, according to the guidelines of the Society of Cardiovascular Computed Tomography [20]. The area, perimeter and the maximum and minimum diameters of the virtual aortic annulus were calculated by direct planimetry and length measurements. The eccentricity of the annulus (incl. index) was also calculated with a limit value for an eccentric ring for an eccentricity index > 0.25 [8]. The calcification of the aortic valve was evaluated visually, categorized as mild, moderate or severe.

2.3. Device Description

ACURATE neo is a supra-annular valve that is available in 3 sizes (small, medium and large). The technical features have already been described [21]. The device consists of a self-expanding nitinol frame with a porcine pericardial leaflets valve in a supra-annular position and a pericardial sealing skirt on the outer and inner surfaces of the stent body. ACURATE neo is delivered transfemorally using the ACURATE neo/TF delivery system compatible with a 15-F–18-F catheter sheath (internal diameter). Recently, a new 14-F sheath expanding to 21-F during the passing of the prepared prosthesis, the iSleeve, became available and was also used in a study cohort.
PORTICO is a resheathable, intra-annular valve that is available in 4 sizes (23, 25, 27 and 29 mm). It consists of a self-expanding nitinol frame with bovine pericardial leaflets and a porcine pericardial sealing cuff. The valve is delivered using the flexible PORTICO Delivery system, which has an 18-F outer diameter for the small valves (23 and 25 mm) and a 19-F outer diameter for the larger valves (27 and 29 mm). The system has the ability to retrieve and reposition the PORTICO valve until 80% deployment. Further technical features have already been described in detail [17]. Recently, a novel 15-F sheathless delivery system (Flexnav) became available and was also used in the present cohort.
The technical features of both THVs, their sheath dimensions and sizing recommendations are summarized in Online Table S1.

2.4. Definition of Endpoints and Follow-Up

The primary endpoints were in-hospital and 30-day mortality. The secondary outcome measures were device success, including technical success and the early safety combined endpoint at 30 days, according to the VARC-2 criteria. Follow-up to 30 days was prospectively collected at each of the participating sites in the outpatient clinic, contacting the primary care physician or by direct contact with the patient. Transthoracic echocardiography was performed at the baseline and before discharge.

2.5. Statistical Analysis

The categorical variables were expressed as counts (percentages), and continuous variables were expressed as the mean (SD) or the median (interquartile range) and compared using the Student’s t-test or Mann–Whitney U test, respectively. To reduce the imbalance in the patient baseline characteristics and the effect of a potential selection bias on both endpoints for comparing ACURATE neo with PORTICO, propensity matching was performed using R Studio version 1.2.5042 (The R Foundation for Statistical Computing, Vienna, Austria). A 1-to-1 nearest neighbor matching was used to identify one control case treated with PORTICO (n = 344) for each case treated with ACURATE neo (n = 344). The baseline clinical history, electrocardiogram and MSCT characteristics with known impacts or showing significant (p < 0.05) univariate differences between both groups were included in the matching algorithm (Figure 1).
The occurrence of VARC-2-defined in-hospital complications were determined for the total and the matched populations. A logistic regression analysis was used to determine the predictors of device failure. A Cox proportional hazard analysis, as well as the Kaplan–Meier method, were used to calculate the mortality after 30 days and were indicated by hazard ratios (HRs) and 95% confidence intervals (CIs). The data for the follow-up analysis after 30 days were available for 92.6% (1474 out of 1591) of the entire population and for 91.7% (631 out of 688) of the matched population.
All analyses were carried out in the matched population, as well as the subgroups of the patients with device failures and with indications of new pacemaker implantations. A 2-sided p-value of <0.05 was considered statistically significant for all analyses.

3. Results

3.1. Baseline Characteristics and Propensity Matching

The baseline characteristics of the entire cohort, as well as of the matched cohort, are displayed in Table 1. In comparison to the patients treated with PORTICO, the ACURATE neo recipients were significantly younger, had a tendency for a better left ventricular ejection fraction (62% vs. 60%; p = 0.057), lower mean transaortic gradient (41 mmHg vs. 43 mmHg; p = 0.006) and a higher prevalence of right bundle branch blocks (10.7% vs. 5.0%; p = 0.002) in the entire population. Patients treated with ACURATE neo THV had a significantly lower percentage of heavily calcified aortic valve morphology than patients treated with the PORTICO device. In the matched population, the baseline characteristics were similar between the two groups (Table 1). The quality of the propensity matching is visualized in Figure 2.

3.2. Procedural Data and In-Hospital Outcome of the Matched Cohort

The procedural details and in-hospital complications are summarized in Table 2 (see Online Table S2 for the analysis with entire population). The majority of the matched population received TAVR under conscious sedation (PORTICO 89.5% vs. ACURATE neo 87.2%; p = 0.405). Pre-dilatation was similar (PORTICO 79.9% vs. 78.5%; p = 0.707), while post-dilation was significantly more common with ACURATE neo (18.6% vs. 32.0%; p < 0.001). The small, medium and large sizes of ACURATE neo were used in 14.2%, 43.0% and 42.7% of the cases, while 23, 25, 27 and 29 mm of PORTICO were used in 1.7%, 27.0%, 35.8% and 35.5%. The total fluoroscopy time was significantly shorter for ACURATE neo implantation (10.3 min vs. 12.5 min; p < 0.001), and less contrast agent was used compared to PORTICO (100 mL vs. 120 mL; p < 0.001).
There were no differences between the matched populations regarding incidences of stroke, severe vascular complications, life-threatening bleeding, kidney failure or myocardial infarction (Table 2). Patients treated with PORTICO had a higher rate of new permanent pacemaker implantations (PPI) (9.5% vs. 18.7%; p = 0.002). PORTICO was an independent predictor of pacemaker implantations (OR 1.78; 95% CI 1.25–2.53; p = 0.001). Overall, the patients in need of new PPI more frequently had preexisting RBBB (new PPI 39.7% vs. no PPI 10.0%, p < 0.001). The length of stay was comparable between both groups. The in-hospital all-cause mortality was 2.9% for ACURATE neo and 2.9% for PORTICO, without significant differences.

3.3. Device Failure According to VARC-2

Device failure for PORTICO and ACURATE neo (see Online Table S3 for the analysis of the entire population) was comparable (ACURATE neo 7.3% vs. PORTICO 7.6% p = 1.000). The mean transvalvular gradients decreased post-procedurally with both THVs without significant differences. Moderate-to-severe paravalvular leakage (PVL) was similar for both devices (ACURATE neo 4.8% vs. PORTICO 3.5%, p = 0.546).
Urgent conversion to sternotomy was rare in both groups (ACURATE neo 0.6% vs. PORTICO 1.5%; p = 0.451). Conversion followed coronary impairment (one), THV embolization (five), pericardial effusion (five) and severe mitral regurgitation due to wire perforation (one) (see Online Table S4). The procedural mortality was 2.0% for ACURATE neo and 0.5% for PORTICO (p = 0.623). The details for device failure are given in Table 3 and Table 4.

3.4. 30-Day Follow-Up

There were no significant differences regarding mortality after 30 days (3.8% vs. 4.1%, RR 1.13, 95% CI 0.53–2.40, p = 0.757) in the matched population (Figure 3).

4. Discussion

As TAVR has become a highly standardized procedure not only in regard to the preprocedural diagnostics but also the periprocedural workflow, the overall procedural success rate is very high.
During the last years, several TAVR devices, including specific iterations to address typical complications that are known to influence the outcome, entered the clinical market.
While, initially, valve selection was based on the individual experience of the interventionalist, with growing numbers of procedures and increasing experience, comparative studies including different TAVR devices have been published. In the SCOPE I trial, ACURATE neo did not meet noninferiority compared to the balloon-expandable SAPIEN 3 device in terms of early safety (30 days) and clinical efficacy outcomes [11]. This was mainly driven by differences in the severity of the PVL and the frequency of stage 2 or 3 acute kidney injury. Interestingly, in contrast to prior nonrandomized trials, the rates of new pacemaker implantations were comparable between ACURATE neo and SAPIEN 3. Comparably to prior results, echocardiography revealed smaller gradients and larger effective orifice areas after ACURATE neo prostheses [22]. At 1 year, no differences in the clinical outcomes were observed in the randomized comparison. The rate of PVL remained higher and the transprosthetic mean gradients lower in ACURATE neo recipients from 30 days to the 1-year follow-up [23]. In addition to this, the SCOPE II trial of ACURATE neo did not meet noninferiority compared to the self-expanding CoreValve Evolute device in terms of all-cause death or stroke at 30 days and 1 year. However, ACURATE neo was associated with a lower incidence of permanent pacemakers. Nevertheless, a secondary analysis revealed a higher incidence of moderate or severe regurgitation at 30 days and cardiac death at 30 days and 1 year after ACURATE neo compared to CoreValve Evolute [14].
The randomized PORTICO IDE trial compared the PORTICO valve with different commercial valves. It revealed a higher rate of safety endpoint events, including mortality, of the PORTICO valve than the commercial valves at 30 days [12]. In addition, the rates of permanent pacemaker implantation and moderate or greater PVL were higher in the PORTICO valve group than in the commercial valve group (Edwards SAPIEN 3, CoreValve Evolute R/Pro). A post hoc comparison showed increased mortality at 2 years in the PORTICO group compared with the SAPIEN 3 valve and a similar mortality in Evolut R and Evolut PRO valves. However, in a post-hoc analysis, superiority was not reached for the Edwards SAPIEN or the Medtronic CoreValve prostheses.
To the best of our knowledge, this is the first two-center, propensity-matched comparison of the ACURATE neo and the PORTICO TAVR valve prostheses.
Consistent with prior publications, in our analysis, both valves showed high procedural success rates (92.7% for the ACURATE neo and 92.4% for the PORTICO valve) [12,22].
As a main finding of our trial, no significant differences could be observed in regard to procedural success and intrahospital and 30-day mortality.

4.1. Echocardiographic Data

Residual PVL after TAVR is generally associated with adverse outcomes [11,12,24]. In our trial, both valves demonstrated low rates of more than mild PVL, which was comparable to the post-market follow-up data [16,25,26]. Due to the important impact of residual regurgitation, newer generations of both valves have an additional skirt to further reduce the incidence of PVL.
Despite the intra-annular design of the PORTICO valve, the hemodynamics, including the aortic valve area and aortic valve gradients at discharge, were comparable with the supra-annular ACURATE neo valve. This is remarkable, since the supra-annular design was believed to be associated with improved hemodynamics compared to intra-annular valves [8]. However, this effect may be more meaningful in patients with small annuli, which were underrepresented in our PORTICO cohort at only 1.7%.

4.2. Access-Related Complications and Major Bleeding Events

Access-related complications and major bleedings events are known to be strongly related to adverse outcomes [2,5,27,28]. With the development of next-generation transfemoral THV, delivery systems have been optimized to minimize vascular complications and bleeding [29].
Major vascular complications and major bleeding have been reported in about 8% with ACURATE neo and in about 6% with PORTICO [11,12].
In our cohort, major bleeding events were rare, and no differences between ACURATE neo and PORTICO for major vascular complications and for life-threatening bleeding were observed.
However, to further reduce this important complication, recently, a new 14-F introducer sheath, expanding to 21-F during passing of the prepared prosthesis, for the implantation of the ACURATE neo and a new generation introducer sheath for the PORTICO valve, which can be inserted sheathlessly, became available. Both devices were only used in a relatively small proportion in the study cohort; therefore, an intercomparison would not have been meaningful.

4.3. Permanent Pacemaker Implantation

A main finding of the present study was a significantly higher incidence of PPI in the PORTICO group. Differences in the radial force and the stent design, including different implantation techniques (ACUARET neo: top-down vs. PORTICO: bottom-up deployment) with potentially less interference with the conduction system, may be an important explanation for this result. In line with prior data, preexisting RBBB was an independent predictor for the need of PPI in the overall cohort [30]. Furthermore, the implantation depth has an important impact on the incidences of conduction disturbances [31]. Therefore, a high prosthesis position should always be attempted, which might be a reason for the relatively high number of embolizations in the portico arm. In this context, the cusp overlay technique gave some important impact recently [32,33]. Even though PPI may not have any impact on short-term outcomes, potentially detrimental effects on mortality may become apparent in the long-term [34,35,36]. It has to be taken into account that the data were collected mainly from elderly patients with other comorbidities, influencing the life expectancy. Therefore, the real issue of long-term right ventricular pacing demonstrated in other settings may not be readily apparent in the sicker TAVR population. New PPI after TAVR using earlier generation ranged between 5% and 12% for balloon-expandable and 28% in self-expanding devices [37]. In contrast to a significant reduction of other typical TAVR complications, such as PVL, the available evidence to date does not support a dramatic reduction in the PPM rates since the arrival of newer-generation devices [38]. As the strategies and indications for permanent pacemaker implantations differ significantly between centers, recently, the first recommendations of the management of conduction disturbances associated with TAVR were published [39].

4.4. Limitation

The lack of randomization is an obvious limitation of the present study; however, the main strength of the present study is the relatively high number of patients and the use of a case-matching procedure using a propensity score to achieve comparable groups of patients with both valves to be included in the analysis. This is a real-world study and reflects the current clinical practices in two high-volume centers performing TAVR using both systems for many years in Germany. All implanting interventionalists were highly experienced with both devices, and both centers included a balanced rate of patients. Even though the patients were treated using comparable procedural standards, a minor bias could not be excluded.
Generally, it has to be taken into account that both valve prostheses have a known learning curve, which might have an effect at less experienced centers.

5. Conclusions

In this two-center case-matched comparison, the short-term clinical and hemodynamic outcomes showed comparable results between PORTICO and ACURATE neo prostheses. However, PORTICO was associated with a significantly higher incidence of PPI.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/jcm11144228/s1, Table S1: Prosthesis parameters, sizing recommendations and sheath profiles for ACURATE neo and PORTICO; Table S2: Procedural characteristics and in-hospital complications of patients treated with PORTICO and of the entire and the matched population treated with ACURATE neo; Table S3: Device failure of patients treated with PORTICO and ACURATE neo of the entire population; Table S4 Reasons for Conversion (Entire population).

Author Contributions

Conceptualization, C.G.; Methodology, H.A.-T., D.S., L.K. and C.G.; Supervision, C.W.H. and H.M.; Writing—original draft, J.B., C.E., W.-K.K. and H.M.; Writing—review & editing, O.H., M.R., Y.-H.C., C.W.H., V.T., L.G. and G.D. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

H.M.: Proctor fees and or speaker honoraria from Boston Scientific and Abott. W.-K.K.: Proctor fees and or speaker honoraria from Boston and Abott. J.B.: Proctor fees and or speaker honoraria from Boston Scientific and Abott.

References

  1. Adams, D.H.; Popma, J.J.; Reardon, M.J.; Yakubov, S.J.; Coselli, J.S.; Deeb, G.M.; Gleason, T.G.; Buchbinder, M.; Hermiller, J., Jr.; Kleiman, N.S.; et al. Transcatheter aortic-valve replacement with a self-expanding prosthesis. N. Engl. J. Med. 2014, 370, 1790–1798. [Google Scholar] [CrossRef] [Green Version]
  2. Leon, M.B.; Smith, C.R.; Mack, M.J.; Makkar, R.R.; Svensson, L.G.; Kodali, S.K.; Thourani, V.H.; Tuzcu, E.M.; Miller, D.C.; Herrmann, H.C.; et al. Transcatheter or Surgical Aortic-Valve Replacement in Intermediate-Risk Patients. N. Engl. J. Med. 2016, 374, 1609–1620. [Google Scholar] [CrossRef] [PubMed]
  3. Mack, M.J.; Leon, M.B.; Thourani, V.H.; Makkar, R.; Kodali, S.K.; Russo, M.; Kapadia, S.R.; Malaisrie, S.C.; Cohen, D.J.; Pibarot, P.; et al. Transcatheter Aortic-Valve Replacement with a Balloon-Expandable Valve in Low-Risk Patients. N. Engl. J. Med. 2019, 380, 1695–1705. [Google Scholar] [CrossRef]
  4. Popma, J.J.; Deeb, G.M.; Yakubov, S.J.; Mumtaz, M.; Gada, H.; O’Hair, D.; Bajwa, T.; Heiser, J.C.; Merhi, W.; Kleiman, N.S.; et al. Transcatheter Aortic-Valve Replacement with a Self-Expanding Valve in Low-Risk Patients. N. Engl. J. Med. 2019, 380, 1706–1715. [Google Scholar] [CrossRef]
  5. Reardon, M.J.; Van Mieghem, N.M.; Popma, J.J.; Kleiman, N.S.; Sondergaard, L.; Mumtaz, M.; Adams, D.H.; Deeb, G.M.; Maini, B.; Gada, H.; et al. Surgical or Transcatheter Aortic-Valve Replacement in Intermediate-Risk Patients. N. Engl. J. Med. 2017, 376, 1321–1331. [Google Scholar] [CrossRef] [PubMed]
  6. Smith, C.R.; Leon, M.B.; Mack, M.J.; Miller, D.C.; Moses, J.W.; Svensson, L.G.; Tuzcu, E.M.; Webb, J.G.; Fontana, G.P.; Makkar, R.R.; et al. Transcatheter versus surgical aortic-valve replacement in high-risk patients. N. Engl. J. Med. 2011, 364, 2187–2198. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  7. Thyregod, H.G.; Steinbruchel, D.A.; Ihlemann, N.; Nissen, H.; Kjeldsen, B.J.; Petursson, P.; Chang, Y.; Franzen, O.W.; Engstrom, T.; Clemmensen, P.; et al. Transcatheter Versus Surgical Aortic Valve Replacement in Patients With Severe Aortic Valve Stenosis: 1-Year Results From the All-Comers NOTION Randomized Clinical Trial. J. Am. Coll. Cardiol. 2015, 65, 2184–2194. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  8. Abdel-Wahab, M.; Mehilli, J.; Frerker, C.; Neumann, F.J.; Kurz, T.; Tolg, R.; Zachow, D.; Guerra, E.; Massberg, S.; Schafer, U.; et al. Comparison of balloon-expandable vs self-expandable valves in patients undergoing transcatheter aortic valve replacement: The CHOICE randomized clinical trial. JAMA 2014, 311, 1503–1514. [Google Scholar] [CrossRef] [PubMed]
  9. Feldman, T.E.; Reardon, M.J.; Rajagopal, V.; Makkar, R.R.; Bajwa, T.K.; Kleiman, N.S.; Linke, A.; Kereiakes, D.J.; Waksman, R.; Thourani, V.H.; et al. Effect of Mechanically Expanded vs Self-Expanding Transcatheter Aortic Valve Replacement on Mortality and Major Adverse Clinical Events in High-Risk Patients With Aortic Stenosis: The REPRISE III Randomized Clinical Trial. JAMA 2018, 319, 27–37. [Google Scholar] [CrossRef]
  10. Kim, W.K.; Blumenstein, J.; Liebetrau, C.; Rolf, A.; Gaede, L.; Van Linden, A.; Arsalan, M.; Doss, M.; Tijssen, J.G.P.; Hamm, C.W.; et al. Comparison of outcomes using balloon-expandable versus self-expanding transcatheter prostheses according to the extent of aortic valve calcification. Clin. Res. Cardiol. 2017, 106, 995–1004. [Google Scholar] [CrossRef]
  11. Lanz, J.; Kim, W.K.; Walther, T.; Burgdorf, C.; Mollmann, H.; Linke, A.; Redwood, S.; Thilo, C.; Hilker, M.; Joner, M.; et al. Safety and efficacy of a self-expanding versus a balloon-expandable bioprosthesis for transcatheter aortic valve replacement in patients with symptomatic severe aortic stenosis: A randomised non-inferiority trial. Lancet 2019, 394, 1619–1628. [Google Scholar] [CrossRef]
  12. Makkar, R.R.; Cheng, W.; Waksman, R.; Satler, L.F.; Chakravarty, T.; Groh, M.; Abernethy, W.; Russo, M.J.; Heimansohn, D.; Hermiller, J.; et al. Self-expanding intra-annular versus commercially available transcatheter heart valves in high and extreme risk patients with severe aortic stenosis (PORTICO IDE): A randomised, controlled, non-inferiority trial. Lancet 2020, 396, 669–683. [Google Scholar] [CrossRef]
  13. Pagnesi, M.; Kim, W.K.; Conradi, L.; Barbanti, M.; Stefanini, G.G.; Zeus, T.; Pilgrim, T.; Schofer, J.; Zweiker, D.; Testa, L.; et al. Transcatheter Aortic Valve Replacement With Next-Generation Self-Expanding Devices: A Multicenter, Retrospective, Propensity-Matched Comparison of Evolut PRO Versus Acurate neo Transcatheter Heart Valves. JACC Cardiovasc. Interv. 2019, 12, 433–443. [Google Scholar] [CrossRef] [PubMed]
  14. Tamburino, C.; Bleiziffer, S.; Thiele, H.; Scholtz, S.; Hildick-Smith, D.; Cunnington, M.; Wolf, A.; Barbanti, M.; Tchetche, D.; Garot, P.; et al. Comparison of Self-Expanding Bioprostheses for Transcatheter Aortic Valve Replacement in Patients With Symptomatic Severe Aortic Stenosis: SCOPE 2 Randomized Clinical Trial. Circulation 2020, 142, 2431–2442. [Google Scholar] [CrossRef]
  15. Mollmann, H.; Linke, A.; Holzhey, D.M.; Walther, T.; Manoharan, G.; Schafer, U.; Heinz-Kuck, K.; Van Boven, A.J.; Redwood, S.R.; Kovac, J.; et al. Implantation and 30-Day Follow-Up on All 4 Valve Sizes Within the Portico Transcatheter Aortic Bioprosthetic Family. JACC Cardiovasc. Interv. 2017, 10, 1538–1547. [Google Scholar] [CrossRef]
  16. Sondergaard, L.; Rodes-Cabau, J.; Hans-Peter Linke, A.; Fichtlscherer, S.; Schafer, U.; Kuck, K.H.; Kempfert, J.; Arzamendi, D.; Bedogni, F.; Asch, F.M.; et al. Transcatheter Aortic Valve Replacement With a Repositionable Self-Expanding Prosthesis: The PORTICO-I Trial 1-Year Outcomes. J. Am. Coll. Cardiol. 2018, 72, 2859–2867. [Google Scholar] [CrossRef]
  17. Willson, A.B.; Rodes-Cabau, J.; Wood, D.A.; Leipsic, J.; Cheung, A.; Toggweiler, S.; Binder, R.K.; Freeman, M.; DeLarochelliere, R.; Moss, R.; et al. Transcatheter aortic valve replacement with the St. Jude Medical Portico valve: First-in-human experience. J. Am. Coll. Cardiol. 2012, 60, 581–586. [Google Scholar] [CrossRef] [Green Version]
  18. Baumgartner, H.; Falk, V.; Bax, J.J.; De Bonis, M.; Hamm, C.; Holm, P.J.; Iung, B.; Lancellotti, P.; Lansac, E.; Rodriguez Munoz, D.; et al. 2017 ESC/EACTS Guidelines for the management of valvular heart disease. Eur. Heart J. 2017, 38, 2739–2791. [Google Scholar] [CrossRef]
  19. Vahanian, A.; Beyersdorf, F.; Praz, F.; Milojevic, M.; Baldus, S.; Bauersachs, J.; Capodanno, D.; Conradi, L.; De Bonis, M.; De Paulis, R.; et al. 2021 ESC/EACTS Guidelines for the management of valvular heart disease. Eur. Heart J. 2022, 43, 561–632. [Google Scholar] [CrossRef]
  20. Achenbach, S.; Delgado, V.; Hausleiter, J.; Schoenhagen, P.; Min, J.K.; Leipsic, J.A. SCCT expert consensus document on computed tomography imaging before transcatheter aortic valve implantation (TAVI)/transcatheter aortic valve replacement (TAVR). J. Cardiovasc. Comput. Tomogr. 2012, 6, 366–380. [Google Scholar] [CrossRef]
  21. Mollmann, H.; Diemert, P.; Grube, E.; Baldus, S.; Kempfert, J.; Abizaid, A. Symetis ACURATE TF aortic bioprosthesis. EuroIntervention 2013, 9, S107–S110. [Google Scholar] [CrossRef] [PubMed]
  22. Husser, O.; Kim, W.K.; Pellegrini, C.; Holzamer, A.; Walther, T.; Mayr, P.N.; Joner, M.; Kasel, A.M.; Trenkwalder, T.; Michel, J.; et al. Multicenter Comparison of Novel Self-Expanding Versus Balloon-Expandable Transcatheter Heart Valves. JACC Cardiovasc. Interv. 2017, 10, 2078–2087. [Google Scholar] [CrossRef] [PubMed]
  23. Kim, W.K.; Walther, T.; Burgdorf, C.; Mollmann, H.; Linke, A.; Redwood, S.; Thilo, C.; Hilker, M.; Joner, M.; Thiele, H.; et al. One-Year Outcomes of a Randomized Trial Comparing a Self-Expanding With a Balloon-Expandable Transcatheter Aortic Valve. Circulation 2021, 143, 1267–1269. [Google Scholar] [CrossRef] [PubMed]
  24. Kodali, S.; Pibarot, P.; Douglas, P.S.; Williams, M.; Xu, K.; Thourani, V.; Rihal, C.S.; Zajarias, A.; Doshi, D.; Davidson, M.; et al. Paravalvular regurgitation after transcatheter aortic valve replacement with the Edwards sapien valve in the PARTNER trial: Characterizing patients and impact on outcomes. Eur. Heart J. 2015, 36, 449–456. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Kim, W.K.; Hengstenberg, C.; Hilker, M.; Kerber, S.; Schafer, U.; Rudolph, T.; Linke, A.; Franz, N.; Kuntze, T.; Nef, H.; et al. The SAVI-TF Registry: 1-Year Outcomes of the European Post-Market Registry Using the ACURATE neo Transcatheter Heart Valve Under Real-World Conditions in 1,000 Patients. JACC Cardiovasc. Interv. 2018, 11, 1368–1374. [Google Scholar] [CrossRef]
  26. Mollmann, H.; Hengstenberg, C.; Hilker, M.; Kerber, S.; Schafer, U.; Rudolph, T.; Linke, A.; Franz, N.; Kuntze, T.; Nef, H.; et al. Real-world experience using the ACURATE neo prosthesis: 30-day outcomes of 1,000 patients enrolled in the SAVI TF registry. EuroIntervention 2018, 13, e1764–e1770. [Google Scholar] [CrossRef] [Green Version]
  27. Dencker, D.; Taudorf, M.; Luk, N.H.; Nielsen, M.B.; Kofoed, K.F.; Schroeder, T.V.; Sondergaard, L.; Lonn, L.; De Backer, O. Frequency and Effect of Access-Related Vascular Injury and Subsequent Vascular Intervention After Transcatheter Aortic Valve Replacement. Am. J. Cardiol. 2016, 118, 1244–1250. [Google Scholar] [CrossRef]
  28. Genereux, P.; Head, S.J.; Van Mieghem, N.M.; Kodali, S.; Kirtane, A.J.; Xu, K.; Smith, C.; Serruys, P.W.; Kappetein, A.P.; Leon, M.B. Clinical outcomes after transcatheter aortic valve replacement using valve academic research consortium definitions: A weighted meta-analysis of 3,519 patients from 16 studies. J. Am. Coll. Cardiol. 2012, 59, 2317–2326. [Google Scholar] [CrossRef] [Green Version]
  29. Barbanti, M.; Buccheri, S.; Rodes-Cabau, J.; Gulino, S.; Genereux, P.; Pilato, G.; Dvir, D.; Picci, A.; Costa, G.; Tamburino, C.; et al. Transcatheter aortic valve replacement with new-generation devices: A systematic review and meta-analysis. Int. J. Cardiol. 2017, 245, 83–89. [Google Scholar] [CrossRef]
  30. Husser, O.; Pellegrini, C.; Kim, W.K.; Holzamer, A.; Pilgrim, T.; Toggweiler, S.; Schafer, U.; Blumenstein, J.; Deuschl, F.; Rheude, T.; et al. Transcatheter Valve SELECTion in Patients With Right Bundle Branch Block and Impact on Pacemaker Implantations. JACC Cardiovasc. Interv. 2019, 12, 1781–1793. [Google Scholar] [CrossRef]
  31. Bruno, F.; D’Ascenzo, F.; Vaira, M.P.; Elia, E.; Omede, P.; Kodali, S.; Barbanti, M.; Rodes-Cabau, J.; Husser, O.; Sossalla, S.; et al. Predictors of pacemaker implantation after transcatheter aortic valve implantation according to kind of prosthesis and risk profile: A systematic review and contemporary meta-analysis. Eur. Heart J. Qual. Care Clin. Outcomes 2021, 7, 143–153. [Google Scholar] [CrossRef] [PubMed]
  32. Pascual, I.; Almendarez, M.; Avanzas, P.; Alvarez, R.; Arboine, L.A.; Del Valle, R.; Hernandez-Vaquero, D.; Alfonso, F.; Moris, C. Cusp-overlapping TAVI technique with a self-expanding device optimizes implantation depth and reduces permanent pacemaker requirement. Rev. Esp. Cardiol. 2022, 75, 412–420. [Google Scholar] [CrossRef] [PubMed]
  33. Pascual, I.; Hernandez-Vaquero, D.; Alperi, A.; Almendarez, M.; Avanzas, P.; Kalavrouziotis, D.; Lorca, R.; Mesnier, J.; Arboine, L.; Mohammadi, S.; et al. Permanent Pacemaker Reduction Using Cusp-Overlapping Projection in TAVR: A Propensity Score Analysis. JACC Cardiovasc. Interv. 2022, 15, 150–161. [Google Scholar] [CrossRef] [PubMed]
  34. Costa, G.; Zappulla, P.; Barbanti, M.; Cirasa, A.; Todaro, D.; Rapisarda, G.; Picci, A.; Platania, F.; Tosto, A.; Di Grazia, A.; et al. Pacemaker dependency after transcatheter aortic valve implantation: Incidence, predictors and long-term outcomes. EuroIntervention 2019, 15, 875–883. [Google Scholar] [CrossRef] [Green Version]
  35. Regueiro, A.; Abdul-Jawad Altisent, O.; Del Trigo, M.; Campelo-Parada, F.; Puri, R.; Urena, M.; Philippon, F.; Rodes-Cabau, J. Impact of New-Onset Left Bundle Branch Block and Periprocedural Permanent Pacemaker Implantation on Clinical Outcomes in Patients Undergoing Transcatheter Aortic Valve Replacement: A Systematic Review and Meta-Analysis. Circ. Cardiovasc. Interv. 2016, 9, e003635. [Google Scholar] [CrossRef]
  36. Fadahunsi, O.O.; Olowoyeye, A.; Ukaigwe, A.; Li, Z.; Vora, A.N.; Vemulapalli, S.; Elgin, E.; Donato, A. Incidence, Predictors, and Outcomes of Permanent Pacemaker Implantation Following Transcatheter Aortic Valve Replacement: Analysis From the U.S. Society of Thoracic Surgeons/American College of Cardiology TVT Registry. JACC Cardiovasc. Interv. 2016, 9, 2189–2199. [Google Scholar] [CrossRef]
  37. Siontis, G.C.; Juni, P.; Pilgrim, T.; Stortecky, S.; Bullesfeld, L.; Meier, B.; Wenaweser, P.; Windecker, S. Predictors of permanent pacemaker implantation in patients with severe aortic stenosis undergoing TAVR: A meta-analysis. J. Am. Coll. Cardiol. 2014, 64, 129–140. [Google Scholar] [CrossRef] [Green Version]
  38. Auffret, V.; Puri, R.; Urena, M.; Chamandi, C.; Rodriguez-Gabella, T.; Philippon, F.; Rodes-Cabau, J. Conduction Disturbances After Transcatheter Aortic Valve Replacement: Current Status and Future Perspectives. Circulation 2017, 136, 1049–1069. [Google Scholar] [CrossRef]
  39. Rodes-Cabau, J.; Ellenbogen, K.A.; Krahn, A.D.; Latib, A.; Mack, M.; Mittal, S.; Muntane-Carol, G.; Nazif, T.M.; Sondergaard, L.; Urena, M.; et al. Management of Conduction Disturbances Associated With Transcatheter Aortic Valve Replacement: JACC Scientific Expert Panel. J. Am. Coll. Cardiol. 2019, 74, 1086–1106. [Google Scholar] [CrossRef]
Figure 1. Variables used for the propensity matching.
Figure 1. Variables used for the propensity matching.
Jcm 11 04228 g001
Figure 2. Propensity scores in the treated and control groups.
Figure 2. Propensity scores in the treated and control groups.
Jcm 11 04228 g002
Figure 3. Kaplan–Meier cumulative event rate for the 30-day mortality. Cumulative event rate after 30 days for mortality in ACURATE neo vs. PORTICO (HR 1.13; 95% CI 0.53–2.40, p = 0.757).
Figure 3. Kaplan–Meier cumulative event rate for the 30-day mortality. Cumulative event rate after 30 days for mortality in ACURATE neo vs. PORTICO (HR 1.13; 95% CI 0.53–2.40, p = 0.757).
Jcm 11 04228 g003
Table 1. Baseline characteristics of the patients treated with ACURATE neo and of the entire population and the matched population treated with PORTICO.
Table 1. Baseline characteristics of the patients treated with ACURATE neo and of the entire population and the matched population treated with PORTICO.
Entire PopulationMatched Population (1:1)
PORTICOACURATE Neop-ValueACURATE Neop-Value
(n = 344)(n = 1247) (n = 344)
Clinical characteristics
Age83.0 (79.7–86.0)82.0 (78.6–85.0)0.00382.8 (79.6–86.0)0.863
Gender (male):138 (40.1%)484 (38.8%)0.707149 (43.3%)0.439
BMI (kg/m2)26.7 (24.2–30.7)26.6 (23.9–30.4)0.53326.9 (24.0–30.9)0.905
Log Euroscore (%)17.4 (11.2–26.8)17.5 (11.2–26.4)0.84117.4 (11.6–26.8)0.911
Euroscore II (%)4.2 (2.7–7.0)4.1 (2.6–6.8)0.3444.2 (2.6–7.2)0.731
NYHA (III/IV)290 (84.3%)1008 (80.8%)0.164298 (86.6%)0.449
COPD70 (20.3%)241 (19.3%)0.72972 (20.9%)0.925
Hypertension308 (89.5%)1121 (89.9%)0.924313 (91.0%)0.607
Diabetes120 (34.9%)400 (32.1%)0.359130 (37.8%)0.476
eGFR (mL/min)54.0 (41.8–74.2)59.0 (43.0–78.0)0.05959.0 (42.0–76.2)0.423
Creatinine (mg/dL)1.0 (0.8–1.3)1.0 (0.8–1.3)0.3461.0 (0.8–1.3)0.971
Dialysis6 (1.7%)32 (2.6%)0.4944 (1.2%)0.750
PAD48 (14.0%)173 (13.9%)1.00045 (13.1%)0.824
Previous Stroke31 (9.0%)168 (13.5%)0.03427 (7.8%)0.681
CAD230 (66.9%)821 (65.8%)0.772227 (66.0%)0.872
Previous MI37 (10.8%)142 (11.4%)0.81733 (9.6%)0.705
Previous PCI129 (37.5%)471 (37.8%)0.977124 (36.0%)0.752
Previous CABG31 (9.0%)125 (10.0%)0.64831 (9.0%)1.000
Echocardiographic characteristics
LVEF (%)60.0 (52.0–65.0)62.0 (53.0–65.0)0.05760.0 (50.0–65.0)0.474
Pmean (mmHg)43.0 (35.0–50.0)41.0 (31.0–49.0)0.00641.0 (32.0–51.0)0.405
MR (≥Grade II)5 (1.5%)11 (0.9%)0.3615 (1.5%)1.000
TR (≥Grade II)5 (1.5%)17 (1.4%)0.8004 (1.2%)1.000
sPAP (≥60 mmHg)25 (8.9%)94 (9.0%)1.00032 (9.3%)1.000
Electrocardiographic characteristics
Atrial fibrillation135 (39.2%)479 (38.4%)0.827129 (37.5%)0.695
LBBB34 (10.0%)109 (8.8%)0.56836 (10.5%)0.900
RBBB17 (5.0%)133 (10.7%)0.00214 (4.1%)0.713
Pacemaker66 (19.2%)147 (11.8%)0.00149 (14.2%)0.102
MSCT data
Prosthesis area (cm2)4.3 (4.0–4.9)4.5 (4.0–4.9)0.4354.6 (4.1–4.9)0.064
Minimum diameter (mm)20.7 (19.2–22.0)20.3 (19.0–21.8)0.00720.9 (19.6–22.0)0.197
Maximum diameter (mm)26.9 (25.4–28.2)26.7 (25.1–28.0)0.13127.0 (25.7–28.4)0.431
Distance to LCA (mm)13.0 (11.6–15.0)13.1 (11.1–15.2)0.96613.1 (11.9–15.4)0.321
Distance to RCA (mm)17.0 (15.0–19.0)17.0 (15.0–19.0)0.42217.1 (15.4–19.0)0.040
Eccentricity0.2 (0.2–0.3)0.2 (0.2–0.3)0.0570.2 (0.2–0.3)0.630
Calcification (AU)2366.0 (1661.0–3371.0)2197.5 (1400.5–3187.2)0.0152512.0 (1641.0–3435.0)0.743
Values are the mean ± SD, n (%) or median (interquartile range). CABG = coronary artery bypass grafting; COPD = chronic obstructive pulmonary disease; CAD = coronary artery disease; MI = myocardial infarction; PAD = peripheral artery disease; eGFR = creatinine clearance; LBBB = complete left bundle branch block; LV = left ventricular; EF = Ejection fraction; MR = Mitral Regurgitation, TR = tricuspid regurgitation, sPAP = systolic pulmonary arterial pressure; MSCT = multislice computed tomography; NYHA = New York Heart Association functional class; PCI = percutaneous coronary intervention; RBBB = complete right bundle branch block, AU = Angaston units.
Table 2. Procedural characteristics and in-hospital complications of the patients treated with PORTICO and of the entire population and the matched population treated with ACURATE neo.
Table 2. Procedural characteristics and in-hospital complications of the patients treated with PORTICO and of the entire population and the matched population treated with ACURATE neo.
Matched Population (1:1)
PORTICOACURATE Neop-Value
(n = 344)(n = 344)
Procedural data
Conscious sedation308 (89.5%)300 (87.2%)0.405
THV Size <0.001
  236 (1.7%)49 (14.2%)
  2593 (27.0%)148 (43.0%)
  27123 (35.8%)147 (42.7%)
  29122 (35.5%)0 (0.0%)
Pre-dilatation275 (79.9%)270 (78.5%)0.707
Post-dilatation64 (18.6%)110 (32.0%)<0.001
Cerebral protection2 (0.6%)7 (2.0%)0.177
Procedural time (min)52.0 (40.0–69.0)56.0 (38.0–72.2)0.853
Contrast (mL)120.0 (100.0–160.0)100.0 (80.0–130.0)<0.001
Fluoroscopy dose (Gy)1466.5 (29.1–3463.8)1391.0 (27.1–3635.5)0.868
Fluoroscopy time (s)12.5 (9.2–17.1)10.3 (8.0–14.6)<0.001
Echocardiographic characteristics
Postprocedural mean gradient (mmHg)8.0 (6.0–10.0)8.0 (6.0–10.0)0.982
Postprocedural max gradient (mmHg)13.0 (10.0–18.0)14.0 [11.0;18.0]0.856
Clinical events
Major stroke/minor stroke/TIA13 (3.8%)12 (3.5%)1.000
Major vascular complications9 (4.5%)11 (5.4%)0.854
Life-threatening bleeding (VARC)2 (1.0%)4 (2.0%)0.685
Renal failure (AKIN 2/3)12 (3.5%)13 (3.8%)0.994
Coronary artery obstruction with PCI0 (0.0%)3 (1.5%)0.248
Myocardial infarction6 (3.0%)8 (3.9%)0.815
Permanent pacemaker implantation 152 (18.7%)28 (9.5%)0.002
Days in hospital7.0 (6.0–10.0)7.5 (6.0–11.0)0.965
Days in the intensive care unit2.0 (1.0–3.0)2.0 (1.0–3.0)0.825
In-hospital mortality10 (2.9%)10 (2.9%)1.000
Values are the mean ± SD, n (%) or median (interquartile range). 1 Excluding patients with pacemakers at the baseline (n = 115 in the matched population). VARC = Valve Academic Research Consortium, AKIN = Acute Kidney Injury Network, TIA = transitory ischemic attack.
Table 3. Device failure for patients treated with PORTICO and ACURATE neo of the matched population.
Table 3. Device failure for patients treated with PORTICO and ACURATE neo of the matched population.
PORTICOACURATE Neop-Value
(n = 344)(n = 344)
Device failure 126 (7.6%)25 (7.3%)1.000
Procedural related death1 (0.5%)4 (2.0%)0.372
Significant paravalvular leakage (>Grade II)12 (3.5%)16 (4.8%)0.546
Elevated gradient (>20 mmHg)4 (1.2%)5 (1.5%)0.752
Multiple valves10 (2.9%)7 (2.0%)0.623
Conversion to sternotomy5 (1.5%)2 (0.6%)0.451
Values are the mean ± SD, n (%). 1 Prothesis mismatch, mean aortic gradient ≥20 mmHg or peak velocity ≥3 m/s, moderate or severe prosthetic valve aortic regurgitation of the first implanted valve and multiple events possible.
Table 4. Reasons for conversion to open heart surgery (entire population).
Table 4. Reasons for conversion to open heart surgery (entire population).
PORTICOACURATE
(n = 5)(n = 7)
Reasons for conversion
Coronary impairment0 (0.0%)1 (14.3%)
Embolization3 (60%)2 (28.6%)
Pericardial effusion1 (20%)4 (57.1%)
Severe mitral regurgitation (due to wire)1 (20%)0 (0.0%)
Values are n (%).
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Blumenstein, J.; Eckel, C.; Husser, O.; Kim, W.-K.; Renker, M.; Choi, Y.-H.; Hamm, C.W.; Al-Terki, H.; Sötemann, D.; Körbi, L.; et al. Multi-Center Comparison of Two Self-Expanding Transcatheter Heart Valves: A Propensity Matched Analysis. J. Clin. Med. 2022, 11, 4228. https://doi.org/10.3390/jcm11144228

AMA Style

Blumenstein J, Eckel C, Husser O, Kim W-K, Renker M, Choi Y-H, Hamm CW, Al-Terki H, Sötemann D, Körbi L, et al. Multi-Center Comparison of Two Self-Expanding Transcatheter Heart Valves: A Propensity Matched Analysis. Journal of Clinical Medicine. 2022; 11(14):4228. https://doi.org/10.3390/jcm11144228

Chicago/Turabian Style

Blumenstein, Johannes, Clemens Eckel, Oliver Husser, Won-Keun Kim, Matthias Renker, Yeong-Hoon Choi, Christian W. Hamm, Hani Al-Terki, Dagmar Sötemann, Leon Körbi, and et al. 2022. "Multi-Center Comparison of Two Self-Expanding Transcatheter Heart Valves: A Propensity Matched Analysis" Journal of Clinical Medicine 11, no. 14: 4228. https://doi.org/10.3390/jcm11144228

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop