Next Article in Journal
Ubiquitous Carbohydrate Binding Modules Decorate 936 Lactococcal Siphophage Virions
Next Article in Special Issue
Hepatitis E Virus Replication
Previous Article in Journal
The Nucleoprotein and Phosphoprotein of Peste des Petits Ruminants Virus Inhibit Interferons Signaling by Blocking the JAK-STAT Pathway
Previous Article in Special Issue
Hepatitis E and Allogeneic Hematopoietic Stem Cell Transplantation: A French Nationwide SFGM-TC Retrospective Study
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Viruses
Volume 11
Issue 7
10.3390/v11070630
viruses-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Plasma Hepatitis E Virus Kinetics in Solid Organ Transplant Patients Receiving Ribavirin

by
Sebastien Lhomme
1,*,
Swati DebRoy
2,3,
Nassim Kamar
4,
Florence Abravanel
1,
David Metsu
5,
Olivier Marion
4,
Chloé Dimeglio
1,
Scott J. Cotler
2,
Jacques Izopet
1 and
Harel Dahari
2,*
1
National Reference Center for Hepatitis E, Department of Virology, Federative Institute of Biology, CHU Purpan, INSERM U1043, University Toulouse III-Paul Sabatier, 31300 Toulouse, France
2
The Program for Experimental & Theoretical Modeling, Division of Hepatology, Loyola University Medical Center, Maywood, IL 60153, USA
3
Department of Mathematics and Computational Science, University of South Carolina-Beaufort, Bluffton, SC 29909, USA
4
Department of Nephrology and Organ Transplantation, CHU Rangueil, INSERM U1043, University Toulouse III-Paul Sabatier, 31300 Toulouse, France
5
Department of Pharmacokinetics and Toxicology, Federative Institute of Biology, CHU Purpan, INTHERES, INRA, ENVT, University Toulouse III-Paul Sabatier, 31300 Toulouse, France
*
Authors to whom correspondence should be addressed.
Viruses 2019, 11(7), 630; https://doi.org/10.3390/v11070630
Submission received: 17 June 2019 / Revised: 6 July 2019 / Accepted: 8 July 2019 / Published: 9 July 2019
(This article belongs to the Special Issue Hepatitis E Virus)
Browse Figures
Versions Notes

Abstract

:
Hepatitis E virus (HEV) infection causes chronic hepatitis in solid organ transplant (SOT) recipients. Antiviral therapy consists of three months of ribavirin, although response rates are not optimal. We characterized plasma HEV kinetic patterns in 41 SOT patients during ribavirin therapy. After a median pharmacological delay of three (range: 0–21) days, plasma HEV declined from a median baseline level of 6.12 (3.53–7.45) log copies/mL in four viral kinetic patterns: (i) monophasic (n = 18), (ii) biphasic (n = 13), (iii) triphasic (n = 8), and (iv) flat-partial response (n = 2). The mean plasma HEV half-life was estimated to be 2.0 ± 0.96 days. Twenty-five patients (61%) had a sustained virological response (SVR) 24 weeks after completion of therapy. Viral kinetic patterns (i)–(iii) were not associated with baseline characteristics or outcome of therapy. A flat-partial response was associated with treatment failure. All patients with a log concentration decrease of plasma HEV at day seven of >15% from baseline achieved SVR. In conclusion, viral kinetic modeling of plasma HEV under ribavirin therapy showed, for the first time, four distinct kinetic profiles, a median pharmacologic delay of three days, and an estimated HEV half-life of two days. Viral kinetic patterns were not associated with response to therapy, with the exception of a flat-partial response.

1. Introduction

Hepatitis E virus (HEV) is a single strand positive-sense RNA virus belonging to the Hepeviridae family, which causes an estimated 20 million infections annually including about 3.3 million cases of symptomatic hepatitis [1,2]. Hepatitis E (genotype 1 and 2) was considered an exotic disease, present only in developing countries until 1997 when HEV genotype 3 was identified in Western countries, first in pigs [3] and thereafter in persons who had never travelled to highly endemic areas.
Hepatitis E virus causes a self-limited illness in immunocompetent persons and most infections (>95%) are asymptomatic. However, HEV can cause chronic infection in immunocompromised individuals, including solid organ transplant (SOT) recipients and patients with HIV infection or hematological diseases [4]. Rapidly progressing liver fibrosis and cirrhosis develops in 10% of chronically infected immunosuppressed patients [5,6]. Extra-hepatic manifestations are increasingly reported, especially neurological diseases [7,8]. Emergence of virus–host recombinant variants was described in chronically infected patients [9,10].
Decreasing immunosuppressive therapy, especially drugs targeting T-cells, is considered first-line therapy in SOT patients with chronic HEV, resulting in virus clearance in nearly one-third of patients [11]. Antiviral therapy has been studied in SOT patients who do not clear HEV viremia with reduction of immunosuppression. In a multicenter study, 59 patients were treated with ribavirin monotherapy, and a sustained virologic response (SVR), defined as an undetectable plasma HEV RNA level at least 24 weeks after cessation of treatment, was achieved in 78% of patients [12]. The European Association for the Study of the Liver (EASL) recommended ribavirin monotherapy for a duration of 12 weeks for treatment of chronic HEV in SOT patients [2].
Several preliminary predictors of response to ribavirin therapy were proposed: (i) in two patients with ribavirin treatment failure, the emergence of the 1634R mutation was identified in the polymerase at the time of treatment failure [13]. However, the presence of the 1634R mutation in the HEV polymerase at ribavirin initiation was not associated with ribavirin treatment failure [14]; (ii) a lower lymphocyte count at the initiation of ribavirin was identified in treatment failures in comparison to patients who achieved SVR [12]; (iii) the persistence of HEV RNA in stool at the end of ribavirin therapy, despite the absence of HEV RNA in blood, was associated with HEV relapse after ribavirin cessation [15]; finally, (iv) early kinetics of viral load in blood under therapy showed that a decrease of HEV RNA concentration of at least 0.5 log copies/mL from the pre-treatment level within the first week of ribavirin therapy was associated with SVR [16].
A comprehensive characterization of plasma HEV kinetics under ribavirin therapy has not been performed. We sought to characterize HEV kinetic parameters and patterns during ribavirin monotherapy in SOT patients and to evaluate whether viral kinetic patterns are associated with treatment response.

2. Materials and Methods

2.1. Patients and Ethical Statement

The study was approved by the institutional review board at Toulouse University Hospital, and all patients gave written informed consent to participate. Data were obtained from 41 SOT patients (26 kidney, 9 liver, 3 heart, 1 pancreas, 1 lung and 1 liver/kidney) who received ribavirin for 12 weeks for chronic HEV infection between October 2009 and December 2015 and had sufficiently frequent blood sampling during treatment for viral kinetic analysis. Twenty-two of the cases were described both in our previous study focused on HEV RNA fecal shedding [15] and in the early viral response study [16]. Thirteen patients were only described in the early viral response study [16]. The remaining six patients were included only in this study. Seven patients who were described in our most recent publication [17] were not included due to lack of frequent sampling.
Persistent, unexplained aminotransferase elevations on protocol laboratory measurements prompted HEV RNA testing in SOT patients at our institution. The duration of hepatitis E viremia prior to treatment was calculated from the time of the first positive HEV RNA level. Immunosuppression was decreased in all patients found to have HEV viremia as previously reported [11]. Patients with persistent HEV infection despite a reduction of immunosuppression were treated with 12 weeks of ribavirin.

2.2. Biochemical Measurements

Alanine (ALT) and aspartate (AST) aminotransferase levels were measured at pre-treatment (baseline). The ALT normal physiological range was defined as <40 IU/L in men and <35 IU/L in women (adapted from [18]). The AST normal physiological range was defined as <50 IU/L in men and <35 IU/L in women (adapted from [18]).

2.3. Detection of Anti-HEV IgM and IgG

Anti-HEV IgM and IgG were detected with an enzyme immunoassay (Wantai Biologic Pharmacy Enterprise, Beijing, China) according to the manufacturer’s recommendations. World Health Organization (WHO) reference material for anti-HEV IgG was used to determine concentrations of IgG. The limit of detection was 0.25 WHO U/mL.

2.4. HEV RNA Measurements

All samples were analyzed in the French National Reference Center. HEV RNA was quantified in plasma samples and detected in stool samples using an accredited (ISO 15189) PCR test for HEV3 [19]. HEV RNA measurements were performed at pre-treatment (baseline), at days 3, 7, 15, and 21, and months 1, 2, 3 during therapy, and at months 1, 3, and 6 after completion of ribavirin treatment. The limit of detection for HEV RNA was 100 copies/mL in plasma and stool. HEV RNA at concentrations <100 copies/mL were designated as detected but not quantifiable (DNQ). An SVR was defined as undetectable HEV RNA in plasma for at least 24 weeks after completion of ribavirin therapy.

2.5. Genotype Determination

HEV genotype was determined by sequencing a 348-nucleotide fragment within the ORF2 gene [20] and phylogenetic analysis with HEV reference strains (GenBank) [21].

2.6. Determination of G1634R Polymorphism by Direct Nucleotide Sequencing

Testing for the G1634R polymorphism was performed on pre-treatment blood samples by sequencing a 451-nucleotide fragment encompassing the C-terminal region of the HEV polymerase as previously described [14].

2.7. Measurement of Ribavirin Levels

Plasma ribavirin levels were measured at days 7 and 15 and months 1 and 2 after initiation of ribavirin therapy using a HPLC-UV system, as previously described [22].

2.8. Characterization of Plasma Viral Kinetic Patterns

The viral decline patterns were categorized into four main groups by empirical analysis (as previously done to characterize hepatitis C virus (HCV) kinetics under silibinin treatment [23]). Each identified slope (or phase) was calculated by linear regression. We defined a viral decline as monophasic (i.e., single phase of viral decline) if only one phase was present or two viral decline slopes were identified but differed by less than a factor of 2. A two-phase (or biphasic) HEV RNA decline was defined in cases where the first phase decline was 2-fold larger (or smaller) than the second phase decline rate. A flat-partial response was defined in subjects who had a first phase viral decline followed by an extremely slow (or flat) second phase until the end of treatment (EOT). A triphasic viral decline was similar to a flat-partial response but with resumption of viral decline before EOT.

2.9. Statistical Analysis

Statistical analysis was performed with STATA statistical software, release 14 (STATA Corporation, College station, TX, USA). Descriptive statistics were performed using number and frequency for qualitative data and median range for quantitative data. We excluded from the statistical analyses the flat-partial viral kinetic group (of the 4 identified groups) because it included only two patients. Due to the small number of patients with some kinetic patterns, we combined the data into two main groups: the viral kinetic monophasic pattern and the viral kinetic multiphasic pattern (i.e., biphasic and triphasic). Qualitative variables were compared between groups using chi-square tests (or Fisher’s exact tests in the case of small expected numbers). The student’s t test was used to compare the distribution of normally distributed continuous variables (or Mann–Whitney’s test when the distribution departed from normality or when homoscedasticity was rejected). The independent variables initially introduced into the linear model were those associated with the viral kinetic patterns in bivariate analysis (p value < 0.20). Then, a stepwise backward regression procedure was applied to assess variables that were significantly and independently associated with the pattern (p value < 0.05). All reported p values were two-sided, and the significance threshold was <0.05.

3. Results

3.1. Baseline Characteristics

Demographic data are summarized in Table 1. The mean age at ribavirin initiation was 51 ± 14 years. A majority of patients were male (n = 29/41, 71%) and 63% (n = 26/41) were kidney transplant recipients. The median HEV RNA concentration was 6.12 (range (3.53–7.45)) log10 copies/mL. The most frequent sub-genotype was HEV3f (61%). At ribavirin initiation, 13 patients had persistently positive tests for plasma HEV RNA for more than six months and 25 patients had viremia for 3–6 months. Three patients were treated at less than three months of viremia because they were deemed to be at high risk for developing chronic infection.
Ribavirin therapy was initiated at a median dose of 600 (200–1200) mg per day, which was equivalent to 9.7 (2.7–16.3) mg per kilogram of body weight per day. Initial ribavirin doses were adjusted on the basis of the estimated glomerular filtration rate (eGFR), as described previously [24]. Although eGFR did not change appreciably during therapy, the ribavirin dose was decreased in 11 patients (27%) because of anemia and was increased in four other patients (9.5%) during treatment. Overall, median ribavirin doses were 600 (200–1200) mg per day at month 1 and 600 (114–1200) mg per day at the EOT.

3.2. Response to Ribavirin Therapy

At EOT, 38/41 (93%) patients had undetectable HEV RNA. One-third (13/38) of patients with an EOT response had a post-treatment relapse and none of the three patients with detectable RNA at EOT achieved SVR. Overall, SVR was observed in 25/41 (61%) SOT patients treated with three months of ribavirin. The median log decrease in viral concentration from baseline to day 7, relative to the RNA concentration at day 0, was greater in patients who achieved SVR (14% (0%–21%)) compared to those without SVR (7% (0%–15%); p = 0.03). All 10 patients with a log concentration decrease at day 7 and >15% of the log concentration at day 0 achieved SVR. The positive predictive value (PPV) was 100% and the negative predictive (NPV) value was 50%. The sensitivity was 46% and the specificity was 100%. Nineteen patients had undetectable HEV RNA in stool at EOT, 89% of who achieved SVR.

3.3. Viral Kinetics

After a short median delay t0 = 3 (0–21) days, during which viral load remained at the pre-treatment level, HEV declined in four main viral kinetic patterns: (i) monophasic (n = 18), where the slope of decline of VL remained constant during treatment (median t1/2 = 2.2 days) (Table 2 and Table S1, Figure 1A,B); (ii) biphasic (n = 13), consisting of two distinct slopes of decline (Table 2 and Table S2, Figure 1C,D). Among the biphasic patients, six patients had a rapid–slow pattern (median first phase t1/2 = 1.7 days and second phase t1/2 = 5.0 days) whereas seven patients had a slow–fast decline (median first phase t1/2 = 2.8 days and second phase t1/2 = 0.9 days, Table 2 and Table S2); (iii) triphasic (n = 8), characterized by an intermediate “shoulder phase” where VL remained constant or declined very slowly (median slope = 0.01 log copies/mL/day, length = 14 days, and VL = 3.23 log copies/mL), between two rapid viral decay phases (median first phase t1/2 = 1.7 days; third (or final) phase t1/2 = 2.4 days) (Table 2 and Table S3, Figure 1E,F); (iv) flat-partial responders (n = 2), with a rapid decline (median first phase t1/2 = 1.5 days) followed by a viral plateau until EOT (median 0.01 log copies/mL/day, VL = 3.02 log copies/mL) (Table 2 and Table S4, Figure 1G,H).
The SVR rate was 67% (12/18) in patients with a monophasic decline, 62% (8/13) in those with a biphasic decline, 63% (5/8) in those with a triphasic decline and 0% (0/2) in patients with flat-partial response. None of the profiles was statistically associated with an SVR (p = 0.43) or with HEV RNA negative in stool at EOT (p = 0.31). Overall, the mean plasma HEV t1/2 (calculated from the first phase of viral decline) was estimated at 2.0 ± 0.96 days. The estimated HEV t1/2 was similar among the four viral kinetic patterns (p = 0.36) and was not associated with treatment outcome (p = 0.63) or the ribavirin concentration in blood (ρ = −0.00083, and p = 0.97 at day 7; ρ = −0.21, and p = 0.2 at month 1). There was no correlation between the dose of ribavirin (9.7 mg/kg/day (2.7–16.3)) and the duration of the delay preceding the viral decline at the initiation of treatment (t0 = 3 (0–21) days; ρ = 0.07 and p = 0.64). Interestingly, however, non-SVR patients had a longer delay (median t0 = 7 (0–21) days) in comparison to patients who achieved SVR (median t0 = 3 (0–21) days, p = 0.02). Lastly, there was no correlation between the time for HEV RNA to become undetectable in the blood and the treatment outcome (median delay = 52 (15–84) days for both SVR and non-SVR patients; p = 0.74).
Baseline characteristics, including the detection of the 1634R mutation, immunosuppressive drug treatment, decrease in ribavirin dose (44% (8/18) and 31% (4/13) of patients with monophasic and biphasic decline patterns, respectively), ribavirin dose increase (13% (1/8) of triphasic and the two subjects with flat-partial response), and ribavirin trough levels at day 7, day 15, month 1 and at steady state (month 2) (Figure 2) were not associated (all p > 0.09) with the four identified viral kinetic patterns. In addition, the ribavirin concentrations were not associated with the decline slopes or the time to TND (all p > 0.1). Lastly, there was no association among the viral kinetic patterns and the duration of the HEV RNA fecal shedding at months 1–3 (p = 0.36, 0.54 and 0.31 respectively) (Figure 3 and Table S5) (excluding the two patients with flat-partial response in whom HEV shedding in stool was missing in one patient, Figure 1G–H).

4. Discussion

Chronic HEV infection was recently recognized as a cause of progressive liver injury and neurologic complications in immunocompromised SOT patients [4] and SVR rates to 12 weeks of ribavirin therapy are suboptimal [12]. Kinetic modeling provides insight into patterns of response to antiviral therapy and viral measurements can be used to optimize treatment of chronic viral infections such as HCV infection [25,26,27]. The current study provides the first detailed viral kinetic assessment of chronic HEV infection during ribavirin therapy. After a median pharmacological delay of three [range = 0–21] days, all patients with chronic HEV treated with ribavirin had a first rapid viral decline in plasma. The estimated half-life of HEV was 2.0 ± 0.96 days, which was not associated with ribavirin concentration in blood. Four viral kinetic patterns were identified: (i) monophasic, (ii) biphasic, (iii) triphasic or (iv) a flat-partial response. Viral kinetic patterns (i), (ii) and (iii) were not associated with outcome of therapy, while the two patients with pattern (iv) failed to achieve SVR. A log plasma HEV concentration decrease at week 1 ≥15% from baseline was associated with SVR, with PPV and NPV of 100% and 50%, respectively, providing a refinement of our previous analysis [15]. Therefore, a day 7 viral load measurement could have predicted SVR with 12 weeks of treatment in 24% of patients in this cohort.
A previous viral kinetic study of HCV showed that a shorter time to HCV target not detected (TND) under pegylated interferon-alpha and ribavirin predicted SVR [28]. In contrast, there was no correlation between the time to HEV TND and SVR. Examination of the HEV RNA decline beyond week 1 showed that 95% of patients (n = 39) with viral kinetic patterns (i), (ii) and (iii) reached plasma HEV TND by EOT. Moreover, the two patients who had a flat-partial response did not achieve SVR, suggesting that detectable plasma HEV at EOT is an indication of ribavirin failure. The clinical and demographic characteristics evaluated here were not associated with the viral kinetic patterns. Decrease or increase of ribavirin dose does not seem to influence the kinetic patterns. However, our findings must be confirmed in a more homogenous patient group. While the G1634R mutation in the viral polymerase increases HEV replication in vitro [13], this mutation was not associated with a specific kinetic pattern.
Ribavirin is not a particularly potent antiviral agent and its mechanism of action remains a matter of controversy. The ability of ribavirin monotherapy to eradicate chronic HEV in some immunosuppressed SOT patients is notable. Ribavirin may act to block HEV production since the active metabolite ribavirin monophosphate is a competitive inhibitor of the cellular enzyme inosine monophosphate dehydrogenase (IMPDH), and in vitro experiments suggested that ribavirin activity depends on depletion of intracellular GTP pools, thus impeding RNA replication through inhibition of IMPDH [29]. The strikingly strong effect of ribavirin on HEV is in contrast to the limited/transient effect of ribavirin on HCV [30,31]. If ribavirin acts to inhibit HEV production, the estimated HEV t1/2 should reflect the viral t1/2 in blood and the magnitude of viral decline from baseline during the first phase may reflect drug efficacy as previously shown during antiviral treatment for hepatitis C, B and D [32,33,34,35]. Interestingly, in vitro studies found that the IMPDH inhibitor mycophenolic acid (MPA) inhibited HEV replication [36,37] and the combination of MPA and ribavirin had a greater impact on HEV replication than MPA or ribavirin alone [36]. However, synergy between ribavirin and MPA was not confirmed in vivo in our previous study [16]. An alternative or complementary explanation for the first phase decline in HEV levels is a rapid turnover of infected cells if ribavirin blocks de novo HEV infection. A strong mutagenic effect of ribavirin on the HEV genome was described in vivo [38], reminiscent of proposed ribavirin effect against HCV [39,40,41,42]. However, using the human liver chimeric UPA/SCID/beige mouse model, Allweiss et al. [43] showed that the administration of ribavirin after the establishment of HEV infection led to a strong reduction of HEV (genotype 1) concentration in both plasma and the liver of infected mice, without evidence of ribavirin-induced cellular damage. Further experiments with humanized mouse models are needed to clarify the mechanism of action of ribavirin in treating HEV genotype 3 [44].
Another obstacle to understanding the mechanism of action of ribavirin against HEV and the viral–host interplay in humans is the evidence for widespread extrahepatic replication of HEV, which is in contrast to chronic hepatitis B, C and D infections that are considered hepatotropic [45]. Extrahepatic HEV replication was described in pigs [46] and rabbits [47,48]. In humans, the detection of HEV particles in urine [49,50] and in stool raises the question of the contribution of the kidney and intestine compartments to the viral kinetic patterns observed here. The presence or absence of HEV RNA in stool at the completion of 12 weeks of ribavirin therapy was previously shown to be a robust predictor of response [15,17]. HEV plasma viral kinetic patterns were not associated with absence of viral shedding in stool at EOT, reflecting the challenge of modeling the response of pathogens with extra-hepatic reservoirs.

5. Conclusions

In conclusion, we identified, for the first time, four kinetic patterns during ribavirin treatment for chronic HEV in SOT patients. The viral half-life was estimated at 2.0 ± 0.96 days and a flat-partial response was associated with treatment failure with 12 weeks of ribavirin. The other three viral kinetic patterns did not predict SVR. A 15% HEV RNA log reduction at day 7 identified a subset of patients who achieved SVR with 12 weeks of treatment. Further modeling studies will be required to understand the relationship between plasma viral kinetics and extrahepatic reservoirs of HEV.

Supplementary Materials

The following are available online at https://www.mdpi.com/1999-4915/11/7/630/s1, Table S1: Details of Patients with Monophasic Viral Load Decline. Table S2: Details of Patients with Biphasic Viral Decline. Table S3: Details of Patients with Triphasic Viral Decline. Table S4: Details of Patients with Flat-Partial Response. Table S5: Viral Kinetic Patterns and HEV RNA in Plasma and Stool at the End of Ribavirin Treatment (EOT).

Author Contributions

Conceptualization, J.I. and H.D.; Data curation, S.L., S.D., J.I. and H.D.; Formal analysis, S.L., S.D., D.M., O.M. and C.D.; Investigation, N.K. and O.M.; Supervision, J.I. and H.D.; Writing—original draft, S.L., S.D. and C.D.; Writing—review and editing, N.K., F.A., S.J.C., J.I. and H.D.

Funding

This research was funded by INSERM UMR1043 and USA National Institutes of Health grant numbers R01-AI078881, R01AI144112 and R01-GM121600.

Acknowledgments

We thank Frederique Laroquette and Sebastien Gadat for helpful discussions at the very beginning of this project. We also thank Céline Verdier for helpful discussions.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Rein, D.B.; Stevens, G.A.; Theaker, J.; Wittenborn, J.S.; Wiersma, S.T. The global burden of hepatitis E virus genotypes 1 and 2 in 2005. Hepatology 2012, 55, 988–997. [Google Scholar] [CrossRef]
  2. European Association for the Study of the Liver. EASL Clinical Practice Guidelines on hepatitis E virus infection. J. Hepatol. 2018. [Google Scholar] [CrossRef]
  3. Meng, X.J.; Purcell, R.H.; Halbur, P.G.; Lehman, J.R.; Webb, D.M.; Tsareva, T.S.; Haynes, J.S.; Thacker, B.J.; Emerson, S.U. A novel virus in swine is closely related to the human hepatitis E virus. Proc. Natl. Acad. Sci. USA 1997, 94, 9860–9865. [Google Scholar] [CrossRef] [Green Version]
  4. Kamar, N.; Izopet, J.; Pavio, N.; Aggarwal, R.; Labrique, A.; Wedemeyer, H.; Dalton, H.R. Hepatitis E virus infection. Nat. Rev. Dis. Primers 2017, 3, 17086. [Google Scholar] [CrossRef]
  5. Kamar, N.; Mansuy, J.M.; Cointault, O.; Selves, J.; Abravanel, F.; Danjoux, M.; Otal, P.; Esposito, L.; Durand, D.; Izopet, J.; et al. Hepatitis E virus-related cirrhosis in kidney- and kidney-pancreas-transplant recipients. Am. J. Transplant. 2008, 8, 1744–1748. [Google Scholar] [CrossRef]
  6. Gerolami, R.; Moal, V.; Colson, P. Chronic hepatitis E with cirrhosis in a kidney-transplant recipient. N. Engl. J. Med. 2008, 358, 859–860. [Google Scholar] [CrossRef]
  7. Dalton, H.R.; van Eijk, J.J.J.; Cintas, P.; Madden, R.G.; Jones, C.; Webb, G.W.; Norton, B.; Pique, J.; Lutgens, S.; Devooght-Johnson, N.; et al. Hepatitis E virus infection and acute non-traumatic neurological injury: A prospective multicentre study. J. Hepatol. 2017, 67, 925–932. [Google Scholar] [CrossRef]
  8. Dalton, H.R.; Kamar, N.; van Eijk, J.J.; McLean, B.N.; Cintas, P.; Bendall, R.P.; Jacobs, B.C. Hepatitis E virus and neurological injury. Nat. Rev. Neurol. 2016, 12, 77–85. [Google Scholar] [CrossRef]
  9. Lhomme, S.; Abravanel, F.; Dubois, M.; Sandres-Saune, K.; Mansuy, J.M.; Rostaing, L.; Kamar, N.; Izopet, J. Characterization of the polyproline region of the hepatitis E virus in immunocompromised patients. J. Virol. 2014, 88, 12017–12025. [Google Scholar] [CrossRef]
  10. Shukla, P.; Nguyen, H.T.; Torian, U.; Engle, R.E.; Faulk, K.; Dalton, H.R.; Bendall, R.P.; Keane, F.E.; Purcell, R.H.; Emerson, S.U. Cross-species infections of cultured cells by hepatitis E virus and discovery of an infectious virus-host recombinant. Proc. Natl. Acad. Sci. USA 2011, 108, 2438–2443. [Google Scholar] [CrossRef]
  11. Kamar, N.; Abravanel, F.; Selves, J.; Garrouste, C.; Esposito, L.; Lavayssiere, L.; Cointault, O.; Ribes, D.; Cardeau, I.; Nogier, M.B.; et al. Influence of immunosuppressive therapy on the natural history of genotype 3 hepatitis-E virus infection after organ transplantation. Transplantation 2010, 89, 353–360. [Google Scholar] [CrossRef]
  12. Kamar, N.; Izopet, J.; Tripon, S.; Bismuth, M.; Hillaire, S.; Dumortier, J.; Radenne, S.; Coilly, A.; Garrigue, V.; D’Alteroche, L.; et al. Ribavirin for chronic hepatitis E virus infection in transplant recipients. N. Engl. J. Med. 2014, 370, 1111–1120. [Google Scholar] [CrossRef]
  13. Debing, Y.; Gisa, A.; Dallmeier, K.; Pischke, S.; Bremer, B.; Manns, M.; Wedemeyer, H.; Suneetha, P.V.; Neyts, J. A mutation in the hepatitis E virus RNA polymerase promotes its replication and associates with ribavirin treatment failure in organ transplant recipients. Gastroenterology 2014, 147, 1008–1011.e7. [Google Scholar] [CrossRef]
  14. Lhomme, S.; Kamar, N.; Nicot, F.; Ducos, J.; Bismuth, M.; Garrigue, V.; Petitjean-Lecherbonnier, J.; Ollivier, I.; Alessandri-Gradt, E.; Goria, O.; et al. Mutation in the Hepatitis E Virus Polymerase and Outcome of Ribavirin Therapy. Antimicrob. Agents Chemother. 2015, 60, 1608–1614. [Google Scholar] [CrossRef]
  15. Abravanel, F.; Lhomme, S.; Rostaing, L.; Kamar, N.; Izopet, J. Protracted fecal shedding of HEV during ribavirin therapy predicts treatment relapse. Clin. Infect. Dis. 2015, 60, 96–99. [Google Scholar] [CrossRef]
  16. Kamar, N.; Lhomme, S.; Abravanel, F.; Cointault, O.; Esposito, L.; Cardeau-Desangles, I.; Del Bello, A.; Dorr, G.; Lavayssiere, L.; Nogier, M.B.; et al. An Early Viral Response Predicts the Virological Response to Ribavirin in Hepatitis E Virus Organ Transplant Patients. Transplantation 2015, 99, 2124–2131. [Google Scholar] [CrossRef]
  17. Marion, O.; Lhomme, S.; del Bello, A.; Abravanel, F.; Esposito, L.; Hebral, A.L.; Lavayssiere, L.; Cointault, O.; Ribes, D.; Izopet, J.; et al. Monitoring hepatitis E virus fecal shedding to optimize ribavirin treatment duration in chronically infected transplant patients. J. Hepatol. 2019, 70, 206–209. [Google Scholar] [CrossRef]
  18. Wu, A. Tietz Clinical Guide to Laboratory Tests, 4th ed.; Elsevier: Amsterdam, The Netherlands; Saunders: Philadelphia, PA, USA, 2006. [Google Scholar]
  19. Abravanel, F.; Sandres-Saune, K.; Lhomme, S.; Dubois, M.; Mansuy, J.M.; Izopet, J. Genotype 3 diversity and quantification of hepatitis E virus RNA. J. Clin. Microbiol. 2012, 50, 897–902. [Google Scholar] [CrossRef]
  20. Legrand-Abravanel, F.; Mansuy, J.M.; Dubois, M.; Kamar, N.; Peron, J.M.; Rostaing, L.; Izopet, J. Hepatitis E virus genotype 3 diversity, France. Emerg. Infect. Dis. 2009, 15, 110–114. [Google Scholar] [CrossRef]
  21. Smith, D.B.; Simmonds, P.; Izopet, J.; Oliveira-Filho, E.F.; Ulrich, R.G.; Johne, R.; Koenig, M.; Jameel, S.; Harrison, T.J.; Meng, X.J.; et al. Proposed reference sequences for hepatitis E virus subtypes. J. Gen. Virol. 2016, 97, 537–542. [Google Scholar] [CrossRef]
  22. Gandia, P.; Trancart, S.; Nicot, F.; Barange, K.; Alric, L.; Izopet, J.; Seraissol, P.; Lavit, M.; Houin, G. Influence of pre-analytical conditions on plasma ribavirin concentrations. Arzneimittelforschung 2010, 60, 636–639. [Google Scholar] [CrossRef]
  23. Guedj, J.; Dahari, H.; Pohl, R.T.; Ferenci, P.; Perelson, A.S. Understanding silibinin’s modes of action against HCV using viral kinetic modeling. J. Hepatol. 2012, 56, 1019–1024. [Google Scholar] [CrossRef]
  24. Kamar, N.; Chatelut, E.; Manolis, E.; Lafont, T.; Izopet, J.; Rostaing, L. Ribavirin pharmacokinetics in renal and liver transplant patients: Evidence that it depends on renal function. Am. J. Kidney Dis. 2004, 43, 140–146. [Google Scholar] [CrossRef]
  25. Canini, L.; Imamura, M.; Kawakami, Y.; Uprichard, S.L.; Cotler, S.J.; Dahari, H.; Chayama, K. HCV kinetic and modeling analyses project shorter durations to cure under combined therapy with daclatasvir and asunaprevir in chronic HCV-infected patients. PLoS ONE 2017, 12, e0187409. [Google Scholar] [CrossRef]
  26. Dahari, H.; Canini, L.; Graw, F.; Uprichard, S.L.; Araujo, E.S.; Penaranda, G.; Coquet, E.; Chiche, L.; Riso, A.; Renou, C.; et al. HCV kinetic and modeling analyses indicate similar time to cure among sofosbuvir combination regimens with daclatasvir, simeprevir or ledipasvir. J. Hepatol. 2016, 64, 1232–1239. [Google Scholar] [CrossRef] [Green Version]
  27. Dahari, H.; Shteingart, S.; Gafanovich, I.; Cotler, S.J.; D’Amato, M.; Pohl, R.T.; Weiss, G.; Ashkenazi, Y.J.; Tichler, T.; Goldin, E.; et al. Sustained virological response with intravenous silibinin: Individualized IFN-free therapy via real-time modelling of HCV kinetics. Liver Int. 2015, 35, 289–294. [Google Scholar] [CrossRef]
  28. Ferenci, P.; Laferl, H.; Scherzer, T.M.; Gschwantler, M.; Maieron, A.; Brunner, H.; Stauber, R.; Bischof, M.; Bauer, B.; Datz, C.; et al. Peginterferon alfa-2a and ribavirin for 24 weeks in hepatitis C type 1 and 4 patients with rapid virological response. Gastroenterology 2008, 135, 451–458. [Google Scholar] [CrossRef]
  29. Debing, Y.; Emerson, S.U.; Wang, Y.; Pan, Q.; Balzarini, J.; Dallmeier, K.; Neyts, J. Ribavirin inhibits in vitro hepatitis E virus replication through depletion of cellular GTP pools and is moderately synergistic with alpha interferon. Antimicrob. Agents Chemother. 2014, 58, 267–273. [Google Scholar] [CrossRef]
  30. Rotman, Y.; Noureddin, M.; Feld, J.J.; Guedj, J.; Witthaus, M.; Han, H.; Park, Y.J.; Park, S.H.; Heller, T.; Ghany, M.G.; et al. Effect of ribavirin on viral kinetics and liver gene expression in chronic hepatitis C. Gut 2014, 63, 161–169. [Google Scholar] [CrossRef]
  31. Pawlotsky, J.M.; Dahari, H.; Neumann, A.U.; Hezode, C.; Germanidis, G.; Lonjon, I.; Castera, L.; Dhumeaux, D. Antiviral action of ribavirin in chronic hepatitis C. Gastroenterology 2004, 126, 703–714. [Google Scholar] [CrossRef]
  32. Neumann, A.U.; Lam, N.P.; Dahari, H.; Gretch, D.R.; Wiley, T.E.; Layden, T.J.; Perelson, A.S. Hepatitis C viral dynamics in vivo and the antiviral efficacy of interferon-alpha therapy. Science 1998, 282, 103–107. [Google Scholar] [CrossRef] [PubMed]
  33. Dahari, H.; Shudo, E.; Ribeiro, R.M.; Perelson, A.S. Modeling complex decay profiles of hepatitis B virus during antiviral therapy. Hepatology 2009, 49, 32–38. [Google Scholar] [CrossRef]
  34. Guedj, J.; Rotman, Y.; Cotler, S.J.; Koh, C.; Schmid, P.; Albrecht, J.; Haynes-Williams, V.; Liang, T.J.; Hoofnagle, J.H.; Heller, T.; et al. Understanding early serum hepatitis D virus and hepatitis B surface antigen kinetics during pegylated interferon-alpha therapy via mathematical modeling. Hepatology 2014, 60, 1902–1910. [Google Scholar] [CrossRef] [PubMed]
  35. Koh, C.; Canini, L.; Dahari, H.; Zhao, X.; Uprichard, S.L.; Haynes-Williams, V.; Winters, M.A.; Subramanya, G.; Cooper, S.L.; Pinto, P.; et al. Oral prenylation inhibition with lonafarnib in chronic hepatitis D infection: A proof-of-concept randomised, double-blind, placebo-controlled phase 2A trial. Lancet Infect. Dis. 2015, 15, 1167–1174. [Google Scholar] [CrossRef]
  36. Wang, Y.; Zhou, X.; Debing, Y.; Chen, K.; Van Der Laan, L.J.; Neyts, J.; Janssen, H.L.; Metselaar, H.J.; Peppelenbosch, M.P.; Pan, Q. Calcineurin inhibitors stimulate and mycophenolic acid inhibits replication of hepatitis E virus. Gastroenterology 2014, 146, 1775–1783. [Google Scholar] [CrossRef] [PubMed]
  37. Zhou, X.; Wang, Y.; Metselaar, H.J.; Janssen, H.L.; Peppelenbosch, M.P.; Pan, Q. Rapamycin and everolimus facilitate hepatitis E virus replication: Revealing a basal defense mechanism of PI3K-PKB-mTOR pathway. J. Hepatol. 2014, 61, 746–754. [Google Scholar] [CrossRef] [Green Version]
  38. Todt, D.; Gisa, A.; Radonic, A.; Nitsche, A.; Behrendt, P.; Suneetha, P.V.; Pischke, S.; Bremer, B.; Brown, R.J.; Manns, M.P.; et al. In vivo evidence for ribavirin-induced mutagenesis of the hepatitis E virus genome. Gut 2016, 65, 1733–1743. [Google Scholar] [CrossRef] [Green Version]
  39. Dahari, H.; Ribeiro, R.M.; Perelson, A.S. Triphasic decline of hepatitis C virus RNA during antiviral therapy. Hepatology 2007, 46, 16–21. [Google Scholar] [CrossRef]
  40. Dixit, N.M.; Layden-Almer, J.E.; Layden, T.J.; Perelson, A.S. Modelling how ribavirin improves interferon response rates in hepatitis C virus infection. Nature 2004, 432, 922–924. [Google Scholar] [CrossRef]
  41. Hofmann, W.P.; Polta, A.; Herrmann, E.; Mihm, U.; Kronenberger, B.; Sonntag, T.; Lohmann, V.; Schonberger, B.; Zeuzem, S.; Sarrazin, C. Mutagenic effect of ribavirin on hepatitis C nonstructural 5B quasispecies in vitro and during antiviral therapy. Gastroenterology 2007, 132, 921–930. [Google Scholar] [CrossRef]
  42. Lutchman, G.; Danehower, S.; Song, B.C.; Liang, T.J.; Hoofnagle, J.H.; Thomson, M.; Ghany, M.G. Mutation rate of the hepatitis C virus NS5B in patients undergoing treatment with ribavirin monotherapy. Gastroenterology 2007, 132, 1757–1766. [Google Scholar] [CrossRef] [PubMed]
  43. Allweiss, L.; Gass, S.; Giersch, K.; Groth, A.; Kah, J.; Volz, T.; Rapp, G.; Schobel, A.; Lohse, A.W.; Polywka, S.; et al. Human liver chimeric mice as a new model of chronic hepatitis E virus infection and preclinical drug evaluation. J. Hepatol. 2016, 64, 1033–1040. [Google Scholar] [CrossRef] [PubMed]
  44. Sayed, I.M.; Verhoye, L.; Cocquerel, L.; Abravanel, F.; Foquet, L.; Montpellier, C.; Debing, Y.; Farhoudi, A.; Wychowski, C.; Dubuisson, J.; et al. Study of hepatitis E virus infection of genotype 1 and 3 in mice with humanised liver. Gut 2017, 66, 920–929. [Google Scholar] [CrossRef] [PubMed]
  45. Thomas, H.; Locarnini, S.; Zuckerman, A. Viral Hepatitis, 4th ed.; Wiley-Blackwell: Hoboken, NJ, USA, 2013. [Google Scholar] [CrossRef]
  46. Williams, T.P.; Kasorndorkbua, C.; Halbur, P.G.; Haqshenas, G.; Guenette, D.K.; Toth, T.E.; Meng, X.J. Evidence of extrahepatic sites of replication of the hepatitis E virus in a swine model. J. Clin. Microbiol. 2001, 39, 3040–3046. [Google Scholar] [CrossRef] [PubMed]
  47. Izopet, J.; Dubois, M.; Bertagnoli, S.; Lhomme, S.; Marchandeau, S.; Boucher, S.; Kamar, N.; Abravanel, F.; Guerin, J.L. Hepatitis E virus strains in rabbits and evidence of a closely related strain in humans, France. Emerg. Infect. Dis. 2012, 18, 1274–1281. [Google Scholar] [CrossRef] [PubMed]
  48. Liu, P.; Bu, Q.N.; Wang, L.; Han, J.; Du, R.J.; Lei, Y.X.; Ouyang, Y.Q.; Li, J.; Zhu, Y.H.; Lu, F.M.; et al. Transmission of hepatitis E virus from rabbits to cynomolgus macaques. Emerg. Infect. Dis. 2013, 19, 559–565. [Google Scholar] [CrossRef] [PubMed]
  49. Geng, Y.; Zhao, C.; Huang, W.; Harrison, T.J.; Zhang, H.; Geng, K.; Wang, Y. Detection and assessment of infectivity of hepatitis E virus in urine. J. Hepatol. 2016, 64, 37–43. [Google Scholar] [CrossRef] [PubMed]
  50. Marion, O.; Capelli, N.; Lhomme, S.; Dubois, M.; Pucelle, M.; Abravanel, F.; Kamar, N.; Izopet, J. Hepatitis E virus genotype 3 and capsid protein in the blood and urine of immunocompromised patients. J. Infect. 2019. [Google Scholar] [CrossRef] [PubMed]
Viruses 11 00630 g001 550
Figure 1. Four identified plasma HEV RNA kinetic patterns during ribavirin monotherapy. Eight representative subjects are plotted. Blue rectangles represent time of ribavirin therapy. Four viral kinetic patterns were identified: (A,B) monophasic decline, (C,D) biphasic decline, (E,F) triphasic decline and (G,H) flat-partial response. Circles = quantifiable HEV RNA; squares = undetectable HEV RNA; stars = detectable but non quantifiable HEV RNA; +/− = positive/negative HEV RNA in stool. Solid curves were used to illustrate each identified kinetic phase. SVR = sustained virological response. Patients (Pt) 12 and 34 were retreated with ribavirin for 24 weeks and achieved SVR (not shown).
Figure 1. Four identified plasma HEV RNA kinetic patterns during ribavirin monotherapy. Eight representative subjects are plotted. Blue rectangles represent time of ribavirin therapy. Four viral kinetic patterns were identified: (A,B) monophasic decline, (C,D) biphasic decline, (E,F) triphasic decline and (G,H) flat-partial response. Circles = quantifiable HEV RNA; squares = undetectable HEV RNA; stars = detectable but non quantifiable HEV RNA; +/− = positive/negative HEV RNA in stool. Solid curves were used to illustrate each identified kinetic phase. SVR = sustained virological response. Patients (Pt) 12 and 34 were retreated with ribavirin for 24 weeks and achieved SVR (not shown).
Viruses 11 00630 g001
Viruses 11 00630 g002 550
Figure 2. Comparison of ribavirin concentrations and plasma HEV kinetic patterns at days 7 and 15 and months 1 and 2. monoP = monophasic pattern; biP = biphasic pattern; triP = triphasic pattern; grey symbol = 1634R mutation; M1 = month 1; M2 = month 2. The line represents the median.
Figure 2. Comparison of ribavirin concentrations and plasma HEV kinetic patterns at days 7 and 15 and months 1 and 2. monoP = monophasic pattern; biP = biphasic pattern; triP = triphasic pattern; grey symbol = 1634R mutation; M1 = month 1; M2 = month 2. The line represents the median.
Viruses 11 00630 g002
Viruses 11 00630 g003 550
Figure 3. Percentage of patients excreting HEV RNA in stools after 1, 2 or 3 months (M1, M2 and M3, respectively) of ribavirin initiation according to the defined viral kinetic patterns. Grey = monophasic decline; white = biphasic decline; black = triphasic decline. Flat-partial responders (n = 2) were excluded (see Figure 1G,H).
Figure 3. Percentage of patients excreting HEV RNA in stools after 1, 2 or 3 months (M1, M2 and M3, respectively) of ribavirin initiation according to the defined viral kinetic patterns. Grey = monophasic decline; white = biphasic decline; black = triphasic decline. Flat-partial responders (n = 2) were excluded (see Figure 1G,H).
Viruses 11 00630 g003
Table
Table 1. Demographic and clinical characteristics of the 41 patients.
Table 1. Demographic and clinical characteristics of the 41 patients.
VariableValue
Age, years (mean, SEM)51 ± 14
Sex, Male (%)29 (70.7)
HEV RNA concentration (log copies/mL)6.12 [3.53–7.45]
HEV genotype, n (%)
3f25 (60.9)
3c12 (29.3)
3e2 (4.9)
31 (2.4)
Not determined1 (2.4)
Type of organ transplant, n (%)
Kidney26 (63.4)
Liver9 (22.0)
Heart3 (7.3)
Kidney/pancreas1 (2.4)
Lung1 (2.4)
Liver/kidney1 (2.4)
Dose of ribavirin (mg/kg/day)9.7 [2.7–16.3]
Immunosuppressive therapy at the initiation of ribavirin, n (%)
Calcineurin inhibitors32 (78.0)
Tacrolimus31 (75.6)
Cyclosporin1 (2.4)
Antimetabolite34 (82.9)
Steroids35 (85.4)
mTOR inhibitors11 (26.2)
ALT level (IU/L)119 [24–1506]
AST level (IU/L)71 [30–1263]
Serum creatinine at the initiation of ribavirin (µmol/L)133 [40–360]
Lymphocyte count at the initiation of ribavirin (cells/mm3)1200 [178–6000]
Hemoglobin level at the initiation of ribavirin (g/dL)12.6 [9.3–15.6]
Platelet count at the initiation of ribavirin (cells/mm3)166 [12–1023]
Positive test for anti-HEV IgG antibodies at the initiation of ribavirin, n/total (%)31/41 (75.6)
Positive test for anti-HEV IgM antibodies at the initiation of ribavirin, n/total (%)37/41 (90.2)
Positive test for HEV RNA at the initiation of ribavirin, n (%)41 (100)
Interval between transplantation and initiation of ribavirin (months)43 [3–268]
Interval between immunosuppression decrease and initiation of ribavirin (months)4 [0–26]
Interval between diagnosis of HEV infection and initiation of ribavirin (months)4 [0–47]
Values are median [range] unless indicated otherwise. HEV = hepatitis E virus; ALT = alanine aminotransferase; AST = aspartate aminotransferase.
Table
Table 2. Kinetic parameters of the monophasic, biphasic, triphasic or flat-partial response.
Table 2. Kinetic parameters of the monophasic, biphasic, triphasic or flat-partial response.
PatientsBaseline HEV/RNADelayFirst Phase SlopeFirst Phase LengthFirst PhaseSecond Phase SlopeSecond Phase Plateau SlopeMean VL at PlateauShoulder Phase SlopeLength of PlateauMean VL at PlateauFinal Phase SlopeFinal PhaseTime to First DNQTime
to First		Time to First TND in Stool (Days)
[log10 copies/mL][days][log10 copies/mL/day][days]t1/2 [days][log10 copies/mL/day][log10 copies/mL/day][log10 copies/mL][log10 copies/mL/day][days][log10 copies/mL][log10 copies/mL/day]t1/2 [days][days]TND [days]
Monophasic
(n = 18)		5.6030.14 2.21 155660
IQR(1.51)(7)(0.13) (1.35) (35)(38)
Biphasic
(n = 13)		6.450.000.1515.002.050.14 2.10565645
IQR(0.95)(3.00)(0.1)(4.50)(1.34)(0.3) (4.12) (56)(59)
Triphasic
(n = 8)		5.3900.1871.71 0.01143.230.132.43285660
IQR(1.19)(6)(0.21)(12)(1.30) (0.03)(6)(1.34)(0.24)(4.06) (49)(52)
Flat-partial (n = 2)6.673.500.20211.50 0.013.02
Data are median (interquartile range (IQR)). DNQ = detected but not quantifiable; TND = target not detected; VL = viral load.

Share and Cite

MDPI and ACS Style

Lhomme, S.; DebRoy, S.; Kamar, N.; Abravanel, F.; Metsu, D.; Marion, O.; Dimeglio, C.; Cotler, S.J.; Izopet, J.; Dahari, H. Plasma Hepatitis E Virus Kinetics in Solid Organ Transplant Patients Receiving Ribavirin. Viruses 2019, 11, 630. https://doi.org/10.3390/v11070630

AMA Style

Lhomme S, DebRoy S, Kamar N, Abravanel F, Metsu D, Marion O, Dimeglio C, Cotler SJ, Izopet J, Dahari H. Plasma Hepatitis E Virus Kinetics in Solid Organ Transplant Patients Receiving Ribavirin. Viruses. 2019; 11(7):630. https://doi.org/10.3390/v11070630

Chicago/Turabian Style

Lhomme, Sebastien, Swati DebRoy, Nassim Kamar, Florence Abravanel, David Metsu, Olivier Marion, Chloé Dimeglio, Scott J. Cotler, Jacques Izopet, and Harel Dahari. 2019. "Plasma Hepatitis E Virus Kinetics in Solid Organ Transplant Patients Receiving Ribavirin" Viruses 11, no. 7: 630. https://doi.org/10.3390/v11070630

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop