Next Article in Journal
PET-Based Imaging with 18F-FDG and 18F-NaF to Assess Inflammation and Microcalcification in Atherosclerosis and Other Vascular and Thrombotic Disorders
Next Article in Special Issue
Prevalence of Occult Hepatitis C Virus Infection in Egyptian Patients with Lymphoma: A New Vision
Previous Article in Journal
Assessing Liver Fibrosis Using the FIB4 Index in the Community Setting
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Depressive and Anxious Symptoms in Hepatitis C Virus Infected Patients Receiving DAA-Based Therapy

by
Claudia Monica Danilescu
1,
Daniela Larisa Sandulescu
2,
Mihail Cristian Pirlog
3,*,
Costin Teodor Streba
4 and
Ion Rogoveanu
2
1
Doctoral School, University of Medicine and Pharmacy Craiova, 200349 Craiova, Romania
2
Department of Gastroenterology, Faculty of Medicine, University of Medicine and Pharmacy of Craiova, 200349 Craiova, Romania
3
Department of Medical Sociology, Faculty of Medicine, University of Medicine and Pharmacy of Craiova, 200349 Craiova, Romania
4
Department of Scientific Research Methodology, Faculty of Medicine, University of Medicine and Pharmacy of Craiova, 200349 Craiova, Romania
*
Author to whom correspondence should be addressed.
Diagnostics 2021, 11(12), 2237; https://doi.org/10.3390/diagnostics11122237
Submission received: 21 October 2021 / Revised: 26 November 2021 / Accepted: 27 November 2021 / Published: 29 November 2021
(This article belongs to the Special Issue Diagnosis and Management of Hepatitis C)

Abstract

:
Hepatitis C virus (HCV) represents the most important etiologic factor for advanced fibrosis/cirrhosis and hepatocellular carcinoma associated with a psychological dimension. Our study aims to assess, on a sample comprising of 90 HCV-infected subjects (96.67% F3–F4 METAVIR), the relationship between Direct-Acting Antiviral (DAA) therapies and the psychological effects of the liver disease, focused on the anxious and depressive symptoms. The comprehensive evaluation was done before starting the DAA treatment (BSL), after 12 weeks (End of Treatment—EOT), respectively after another 12 weeks (Sustained Viral Response—SVR). Presumable depressive and/or anxious symptoms were evaluated by Hospital Anxiety and Depression Scale (HADS). The reported depressive symptoms decreased from 21.11% (BSL) to 1.11% (SVR) (p < 0.00001), while the anxious ones dropped from 43.34% (BSL) to 4.44% (SVR) (p < 0.00001), without a clear evolutionary pattern. We identified no statistically significant interaction between comorbidities (anemia, CKD, obesity) over HADS scores evolution (p > 0.05), while the DAAs side-effects (fatigue, headache, pruritus) significantly influenced the anxious and depressive symptoms (p < 0.05). During and after the DAA-based therapy, patients with HCV infection presented a significantly reduced rate of the associated depressive and anxious relevant symptoms.

1. Introduction

The HCV infection is one of the most frequent causes of liver cirrhosis in the world with consequent significant social and health burdens [1]. Until 2011, pegylated interferon (peg-IFN) and ribavirin (RBV) therapy were used in the treatment of hepatitis C all over the world. The chance of success with this treatment was 30–40%. Success rates have reached 90–95% with the combination of Ombitasvir/Paritaprevir/Ritonavir/Dasabuvir, which is used worldwide since 2014 [2,3,4]. It is known that patients with chronic medical illness, such as liver cirrhosis, may be afflicted by symptoms of depression [5] and anxiety [6], especially in the end stage of their liver disease, which is characterized by frequent medical complications, hospitalization, functional limitation and change of body image. In patients with HCV infection, alterations in health-related quality of life (HRQoL) and neuropsychological disturbances were described also in the absence of liver cirrhosis [7,8]. In fact, even in the absence of debilitating symptoms, HCV may adversely affect the HRQoL by negatively impacting the physical and mental well-being of the patients [9]. Many authors have postulated a direct action of the HCV at the central nervous system level and viral replicates have been detected in the cerebral tissue, but it is difficult to determine whether the neuropsychiatric symptoms are due to direct neurotoxicity of the virus per se or to emotional stress related to the functional deficit, social stigma and apprehension for long-term prognosis [10,11]. In the past, patients with a diagnosed mental health disease (MHD), such as major depression, bipolar disorder, schizophrenia, generalized anxiety, and post-traumatic stress disorder or requiring anti-depressants, antipsychotics, mood stabilizers, or psychotropic drugs prescribed by a psychiatrist, were marginalized with respect to HCV therapy and MHD was one of the most frequently cited reason for exclusion from interferon-based therapy [12]. During the last years, HCV therapy has evolved from interferon-based to Direct Acting Antivirals (DAA), with excellent tolerability and efficacy [13]. Several studies investigated the modifications of HRQoL after HCV eradication [14,15,16].
Our study aims to assess the influence of liver disease, its treatment with DAAs and biological status, toward the psychological status of the subjects, focused on anxiety and depressive disorders.

2. Materials and Methods

A prospective and single-centered study was conducted between August 2017 and December 2018 in the Gastroenterology Clinic of the Emergency Hospital Craiova, Dolj County, Romania.
The study sample consisted of 90 consecutive patients diagnosed with HCV infection: compensated hepatic cirrhosis (Child Pugh A or B) or hepatitis. During the study period, all the subjects were under treatment with DAAs: Ombitasvirum/Paritaprevirum/Ritonavirum/Dasabuvirum combination for 12 weeks, according to the Romanian National Protocol for HCV infected patients (2017) [17] and to the guidelines of the Romanian Society of Gastroenterology and Hepatology (RSGH) [18,19] respecting the recommendations of the European Association for the Study of the Liver [4]. These patients were recruited from those who received DAAs treatment in the Romanian national program of interferon-free therapy for HCV infection.
We considered including in the study patients aged 18–80 years, being treatment naïve or previously treated with interferon, without neurologic and psychiatric comorbidities, and without being under any psychiatric medication, for the last 12 months. All these data that referred to the personal medical history of each patient were obtained during the first evaluation visit that they needed to pass through in order to become eligible for the Romanian National Program for HCV interferon-free therapy. Moreover, at the baseline moment of our study, the medical history of the patients was checked again by the gastroenterologist, who rechecked the personal records of the patient and also questioned him/her about psychiatric status during the structured clinical interview, in order to fulfill our study’s inclusion criteria.
The assessment of the biological and psychological status was done at the following three moments of the study (Figure 1):
  • Baseline (before the initiation of the DAA treatment—BSL);
  • End of the DAA treatment (end of treatment—12 weeks after baseline—EOT);
  • Follow-up (Sustain Viral Response—12 weeks after the end of the treatment—SVR).
Figure 1. Patients flow diagram for the whole process of DAAs intervention. The study arm consisted of 90 subjects from BSL to SVR.
Figure 1. Patients flow diagram for the whole process of DAAs intervention. The study arm consisted of 90 subjects from BSL to SVR.
Diagnostics 11 02237 g001
The subjects were evaluated upon performing a clinical examination and by taking a detailed medical history, including interferon-based treatment history and comorbidities. We also recorded the participants’ demographic (gender, age, residence), clinical (height, weight, Body-Mass-Index—BMI) and biological data (results of Fibrotest, Hepatitis C virus ribonucleic acid viral load–HCV-RNA, Child scores and blood samples).
Fibrosis degrees were classified according to international guidelines by the FibroTest® and/or FibroScan® methods (F0, F1, F2, F3 or F4). HCV-RNA was obtained from blood samples, and the biomedical parameter collected were hemoglobin (mg/dL), alanine aminotransferase (ALT) (IU/L), aspartate aminotransferase (AST) (IU/L), total bilirubin (mg/dL), direct bilirubin (mg/dL), gamma glutamyl transpeptidase (GGT) (IU/L), albumin (g/dL), alpha-fetoprotein (IU/mL), creatinine (mg/dL), and international normalized ratio (INR).
In order to identify and measure the severity of the anxious and depressive symptoms, we used the Hospital Anxiety and Depression Scale (HADS), a self-reported screening tool that includes 14 multiple-choice questions. There are seven depression items measuring cognitive and emotional aspects of depression, predominantly anhedonia, intermingled with seven anxiety items that focus on cognitive and emotional aspects of anxiety. There are anxiety subscale (HADS-A) and depression subscale (HADS-D) both with a four-point Likert scale, ranging from 0–3—score range 0–21 for the HADS-A, respectively HADS-D, while higher scores indicate greater severity. Zigmond and Snaith [20,21] recommend the following cutoff scores for the subscales: 0–7 = non-case, 8–10 = possible case (borderline), and 11–21 = probable case, in our study being used these cutoff scores, which proved for anxiety a specificity of 0.78 and a sensitivity of 0.9, and for depression a specificity of 0.79 and a sensitivity of 0.83 [22]. The HADS questionnaire has been considered useful for the initial diagnosis of depression and anxiety by the National Institute for Health and Care Excellence (NICE) [23] and in our study, we have used the previously validated version for the Romanian population [24].
The study’s questionnaires were explained and administered by the gastroenterologist, during the scheduled consultations for the national program that matched the study’s moments (BSL, EOT, SVR), in a room dedicated to the study’s activities. The filled questionnaires were collected by the research assistant right after the patient completed them and recorded in the secured digital database. The patients identified by HADS results as probable cases for anxiety or depression were sent for counseling and further assessment/monitoring to the psychologist of the Gastroenterology Clinic of the Emergency Hospital Craiova. Based on this supplementary evaluation, those possible individuals considered at risk would be referred to psychiatry.
There were no drop-out patients recorded during the whole research time interval. The facts that contributed to this rate were the following: (1) all subjects were included in the Romanian National Program for HCV interferon-free therapy, which required finishing the treatment unless some serious side-effects or other medical conditions intervened; (2) it was mandatory for all these patients to follow the Romanian National Program’s schedule which included laboratory tests, ultrasound evaluation, and clinical exams at five moments (week 0, week 4, week 8, week 12, week 24), three of these moments overlapping our study’s milestones; (3) all patients were voluntarily selected and, during the inform consent process, they understood the importance of our study and all of them have shown a proactive behavior; (4) before, during, and after the therapy period, a good professional collaboration between the gastroenterologist, the research assistant, and the patient was established, which was an important aspect that contributed to this zero drop-out rate.
The study was approved by the Ethics Committee of Craiova University of Medicine and Pharmacy of Craiova and was in line with the Helsinki Declaration. All patients were enrolled voluntarily upon submission of written informed consent and their data were kept secure.

Statistical Analysis

The study database included 18 factors as follows: demographic, laboratory investigations, comorbidities, previous HCV treatment, and, for the experienced ones, the quality of response on interferon-based therapy (discontinuation due to side-effects, non-responders, relapse), and the assessment of the psychological status.
Descriptive analysis for continuous variables was performed with mean ± standard deviation for normally distributed data and the qualitative variables as absolute and relative frequencies (%).
We used the Friedman test, a non-parametric test for repeated measures, to test for differences between groups when the dependent variable being measured was ordinal. The categorical data were compared with the Chi-square test (χ2). Comorbidities’ interaction on the evolution of HADS scores over time was tested using the two-way mixed ANOVA statistical test. We used the Shapiro–Wilk’s test for data normality analysis, Levene’s test of homogeneity of variances and Box’s M test for variances and covariances, as well as Mauchly’s test for sphericity. The following p values were accepted: p < 0.05 significant in a confidence interval (CI) of 95%, p < 0.01 (CI of 99%), p < 0.001 highly significant (CI of 99.9%). Using Kendall’s W as an effect size measurement for Friedman’s test, and choosing 0.2 as the effect size value, for a significance level α = 0.05 and a power 1 − β = 0.8, for three groups of repeated measurements, we have suggested a sample size of 42 persons (G*Power 3.1.9.7, Heinrich Heine University Düsseldorf, Düsseldorf, Germany). Even with the 15% correction of the sample size, we would need 49 subjects as the minimum sample size for the desired levels for effect size, significance level and power, for the described study design.
All statistical analyses were performed by IBM SPSS Statistics 25.0 (Chicago, IL, USA), while the primary data were recorded in Microsoft Excel files.

3. Results

The present study comprises data from 90 HCV infected patients that were under treatment with DAA for the 12 weeks after the recruitment (76.63% women; mean age 67.71 ± 7.83 years, age ranging from 33 to 79 years, 53.3% of them living in an urban environment) (Table 1).
At BSL, 53 patients (58.88%) were classified as affected by well compensated cirrhosis (48 Child-Pugh class A and five Child-Pugh class B) on clinical and radiological findings. The degree of fibrosis according to the METAVIR score was F2 in three patients (3.3%), F3 in 34 (37.77%), respectively F4 in 53 (58.88%) (Table 2).
The mean viral load was 1,178,736 ± 1,387,127 IU/mL (BSL), decreased to zero (EOT) and kept the same zero value (SVR) for all the study subjects. We identified 64 patients (71.11%) as therapy-naïve, while the remaining 26 (28.88%) had been treated before with combinations of pegylated interferon and ribavirin.
Fifteen subjects (16.67%) were identified with diabetes mellitus and 26 (28.89%) fulfilled the criteria for obesity class I and II (BMI > 30 kg/m2). Chronic kidney disease (CKD) was present on G2 stage in 58 (64.44%) of the subjects, respectively G3 stage on four patients (4.44%), while anemia (hemoglobin level less than 13.5 mg/dL in males and less than 12 mg/dL in female) was found in 22 subjects (26.67%) (Table 2). For all identified comorbidities found at BSL, which were under specific treatment, their current therapeutically status was kept. During the all-study period, those patients were monitored both by the gastroenterologist and the specialist physician, who was on duty for the comorbidity’s therapy. While the treatment of comorbidities was kept as previously established before the start of the HCV therapy, we observed that the improvement of the psychological status appeared after the DAAs treatment. Thus, we could consider that the changes in mental health were directly related to HCV therapy.
Before starting DAA therapy, the level of Hemoglobin was 13.26 ± 1.73 mg/dL, the levels of transaminase, as we expect, were higher (ALT 105.25 ± 86.99 IU/L, AST 86.11 ± 55.79 IU/L) as well as GGT (68.13 ± 37.79 IU/L) and Alpha-fetoprotein (11.05 ± 16.45 IU/L). Total bilirubin (1.02 ± 0.59 mg/dL), albumin (4.06 ± 0.5 g/dL), INR (1.05 ± 0.21) and creatinine (0.77 ± 0.14 mg/dL) mean levels were between normal limits at baseline (Table 3).
The evaluation of the psychological status in all three moments did not show a clear pattern of the severity of the anxious and depressive symptoms. Thus, at BSL, 39 probable cases of anxiety (43.33%), respectively 19 (21.11%) probable cases of depression, out of which seven individuals (7.78%) presented associated anxious and depressive significant symptoms. During the study period, it was revealed that HADS scores decreased for both psychiatric disorders, which meant that the patients’ mental health had improved in a significant way (Table 4).
Interestingly, at SVR, the scores of the HADS showed that depressive symptoms were clearly improved, while anxious ones remained in the probable case category in only four subjects (4.44%) (Figure 2, Table 4). The dynamic measures of HADS scores showed a highly significant difference both for anxiety scores (Friedman test χ2 = 53.19, p < 0.00001), and for depression (Friedman test χ2 = 26.23, p < 0.00001). This fact could be considered a relevant indicator of the improvement of the mental health status during the DAA treatment.
Analyzing the psychological impact of the HCV infection and its treatment according to the gender of the patients, we found that 47.82% of women had clinically relevant anxious symptoms before DAAs initiation (HADS-A 13.21 ± 1.96) to an EOT score of 7.18 ± 2.96, while at the SVR the same score decreases to 4.72 ± 3.06 (Friedman test χ2 = 44.65, p < 0.00001), similarly to the male patients (BSL 13 ± 1.78; EOT 6.83 ± 2.78; SVR 4 ± 1.89; Friedman test χ2 = 9.33, p = 0.0004). The same phenomenon was recorded for the depressive symptoms identified in our subjects based on HADS-D scores, especially for the female subgroup (BSL 12.11 ± 1.69; EOT 3.35 ± 3.18; SVR 3.17 ± 2.78) (Friedman test χ2 = 22.85, p = 0.00001) (Table 4).
Moreover, analyzing the evolution of the average HADS-A scores in normal patients, we identified an increasing trend in the level of severity of anxious symptoms, from BSL 4.9 ± 1.91 to the EOT 8.55 ± 2.74 (borderline cases of anxiety), and decreasing to normality at SVR 5.75 ± 3.55 (Friedman test χ2 = 9.175, p = 0.01018) (Table 4). This process was also more prevalent in women, where the mean score starts at BSL 4.85 ± 1.91, increase to EOT 8.85 ± 2.65, and ended at SVR 5 ± 3.5 (Friedman test χ2 = 10.71, p = 0.0047).
There existed a certain number of individuals who reported increased scores on HADS-A (23 subjects—25.5%), respectively HADS-D (19 subjects—21.1%) at SVR, compared to EOT. To analyze these groups of patients we extracted what we considered important components that could have an influence on the evolution of the HADS score from the clinical and psychological points of view (Table 5).
We analyzed anemia, CKD and obesity as comorbidities with potential influence on the HADS scores’ evolution, for both anxiety and depression. For each subgroup, there were very few outliers, as assessed by boxplot, but they were maintained in our analysis, as the study lot was considered large enough. HADS values were normally distributed, except for very few groups. There was homogeneity of both variances and covariances, and Mauchly’s test of sphericity suggested that the assumption of sphericity was indeed met for the two-way interaction between comorbidities’ presence and scores values. We identified no statistically significant interaction between the presence of anemia, CKD and obesity over HADS scores evolution (Table 6).
The periodical clinical assessment imposed by the Romanian National Program for HCV interferon-free therapy (Figure 1) has revealed the presence of DAAs side-effects during the treatment administration, but for our study’s purposes, we have evaluated them at EOT, respectively SVR. At EOT, these adverse effects were recorded in almost a third of the whole study sample, and, similar to the literature [2,12,15] and clinical guidelines [4,18,19] there was pruritus (12.22%), fatigue (8.88%), headache (6.66%) and insomnia (6.66%). Twelve weeks later, at SVR, the medication’s side effects were not present (Table 7).
Analyzing the impact of adverse phenomena on these subjects’ mental health, we found out statistically significant differences (Friedman test) regarding the correlation of fatigue, headache and pruritus with anxious and depressive symptoms, as expressed by the HADS scores. This finding was not applicable for insomnia (Table 7).

4. Discussion

The clinical picture of the patients with HCV infection includes numerous symptoms, such as joint pain, itching, loss of appetite, weakened libido, protein energy malnutrition [25,26,27] jaundice, increased bleeding, abdominal distension, ascites, peripheral edema, dyspnea, weight loss, muscle cramps, and the inability to work that are leading to mental health disruption [28,29]. Moreover, it was well known that the peg-IFN and RBV treatment represents a cause for major depression in around 30% of patients [30] and many other side-effects, such as medical manifestations (fatigue and weakness) [2,4,12], or neuropsychiatric symptoms (cognitive deficit, sleep disorders, anger/hostility, anxiety) [31,32] and, in these conditions, adjunctive therapy (e.g., pharmacological, psychotherapy or psychological counseling) must be considered in order to control those side effects.
Among these outcomes could be some other issues related to the association between liver infection and psychopathology, such as mild cognitive deficits, stigma and lower acceptance of illness, history of illicit drug use, lower work capacity, or decreased social support [33,34]. This plethora of side effects was proven to be one of the most important reasons for the treatment discontinuation [35].
Since 2011, DAAs were introduced as a therapy for HCV. They were proven to have optimal safety profiles, higher efficacy, shorter duration of treatment, increased barriers to resistance [36,37,38] and, most importantly in our context, do not favor the onset of psychiatric disorders, while being well-tolerated [39,40]. Additionally, previous studies have shown that the DAAs lead to a significant improvement in the results of the neuropsychological tests after HCV eradication [41,42,43].
As mentioned above, for our study sample a clear evolutionary pattern related to the patient-reported anxious and depressive symptoms could not be underlined. The process accomplished through the mental health status evaluation in all three moments have shown an important incidence of both psychiatric symptoms at the starting point of the study, with a non-linear evolution during the therapy period (Figure 2), a phenomenon that was not revealed by previous studies [41,42,44].
A particular situation within our sample was the one linked to those seven subjects identified with both categories of psychological symptoms, in which case we have noticed that the positive outcomes of the infection’s therapy were accompanied by a complete remission of the mood disturbances. The positive influence of the DAAs on the mental status of these subjects was even better than the one presented in other studies [45].
The results of our study showed a direct association between the biological status of the HCV infection (METAVIR scores and laboratory data) and the impairment of the mental health, the worsening of one aspect conducting to a similar effect on the other (Table 5). Thus, based on these observations, the importance of the DAAs intervention could be affirmed as early as possible once the HCV infection was identified and diagnosed, in order to avoid further complications.
Since data from literature [13,15] have shown that comorbid conditions associated to the HCV infection have an impact on the mental health of the affected individuals, another objective of the research was to analyze the characteristics of the study sample from this point of view too. The medical conditions diagnosed in our patients also had an influence on their psychological status, in this context being recommended to assess the overall patients’ status in order to detect the possible comorbidities and to keep them under control to reduce their influence on the HCV infection’s evolution and mental health.
We consider that one of the limitations of this study was that the subjects’ mental status was assessed only by guided self-administrated questionnaires without a structured clinical interview done by a qualified psychiatrist/psychologist. Conversely, a strength of the research is represented by the use of a widely-known and friendly screening instrument for anxiety and depression, and prospective assessments every 12 weeks in terms of clinical, biochemical, virological and psychological monitoring. Moreover, our study was conducted on a well-characterized sample, which reflects real world patients, thus increasing the applicability of the findings to a similar population.

5. Conclusions

DAAs therapy proved to be efficient for remitting HCV infection and improving the mental health status: HCV-RNA decreased from a mean value of 1,178,736 IU/mL to zero, while identified depressive and anxious symptoms were significantly enhanced, even if a clear evolutionary pattern could not be highlighted. The psychological disturbances were correlated with the medication side effects, but there could not be found a significant influence by the HCV associated comorbidities. Thus, our data sustain the positive effects of the new HCV therapy for achieving both the remission of the liver disease and the reduction of depressive and anxious symptom severity.

Author Contributions

Conceptualization, D.L.S. and M.C.P.; methodology, D.L.S. and M.C.P.; software, C.M.D.; formal analysis, C.M.D. and M.C.P.; investigation, D.L.S. and C.M.D.; resources, D.L.S.; data curation, C.M.D.; writing—original draft preparation, C.M.D. and M.C.P.; writing—review and editing, I.R. and C.T.S. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was approved by the Ethics Committee of Craiova University of Medicine and Pharmacy of Craiova and was in line with the Helsinki Declaration (Ethical Approval of Research Project No. 66/23 February 2017).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data used in this study could be available by request and after the approval of the local IRB.

Conflicts of Interest

All authors excepting D.L.S. declared that have no conflict of interest related to this paper. D.L.S. has received support for attending meetings and/or travel from AbbVie, Gilead Sciences, Inc., and Merck KGaA. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript, or in the decision to publish the results.

References

  1. Petruzziello, A.; Marigliano, S.; Loquercio, G.; Cozzolino, A.; Cacciapuoti, C. Global epidemiology of hepatitis C virus infection: An up-date of the distribution and circulation of hepatitis C virus genotypes. World J. Gastroenterol. 2016, 22, 7824–7840. [Google Scholar] [CrossRef] [PubMed]
  2. Afdhal, N.; Reddy, K.R.; Nelson, D.R.; Lawitz, E.; Gordon, S.C.; Schiff, E.; Nahass, R.; Ghalib, R.; Gitlin, N.; Herring, R.; et al. Ledipasvir and Sofosbuvir for Previously Treated HCV Genotype 1 Infection. N. Engl. J. Med. 2014, 370, 1483–1493. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  3. Afdhal, N.; Zeuzem, S.; Kwo, P.; Chojkier, M.; Gitlin, N.; Puoti, M.; Romero-Gomez, M.; Zarski, J.-P.; Agarwal, K.; Buggisch, P.; et al. Ledipasvir and Sofosbuvir for Untreated HCV Genotype 1 Infection. N. Engl. J. Med. 2014, 370, 1889–1898. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Pawlotsky, J.-M.; Negro, F.; Aghemo, A.; Berenguer, M.; Dalgard, O.; Dusheiko, G.; Marra, F.; Puoti, M.; Wedemeyer, H. European Association for the Study of the Liver, EASL Recommendations on Treatment of Hepatitis C 2018. J. Hepatol. 2018, 69, 461–511. [Google Scholar] [CrossRef] [Green Version]
  5. Singh, N.; Gayowski, T.; Wagener, M.M.; Marino, I.R. Depression in patients with cirrhosis. Impact on outcome. Dig. Dis. Sci. 1997, 42, 1421–1427. [Google Scholar] [CrossRef]
  6. De Bona, M.; Ponton, P.; Ermani, M.; Iemmolo, R.M.; Feltrin, A.; Boccagni, P.; Gerunda, G.; Naccarato, R.; Rupolo, G.; Burra, P. The impact of liver disease and medical complications on quality of life and psychological distress before and after liver transplantation. J. Hepatol. 2000, 33, 609–615. [Google Scholar] [CrossRef]
  7. Prell, T.; Dirks, M.; Arvanitis, D.; Braun, D.; Peschel, T.; Worthmann, H.; Schuppner, R.; Raab, P.; Grosskreutz, J.; Weissenborn, K. Cerebral patterns of neuropsychological disturbances in hepatitis C patients. J. Neurovirol. 2019, 25, 229–238. [Google Scholar] [CrossRef]
  8. García-Guerrero, M.A.; Sánchez Gómez, P.; Peña Lasa, J.; Portu Zapirain, J.; Elizagárate Zabala, E.; Gorria Bernal, V.; Ojeda Del Pozo, N. Effect of psychiatric symptoms and quality of life on cognitive performance in HCV patients. Rev. Psiquiatr. Salud Ment. 2018, 13, 22–30. [Google Scholar] [CrossRef]
  9. Foster, G.R. Quality of life considerations for patients with chronic hepatitis C. J. Viral Hepat. 2009, 16, 605–611. [Google Scholar] [CrossRef]
  10. Forton, D.M.; Thomas, H.C.; Taylor-Robinson, S.D. Central nervous system involvement in hepatitis C virus infection. Metab. Brain Dis. 2004, 19, 383–391. [Google Scholar] [CrossRef]
  11. Forton, D.M.; Hamilton, G.; Allsop, J.M.; Grover, V.P.; Wesnes, K.; O’Sullivan, C.; Thomas, H.C.; Taylor-Robinson, S.D. Cerebral immune activation in chronic hepatitis C infection: A magnetic resonance spectroscopy study. J. Hepatol. 2008, 49, 316–322. [Google Scholar] [CrossRef] [PubMed]
  12. Tang, L.S.Y.; Masur, J.; Sims, Z.; Nelson, A.; Osinusi, A.; Kohli, A.; Kattakuzhy, S.; Polis, M.; Kottilil, S. Safe and effective sofosbuvir-based therapy in patients with mental health disease on hepatitis C virus treatment. World J. Hepatol. 2016, 8, 1318–1326. [Google Scholar] [CrossRef] [PubMed]
  13. Ioannou, G.N.; Feld, J.J. What Are the Benefits of a Sustained Virologic Response to Direct-Acting Antiviral Therapy for Hepatitis C Virus Infection? Gastroenterology 2019, 156, 446–460.e2. [Google Scholar] [CrossRef] [PubMed]
  14. Esarte, S.G.; Juanbeltz, R.; Martínez-Baz, I.; Castilla, J.; Miguel, R.S.; Herrero, J.I.; Zozaya, J.M. Long-term changes on health-related quality of life in patients with chronic hepatitis C after viral clearance with direct-acting antiviral agents. Rev. Esp. Enferm. Dig. 2019, 111, 445–452. [Google Scholar] [CrossRef]
  15. Juanbeltz, R.; Castilla, J.; Martínez-Baz, I.; O’Leary, A.; Sarobe, M.; Miguel, R.S. Health-related quality of life in hepatitis C patients who achieve sustained virological response to direct-acting antivirals: A comparison with the general population. Qual. Life Res. 2019, 28, 1477–1484. [Google Scholar] [CrossRef] [PubMed]
  16. Juanbeltz, R.; Martínez-Baz, I.; Miguel, R.S.; Goñi-Esarte, S.; Cabasés, J.M.; Castilla, J. Impact of successful treatment with direct-acting antiviral agents on health-related quality of life in chronic hepatitis C patients. PLoS ONE 2018, 13, e0205277. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Ministerul Sănătăţii; Casa Naţională de Asigurări de Sănătate. Ordin Privind Modificarea şi Completarea Ordinului Min-Istrului Sănătăţii Publice şi al Preşedintelui Casei Naţionale de Asigurări de Sănătate nr. 1.301/500/2008 Pentru Aprobarea Protocoalelor Terapeutice Privind Prescrierea Medicamentelor Aferente Denumirilor Comune Internaţionale Prevăzute în Lista cuprinzând Denumirile Comune Internaţionale Corespunzătoare Medicamentelor de Care Beneficiază Asiguraţii, cu sau Fără Contribuţie Personală, pe Bază de Prescripţie Medicală, în Sistemul de Asigurări Sociale de Sănătate, Aprobată prin Hotărârea Guvernului nr. 720/2008. Available online: http://www.ms.ro/wp-content/uploads/2017/03/Ordin-25.04.2017.pdf (accessed on 15 April 2021).
  18. Gheorghe, L.; Sporea, I.; Iacob, S.; Şirli, R.; Trifan, A.; Dobru, D.; Diculescu, M.; Stanciu, C.; Pascu, O.; Acalovschi, M.; et al. Position Paper on Treatment of Hepatitis C in Romania, 2017. Part One. J. Gastrointest. Liver Dis. 2017, 26, 171–181. [Google Scholar] [CrossRef]
  19. Gheorghe, L.; Sporea, I.; Iacob, S.; Șirli, R.; Trifan, A.; Diculescu, M.; Stanciu, C.; Pascu, O.; Acalovschi, M.; Brisc, C.; et al. Position Paper on Treatment of Hepatitis C in Romania 2017. Part Two. J. Gastrointest. Liver Dis. 2017, 26, 309–317. [Google Scholar] [CrossRef] [Green Version]
  20. Snaith, R.P.; Zigmond, A.S. The Hospital Anxiety and Depression Scale Manual; Nfer-Nelson: Windsor, UK, 1994. [Google Scholar]
  21. Zigmond, A.S.; Snaith, R.P. The Hospital Anxiety and Depression Scale. Acta Psychiatr Scand. 1983, 67, 361–370. [Google Scholar] [CrossRef] [Green Version]
  22. Bjelland, I.; Dahl, A.A.; Haug, T.T.; Neckelmann, D. The validity of the Hospital Anxiety and Depression Scale. An updated literature reviews. J. Psychosom. Res. 2002, 52, 69–77. [Google Scholar] [CrossRef]
  23. National Institute for Health and Care Excellence. Common Mental Health Problems: Identification and Pathways to Care. Clinical Guideline Published 25 May 2011. Available online: https://www.nice.org.uk/guidance/cg123/resources/common-mental-health-problems-identification-and-pathways-to-care-pdf-35109448223173 (accessed on 18 November 2021).
  24. Ladea, M. Validation of the Hospital Anxiety and Depression Scale on a population of psychiatric patients in Romania. Rom. J. Psychiatry 2005, 7, 104–109. [Google Scholar]
  25. Kim, H.J.; Chu, H.; Lee, S. Factors influencing on health-related quality of life in South Korean with chronic liver disease. Health Qual. Life Outcomes 2018, 16, 142. [Google Scholar] [CrossRef]
  26. Fagerström, C.; Frisman, G.H. Living with Liver Cirrhosis: A vulnerable life. Gastroenterol. Nurs. 2017, 40, 38–46. [Google Scholar] [CrossRef]
  27. Nishikawa, H.; Osaki, Y. Liver Cirrhosis: Evaluation, Nutritional Status, and Prognosis. Mediat. Inflamm. 2015, 2015, 1–9. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Hansen, L.; Leo, M.C.; Chang, M.F.; Zaman, A.; Naugler, W.; Schwartz, J. Symptom Distress in Patients With End-Stage Liver Disease Toward the End of Life. Gastroenterol. Nurs. 2015, 38, 201–210. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Loria, A.; Escheik, C.; Gerber, L.; Younossi, Z.M. Quality of Life in Cirrhosis. Curr. Gastroenterol. Rep. 2012, 15, 301. [Google Scholar] [CrossRef] [PubMed]
  30. Udina, M.; Castellvi, P.; Moreno-España, J.; Navinés, R.; Valdés, M.; Forns, X.; Langohr, K.; Solà, R.; Vieta, E.; Martín-Santos, R. Interferon-Induced Depression in Chronic Hepatitis C. J. Clin. Psychiatry 2012, 73, 1128–1138. [Google Scholar] [CrossRef]
  31. Miller, E.R.; McNally, S.; Wallace, J.; Schlichthorst, M. The ongoing impacts of hepatitis c—A systematic narrative review of the literature. BMC Public Health 2012, 12, 672. [Google Scholar] [CrossRef] [Green Version]
  32. Manns, M.P.; Wedemeyer, H.; Cornberg, M. Treating viral hepatitis C: Efficacy, side effects, and complications. Gut 2006, 55, 1350–1359. [Google Scholar] [CrossRef]
  33. Vera-Llonch, M.; Martin, M.; Aggarwal, J.; Donepudi, M.; Bayliss, M.; Goss, T.; Younossi, Z. Health-related quality of life in genotype 1 treatment-naïve chronic hepatitis C patients receiving telaprevir combination treatment in the ADVANCE study. Aliment. Pharmacol. Ther. 2013, 38, 124–133. [Google Scholar] [CrossRef] [Green Version]
  34. Younossi, Z.; Kallman, J.; Kincaid, J. The effects of HCV infection and management on health-related quality of life. Hepatology 2007, 45, 806–816. [Google Scholar] [CrossRef] [PubMed]
  35. Martín-Santos, R.; Díez-Quevedo, C.; Castellví, P.; Navinés, R.; Miquel, M.; Masnou, H.; Soler, A.; Ardevol, M.; García, F.; Galeras, J.A.; et al. De novo depression and anxiety disorders and influence on adherence during peginterferon-alpha-2a and ribavirin treatment in patients with hepatitis C. Aliment. Pharmacol. Ther. 2007, 27, 257–265. [Google Scholar] [CrossRef]
  36. Leventer-Roberts, M.; Hammerman, A.; Brufman, I.; Hoshen, M.; Braun, M.; Ashur, Y.; Lieberman, N.; Balicer, R. Effectiveness of dasabuvir/ombitasvir/paritaprevir/ritonavir for hepatitis C virus in clinical practice: A population-based observational study. PLoS ONE 2017, 12, e0176858. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Juanbeltz, R.; Zozaya, J.M.; Reparaz, J.; Castilla, J.; Sarobe, M.T.; Uriz Otano, J.I. Effectiveness of second-generation direct-acting antivirals in chronic hepatitis C. An. Sist. Sanit. Navar. 2017, 40, 57–66. [Google Scholar] [CrossRef] [Green Version]
  38. Juanbeltz, R.; Esarte, S.G.; Úriz-Otano, J.I.; Echeverría, A.M.; Elizalde, I.; Zozaya, J.M.; Castilla, J.; Miguel, R.S. Safety of oral direct acting antiviral regimens for chronic hepatitis C in real life conditions. Postgrad. Med. 2017, 129, 476–483. [Google Scholar] [CrossRef]
  39. Lam, B.P.; Jeffers, T.; Younoszai, Z.; Fazel, Y.; Younossi, Z.M. The changing landscape of hepatitis C virus therapy: Focus on interferon-free treatment. Ther. Adv. Gastroenterol. 2015, 8, 298–312. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  40. Gaetano, J. Benefit–risk assessment of new and emerging treatments for hepatitis C: Focus on simeprevir and sofosbuvir. Drug Healthc. Patient Saf. 2014, 6, 37–45. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  41. Ferenci, P.; Bernstein, D.D.; Lalezari, J.; Cohen, D.; Luo, Y.Y.; Cooper, C.C.; Tam, E.; Marinho, R.T.R.; Tsai, N.N.; Nyberg, A.A.; et al. ABT-450/r–Ombitasvir and Dasabuvir with or without Ribavirin for HCV. N. Engl. J. Med. 2014, 370, 1983–1992. [Google Scholar] [CrossRef] [Green Version]
  42. Kesen, O.; Kani, H.T.; Yanartas, O.; Aykut, U.E.; Gok, B.; Gunduz, F.; Yilmaz, Y.; Ozdogan, O.C.; Alahdab, Y.O. Evaluation of depression, anxiety and quality of life in hepatitis C patients who treated with direct acting antiviral agents. Turk. J. Gastroenterol. 2019, 30, 801–806. [Google Scholar] [CrossRef]
  43. Nardelli, S.; Riggio, O.; Rosati, D.; Gioia, S.; Farcomeni, A.; Ridola, L. Hepatitis C virus eradication with directly acting antivirals improves health-related quality of life and psychological symptoms. World J. Gastroenterol. 2019, 25, 6928–6938. [Google Scholar] [CrossRef]
  44. Pagoto, S. Psychological Co-Morbidities of Physical Illness: A Behavioral Medicine Perspective; Springer: New York, NY, USA, 2011. [Google Scholar]
  45. Yek, C.; De La Flor, C.; Marshall, J.; Zoellner, C.; Thompson, G.; Quirk, L.; Mayorga, C.; Turner, B.J.; Singal, A.G.; Jain, M.K. Effectiveness of direct-acting antiviral therapy for hepatitis C in difficult-to-treat patients in a safety-net health system: A retrospective cohort study. BMC Med. 2017, 15, 1–8. [Google Scholar] [CrossRef] [PubMed]
Figure 2. Graphic description of the anxious and depressive symptoms evolution during the study period (gender distribution). HADS scores showed similar patterns of the identified mental health disorders according to the patient’s gender. The dynamic measures of HADS scores showed a significant positive evolution of the psychological status for the subjects included in the study. (A) Evolution of HADS-A scores at the three moments of assessment in female subjects; (B) Evolution of HADS-D scores at the three moments of assessment in female subjects; (C) Evolution of HADS-A scores at the three moments of assessment in male subjects; (D) Evolution of HADS-D scores at the three moments of assessment in male subjects.
Figure 2. Graphic description of the anxious and depressive symptoms evolution during the study period (gender distribution). HADS scores showed similar patterns of the identified mental health disorders according to the patient’s gender. The dynamic measures of HADS scores showed a significant positive evolution of the psychological status for the subjects included in the study. (A) Evolution of HADS-A scores at the three moments of assessment in female subjects; (B) Evolution of HADS-D scores at the three moments of assessment in female subjects; (C) Evolution of HADS-A scores at the three moments of assessment in male subjects; (D) Evolution of HADS-D scores at the three moments of assessment in male subjects.
Diagnostics 11 02237 g002
Table 1. Demographic data of the study sample.
Table 1. Demographic data of the study sample.
(Mean Value ± SD)
Mean age (year) 67.71 ± 7.83
HCV—RNA (UI/mL) 1,178,736 ± 1,387,127
n (%)
Gendermale21 (23.37)
female69 (76.63)
Environmenturban48 (53.3)
rural42 (46.5)
Table 2. Patients’ clinical status (BSL).
Table 2. Patients’ clinical status (BSL).
n (%)
Fibrosis acording to METAVIRF23 (3.33)
F334 (37.78)
F453 (58.89)
Cirrhosisnon-cirrhosis37 (41.11)
Child A48 (53.33)
Child B5 (5.56)
Previous HCV TreatmentTreatment naïve64 (71.11)
IFN + RBV26 (28.89)
Interferon base therapy responsediscontinuation (side effects)3 (3.33)
non-responder18 (20.00)
relapse5 (5.56)
Diabetes mellitusnon insulin-dependent3 (3.33)
insulin-dependent12 (13.33)
BMI (kg/m2)mildly underweight1 (1.11)
normal weight22 (24.44)
overweight41 (45.56)
obese class I21 (23.33)
obese class II5 (5.56)
Table 3. Patients’ biochemical status (BSL).
Table 3. Patients’ biochemical status (BSL).
(Mean Value ± SD)Range
Hemoglobin (mg/dL) 13.26 ± 1.738.99–16.00
ALT (IU/L) 105.25 ± 86.9920–354
AST (IU/L)86.11 ± 55.7922–321
Total Bilirubin (mg/dL)1.02 ± 0.590.2–2.8
GGT (IU/L)68.13 ± 37.7921–186
Albumin (g/dL)4.06 ± 0.53.1–5.1
INR1.05 ± 0.210.7–2
α-fetoprotein (IU/mL)11.05 ± 16.450.4–87
Creatinine (mg/dL)0.77 ± 0.140.5–1.3
Table 4. Patients’ psychological status during the study period (χ2 Friedman test). On the p-Value column, bold is used in order to underline the statistically significant values of p.
Table 4. Patients’ psychological status during the study period (χ2 Friedman test). On the p-Value column, bold is used in order to underline the statistically significant values of p.
n (%)HADS Avg Score BSLHADS Avg Score EOTHADS Avg Score SVRχ2p-Value
All patients90 (100)
HADS-A Probable case39 (43.33)13.17 ± 1.877.12 ± 2.854.61 ± 2.9053.19<0.00001
HADS-A Borderline31 (34.44)9.03 ± 0.766.70 ± 2.745.61 ± 2,8720.530.00003
HADS-A Non-case20 (22.22)4.9 ± 1.918.55 ± 2.745.75 ± 3.559.1750.01018
HADS-D Probable case19 (21.11)12.21 ± 1.753.36 ± 3.112.94 ± 2.7326.23<0.00001
HADS-D Borderline23 (25.56)8.91 ± 0.664.86 ± 2.762.82 ± 2.729.76<0.00001
HADS-D Non-case48 (53.33)3.93 ± 2.074.37 ± 2.183.18 ± 2.746.3850.04106
Female69 (76.67)
HADS-A Probable case33 (36.67)13.21 ± 1.967.18 ± 2.964.72 ± 3.0644.65<0.00001
HADS-A Borderline22 (24.44)9.18 ± 0.736.77 ± 2.895.45 ± 2.818.090.00012
HADS-A Non-case14 (15.56)4.85 ± 1.918.85 ± 2.655 ± 3.510.710.0047
HADS-D Probable case17 (18.89)12.11 ± 1.693.35 ± 3.183.17 ± 2.7822.850.00001
HADS-D Borderline18 (20.00)8.8 ± 0.675.44 ± 2.613.16 ± 2.9522.750.00001
HADS-D Non-case34 (37.78)3.75 ± 2.064.41 ± 2.253.41 ± 2.823.350.18703
Male21 (23.33)
HADS-A Probable case6 (6.67)13 ± 1.786.83 ± 2.784 ± 1.899.330.0004
HADS-A Borderline9 (10.00)8.66 ± 0.76.55 ± 2.56 ± 3.163.380.1837
HADS-A Non-case6 (6.67)5 ± 2.097.83 ± 3.067.5 ± 3.270.580.74702
HADS-D Probable case2 (2.22)133.51--
HADS-D Borderline5 (5.56)9 ± 0.72.8 ± 2.481.6 ± 0.897.60.02237
HADS-D Non-case14 (15.56)4.42 ± 2.184.28 ± 2.082.64 ± 2.565.820.0544
Table 5. Differences between patients’ groups who had rebound HADS scores at SVR compared to EOT.
Table 5. Differences between patients’ groups who had rebound HADS scores at SVR compared to EOT.
HADS-A EOT <
HADS-A SVR Group
HADS-A EOT >
HADS-A SVR Group
HADS-D EOT <
HADS-D SVR Group
HADS-D EOT >
HADS-D SVR Group
n23 (100.00%)67 (100.00%)19 (100.00%)71 (100.00%)
Rural7 (30.43%)41 (61.20%)8 (42.10%)40 (56.34%)
Urban16 (69.57%)26 (38.80%)11 (57.89%)31 (43.66%)
Female16 (69.57%)53 (79.10%)17 (89.47%)52 (73.24%)
Male7 (30.43%)14 (20.90%)2 (10.53%)19 (26.76%)
Age63.35 ± 7.9663.84 ± 7.9163.57 ± 8.5362.53 ± 7.76
BMI27.44 ± 4.4227.63 ± 4.1828.49 ± 4.7327.33 ± 4.07
Previous PegIFN therapy8 (34.78%)18 (26.87%)5 (26.32%)21 (29.58%)
Diabetes7 (30.43%)8 (11.94%)5 (26.32%)10 (14.08%)
CKD stage G3 and over1 (4.35%)3 (4.48%)1 (5.26%)3 (4.23%)
SOT HADS-A9.70 ± 3.219.99 ± 3.769.79 ± 1.419.94 ± 2.55
EOT HADS-A4.87 ± 2.268.13 ± 2.556.68 ± 3.427.46 ± 2.62
SVR HADS-A8.39 ± 2.544.12 ± 2.407.63 ± 2.854.56 ± 1.68
SOT HADS-D6.48 ± 4.457.12 ± 3.647.00 ± 4.046.94 ± 3.53
EOT HADS-D3.43 ± 2.254.58 ± 2.642.26 ± 4.814.83 ± 3.59
SVR HADS-D4.13 ± 3.702.67 ± 2.196.63 ± 2.142.08 ± 3.00
Table 6. Two-way mixed ANOVA analysis for comorbidities interaction with HADS scores’ evolution over time.
Table 6. Two-way mixed ANOVA analysis for comorbidities interaction with HADS scores’ evolution over time.
F (2176)p *Partial η2
HADS-AAnemia0.2630.7690.003
CKD2.4880.0860.028
Obesity0.6290.5340.007
HADS-DAnemia0.0690.9330.001
CKD0.6360.5310.007
Obesity1.3440.2640.015
* Two-way mixed ANOVA.
Table 7. Side-effects distribution according to the psychological status (χ2 Friedman test). On the p-Value column, bold is used in order to underline the statistically significant values of p.
Table 7. Side-effects distribution according to the psychological status (χ2 Friedman test). On the p-Value column, bold is used in order to underline the statistically significant values of p.
Side Effects at EOTn (%)BSL (Mean ± SD)EOT (Mean ± SD)SVR (Mean ± SD)χ2p
HADS-A scoresfatigue8 (8.88)10 ± 3.204.75 ± 2.714.75 ± 2.678.060.017
headache6 (6.66)12 ± 2.608.16 ± 2.564.16 ± 2.048.330.0155
insomnia6 (6.66)9.33 ± 3.386.33 ± 1.865.83 ± 32.330.31
pruritus11 (12.22)9.63 ± 3.56.09 ± 2.384.72 ± 2.417.090.028
HADS-D scoresfatigue8 (8.88)9.125 ± 4.543.5 ± 2.321 ± 0.759.750.0076
headache6 (6.66)7 ± 4.144.5 ± 1.372 ± 29.330.0094
insomnia6 (6.66)4.83 ± 3.982.5 ± 2.073.5 ± 2.661.580.45
pruritus11 (12.22)7.63 ± 2.874.9 ± 1.641.36 ± 0.9218.130.00013
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Danilescu, C.M.; Sandulescu, D.L.; Pirlog, M.C.; Streba, C.T.; Rogoveanu, I. Depressive and Anxious Symptoms in Hepatitis C Virus Infected Patients Receiving DAA-Based Therapy. Diagnostics 2021, 11, 2237. https://doi.org/10.3390/diagnostics11122237

AMA Style

Danilescu CM, Sandulescu DL, Pirlog MC, Streba CT, Rogoveanu I. Depressive and Anxious Symptoms in Hepatitis C Virus Infected Patients Receiving DAA-Based Therapy. Diagnostics. 2021; 11(12):2237. https://doi.org/10.3390/diagnostics11122237

Chicago/Turabian Style

Danilescu, Claudia Monica, Daniela Larisa Sandulescu, Mihail Cristian Pirlog, Costin Teodor Streba, and Ion Rogoveanu. 2021. "Depressive and Anxious Symptoms in Hepatitis C Virus Infected Patients Receiving DAA-Based Therapy" Diagnostics 11, no. 12: 2237. https://doi.org/10.3390/diagnostics11122237

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop