Next Article in Journal
The Prevalence of Risk Factors for Cardiovascular Diseases in Najran Region, Saudi Arabia
Previous Article in Journal
Laparoscopic Management of Cesarean Scar Pregnancy with Temporary Clipping of Anterior Trunk of Hypogastric Arteries: A Case Report
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

The Impact of Dupilumab on Work Productivity and Emotional Health in CRSwNP: A Multicentric Study in Northeast Italy

1
Department of Neurosciences DNS, Otolaryngology Section, University of Padova, 35122 Padova, Italy
2
ENT Department, Ospedale dell’Angelo, ULSS 3 Serenissima, Mestre, 30174 Venezia, Italy
3
ENT Department, Hospital of Cittadella, 35013 Padova, Italy
4
ENT Department, Hospital of Rovigo, 45100 Rovigo, Italy
5
ENT Unit, Department of Surgery, Ospedali Riuniti Padova Sud, 35043 Monselice, Italy
6
ENT Consultant, Head and Neck Department, ULSS 2 Marca Trevigiana, 31100 Treviso, Italy
7
Department of Otorhinolaryngology, University Hospital “Santa Maria Della Misericordia”, Azienda Sanitaria Universitaria Friuli Centrale (ASUFC), 33100 Udine, Italy
8
Department of Otolaryngology Head and Neck Surgery, San Bassiano Hospital, Via Dei Lotti 40, 36061 Bassano Del Grappa, Italy
9
Department of Neurosciences, Section of Otolaryngology, University of Padova, 31100 Treviso, Italy
10
ENT Unit, Ospedale San Martino, Belluno, ULSS1 Dolomiti, 32100 Belluno, Italy
11
Department of Statistical Sciences, University of Padova, 35122 Padova, Italy
*
Author to whom correspondence should be addressed.
J. Pers. Med. 2024, 14(5), 468; https://doi.org/10.3390/jpm14050468
Submission received: 1 April 2024 / Revised: 22 April 2024 / Accepted: 26 April 2024 / Published: 28 April 2024
(This article belongs to the Section Clinical Medicine, Cell, and Organism Physiology)

Abstract

:
Chronic rhinosinusitis with nasal polyps (CRSwNP) in the severe forms is associated with a poor quality of life. Dupilumab has been suggested as an add-on treatment option for severe CRSwNP. Severe CRSwNP patients treated with Dupilumab in different rhinological units were considered for this study via their evaluation at the baseline at first and the consequential follow-up at 6-, 12-, and 24 months from the first administration. At baseline (T0) and at each follow-up, patients underwent NPS, Sinonasal Outcome Test (SNOT)-22, Visual Analogue Scale (VAS) for smell, and Sniffin’ sticks identification test (SSIT). The SNOT-22 domains for function and emotion were also analysed separately. Two hundred and seventeen patients with at least 6 months of follow-up were included. All parameters have improved during treatment (p < 0.0001). Noticeably, both the function and emotion SNOT-22 domains have improved within 6 months of treatment and have continued to progress during every interval within 12 months from the baseline, positively influencing patients’ emotivity and augmenting their social and economic performances. Dupilumab improves the QoL of CRSwNP patients with good effects on the reported productivity and emotional health. Clinicians should pay attention to these two aspects when dealing with patients affected by severe CRSwNP.

1. Introduction

Chronic rhinosinusitis (CRS) is a prolonged inflammation of the nasal cavity and sinus mucosa lasting more than 12 weeks. CRS has traditionally been classified into either with nasal polyps (CRSwNP) or without nasal polyps (CRSsNP) [1]. The former accounts for approximately 30% of CRS cases [2] and has a higher disease burden than CRSsNP [1]. CRSwNP is a multifactorial disease that not only can be associated with genetic disorders, immunodeficiency, anatomical abnormalities, and chronic osteomyelitis, but it can also be influenced by exposure to environmental factors such as air pollution, smoke, allergens, viruses, bacteria, and fungi [3]. It has been recognised that the most common endotype of CRSwNP in the West Countries is type 2 inflammation [1,2]. CRSwNP is a common health condition in the Western world, with an estimated prevalence of approximately 3% [1,4]. Consistent with most of the Western Countries, Italy reports the majority of CRSwNP cases being affected by a type 2 inflammation with elevated levels of interleukin (IL)-4, IL-5, and IL-13, as well as a remarkable presence of eosinophils, type 2 innate lymphoid cells, macrophages, and mast cells [2,5,6,7]. As a chronic inflammatory disease, CRSwNP significantly affects wellbeing and social function, de facto associating CRSwNP with an increased risk of depression and social dysfunction [8], especially among young adults and middle-aged populations [1]. Similarly important is the extensively studied association between CRSwNP and sleep disturbance [9], which is linked to cardiovascular disease and reduced quality of life [10]. Of note, the impact of CRSwNP on quality of life (QoL) appears to be equivalent to chronic obstructive pulmonary diseases, congestive heart failure, and diabetes [11,12].
With the introduction of targeted biologic molecules in the management of severe CRSwNP, patients’ QoL has substantially improved [13]. Dupilumab, a human monoclonal antibody of the immunoglobulin G4 subclass able to block IL-4 and IL-13 signalling by specifically binding to the IL-4 receptor α subunit [9], has been demonstrated to be effective in reducing nasal polyps’ volume and improving the QoL of patients affected by severe CRSwNP [14], including older patients [15]. Being IL-4 and IL-13 relatively upstream players in the inflammatory cascade, these ILs are pivotal in the pathogenesis of both CRSwNP and asthma. At the moment, Dupilumab is approved for the treatment of moderate-to-severe atopic dermatitis, moderate-to-severe asthma with evidence of type 2 inflammation, eosinophilic esophagitis, prurigo nodularis and for the treatment of severe CRSwNP [9].
Both nasal obstruction and hypo-anosmia are the main symptoms reported by CRSwNP patients. In particular, more than 90% of CRSwNP patients complain of nasal blockage [16], while olfaction is impaired in about 83–91% of patients with CRSwNP [17], where the majority is anosmic [18].
The aim of the present multicentric study is to evaluate the effects of Dupilumab in patients with severe uncontrolled CRSwNP on wellbeing, with a special focus on productivity and improvement of emotion for patients residing in the region of Triveneto, one of the most industrialised areas of Italy [19,20].

2. Materials and Methods

2.1. Population

This is a no-profit, observational, retrospective, multicentric study. Study participants were recruited in the rhinological units of 10 different hospitals in Triveneto.
Inclusion criteria were defined as follows: (1) age ≥ 18 years; (2) diagnosis of severe chronic rhinosinusitis with nasal polyps (CRSwNP), defined by a nasal polyp score (NPS) ≥ 5 and/or a Sinonasal Outcome Tests-22 (SNOT-22) ≥ 50, with inadequate symptoms control despite intranasal corticosteroids (INCS) use, receiving at least two cycles of systemic corticosteroid in the last year and/or having undergone one or more sinonasal surgeries [(endoscopic sinus surgery (ESS)]; (3) at least 6 months of biological therapy administration (Dupilumab 300 mg, one subcutaneous injection every 15 days) indicated specifically for severe CRSwNP treatment.
A total of 217 patients were included in this study, recruited from February 2021 to September 2023: 73 patients from the Rhinological Unit of Padova University Hospital, 42 patients from the ENT Unit of Venezia Mestre “dell’Angelo” Hospital, 27 patients from the ENT Unit of Cittadella Hospital, 19 patients from the ENT Unit of Rovigo “Santa Maria della Misericordia” Hospital, 12 patients from the ENT Unit of Schiavonia “Madre Teresa di Calcutta” Hospital, 10 patients from the ENT Unit of Udine “Santa Maria della Misericordia” Hospital, 10 patients from the ENT Rhinological Unit of Montebelluna “San Valentino” Hospital, 8 patients from the ENT Unit of Treviso “Ca’ Foncello” Hospital, 8 patients from the ENT units of BellunoHospitals, and 8 patients from the ENT Unit of Bassano del Grappa “San Bassiano” Hospital. All patients underwent Dupilumab 300 mg, subcutaneous injection every 15 days, added to INCS as conventional treatment [21].
We collected data at baseline (before starting the biological treatment) (T0) and at the subsequent follow-up visits [6 months (T1), 12 months (T2), and 24 months (T3)]. During each visit patients’ QoL was assessed using the Sinonasal Outcome Test 22 (SNOT 22) [22], administered during each visit. SNOT 22 questions were therefore categorised into 5 distinct domains, namely nasal, ear/facial, sleep, function, and emotion [23]. Nasal obstruction and impairment of the sense of smell were also measured subjectively by means of the Visual Analogue Scale (VAS) for nasal obstruction (NO), smell, rhinorrhea and facial pain by 4 centres (Padova, Mestre, Schiavonia, Udine, Italy) for a total of 137 patients. Being more than half of the total population, we decided to include these data for the purpose of the analyses [6]. In addition to the subjective olfactory evaluation (VAS smell), olfaction was objectively assessed by means of SSIT (16 odours) (Burghart Messtechnik GmbH, Holm) [24,25]. Following Gevaert et al. [26], nasal polyps’ extension and severity were also evaluated using the Nasal polyp score (NPS) by means of a nasal endoscopy (0° and/or 30° rigid endoscope were used). Finally, at each time point, blood sample analyses were performed in order to assess hematic eosinophils’ levels.
The study was conducted in accordance with the 1996 Helsinki Declaration and was approved by each Hospital ethical committee (5304/AO/22). Informed consent was obtained from each subject before starting any study-related procedure.

2.2. Statistical Analysis

Quantitative variables were presented as median and interquartile range, whereas qualitative variables were expressed as number of observations and percentage. Comparisons of findings between baseline and different follow-ups were performed using the Wilcoxon test. Multiple mixed linear longitudinal regressions with a selection of variables based on Akaike’s information criterion (hybrid backward stepwise) were executed to identify the effects of the available variables on the measurement changes in time.
For all tests p-values have been calculated, and 5% was considered as the critical level of significance. All the analyses have been performed in R v.4.4.3 (R Core Team, Vienna, Austria, 2021) [27].

3. Results

A total of 217 patients (151 males and 66 females, mean age 55.8 ± 12.8 years) undergoing Dupilumab as add-on therapy for at least six months were considered for the present multicentric study. Patients’ main clinical characteristics at baseline (T0) are reported in Table 1. All patients reached at least 6 months of follow-up. One hundred and twenty-three patients reached the 12-month follow-up, while 73 patients reached the 2-year follow-up threshold (35 patients from the Padova group and 38 from the rest of the centres). Comorbid asthma was present in 68% of the population, while 61% of them suffered from inhalation allergies. The majority of the patients (87.6%) have previously undergone endoscopic sinus surgery (ESS), with a mean number of 2.4 ± 2.3 previous surgical treatments (Table 1). The mean body mass index (BMI) of the patients considered in this study was 25.9 ± 5.9 (25.8 ± 5.0 for the male group and 24.0 ± 7.4 for the female group).
NPS significantly decreased through the study period (p < 0.0001). In particular, NPS decreased by −2.58 (p < 0.001) after 6 months, by −0.65 (p < 0.001) between the 12th month and the 6th month of treatment and by −0.41 (p < 0.01) between the 24th month and the 12th month of treatment.
A similar trend is noticeable for SNOT-22, which significantly decreased throughout the initial phase of the study period (p < 0.0001) [in particular −37.7 (p < 0.001) after 6 months; −3.6 (p < 0.001) after 12 months], while no differences were observed between the scores collected after 24 months of treatment compared with those of the 12th month [−0.47 (p = 0.34)]. Additionally, all the VAS considered (NO, smell, rhinorrhea and facial pain) demonstrated a significant reduction through the study period (p < 0.0001 for all). When evaluating the VAS-smell in detail, it decreased by −5.27 (p < 0.001) after 6 months, by −0.37 (p < 0.001) between the 12th month and the 6th month of treatment and by −0.04 (p = 0.72) between the 24th month and the 12th month of treatment. Considering SSIT, there was a significant improvement in the scores measured throughout the study period (p < 0.0001). In greater detail, SSIT increased by 0.24 (p < 0.0001) in the first 6 months, while no significant differences were observed after 6 months (p = 0.55).
Looking at SNOT-22 domains, the nasal one, which includes eight different nasal items (Figure 1), significantly decreased through the study period (p < 0.0001). The reductions amounted to −16.9 (p < 0.001) after 6 months and to −1.39 (p < 0.001) between T1 and T2. No differences were detected between T2 and T3 (p = 0.71). The ear and facial domain improved by −4.81 (p < 0.001) after 6 months of treatment with respect to the baseline and by −0.25 (p < 0.04) between T1 and T2, while no significant differences were noticed between T2 and T3 (p = 0.54). The sleep domain showed a score reduction of −7.02 (p < 0.001) between T0 and T1 and of −0.64 (p = 0.02) between T1 and T2. No significant differences were identified after the 12th month of treatment (between T2 and T3). The emotion domain significantly decreased after initiating Dupilumab by −4.6 between T0 and T1 (p < 0.001). After the sixth month, no significant differences were recognised in terms of emotion (between T1–T2 and between T2–T3). Finally, the domain of function improved between T0 and T1 [−4.74 (p < 0.001)] and between T1 and T2 [−0.59 (p < 0.001)]. No significant differences were detected between T2 and T3. Looking at the specific items within the function domain (fatigue, reduced productivity, and reduced concentration), a significant reduction through the study period of all three items is highlighted (p < 0.0001). In particular, each one of the three items showed a significant reduction at T1 with respect to T0 [reduced productivity −1.53 (p < 0.001), fatigue −1.28 (p < 0.001) and reduced concentration −1.46 (p < 0.001)], whilst only reduced productivity and fatigue showed a reduction at T2 with respect at T1 [−0.19 (p < 0.001) and −0.27 (p < 0.001), respectively] (Figure 2). Similarly, when evaluating the specific items within the emotion domain (irritable, sad and embarrassed), a significant reduction throughout the study period of all three items was detected (p < 0.0001). In greater detail, all three items reported a significant reduction within the first 6 months (p < 0.001) (T1), while no significant differences were observed thereafter (Figure 3).
A multivariate analysis was conducted with a model including all available variables available to assess their influence on the function impairment domain. We evidenced that male sex and time significantly influenced this domain (p = 0.0001 and p = 0.000001, respectively). On the contrary, BMI had a negative impact on the domain (p = 0.008) (Table 2). Similar findings were outlined in the multivariate analysis when selectively considering the item-reduced productivity. There was a significant influence of male sex (p = 0.002) and time (p = 0.000001), but no influences of BMI (Table 3).
When considering the emotion domain in the multivariate analysis, male sex and time from Dupilumab initiation were shown to independently improve the domain (p = 0.003 and p = 0.000001, respectively).
Regarding the safety of Dupilumab, a total of 43 patients (19.8% of the population) experienced minor/moderate adverse events during the study period. In particular, 28/217 patients (12.9%) within the first 6 months of therapy, 12/123 patients (9.7%) between the 6th and the 12th month of therapy and 3/73 patients (4.1%) during the second year of follow-up. No major adverse events were evidenced in the population considered. The most reported adverse events included injection site dermatitis (15 patients), transient musculoskeletal pain (10 patients) and ocular symptoms such as ocular dryness/conjunctivitis (5 patients).
When looking at the blood eosinophils’ levels during the study period, the mean eosinophils’ blood count (EBC) at baseline was 0.54 ± 0.36 with 5/217 (2.3%) patients expressing hyper-eosinophilia (eosinophils > 1500 cells/mm3) and none with eosinophils > 3000 cells/mm3. At T1, mean EBC increased at 0.74 ± 0.62 cells/mm3, and 20/217 patients (9.2%) were found to exhibit hyper-eosinophilia (of whom 2 with eosinophils > 3000 cells/mm3). At T2, the mean EBC was 0.70 ± 0.61 cells/mm3 with 15/123 patients (12.2%) with hyper-eosinophilia (of whom 1 with eosinophils > 3000 cells/mm3). Ultimately, at T3, the mean EBC was 0.61 ± 0.60 cells/mm3, and only 4/73 patients (5.5%) had hyper-eosinophilia (of whom 1 with eosinophils > 3000 cells/mm3). Eleven of the twenty patients who experienced elevated eosinophil levels at T1 had persistent eosinophilia at T2, and three of them reported persistent eosinophilia also in the second year of follow-up. Only for one patient who exhibited 2 years of persistent eosinophilia (>3000 cells/mm3), it was decided to discontinue Dupilumab therapy despite the patient being asymptomatic. Considering the relationship between EBC and adverse events, we outlined a positive correlation at all the follow-up time points [T1 (p = 0.001), T2 (p = 0.007), T3 (p < 0.00001)].
Regarding Dupilumab discontinuation, 17 patients interrupted the treatment during the study period. Seven patients within the first 6 months of treatment, seven within the first year and three within the second year of treatment. The most frequent reasons for discontinuation were poor response in five patients, followed by autonomous patient interruption, despite clinical benefit and without any medical advice in 4 of these cases. After T1, three patients preferred to undergo sinus surgery, and consequently, injections were interrupted. Ultimately, Dupilumab administration was interrupted in five patients for other reasons, including the aforementioned patient with 2 years of asymptomatic persistent hyper-eosinophilia. In none of the patients who underwent Dupilumab interruption, discontinuation was due to major adverse events.

4. Discussion

The findings presented in this multicentric study provide valuable insights into the efficacy and safety profile of Dupilumab treatment as an add-on therapy in the management of severe and uncontrolled CRSwNP. An outstanding decrease in NPS was assessed throughout the treatment period. Despite evidencing the most substantial reduction within the 6 months of treatment, the decrease in NPS remained statistically significant at each interval, demonstrating the long-term maintenance of the positive effects of this biological therapy on nasal polyps’ shrinkage, even after 12 months of treatment. Similarly, SNOT-22 global scores have remarkably improved, with a statistically significant reduction in each interval between baseline, 6th month and 12th month, hence indicating a favourable impact on perceived disease severity, patient-reported outcomes and QoL. Correspondingly, these improvements were mirrored across all the evaluated VAS measures, reflecting a concomitant reduction in perceived NO, smell disturbances, rhinorrhea, and facial pain. Given the fact that, at the moment, no reliable type-2 inflammation biomarkers are available for CRSwNP patients [1], perhaps these results could even be more interesting. In fact, the patients recruited may also have suffered from mixed forms of inflammation, namely type 1 and type 2. In this regard, a previous experience from our group found a significant decrease of the nasal neutrophilic infiltration evaluated at nasal cytology in CRSwNP patients treated with Dupilumab [28]) meaning that in a significant percentage of CRSwNP patients, there may be a mixed inflammatory substrate.
Focusing on the olfactory function, it is worth mentioning how smell improvement was found statistically significant only within 6 months from Dupilumab’s first administration, while patients’ perception of their own olfactory function (evaluated with the VAS smell) progressively improved throughout the study period, maintaining the statistical significance between each interval between baseline, 6 months, 12 months and 24 months. These findings emphasise the divergence between olfactory perception and patients’ subjective insight into their olfactory function. Together with other previous studies, this not only demonstrates the uncertainty in the individual ability to evaluate their own smell abilities [29,30] but also highlights how the commonly used smell tests do not cover some of the relevant aspects of olfactory input perception modalities and how impactful these inputs are in the assessment of patients’ perspectives.
Remarkably, the majority of the specific SNOT-22 domains (nasal, ear/facial, sleep, and function impairment) exhibited both a score reduction in the early phases of the treatment and a statistically significant and sustained improvement of symptoms within 12 months from the baseline. This is true for all domains with the exception of the emotion one, where a statistically significant score decrease can only be observed between T0 and T1 (Figure 3) and maintains a very low score plateau thereafter, even when considering each item individually (irritable, sad, and frustrated). This pattern of reduction in the emotion domain shows how Dupilumab treatment, despite binding patients to a subcutaneous injection every 15 days, quickly induced an emotional and psychological positive effect, enhancing patients’ QoL.
Furthermore, a particular interest of this study was also to evaluate the effects of Dupilumab therapy on the SNOT-22 function domain in order to investigate its effect on patients’ production. The significant progressive improvement of the aforementioned domain during every interval within 12 months, mirrored singularly by its respective items (fatigue, reduced productivity, and reduced concentration), highlights that Dupilumab, reducing both nasal inflammation and nasal polyps’ volume, is able to enhance nasal function, i.e., olfaction, as measured by SSIT, and, eventually, patients’ productivity. This result is of paramount importance, particularly in a disease such as CRSwNP, as it is known to have significant social and economic repercussions due to poor sleep quality and loss of working days [1,31,32]. Interestingly, the multivariate analysis showed that patients’ productivity was positively and independently influenced by male sex, implying that male patients reported a stronger benefit in their productivity. This result can be linked to the fact that in Italy, workers’ occupation is higher among males (69%) than females (55%) [33]. To note, there is a gender diversity also in the Veneto region employment landscape, seeing the percentage of female workers at 59%, yet still inferior to that of males [34]. A possible explanation behind males showing higher productivity than females could be associated with the fact that at SNOT-22, males usually score lower than females, especially in the age group of our mean age population [35]. In multivariate analyses, BMI negatively influenced productivity. This influence may be more associated with the effects that BMI can have on sleep quality/performance and, consequently, on productivity [36,37]. Ultimately, both function and emotion domains were positively influenced by the time of Dupilumab therapy duration, highlighting how prolonged therapy with Dupilumab is able to remarkably reduce SNOT-22 scores related to both domains.

4.1. Limitations

The present study has some limitations. The first one could be the retrospective design of the study. A more important one could be that patients were treated by different ENT doctors in different ENT Units. Nevertheless, the Hospitals involved in the study comply with high-quality standards of care of patients’ evaluation and management according to ISO 9000 certification (International Organization for Standardization, Geneva, Switzerland) [38] guaranteeing a comparable practice among the different Units [1]. On the contrary, we believe that the value of a multicentric study far outweighs this possible limitation. Lastly, another possible limitation could be the lack of reliable biomarkers to identify type 2 inflammation. In this regard, there is a study showing the predictive role of CCL3 as a biochemical marker of type 2 inflammation in allergic rhinitis [39]. It certainly could be interesting in future to evaluate the role of CCL3 as a type 2 endotype biomarker in CRSwNP.

4.2. Safety

There is a major interest in the safety of biological drugs adopted for treating CRSwNP patients. In particular, although Dupilumab is demonstrated to be a safe drug in both phase 3 [40] and phase 4 studies [14,28], it is known that it is able to increase the absolute eosinophil count because of its mechanism of action and that, although rarely, Dupilumab induced hypereosinophilia has been associated to eosinophilic granulomatosis with polyangiitis and hypereosinophilic syndrome [41]. Importantly, no significant increase in adverse events has been observed [15]. In the present study, 43 patients (19.8% of the population) experienced adverse events during the study period. All these events were defined as minor or moderate, as all the patients with adverse events were asymptomatic or had mild symptoms, and no intervention or minimal non-invasive intervention was indicated. Most of the adverse events were injection site dermatitis and transient musculoskeletal pain, which resolved spontaneously. Focusing on the relationship between EBC and adverse events, we outlined a positive correlation at all the follow-up time points [T1 (p = 0.001), T2 (p = 0.007), T3 (p < 0.00001)], highlighting that higher EBC values are likely to be associated with higher, although minor, adverse events rate.
During the follow up, a small portion (at most 12%) of patients showed an increase of EBC. As already reported by previous studies [42], in most cases, this increase was transient, and the blood eosinophils count returned to the baseline values with time. In our cohort, only three patients showed persistent and asymptomatic hypereosinophilia at 2 years follow-up (4% of the population that reached T3). To the best of our knowledge, only Rampi et al. [43]. reported their results in the CRSwNP population in the second year of follow-up, with just four patients reaching the 24-month follow-up. As previously noted [44], pre-therapy EBC > 500 cells/mm3 is a risk factor for hypereosinophilia during the study, and our results confirm these previous observations; in fact, all of our patients affected by persistent hypereosinophilia presented EBC > 1000 cells/mm3 at the baseline.
Overall, no patients had to interrupt the therapy for safety reasons or major adverse events.

5. Conclusions

Sinonasal inflammation is associated with reduced quality of life, especially due to nasal obstruction and olfactory loss in patients affected by severe and uncontrolled CRSwNP. These symptoms, together with reduced sleep quality, are associated with a significant impact on patients’ productivity and emotions.
With the introduction of targeted biologic molecules in the management of severe CRSwNP, such as Dupilumab, patients’ QoL has substantially improved with a significant reduction of irritation, sadness and frustration and, consequently, with a long-lasting reduction of fatigue and significant improvements in both concentration and productivity.
Clinicians dealing with severe CRSwNP patients should be mindful of the emotional and productivity sphere of influence in order to have a comprehensive evaluation of the patients’ conditions.

Author Contributions

Conceptualisation, G.O.; methodology, G.O. and T.S.; software, B.S.; validation, P.N., G.O., G.R. and T.S.; formal analysis, B.S.; investigation, G.O., G.R., T.S., L.L., E.B., E.T., L.C., W.C., L.G.L., F.C., M.S., M.V.T., M.B., M.M. and A.G.B.; data curation, G.O., G.R., T.S., L.L., E.B., E.T., L.C., W.C., L.G.L., F.C., M.S., M.V.T., M.B., M.M. and A.G.B.; writing—original draft preparation, G.O., G.R. and T.S.; writing—review and editing, G.O., G.R. and T.S.; visualisation, P.N., G.O., G.R., T.S., L.L., E.B., E.T., L.C., W.C., L.G.L., F.C., M.S., M.V.T., M.B., M.M. and A.G.B.; supervision, G.O. and P.N.; project administration, G.O. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by Hospitals’ ethical committees (Padova University Hospital: 5304/AO/22—date of approval: 10 February 2022).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The datasets generated and analysed during the current study are available upon reasonable request.

Acknowledgments

The authors are thankful to Andrea B. C. Zen for proofreading the manuscript.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

BMI = body mass index; CRS = chronic rhinosinusitis; CRSwNP = chronic rhinosinusitis with nasal polyps; EBC = eosinophils blood count; ESS = endoscopic sinus surgery; INCS = intranasal corticosteroids; ISO = International Organization for Standardization; M = males NO = nasal obstruction; NPS = nasal polyp score; NSAIDs = non-steroidal anti-inflammatory drugs; OCS = oral corticosteroids; QoL = quality of life; SD = standard deviation; SNOT-22 = sinonasal outcome test-22; SSIT = Sniffin’ sticks identification test; T0 = baseline; T1 = 6 months evaluation; T2 = 12 months evaluation; T3 = 24 months evaluation; VAS = Visual Analogue Scale.

References

  1. Fokkens, W.J.; Lund, V.J.; Hopkins, C.; Hellings, P.W.; Kern, R.; Reitsma, S.; Toppila-Salmi, S.; Bernal-Sprekelsen, M.; Mullol, J.; Alobid, I.; et al. European Position Paper on Rhinosinusitis and Nasal Polyps 2020. Rhinol. J. 2020, 58, 1–464. [Google Scholar] [CrossRef]
  2. Bayar Muluk, N.; Cingi, C.; Scadding, G.K.; Scadding, G. Chronic Rhinosinusitis—Could Phenotyping or Endotyping Aid Therapy? Am. J. Rhinol. Allergy 2019, 33, 83–93. [Google Scholar] [CrossRef] [PubMed]
  3. Ottaviano, G.; Cappellesso, R.; Mylonakis, I.; Lionello, M.; Favaretto, N.; Giacomelli, L.; Spoladore, C.; Marchese-Ragona, R.; Marino, F.; Staffieri, A.; et al. Endoglin (CD105) Expression in Sinonasal Polyposis. Eur. Arch. Otorhinolaryngol. 2015, 272, 3367–3373. [Google Scholar] [CrossRef] [PubMed]
  4. Sedaghat, A.R.; Kuan, E.C.; Scadding, G.K. Epidemiology of Chronic Rhinosinusitis: Prevalence and Risk Factors. J Allergy Clin. Immunol. Pract. 2022, 10, 1395–1403. [Google Scholar] [CrossRef]
  5. Vlastos, I.; Gkouskou, K.; Doulaptsi, M.; Karatzanis, A.; Prokopakis, E.P. Precision Medicine in Rhinosinusitis. Curr. Allergy Asthma Rep. 2019, 19, 12. [Google Scholar] [CrossRef] [PubMed]
  6. Ottaviano, G.; De Corso, E.; Cantone, E.; Ciofalo, A.; Saccardo, T.; Bernardi, R.; Mairani, E.; Montuori, C.; Roccuzzo, G.; Soldati, L.; et al. Measuring Nasal Patency and the Sense of Smell in CRSwNP Patients Treated with Dupilumab. J. Pers. Med. 2023, 13, 234. [Google Scholar] [CrossRef] [PubMed]
  7. De Corso, E.; Bellocchi, G.; De Benedetto, M.; Lombardo, N.; Macchi, A.; Malvezzi, L.; Motta, G.; Pagella, F.; Vicini, C.; Passali, D. Biologics for Severe Uncontrolled Chronic Rhinosinusitis with Nasal Polyps: A Change Management Approach. Consens. Jt. Comm. Ital. Soc. Otorhinolaryngol. Biol. Rhinol. Acta Otorhinolaryngol. Ital. 2022, 42, 1–16. [Google Scholar] [CrossRef] [PubMed]
  8. Schlosser, R.J.; Gage, S.E.; Kohli, P.; Soler, Z.M. Burden of Illness: A Systematic Review of Depression in Chronic Rhinosinusitis. Am. J. Rhinol. Allergy 2016, 30, 250–256. [Google Scholar] [CrossRef] [PubMed]
  9. Ferri, S.; Montagna, C.; Casini, M.; Malvezzi, L.; Pirola, F.; Russo, E.; Racca, F.; Messina, M.R.; Puggioni, F.; Nappi, E.; et al. Sleep Quality Burden in Chronic Rhinosinusitis with Nasal Polyps and Its Modulation by Dupilumab. Ann. Allergy Asthma Immunol. 2024, 132, 69–75. [Google Scholar] [CrossRef]
  10. Bisogni, V.; Maiolino, G.; Ceolotto, G.; Pengo, M.F.; Marchese Ragona, R.; Artusi, C.; Brugnolo, L.; Lerco, S.; Borsetto, D.; Gaudioso, P.; et al. Design of a Study to Investigate the Mechanisms of Obstructive Sleep Apnoea by Means of Drug-Induced Sleep Endoscopy. Clin. Chem. Lab. Med. (CCLM) 2019, 57, 1406–1413. [Google Scholar] [CrossRef]
  11. van Agthoven, M.; Fokkens, W.J.; van de Merwe, J.P.; Marijke van Bolhuis, E.; Uyl-de Groot, C.A.; Busschbach, J.J. Quality of Life of Patients with Refractory Chronic Rhinosinusitis: Effects of Filgrastim Treatment. Am. J. Rhinol. 2001, 15, 231–237. [Google Scholar] [CrossRef] [PubMed]
  12. Wensing, M.; Vingerhoets, E.; Grol, R. Functional Status, Health Problems, Age and Comorbidity in Primary Care Patients. Qual. Life Res. 2001, 10, 141–148. [Google Scholar] [CrossRef] [PubMed]
  13. Cergan, R.; Berghi, O.N.; Dumitru, M.; Vrinceanu, D.; Manole, F.; Serboiu, C.S. Biologics for Chronic Rhinosinusitis—A Modern Option for Therapy. Life 2023, 13, 2165. [Google Scholar] [CrossRef] [PubMed]
  14. De Corso, E.; Pasquini, E.; Trimarchi, M.; La Mantia, I.; Pagella, F.; Ottaviano, G.; Garzaro, M.; Pipolo, C.; Torretta, S.; Seccia, V.; et al. Dupilumab in the Treatment of Severe Uncontrolled Chronic Rhinosinusitis with Nasal Polyps (CRSwNP): A Multicentric Observational Phase IV Real-life Study (DUPIREAL). Allergy 2023, 78, 2669–2683. [Google Scholar] [CrossRef] [PubMed]
  15. Ottaviano, G.; De Corso, E.; Saccardo, T.; D’Auria, L.M.; Zampollo, S.; D’Agostino, G.; Mairani, E.; De Maio, G.; Scarpa, B.; Bacci, C.; et al. Effectiveness of Dupilumab in the Treatment of Adult and Older Adult Patients with Severe, Uncontrolled CRSwNP. J. Pers. Med. 2023, 13, 1241. [Google Scholar] [CrossRef] [PubMed]
  16. Khan, A.; Huynh, T.M.T.; Vandeplas, G.; Joish, V.N.; Mannent, L.P.; Tomassen, P.; van Zele, T.; Cardell, L.-O.; Arebro, J.; Olze, H.; et al. The GALEN Rhinosinusitis Cohort: Chronic Rhinosinusitis with Nasal Polyps Affects Health-Related Quality of Life. Rhinology 2019, 57, 343–351. [Google Scholar] [CrossRef] [PubMed]
  17. Litvack, J.R.; Fong, K.; Mace, J.; James, K.E.; Smith, T.L. Predictors of Olfactory Dysfunction in Patients with Chronic Rhinosinusitis. Laryngoscope 2008, 118, 2225–2230. [Google Scholar] [CrossRef] [PubMed]
  18. Passali, G.C.; Passali, D.; Cingi, C.; Ciprandi, G. Smell Impairment in Patients with Chronic Rhinosinusitis: A Real-Life Study. Eur. Arch. Otorhinolaryngol. 2022, 279, 773–777. [Google Scholar] [CrossRef]
  19. Masiol, M.; Squizzato, S.; Formenton, G.; Harrison, R.M.; Agostinelli, C. Air Quality across a European Hotspot: Spatial Gradients, Seasonality, Diurnal Cycles and Trends in the Veneto Region, NE Italy. Sci. Total Environ. 2017, 576, 210–224. [Google Scholar] [CrossRef]
  20. Forlivesi, S.; Turcato, G.; Zivelonghi, C.; Zannoni, M.; Ricci, G.; Cervellin, G.; Lippi, G.; Bovi, P.; Bonetti, B.; Cappellari, M. Association of Short- and Medium-Term Particulate Matter Exposure with Risk of Mortality after Spontaneous Intracerebral Hemorrhage. J. Stroke Cerebrovasc. Dis. 2018, 27, 2519–2523. [Google Scholar] [CrossRef]
  21. Norelli, F.; Schiappoli, M.; Senna, G.; Pinter, P.; Olivieri, B.; Ottaviano, G.; De Corso, E.; Caminati, M. Adherence to Intranasal Steroids in Chronic Rhinosinusitis with Nasal Polyposis Prior to and during Biologic Therapy: A Neglected Matter. J. Clin. Med. 2024, 13, 1066. [Google Scholar] [CrossRef] [PubMed]
  22. Mozzanica, F.; Preti, A.; Gera, R.; Gallo, S.; Bulgheroni, C.; Bandi, F.; Ottaviani, F.; Castelnuovo, P. Cross-Cultural Adaptation and Validation of the SNOT-22 into Italian. Eur. Arch. Otorhinolaryngol. 2017, 274, 887–895. [Google Scholar] [CrossRef] [PubMed]
  23. Khan, A.H.; Reaney, M.; Guillemin, I.; Nelson, L.; Qin, S.; Kamat, S.; Mannent, L.; Amin, N.; Whalley, D.; Hopkins, C. Development of Sinonasal Outcome Test (SNOT-22) Domains in Chronic Rhinosinusitis With Nasal Polyps. Laryngoscope 2022, 132, 933–941. [Google Scholar] [CrossRef] [PubMed]
  24. Hummel, T.; Sekinger, B.; Wolf, S.R.; Pauli, E.; Kobal, G. “Sniffin” Sticks’: Olfactory Performance Assessed by the Combined Testing of Odor Identification, Odor Discrimination and Olfactory Threshold. Chem. Senses 1997, 22, 39–52. [Google Scholar] [CrossRef] [PubMed]
  25. Oleszkiewicz, A.; Schriever, V.A.; Croy, I.; Hähner, A.; Hummel, T. Updated Sniffin’ Sticks Normative Data Based on an Extended Sample of 9139 Subjects. Eur. Arch. Otorhinolaryngol. 2019, 276, 719–728. [Google Scholar] [CrossRef] [PubMed]
  26. Gevaert, P.; De Craemer, J.; Bachert, C.; Blauwblomme, M.; Chaker, A.; Cingi, C.; Hellings, P.W.; Hopkins, C.; Hox, V.; Fokkens, W.J.; et al. European Academy of Allergy and Clinical Immunology Position Paper on Endoscopic Scoring of Nasal Polyposis. Allergy 2023, 78, 912–922. [Google Scholar] [CrossRef] [PubMed]
  27. R Core Team. R: A Language and Environment for Statistical Computing; R Core Team: Vienna, Austria, 2020. [Google Scholar]
  28. Ottaviano, G.; Saccardo, T.; Roccuzzo, G.; Bernardi, R.; Chicco, A.D.; Pendolino, A.L.; Scarpa, B.; Mairani, E.; Nicolai, P. Effectiveness of Dupilumab in the Treatment of Patients with Uncontrolled Severe CRSwNP: A “Real-Life” Observational Study in Naïve and Post-Surgical Patients. J. Pers. Med. 2022, 12, 1526. [Google Scholar] [CrossRef] [PubMed]
  29. Fjaeldstad, A.W.; Konieczny, D.T.; Fernandes, H.; Gaini, L.M.; Vejlø, M.; Sandberg, K. The Relationship between Individual Significance of Olfaction and Measured Olfactory Function. Curr. Res. Behav. Sci. 2022, 3, 100076. [Google Scholar] [CrossRef]
  30. Cantone, E.; De Corso, E.; Ricciardiello, F.; Di Nola, C.; Grimaldi, G.; Allocca, V.; Motta, G. Olfaction Recovery Following Dupilumab Is Independent of Nasal Polyp Reduction in CRSwNP. J. Pers. Med. 2022, 12, 1215. [Google Scholar] [CrossRef]
  31. La Mantia, I.; Ottaviano, G.; Ragusa, M.; Trimarchi, M.; Foglia, E.; Schettini, F.; Bellavia, D.; Cantone, E. Multidimensional Impact of Dupilumab on Chronic Rhinosinusitis with Nasal Polyps: A Complete Health Technology Assessment of Clinical, Economic, and Non-Clinical Domains. J. Pers. Med. 2024, 14, 347. [Google Scholar] [CrossRef]
  32. Varendh, M.; Johannisson, A.; Hrubos-Strom, H.; Andersson, M. Sleep Quality Improves with Endoscopic Sinus Surgery in Patients with Chronic Rhinosinusitis and Nasal Polyposis. Rhinol. J. 2017, 55, 45–52. [Google Scholar] [CrossRef] [PubMed]
  33. Servizio Studi Dipartimento Lavoro Camera dei Deputati. Available online: https://Documenti.Camera.It/Leg19/Dossier/Pdf/PP004LA.Pdf (accessed on 27 March 2024).
  34. Regione del Veneto RAPPORTO SU “L’OCCUPAZIONE MASCHILE E FEMMINILE IN VENETO”. Available online: https://www.regione.veneto.it/article-detail?articleId=13945658 (accessed on 27 March 2024).
  35. Gregório, L.L.; Andrade, J.S.C.; Caparroz, F.A.; Saraceni Neto, P.; Kosugi, E.M. Influence of Age and Gender in the Normal Values of Sino Nasal Outcome Test-22. Clin. Otolaryngol. 2015, 40, 115–120. [Google Scholar] [CrossRef] [PubMed]
  36. Atella, V.; Belotti, F.; Giaccherini, M.; Medea, G.; Nicolucci, A.; Sbraccia, P.; Mortari, A.P. Lifetime Costs of Overweight and Obesity in Italy. Econ. Hum. Biol. 2024, 53, 101366. [Google Scholar] [CrossRef] [PubMed]
  37. Ishibashi, Y.; Shimura, A. Association between Work Productivity and Sleep Health: A Cross-Sectional Study in Japan. Sleep Health 2020, 6, 270–276. [Google Scholar] [CrossRef] [PubMed]
  38. Moore, L.M. High standards: ISO 9000 comes to health care. Trustee 1999, 52, 10–14. [Google Scholar] [PubMed]
  39. Berghi, O.; Dumitru, M.; Caragheorgheopol, R.; Tucureanu, C.; Simioniuc-Petrescu, A.; Sfrent-Cornateanu, R.; Giurcaneanu, C. The Relationship between Chemokine Ligand 3 and Allergic Rhinitis. Cureus 2020, 12, e7783. [Google Scholar] [CrossRef] [PubMed] [PubMed Central]
  40. Bachert, C.; Han, J.K.; Desrosiers, M.; Hellings, P.W.; Amin, N.; Lee, S.E.; Mullol, J.; Greos, L.S.; Bosso, J.V.; Laidlaw, T.M.; et al. Efficacy and Safety of Dupilumab in Patients with Severe Chronic Rhinosinusitis with Nasal Polyps (LIBERTY NP SINUS-24 and LIBERTY NP SINUS-52): Results from Two Multicentre, Randomised, Double-Blind, Placebo-Controlled, Parallel-Group Phase 3 Trials. Lancet 2019, 394, 1638–1650. [Google Scholar] [CrossRef] [PubMed]
  41. Caminati, M.; Micheletto, C.; Norelli, F.; Olivieri, B.; Ottaviano, G.; Padoan, R.; Piacentini, G.; Schiappoli, M.; Senna, G.; Menzella, F. Safety of Dupilumab in T2 Airways Conditions: Focus on Eosinophilia across Trials and Real-Life Evidence. Expert. Opin. Biol. Ther. 2024, 24, 15–23. [Google Scholar] [CrossRef]
  42. Galletti, C.; Barbieri, M.A.; Ciodaro, F.; Freni, F.; Galletti, F.; Spina, E.; Galletti, B. Effectiveness and Safety Profile of Dupilumab in Chronic Rhinosinusitis with Nasal Polyps: Real-Life Data in Tertiary Care. Pharmaceuticals 2023, 16, 630. [Google Scholar] [CrossRef]
  43. Rampi, A.; Tanzini, U.; Vinciguerra, A.; Danè, G.; Moroni, L.; Yacoub, M.; Trimarchi, M. Early Increase in Eosinophil Count May Predict Long-term Hypereosinophilia during Dupilumab Treatment: A 2-year Observational Study. Int. Forum Allergy Rhinol. 2023, 13, 2244–2247. [Google Scholar] [CrossRef]
  44. Wechsler, M.E.; Klion, A.D.; Paggiaro, P.; Nair, P.; Staumont-Salle, D.; Radwan, A.; Johnson, R.R.; Kapoor, U.; Khokhar, F.A.; Daizadeh, N.; et al. Effect of Dupilumab on Blood Eosinophil Counts in Patients With Asthma, Chronic Rhinosinusitis With Nasal Polyps, Atopic Dermatitis, or Eosinophilic Esophagitis. J. Allergy Clin. Immunol. Pract. 2022, 10, 2695–2709. [Google Scholar] [CrossRef] [PubMed]
Figure 1. SNOT-22 items and domains.
Figure 1. SNOT-22 items and domains.
Jpm 14 00468 g001
Figure 2. Sino-Nasal Outcome Test (SNOT-22) function domain changes during the study period. m: months.
Figure 2. Sino-Nasal Outcome Test (SNOT-22) function domain changes during the study period. m: months.
Jpm 14 00468 g002
Figure 3. Sino-Nasal Outcome Test (SNOT-22) emotion domain changes during the study period. m: months.
Figure 3. Sino-Nasal Outcome Test (SNOT-22) emotion domain changes during the study period. m: months.
Jpm 14 00468 g003
Table 1. Patients’ main clinical characteristics at baseline.
Table 1. Patients’ main clinical characteristics at baseline.
Padova
n = 73
Venezia Mestre
n = 42
Cittadella
n = 27
Rovigo
n = 19
Schiavonia
n = 12
Udine
n = 10
Montebelluna
n = 10
Treviso
n = 8
Bassano del Grappa
n = 8
Belluno
n = 8
TOTAL
n = 217
Sex19 Women
54 Men
17 Women
25 Men
9 Women
18 Men
7 Women
12 Men
2 Women
10 Men
1 Women
9 Men
4 Women
6 Men
1 Women
7 Men
3 Women
5 Men
3 Women
5 Men
66 Women
151 Men
Mean Age, yr (SD)52.9 (13.3)55.3 (12.5)57.6 (13.5)57.2 (12.3)62.9 (11.3)60.1 (12.6)55.1 (5.5)59.5 (6.9)56.3 (14.7)55 (16.6)55.8 (12.8)
BMI25.9 (5.1)23.1 (8.6)24.6 (3.1)N/A28 (2.9)N/AN/A26.8 (4.8)25.7 (4.6)26.9 (4.6)25.3 (5.9)
Asthma, n (%)26 (35.6)31 (73.8)21 (77.8)14 (73.7)8 (66.7)6 (60.0)1 (10.0)4 (50.0)6 (75.0)6 (75.0)149 (68.7)
NSAIDs intolerance, n (%)18 (24.7)16 (38.1)3 (11.1)2 (10.5)2 (16.7)0 (0)5 (50.0)1 (12.5)4 (50.0)4 (50.0)63 (29.0)
Allergy, n (%)52 (71.2)34 (81.0)11 (40.7)7 (36.8)7 (58.3)6 (60.0)3 (30.0)5 (62.5)5 (62.5)4 (50.0)134 (61.8)
Smokers, n (%)9 (12.3)5 (11.9)3 (11.1)NA1 (8.3)3 (30.0)1 (10.0)0 (0)1 (12.5)0 (0)37 (17.1)
Previous ESS, n (%)58 (79.5)38 (90.5)21 (77.8)19 (100)12 (100)9 (90.0)9 (90.0)8 (100)8 (100)8 (100)190 (87.6)
Mean n. of previous surgeries, n (SD)1.7 (1.5)3 (3.2)2.9 (2.7)2.6 (3.2)2.1 (2.9)2.4 (1.7)3.4 (2.4)2.5 (1.2)2.9 (1.2)3.5 (2.3)2.4 (2.3)
SD: standard deviation; NSAIDs: non-steroidal anti-inflammatory drugs; ESS: endoscopic sinus surgery; N/A: not available.
Table 2. Multivariate regression model: correlations between function domain and male sex, BMI and time of Dupilumab therapy duration.
Table 2. Multivariate regression model: correlations between function domain and male sex, BMI and time of Dupilumab therapy duration.
EstimateStandard Errort-Valuep-Value
Intercept2.1160.3036.992<0.001
Sex (M)−0.4530.137−3.3080.001
BMI0.0290.0112.6440.008
T0−1.3040.081−16.138<0.001
T1−1.554 0.089−17.449<0.001
T2−1.5370.112−13.764<0.001
M: males; BMI: body mass index; T0: Baseline; T1: 6 months of Dupilumab therapy; T2: 12 months of Dupilumab therapy.
Table 3. Multivariate regression model: correlations between the item-reduced productivity and male sex, BMI and time of Dupilumab therapy duration.
Table 3. Multivariate regression model: correlations between the item-reduced productivity and male sex, BMI and time of Dupilumab therapy duration.
EstimateStandard Errorz-Valuep-Value
Intercept0.3350.3261.0280.304
Sex (M)−0.4270.136−3.1440.002
BMI0.0230.0121.9520.050
T0−1.1000.101−10.884<0.001
T1−1.3890.127−10.908<0.001
T2−1.2660.167−7.564<0.001
M: males; BMI: body mass index; T0: Baseline; T1: 6 months of Dupilumab therapy; T2: 12 months of Dupilumab therapy.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Ottaviano, G.; Roccuzzo, G.; Lora, L.; Bison, E.; Tosin, E.; Calvanese, L.; Cestaro, W.; Locatello, L.G.; Corlianò, F.; Stellin, M.; et al. The Impact of Dupilumab on Work Productivity and Emotional Health in CRSwNP: A Multicentric Study in Northeast Italy. J. Pers. Med. 2024, 14, 468. https://doi.org/10.3390/jpm14050468

AMA Style

Ottaviano G, Roccuzzo G, Lora L, Bison E, Tosin E, Calvanese L, Cestaro W, Locatello LG, Corlianò F, Stellin M, et al. The Impact of Dupilumab on Work Productivity and Emotional Health in CRSwNP: A Multicentric Study in Northeast Italy. Journal of Personalized Medicine. 2024; 14(5):468. https://doi.org/10.3390/jpm14050468

Chicago/Turabian Style

Ottaviano, Giancarlo, Giuseppe Roccuzzo, Lucia Lora, Elisabetta Bison, Enrico Tosin, Leonardo Calvanese, Walter Cestaro, Luca Giovanni Locatello, Fabrizio Corlianò, Marco Stellin, and et al. 2024. "The Impact of Dupilumab on Work Productivity and Emotional Health in CRSwNP: A Multicentric Study in Northeast Italy" Journal of Personalized Medicine 14, no. 5: 468. https://doi.org/10.3390/jpm14050468

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop