Next Article in Journal
Radiolabeled PET/MRI Nanoparticles for Tumor Imaging
Next Article in Special Issue
Chronic Rhinosinusitis—An Update on Epidemiology, Pathogenesis and Management
Previous Article in Journal
Invasive Evaluation of the Microvasculature in Acute Myocardial Infarction: Coronary Flow Reserve versus the Index of Microcirculatory Resistance
Previous Article in Special Issue
Microbiota Dysbiosis in Fungal Rhinosinusitis
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
JCM
Volume 9
Issue 1
10.3390/jcm9010088
jcm-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Maxillary Antrostomy Patency Following Intraoperative Use of Spray Cryotherapy

by
Veronica Trombitaș
1,*,†,
Adriana Zolog
2,
Mioriţa Toader
3 and
Silviu Albu
1,†
1
II-nd Department of Otolaryngology, Iuliu Hatieganu University of Medicine and Pharmacy, Str. Republicii nr. 18, 400015 Cluj-Napoca, Romania
2
Pathology Department, CF Hospital Cluj-Napoca, 400015 Cluj-Napoca, Romania
3
Department of Otolaryngology, Grigore Alexandrescu Hospital, 011743 Bucuresti, Romania
*
Author to whom correspondence should be addressed.
†
Both authors equally contributed to this article.
J. Clin. Med. 2020, 9(1), 88; https://doi.org/10.3390/jcm9010088
Submission received: 31 October 2019 / Revised: 18 December 2019 / Accepted: 26 December 2019 / Published: 29 December 2019
(This article belongs to the Special Issue Prevention, Diagnosis and Management of Chronic Rhinosinusitis)
Browse Figures
Versions Notes

Abstract

:
Objectives/Hypothesis: Stenosis of the middle meatus antrostomy (MMA) represents a major cause of recurrent disease following endoscopic sinus surgery (ESS). Various strategies have been developed to prevent the occurrence of MMA stenosis. The aim of the present study was to evaluate the effects of spray cryotherapy (SC) on nasal wound healing following ESS. Methods: This is a prospective within-subject, randomized, and controlled trial. Twenty-six patients submitted to bilateral ESS with chronic rhinosinusitis without polyps were included. Following surgery, patients were randomized to receive SC on one side and saline contralaterally. Outcomes were represented by MMA diameter and area, histology of nasal mucosa, and nasal symptoms. Variables were assessed at 3 and 12 months postoperatively. Results: The MMA size in the SC group at 3 and 12 months (area—0.578 ± 0.1025 cm2, diameter—0.645 ± 0.1024 cm; 0.605 ± 0.1891 cm2, 0.624 ± 0.0961 cm, respectively) was significantly larger (p = 0.000) than in the control group. Histology established that cell infiltration, goblet cells, edema, and epithelial hyperplasia were prominent and persistent in the control side compared to the SC side. Nasal obstruction and discharge were significantly improved in the SC group compared to the control group. Conclusion: SC is a promising therapy following ESS, since it precludes MMA stenosis and decreases inflammation, edema, and goblet cell hyperplasia.

1. Introduction

Endoscopic sinus surgery (ESS) represents the treatment of choice for chronic rhinosinusitis (CRS) which is unresponsive to maximal medical therapy [1,2,3,4,5]. Recently, ESS has been used extensively in the management of odontogenic CRS and for the extraction of foreign bodies, impacted teeth, and dentigerous cysts from the maxillary sinus [6,7]. Approximately 10%–30% of CRSs are due to a dental source [6]. Recently, Trimarchi et al. described the successful management of dental CRS with the combined transoral (root canal therapy, dental extraction, dental implant removal, oro-antral fistula closure) and ESS approaches [6]. Today, it is widely acknowledged that dental implantation with or without sinus lifting requires close cooperation between otorhinolaryngologists (ENT) and dentists. ENT surgeons are not only involved in the treatment of post-implant CRS, but mainly in the pre-implant management in order to prevent the development of sinus complications [8,9,10,11]. Although ESS is highly successful, failures are still reported in 15% to 26% of patients [12,13,14]. Adhesions and stenosis of the middle meatus antrostomy (MMA) are intensely associated with unsuccessful ESS outcomes [13,14]. Adhesion and MMA stenoses occur as a result of scars and/or granulation development during the tissue recovery process [12,13,14]. Several substances, such as mitomycin and vitamin A, were used in clinical trials to impede development of adhesions [15,16,17].
Endoscopic spray cryotherapy (SC) using low-pressure liquid nitrogen is a new method successfully used in dermatology, oncology, ophthalmology, and gastroenterology [18,19,20,21,22,23,24]. SC with liquid nitrogen (−196 °C) is a noncontact method of tissue ablation. SC destroys tissues, interrupts the vascular supply, and stimulates the immune system [19]. In addition, SC protects the tissue architecture and extracellular matrix, which remain largely intact, generating a favorable wound response [20,21]. SC has also been successfully employed during bronchoscopy, followed or not by balloon dilatation [22,23]. In otolaryngology, SC has been used in patients with glottic and subglottic benign stenoses [24].
We have recently demonstrated that SC significantly improved postoperative objective scores and enhanced healing following ESS [25]. In another paper, we demonstrated that SC increased the antrostomy patency in a CRS rabbit model [26]. In this study, we aimed to assess the consequences of SC on MMA patency. In addition, subjective outcomes were also determined and correlated with the histological pattern.

2. Materials and Methods

Ethical considerations. The study was approved by the Ethic Committee of the Iuliu Hateganu University of Medicine and Pharmacy Cluj-Napoca (No.10/16January 2014). All patients have signed an informed consent preceding inclusion in the study.
Inclusion criteria. This study was a prospective, randomized, and controlled trial. We included the patients presenting bilateral CRS without polyps (CRSsNP) according to the criteria endorsed in the European Position Paper on Rhinosinusitis and Nasal Polyps 2012 [1]. Each patient underwent a preoperative computed tomography (CT) scan, and disease severity was graded according to the Lund–Mackay (LM) system [27]. Exclusion criteria included patients with a difference between sides of higher than two grades in the LM system, prior nasal surgery, nasal polyps, unilateral disease, severe septal deformity, cystic fibrosis, aspirin intolerance, immotile cilia syndrome, neutropenia, and patients with recognized autoimmune diseases [5,15,16,17,28]. Likewise, smokers and patients with bronchial asthma were excluded from the present study.
Surgery. All patients were operated on under general anesthesia by the same senior surgeon. The amount of sinus disease entailed the extent of the surgery fulfilled in each patient [29]. However, every patient included in the study went through uncinectomy, MMA, and anterior ethmoidectomy. MMA was performed using standard instrumentation—using cutting and backbiting forceps, enlarging its diameter in the anterior and posterior directions. When a septal spur restricted the surgical procedure, a septoplasty was also achieved. The middle turbinate was preserved and a mucosa-sparing technique was employed in all patients. Since liquid nitrogen was sprayed close to the orbit, we implemented several strategies to prevent orbital complications. Backbiting forceps were used to perform the uncinectomy, and the lamina papyracea was identified early. The performance of a large MMA permitted the achievement of the three dimensional perspective, allowing one to simultaneously foresee the orbital floor, medial orbital wall, and posterior maxillary wall. The lamina papyracea was skeletonized early during ethmoidectomy to prevent orbital penetration. The removal of all bony septations allowed complete exposure of the lamina.
Patients were randomized by means of a closed envelope system: SC was conveyed in one meatus and saline in the contralateral side. At the conclusion of the procedure, the envelope was unlocked and SC or saline were delivered over the boundaries of the MMA according to the randomization. SC was performed with the Brymill CRY-AC®-3 Cryogenic System (Figure 1) and consisted of 4 sequences of gas delivery (each cycle lasting 5 s) with breaks of 35 s for a complete thaw of the tissues [25]. Mucosa samples were collected from the edges of the MMA for histological evaluation (see Table 1).
At the end of the procedures, both sides were packed with Vaseline gauze. Packing was removed the following day, and patients were discharged on oral broad-spectrum antibiotics for 10 days and daily saline nasal irrigation for 4 weeks (twice a day).
Outcome measurement. Postoperative outcomes were assessed by an investigator blinded to the surgical procedure at 3 months (1st follow-up visit) and 12 months (2nd follow-up visit) following ESS. During each follow-up visit, each nostril was scrutinized by means of a 30° and 45° angled endoscope. Accurate and reproducible measurements of the MMA were obtained according to the previously published accepted guidelines [15,17]: A circular probe was positioned in the same plane as the MMA and in the center of the endoscope’s field of view. When the contour of the probe in the endoscope’s field of view was as spherical as possible, the probe was withdrawn and freeze-frame shots were taken (Figure 2). The MMA areas and diameters were objectively measured using the AutoCAD 2010 (Autodesk Inc., San Rafael, CA, USA) system (Figure 3 and Figure 4). Tissue biopsies were taken from the MMA area during the operative procedure and during the follow-up. Tissue samples were fixed in formaldehyde and stained with hematoxylin and eosin, as well as Masson Trichrome for collagen. A single senior pathologist evaluated the mucosa samples. The histological assessment included the presence of mononuclear cell infiltrate, edema, cilia characteristics, grade of fibrosis, number of goblet cells, epithelial hyperplasia, and squamous metaplasia (see Table 1). All of the mentioned parameters were recorded as categorical variables.
Patient symptoms (nasal blockage, nasal discharge, facial pressure) were recorded before surgery and at the follow-up visits for both operated sides. Patients scored these symptoms on a visual analogue scale (VAS) scale, where absent = 0 and severe = 10. Periorbital swelling and pain, proptosis, globe displacement, eye movements, and visual acuity were assessed preoperatively and compared with postoperative outcomes.
Statistical Analysis. Data are presented as mean ± SD. In a previous investigation, the mean MMA diameter at 3 months was 0.44 cm ± 0.15 cm [24]. The sample size was determined in the following manner: Assuming a 20% difference between the two sides, a power of 80%, and a significance level of 5%, the sample size comprised 23 patients according to the McNemar test. To compensate for drop-outs, the number was increased to 26. The results were analyzed using SPSS Statistics version 20.0 for Windows (SPSS Inc., Chicago, IL, USA). In order to evaluate the normal distribution of data, the Kolmogorov–Smirnov test was used. For normal distributed parameters, the Student t-test and the ANOVA analysis were used for comparison. When ordinal or non-normally distributed data were assessed, we employed the Mann–Whitney U and Kruskall–Wallis tests, as well as the Kendall’s correlation coefficient in the tau-b form. The Spearman rank correlation test was used for correlations. The Wilcoxon test was used for comparison of matched pairs. A receiver operating characteristic (ROC) curve analysis was performed to evaluate the effect of SC on MMA patency. In all analyses, p-values were evaluated for the 1%, 5%, and 10% significance values, depending on the probabilities obtained.

3. Results

Patients. In the present study, 26 patients (11 males/15 females) ranging in age from 21 to 74 years (mean 44.5 years) were enrolled. The mean (±SD) preoperative LM score in the SC-treated side was 5.5 ± 1.2, and 6.2 ± 1.8 in the control side (p > 0.05). No lamina papyracea dehiscence was noted on the coronal preoperative CT scan in any patient included in the study. No major complications (orbital hematoma, visual loss, significant hemorrhage requiring transfusion, CSF leaks, meningitis, or brain abscess) were noted in our cohort. Since the lamina papyracea was kept intact in all our cases, no subcutaneous emphysemas or periorbital ecchymoses were encountered. However, minor complications were noted: One postoperative epistaxis (control side) managed with nasal packing and one postoperative sinus infection (control side) managed with antibiotics.
Antrostomy dimensions. The intraoperative MMA areas and diameters were similar in both groups (p > 0.05, see Table 2). The postoperative MMA was larger in the SC-treated side in comparison with the control side: On the first follow-up visit, the differences in diameter and area between the two groups were statistically significant (see Table 2). At 12 months, the difference was significant at the 1% critical limit (p = 0.000 < 0.01, see Table 2). The comparison of both MMA areas and diameters in the two groups is represented in Figure 3 and Figure 4. The results of the t-test were certified in the ROC investigation (see Table 3). Thus, at the initial assessment, there are no differences in the area under the curve (AUC). However, examination at 3 and 12 months reveals that differences in the AUC between the groups attain significance at a 1% value. The ROC curve is presented in Figure 5. According to previous data [30], MMA stenosis was considered when the diameter was less than 6 mm. At the final follow-up, we encountered one MMA with a reduced dimension in an SC patient and eight MMAs with stenoses in the control group (Figure 6). In the control group, five patients had stenoses rated as mild (diameter < 6 mm), two patients had stenoses rated as moderate (diameter < 5 mm), and one was rated as severe (diameter < 4 mm). In the treatment group, there was just one MMA with stenosis rated as mild.
Histological analysis. The histological analysis highlighted that the fibrosis, mononuclear cell infiltrate, edema, epithelial hyperplasia, and squamous metaplasia had similar scores in the two groups at surgery (see Table 4). At both the first and second follow-up visits, there was no statistical difference for the fibrosis scores between the two sides. Thus, the SC group had a minimal enhancement effect on fibrosis, but the power relationship was low (coefficient Kendall = 0.221 ∊ [0; 0.3], see Table 5). The mononuclear cell infiltrate, edema, goblet cell number, and epithelial hyperplasia were decreased in the SC group, and the difference was statistically significant during the follow-up (see Table 4 and Table 5). As clearly depicted in Table 5, at the first follow-up, the differences between the two groups were significant for edema (p-value = 0.000 < 0.01, coefficient Kendall = 0.543 ∊ [0.3; 0.7]), mononuclear cell infiltrate (p-value = 0.000 < 0.01, coefficient Kendall = −0.391 ∊ [0.3; 0.7]), and goblet cells (p-value = 0.000 < 0.01, coefficient Kendal = −0.422 ∊ [0.3; 0.7]). At the second follow-up, lessening of inflammation was obvious on both sides. However, mononuclear cell infiltrate was significantly reduced on the SC side at a threshold of statistical significance of 1%, the edema differences between the two sides were significant at a threshold of 5%, the goblet cell differences were significant at a threshold of 1%, and the ciliated cells displayed significant differences at a threshold of 1% (see Table 4 and Table 5). On the second follow-up, we concluded that mononuclear cell infiltrate (10–30 cells/field 40×), edema with collagen fiber dislocation, epithelial hyperplasia, and goblet cells (10–50 cells/field 40×) were more abundant on the control side (Figure 7). These histological features were related with MMA stenosis: There was a significant correlation between persistent inflammation and MMA dimensions (Table 6). Reduced MMA diameter and area were significantly associated with increased edema, epithelial hyperplasia, and increased numbers of goblet cells (Table 6 and Figure 7). An increased number of inflammatory cells was associated with a higher number of goblet cells and epithelial hyperplasia (Table 7 and Figure 7). Conversely, increased edema and hyperplasia of epithelium were associated with a higher number of goblet cells (Table 7).
On the SC side, we found a better organization of collagen fibers, the absence of epithelial hyperplasia, and that the number of goblet cells was statistically reduced (0–10 cells/field 40×). The squamous metaplasia persists only in the control group and in association with epithelial hyperplasia (Figure 7).
Subjective outcomes. When compared with the preoperative scores, at the last follow-up, the recorded symptoms demonstrated a significant reduction (p < 0.001, Wilcoxon test). Nasal obstruction and discharge were significantly improved in the SC group in comparison with the control group (see Table 8), while facial pressure scored similarly in both groups at the last follow-up. An increased number of goblet cells was associated with a greater postoperative obstruction (Spearman test, r = 0.412, p = 0.04) and discharge score (Spearman test, r = 0.452, p = 0.03). On the other hand, a reduced number of ciliated cells was associated with increased discharge (Spearman test, r = −0.442, p = 0.02).
Since liquid nitrogen was sprayed around the orbit, visual assessments were carefully recorded and compared with preoperative data and are listed in Table 9.

4. Discussion

Although credited with high success rates, suboptimal ESS outcomes could be attributed to different factors, such as persistent infection, massive inflammation, or poor surgical technique, all resulting in defective wound healing [1,2,3,4,5,6,7,8]. The Caldwell–Luc technique is no longer in use for the management of odontogenic CRS and foreign body extraction from the maxillary sinus due to its high morbidity [6,7]. Several recent papers describe the successful use of ESS in the management of odontogenic sinusitis [6,7,8,9,10,11]. In addition, an in-depth ENT evaluation is required prior to maxillary sinus elevation (particularly transcrestal sinus lifting) and dental implantation [8,9,10,11]. Appropriate sinus drainage and ventilation should be restored by means of medical or surgical therapy in advance of (before) dental management. ESS is considered the treatment of choice in several disorders that compromise maxillary ventilation: Anatomical variants impairing the patency of the osteomeatal complex, recurrent or chronic sinusitis, fungus ball, foreign bodies, and oroantral fistula. These illnesses should be submitted to ESS prior to or in association with maxillary elevation [6,7,8,9,10,11].
In addition to synechia, stenosis of the MMA is associated with poor outcomes following ESS. Stenosis of the maxillary ostium was reported to occur in 27% to 39% of revision ESS cases [6,7,8]. Musy and Kountakis [13] described common findings associated with primary ESS failure: Inadequate anterior ethmoidectomy (64%), scarring of the frontal recess (50%), and MMA stenosis (39%). In the cohort of 52 revision cases reported by Ramadan [12], residual disease in the ethmoid cells was the principal cause of recurrence, followed by MMA stenosis. In an attempt to increase MMA patency rates, various substances have been used in the clinical setting. Mitomycin C hinders fibroblast proliferation and migration, thus limiting adhesion formation [15,16]. Following topical mitomycin C application, MMA stenosis is significantly reduced. However, the drug is carcinogenic in rats and the long-term safety remains unknown [15,16]. Another recent study revealed that topical vitamin A is able to reduce adhesions and improve MMA patency rates following ESS [17]. These authors demonstrated that topical vitamin A hinders the proliferation and migration of fibroblasts. Most importantly, this study established that topical vitamin A treatment enhances the increase of ciliated cell numbers [17].
The present study aims to assess the efficacy of SC in maintaining the MMA patency. We used a device with an ambient pressure system, the solution was liquid nitrogen at −196 °C, and the pulverizations were imprinted around the maxillary antrostomy. In the human airways, cryotherapy was able to improve mucosal healing, as was clearly histologically confirmed [23,24]. The histologic characteristic was a better collagen organization and reduced keratinization [23,24].
In order to carefully assess the precise effect of SC on the healing of nasal mucosa, we followed strict inclusion and exclusion criteria [15,16,17,28]. In addition to the well-known, accepted, and published exclusion factors, we also rejected smokers and patients with asthma from the present investigation. Recent reviews have undoubtedly established that smoking adversely affects wound healing following ESS [31,32]. Asthma is clearly associated with poor objective and subjective postsurgical outcomes [28].
We were able to demonstrate a significant increase in both the MMA diameter and area on the SC side. During the follow-up visits, the MMA patency was constantly larger in the SC-treated group. The effect of increasing the MMA dimensions was also clearly confirmed by means of the ROC curve.
In an experimental model, we proved that cryotherapy is associated with reduced cellular inflammatory infiltrate and fibrosis [26]. On the other hand, SC enhances the development of ciliated cells and better collagen fiber organization [26].
Histology in our group of patients demonstrated that the mononuclear cell infiltration, goblet cells, edema, and epithelial hyperplasia were prominent and persistent in the control side compared to in the SC side. During the healing process, epithelial cells cooperate with inflammatory cells and release cytokines and growth factors, including transforming growth factor ß (TGF-ß) [32,33,34,35,36,37]. TGF-ß is an inflammation modulator and is considerably involved in extracellular matrix production in the respiratory system. Extracellular matrix deposition depends largely on the activity of local fibroblasts and myofibroblasts, and is induced primarily by local inflammatory factors such as interleukins (IL 10) and TGF-ß, produced mainly by M2 macrophages [35,36,37]. An improved collagen organization in the cryotreated side is related to the activity of effector T lymphocytes (TH1 and TH2) and mediators. Even if the local inflammation reaction is decreased in the cryotreated group, the increased M2 activity could explain the collagen deposition. Both clinical and experimental research proved that cryotherapy enhances collagen III production [26,35,36,37].
Another interesting finding was that small MMAs are significantly associated with important edema, epithelial hyperplasia, and increased goblet cells. In line with other published papers [32,33,34], we found that augmentation of inflammatory cells was associated with a higher number of goblet cells and epithelial hyperplasia. This finding is predictable, since the extracellular space significantly increases during inflammation [38,39,40].
Subjective outcomes underlined the efficacy of surgical treatment, since all patients had a clear improvement of SC symptoms. However, obstruction and discharge were significantly improved in the SC group compared to the controls. Increased obstruction and discharge were linked to higher numbers of goblet cells, and reduced numbers of ciliated cells accompanied increased discharge. Thus, persistent mucosal inflammation goes along with increased obstruction and discharge. Since SC significantly decreases tissue inflammation, the SC group subjectively fared better. Another factor associated with poor postsurgical outcomes and recurrent sinusitis is the presence of biofilms [41,42]. Even though the pathology of CRS is assumed to be multifactorial, biofilms are supposed to concur to persistent mucosal inflammation and recurrent disease [41,42]. Recently, an in vitro investigation demonstrated that SC is effective in disruption of biofilms in CRS [43]. Thus, the latter effect may also be responsible for the better outcome in our SC group of patients. According to current knowledge, it is reasonable to assume that proper surgical technique comprising ample opening of the maxillary ostium will suffice to maintain adequate MMA patency in the postoperative period. Thus, cryotherapy along with topical mitomycin C and topical vitamin A should be credited as an alternative method to keep the ostium open after inappropriate surgical techniques. However, MMA stenosis is still being reported as an essential finding in revision cases by well-known surgeons [12,13]. Attempts to maintain postsurgical patency should be considered in severe nasal polyposis with frequent relapses. Nevertheless, a recent investigation confirmed that SC in association with ESS improved objective and subjective outcomes in patients with nasal polyps [44]. Moreover, this study should be considered a prerequisite for the use of cryotherapy in the postoperative care of patients with Draf III procedures, where frontal sinus ostium stenosis is a major concern.
Limitations. The present study has several limitations: The restricted number of patients, IL 10 and TGF-ß were not objectively assessed, and the design of the study with patients acting as their own controls. Even if this strategy decreases biases emerging from natural differences among patients, it also has significant drawbacks: Persistent inflammation on one side may afflict the other nasal fossae, and quality of life (QoL) questionnaires cannot be used in the postoperative assessment [44]. It is widely acknowledged that QoL represents the gold standard in assessing subjective outcomes following ESS [44]. A longer follow-up is warranted to confirm our preliminary results.
Strengths of this study: Prospective, randomized, and controlled clinical study. Appropriate statistical methods used in validating the MMA size difference between the two groups. The present investigation assessed the histology pattern in SC-treated nasal mucosa.
Clinical applicability of the study: SC may represent a future therapy in preventing MMA stenosis and synechia following ESS. Although in most instances, correct surgical technique will result in adequate MMA size in the postoperative period, MMA stenosis is still reported in literature. In addition, mega-antrostomy and medial maxillectomy are employed in revision cases or benign tumors, not in primary CRS cases. Thus, SC may represent a future therapy in preventing MMA stenosis and synechia following ESS.

Author Contributions

Conceptualization of the research was made by V.T. and S.A.; The present study was performed under the supervision of S.A., who was also responsible for the writing-review and editing of the manuscript; V.T., M.T. and A.Z. were responsible in data curation, project administration and writing of the original draft; Investigation was carried out by M.T. All authors have read and agreed to the published version of the manuscript.

Funding

No funding was received for this research.

Conflicts of Interest

Nothing to declare.

References

  1. Fokkens, W.J.; Lund, V.J.; Mullol, J.; Bachert, C.; Alobid, I.; Baroody, F.; Cohen, N.; Cervin, A.; Douglas, R.; Gevaert, P.; et al. EPOS 2012: European position paper on rhinosinusitis and nasal polyps 2012. A summary for otorhinolaryngologists. Rhinology 2012, 50, 1–12. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Damm, M.; Quante, G.; Jungehuelsing, M.; Stennert, E. Impact of functional endoscopic sinus surgery on symptoms and quality of life in chronic rhinosinusitis. Laryngoscope 2002, 112, 310–315. [Google Scholar] [CrossRef] [PubMed]
  3. Khalil, H.S.; Nunez, D.A. Functional endoscopic sinus surgery for chronic rhinosinusitis. Cochrane Database Syst. Rev. 2006, 19, CD004458. [Google Scholar] [CrossRef] [PubMed]
  4. Poetker, D.M.; Smith, T.L. Adult chronic rhinosinusitis: Surgical outcomes and the role of endoscopic sinus surgery. Curr. Opin. Otolaryngol. Head Neck Surg. 2007, 15, 6–9. [Google Scholar] [CrossRef] [PubMed]
  5. Smith, T.L.; Litvack, J.R.; Hwang, P.H.; Loehrl, T.A.; Mace, J.C.; Fong, K.J.; James, K.E. Determinants of outcomes of sinus surgery: A multi-institutional prospective cohort study. Otolaryngol. Head Neck Surg. 2010, 142, 55–63. [Google Scholar] [CrossRef] [Green Version]
  6. Barbieri, D.; Capparè, P.; Gastaldi, G.; Trimarchi, M. Ectopic tooth involving the orbital floor and infraorbital nerve. J. Osseointegr. 2017, 9, 323–325. [Google Scholar]
  7. Trimarchi, M.; Galli, A.; Capparè, P.; Dababou, S.; Vinci, R.; Bussi, M.; Gherlone, E. Odontogenic infections in the head and neck: A case series. J. Osseointegr. 2019, 11, 29–37. [Google Scholar]
  8. Bruschi, G.B.; Crespi, R.; Capparè, P.; Gherlone, E. Transcrestal sinus floor elevation: A retrospective study of 46 patients up to 16 years. Clin. Implant Dent. Relat. Res. 2012, 14, 759–767. [Google Scholar] [CrossRef]
  9. Crespi, R.; Capparè, P.; Gherlone, E. Osteotome sinus floor elevation and simultaneous implant placement in grafted biomaterial sockets: 3 years of follow-up. J. Periodontol. 2010, 81, 344–349. [Google Scholar] [CrossRef]
  10. Bruschi, G.B.; Crespi, R.; Capparè, P.; Bravi, F.; Bruschi, E.; Gherlone, E. Localized management of sinus floor technique for implant placement in fresh molar sockets. Clin. Implant Dent. Relat. Res. 2013, 15, 243–250. [Google Scholar] [CrossRef]
  11. Crespi, R.; Capparè, P.; Gherlone, E. Sinus floor elevation by osteotome: Hand mallet versus electric mallet. A prospective clinical study. Int. J. Oral Maxillofac. Implants 2012, 27, 1144–1150. [Google Scholar] [PubMed]
  12. Ramadan, H.H. Surgical causes of failure in endoscopic sinus surgery. Laryngoscope 1999, 109, 27–29. [Google Scholar] [CrossRef] [PubMed]
  13. Musy, P.Y.; Kountakis, S.E. Anatomic findings in patients undergoing revision endoscopic sinus surgery. Am. J. Otolaryngol. 2004, 25, 418–422. [Google Scholar] [CrossRef] [PubMed]
  14. Henriquez, O.A.; Schlosser, R.J.; Mace, J.C.; Smith, T.L.; Soler, Z.M. Impact of synechiae after endoscopic sinus surgery on long-term outcomes in chronic rhinosinusitis. Laryngoscope 2013, 123, 2615–2619. [Google Scholar] [CrossRef] [Green Version]
  15. Konstantinidis, I.; Tsakiropoulou, E.; Vital, I.; Triaridis, S.; Vital, V.; Constantinidis, J. Intra- and postoperative application of Mitomycin C in the middle meatus reduces adhesions and antrostomy stenosis after FESS. Rhinology 2008, 46, 107–111. [Google Scholar]
  16. Anand, V.K.; Tabaee, A.; Kacker, A.; Newman, J.G.; Huang, C. The role of mitomycin C in preventing synechia and stenosis after endoscopic sinus surgery. Am. J. Rhinol. 2004, 18, 311–314. [Google Scholar] [CrossRef]
  17. Fang, K.M.; Wang, C.T.; Chen, Y.W.; Huang, T.W. Reduction of adhesions and antrostomy stenosis with topical vitamin A after endoscopic sinus surgery. Am. J. Rhinol. Allergy 2015, 29, 430–434. [Google Scholar] [CrossRef]
  18. Canadian Agency for Drugs and Technologies in Health. Cryotherapy Systems for Wart Removal: A Review of the Clinical Effectiveness, Cost-effectiveness, and Guidelines; CADTH Rapid Response Reports; Canadian Agency for Drugs and Technologies in Health: Ottawa, ON, Canada, 2014.
  19. Baust, J.G.; Gage, A.A. Progress toward optimization of cryosurgery. Technol. Cancer Res. Treat. 2004, 3, 95–101. [Google Scholar] [CrossRef] [Green Version]
  20. Johnston, M.H.; Eastone, J.A.; Horwhat, J.D.; Cartledge, J.; Mathews, J.S.; Foggy, J.R. Cryoablation of Barrett’s esophagus: A pilot study. Gastrointest. Endosc. 2005, 62, 842–848. [Google Scholar] [CrossRef]
  21. Patel, V.; Burbridge, R.A. Endoscopic approaches for early-stage esophageal cancer: Current options. Curr. Oncol. Rep. 2015, 17, 421. [Google Scholar] [CrossRef] [Green Version]
  22. Fernando, H.C.; Dekeratry, D.; Downie, G.; Finley, D.; Sullivan, V.; Sarkar, S.; Rivas, R., Jr.; Santos, R.S. Feasibility of spray cryotherapy and balloon dilation for non-malignant strictures of the airway. Eur. J. Cardiothorac. Surg. 2011, 40, 1177–1180. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  23. Krimsky, W.S.; Broussard, J.N.; Sarkar, S.A.; Harley, D.P. Bronchoscopic spray cryotherapy: Assessment of safety and depth of airway injury. J. Thorac. Cardiovasc. Surg. 2010, 139, 781–782. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Krimsky, W.S.; Rodrigues, M.; Sarkar, S.A. Spray cryotherapy for the treatment of glottic and subglottic stenosis. Laryngoscope 2010, 120, 473–477. [Google Scholar] [CrossRef] [PubMed]
  25. Albu, S.; Trombitas, V.; Vlad, D.; Emanuelli, E. The influence of spray cryotherapy on wound healing following endoscopic sinus surgery in chronic rhinosinusitis. Laryngoscope 2016, 126, 25–32. [Google Scholar] [CrossRef]
  26. Lund, V.J.; Mackay, I.S. Staging in rhinosinusitis. Rhinology 1993, 31, 183–184. [Google Scholar] [CrossRef]
  27. Wormald, P.J.; Boustred, R.N.; Le, T.; Hawke, L.; Sacks, R. A prospective single-blind randomized controlled study of use of hyaluronic acid nasal packs in patients after endoscopic sinus surgery. Am. J. Rhinol. 2006, 20, 7–10. [Google Scholar] [CrossRef]
  28. Kennedy, D.W. Functional endoscopic sinus surgery. Tech. Arch. Otolaryngol. 1985, 111, 643–649. [Google Scholar] [CrossRef]
  29. Albu, S.; Tomescu, E. Small and large middle meatus antrostomies in the treatment of chronic maxillary sinusitis. Otolaryngol. Head Neck Surg. 2004, 131, 542–547. [Google Scholar] [CrossRef]
  30. Reh, D.D.; Higgins, T.S.; Smith, T.L. Impact of tobacco smoke on chronic rhinosinusitis: A review of the literature. Int. Forum Allergy Rhinol. 2012, 2, 362–369. [Google Scholar] [CrossRef]
  31. Rudmik, L.; Mace, J.C.; Smith, T.L. Smoking and endoscopic sinus surgery: Does smoking volume contribute to clinical outcome. Int. Forum Allergy Rhinol. 2011, 1, 145–152. [Google Scholar] [CrossRef]
  32. Christensen, D.N.; Franks, Z.G.; McCrary, H.C.; Saleh, A.A.; Chang, E.H. A Systematic Review of the Association between Cigarette Smoke Exposure and Chronic Rhinosinusitis. Otolaryngol. Head Neck Surg. 2018, 158, 801–816. [Google Scholar] [CrossRef] [PubMed]
  33. Preis Sella, G.C.; Tamashiro, E.; Sella, J.A.; Aragon, D.C.; de Mendonça, T.N.; de Paula Arruda, L.K.; Lima, W.T.A.; Valera, F.C.A. Asthma is the dominant factor for recurrence in Chronic Rhinosinusitis. J. Allergy Clin. Immunol. Pract. 2019. [Google Scholar] [CrossRef]
  34. Van Crombruggen, K.; Zhang, N.; Gevaert, P.; Tomassen, P.; Bachert, C. Pathogenesis of chronic rhinosinusitis: Inflammation. J. Allergy Clin. Immunol. 2011, 128, 728–732. [Google Scholar] [CrossRef] [PubMed]
  35. Sziksz, E.; Pap, D.; Lippai, R.; Béres, N.J.; Fekete, A.; Szabó, A.J.; Vannay, Á. Fibrosis Related Inflammatory Mediators: Role of the IL-10 Cytokine Family. Med. Inflamm. 2015, 2015, 764641. [Google Scholar] [CrossRef]
  36. Gong, D.; Shi, W.; Yi, S.J.; Chen, H.; Groffen, J.; Heisterkamp, N. TGFβ signaling plays a critical role in promoting alternative macrophage activation. BMC Immunol. 2012, 13, 31. [Google Scholar] [CrossRef] [Green Version]
  37. Bizaki, A.J.; Numminen, J.; Taulu, R.; Kholova, I.; Rautiainen, M. Treatment of rhinosinusitis and histopathology of nasal mucosa: A controlled, randomized, clinical study. Laryngoscope 2016, 126, 2652–2658. [Google Scholar] [CrossRef]
  38. Soler, Z.M.; Sauer, D.A.; Mace, J.; Smith, T.L. Relationship between clinical measures and histopathologic findings in chronic rhinosinusitis. Otolaryngol. Head Neck Surg. 2009, 141, 454–461. [Google Scholar] [CrossRef] [Green Version]
  39. Neil, B. Histopathological inflammation and symptom outcomes after endoscopic sinus surgery. Int. Forum Allergy Rhinol. 2011, 1, 13–17. [Google Scholar]
  40. Singhal, D.; Psaltis, A.J.; Foreman, A.; Wormald, P.J. The impact of biofilms on outcomes after endoscopic sinus surgery. Am. J. Rhinol. Allergy 2010, 24, 169–174. [Google Scholar] [CrossRef]
  41. Singhal, D.; Foreman, A.; Jervis-Bardy, J.; Wormald, P.J. Staphylococcus aureus biofilms: Nemesis of endoscopic sinus surgery. Laryngoscope 2011, 121, 1578–1583. [Google Scholar] [CrossRef]
  42. Vlad, D.; Dutu, A.; Apostol, A.; Trombitas, V.; Mihalca, A.; Albu, S. The Effect of Spray Cryotherapy on Microbial Biofilms in Chronic Rhinosinusitis. Curr. Infect. Dis. Rep. 2018, 20, 41. [Google Scholar] [CrossRef] [PubMed]
  43. Myller, J.P.; Luukkainen, A.T.; Huhtala, H.S.; Torkkeli, T.V.; Rautiainen, M.E.; Toppila-Salmi, S.K. Satisfaction with maxillary sinus surgery might be influenced by risk factors. Allergy Rhinol. (Provid.) 2013, 4, e6–e12. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  44. Rezaeian, A. Outcome of spray cryotherapy plus functional endoscopic sinus surgery on management of healing in nasal polyposis. Am. J. Otolaryngol. 2018, 39, 10–13. [Google Scholar] [CrossRef] [PubMed]
Jcm 09 00088 g001 550
Figure 1. (A) Device of spray cryotherapy. (B,C) Spray cryotherapy application.
Figure 1. (A) Device of spray cryotherapy. (B,C) Spray cryotherapy application.
Jcm 09 00088 g001
Jcm 09 00088 g002 550
Figure 2. AutoCAD evaluation of maxillary antrostomy.
Figure 2. AutoCAD evaluation of maxillary antrostomy.
Jcm 09 00088 g002
Jcm 09 00088 g003 550
Figure 3. Middle meatus antrostomy area—comparison between the two groups.
Figure 3. Middle meatus antrostomy area—comparison between the two groups.
Jcm 09 00088 g003
Jcm 09 00088 g004 550
Figure 4. Middle meatus antrostomy diameter—comparison between the two groups.
Figure 4. Middle meatus antrostomy diameter—comparison between the two groups.
Jcm 09 00088 g004
Jcm 09 00088 g005 550
Figure 5. ROC curve.
Figure 5. ROC curve.
Jcm 09 00088 g005
Jcm 09 00088 g006 550
Figure 6. The evolution of the middle meatus antrostomy. (A) Intraoperative endoscopic aspect. (B) Spray cryotherapy—second follow-up endoscopic aspect. (C) Control—second follow-up endoscopic aspect.
Figure 6. The evolution of the middle meatus antrostomy. (A) Intraoperative endoscopic aspect. (B) Spray cryotherapy—second follow-up endoscopic aspect. (C) Control—second follow-up endoscopic aspect.
Jcm 09 00088 g006
Jcm 09 00088 g007 550
Figure 7. The histological examination of mucosa from the margins of the maxillary antrostomy. Spray cryotherapy (SC) group: (A) Three months following cryotherapy: Edematous stroma, minimal inflammatory infiltrate, epithelial hyperplasia (Hematoxylin and Eosin stain, 10×). (B) Histological aspect at 12 months after SC: Collagen fibers in the corium, sero glandular mucous acini, and excretory ducts (Hematoxylin and Eosin stain, 10×). (C) Minimal fibrosis in the corium at 12 months after SC (Masson Thrichrome stain, 10×). Control group: (A1) Three months following surgery: mucosa with reactive alterations, edema, important inflammatory infiltrate (Hematoxylin and Eosin stain, 10×). (B1) Twelve months following surgery: Mucosa with moderate edema, fibrosis, and inflammatory infiltrate (Hematoxylin and Eosin stain, 10×). (C1) Twelve months following surgery: Fibrosis and important epithelial hyperplasia (Masson Thrichrome stain, 10×).
Figure 7. The histological examination of mucosa from the margins of the maxillary antrostomy. Spray cryotherapy (SC) group: (A) Three months following cryotherapy: Edematous stroma, minimal inflammatory infiltrate, epithelial hyperplasia (Hematoxylin and Eosin stain, 10×). (B) Histological aspect at 12 months after SC: Collagen fibers in the corium, sero glandular mucous acini, and excretory ducts (Hematoxylin and Eosin stain, 10×). (C) Minimal fibrosis in the corium at 12 months after SC (Masson Thrichrome stain, 10×). Control group: (A1) Three months following surgery: mucosa with reactive alterations, edema, important inflammatory infiltrate (Hematoxylin and Eosin stain, 10×). (B1) Twelve months following surgery: Mucosa with moderate edema, fibrosis, and inflammatory infiltrate (Hematoxylin and Eosin stain, 10×). (C1) Twelve months following surgery: Fibrosis and important epithelial hyperplasia (Masson Thrichrome stain, 10×).
Jcm 09 00088 g007
Table
Table 1. Inflammatory parameters used in the histological assessment [26].
Table 1. Inflammatory parameters used in the histological assessment [26].
ParameterGradeDescription
Mononuclear (inflammatory) cell infiltrate0Normal aspect: 0–10 cells/HPF
1Discrete inflammation: 11–30 cells/HPF
2Moderate inflammation: 31–50 cells/HPF
3Severe inflammation: >50 cells/ HPF
Edema0No edema
1Focal sub-epithelial edema
2Diffuse sub-epithelial edema
3Diffuse sub-epithelial and intraglandular edema
Cilia0Normal aspect
1Shortened cilia
2Dotted cilia disappearance
3Lack of cilia
Goblet cells0Normal aspect: 0 cells/HPF
1Discrete inflammation: 0–30 cells/HPF
2Moderate inflammation: 31–50 cells/HPF
3Severe inflammation: >50 cells/HPF
Fibrosis0No fibrosis
1Sub-epithelial fibrosis
2Sub-epithelial and interglandular fibrosis
3Diffuse fibrosis (sub-epithelial and interglandular) with compression atrophy of glands and capillaries
Epithelial hyperplasia0No epithelial hyperplasia
1Dotted hyperplasia
2Diffuse hyperplasia
Squamous metaplasia0No squamous metaplasia
1Immature squamous metaplasia/dotted
2Mature squamous metaplasia/diffuse
HPF = high-pass filter, 40×.
Table
Table 2. Area and diameter assessment in cryotherapy and control groups.
Table 2. Area and diameter assessment in cryotherapy and control groups.
Cryotherapy Side Control Sidep-Value
Student t-Test
Mean ± SD Mean ± SD
Area (cm2)0.658 ± 0.0998 0.638 ± 0.08720.456
Diameter (cm)0.755 ± 0.1393 0.707 ± 0.12910.173
Area—1st follow-up visit (cm2)0.578 ± 0.1025 0.401 ± 0.08040.000
Diameter—1st follow-up visit (cm)0.645 ± 0.1024 0.426 ± 0.08280.000
Area—2nd follow-up visit (cm2)0.605 ± 0.1891 0.399 ± 0.09760.000
Diameter—2nd follow-up visit (cm)0.624 ± 0.0961 0.415 ± 0.09350.000
1st follow-up visit—3 months following surgery; 2nd follow-up visit—12 months following surgery.
Table
Table 3. Receiver operating characteristic (ROC) curves for area and diameter.
Table 3. Receiver operating characteristic (ROC) curves for area and diameter.
Test Result Variable(s)AUC (p-Value)
Initial Area (cm2)0.581 (0.319)
Initial Diameter (cm)0.602 (0.207)
Area—1st follow-up visit (cm2)0.908 (0.000)
Diameter—1st follow-up visit (cm)0.967 (0.000)
Area—2nd follow-up visit (cm2)0.896 (0.000)
Diameter—2nd follow-up visit (cm)0.938 (0.000)
AUC—Area Under the Curve.
Table
Table 4. Histological scores in the two treatment groups.
Table 4. Histological scores in the two treatment groups.
VariableCryotherapyControlp-Value (Mann-Whitney U)
Fibrosis—intraoperative0 (1)0 (2)0.975
Fibrosis—1st follow-up visit2 (1)2 (0)0.541
Fibrosis—2nd follow-up visit2 (1)1 (1)0.092
Mononuclear (inflammatory) cell infiltrate—intraoperative3 (1)3 (1)0.838
Mononuclear (inflammatory) cell infiltrate—1st follow-up visit1(1)1.5 (1)0.003
Mononuclear (inflammatory) cell infiltrate—2nd follow-up visit0 (1)1 (0)0.000
Edema—intraoperative2 (0)2 (1)0.446
Edema—1st follow-up visit0.5 (1)1 (1)0.000
Edema—2nd follow-up visit0 (1)1 (1)0.040
Ciliated cells—intraoperative1 (0)1 (1)0.091
Ciliated cells—1st follow-up visit2 (1)1 (1)0.007
Ciliated cells—2nd follow-up visit2 (1)1 (1)0.000
Goblet cells—intraoperative1 (1)1 (1)0.055
Goblet cells—1st follow-up visit0 (1)1 (1)0.001
Goblet cells—2nd follow-up visit0 (0)1 (1)0.000
Epithelial hyperplasia—intraoperative2 (1)2 (1)0.273
Epithelial hyperplasia—1st follow-up visit1 (2)2 (1)0.030
Epithelial hyperplasia—2nd follow-up visit0 (1)1 (0)0.001
Squamous metaplasia—intraoperative1 (1)1 (1)0.937
Squamous metaplasia—1st follow-up visit1 (1)1 (1)0.082
Squamous metaplasia—2nd follow-up visit0 (1)1 (1)0.069
1st follow-up visit—3 months following surgery; 2nd follow-up visit—12 months following surgery.
Table
Table 5. The inflammatory parameter evolution in the SC group: Kendall’s correlation coefficient.
Table 5. The inflammatory parameter evolution in the SC group: Kendall’s correlation coefficient.
Histologic Parameter vs. Treatment GroupKendall’s Tau-bp-Value
Fibrosis—intraoperative−0.0040.975
Fibrosis—1st follow-up visit−0.0810.535
Fibrosis—2nd follow-up visit0.2210.072
Mononuclear (inflammatory) cell infiltrate—intraoperative0.0270.837
Mononuclear (inflammatory) cell infiltrate—1st follow-up visit−0.3910.000
Mononuclear (inflammatory) cell infiltrate—2nd follow-up visit−0.5100.000
Edema—intraoperative0.1020.438
Edema—1stfollow-up visit−0.5430.000
Edema—2nd follow-up visit−0.2790.033
Ciliated cells—intraoperative−0.2280.075
Ciliated cells—1st follow-up visit0.3580.002
Ciliated cells—2nd follow-up visit0.4880.000
Goblet cells—intraoperative−0.2620.030
Goblet cells—1st follow-up visit−0.4220.000
Goblet cells—2nd follow-up visit−0.5080.000
Epithelial hyperplasia—intraoperative−0.1440.260
Epithelial hyperplasia—1st follow-up visit−0.2840.019
Epithelial hyperplasia—2nd follow-up visit−0.4540.000
Squamous metaplasia—intraoperative−0.0110.937
Squamous metaplasia—1st follow-up visit−0.2320.065
Squamous metaplasia—2nd follow-up visit−0.2500.055
1st follow-up visit—3 months following surgery; 2nd follow-up visit—12 months following surgery.
Table
Table 6. Correlation between inflammatory histological parameters and size of the middle meatal antrostomy (Spearman correlation test).
Table 6. Correlation between inflammatory histological parameters and size of the middle meatal antrostomy (Spearman correlation test).
AreaDiameter
Inflammatory cell infiltrater = −0.402 p = 0.040r = −0.428 p = 0.029
Edemar = −0.457 p = 0.012r = −0.477 p = 0.003
Goblet cellsr = −0.437 p = 0.027r = −0.469 p = 0.006
Epithelial hyperplasiar = −0.475 p = 0.005r = −0.452 p = 0.031
r—correlation coefficient.
Table
Table 7. Correlation between inflammatory histological parameters (Spearman correlation test).
Table 7. Correlation between inflammatory histological parameters (Spearman correlation test).
EdemaEpithelial Hyperplasia
Inflammatory cell infiltrater = 0.410 p = 0.037r = 0.425 p = 0.030
Goblet cellsr = 0.440 p = 0.022r = 0.450 p = 0.012
r—correlation coefficient.
Table
Table 8. Subjective outcomes in cryotherapy and control groups.
Table 8. Subjective outcomes in cryotherapy and control groups.
Control SideCryotherapy Sidep-Value
Student t-Test
Mean ± SDMean ± SD
Obstruction7.53 ± 1.637.37 ± 1.720.36
Obstruction—2nd follow-up visit3.18 ± 0.891.78 ± 0.720.000
Discharge7.23 ± 1.657.10 ± 1.840.44
Discharge—2nd follow-up visit3.43 ± 0.591.76 ± 0.730.000
Facial pressure6.48 ± 1.726.51 ± 1.680.52
Facial pressure—2nd follow-up visit2.1 ± 0.842.0 ± 0.750.38
2nd follow-up visit—12 months following surgery.
Table
Table 9. Visual assessments in the preoperative and postoperative period.
Table 9. Visual assessments in the preoperative and postoperative period.
PreoperativePostoperative ControlPostoperative Cryotherapy
Periorbital painNoNoNo
Periorbital swellingNoNoNo
ProptosisNoNoNo
Globe displacementNoNoNo
Decreased ocular motilityNoNoNo
DiplopiaNoNoNo
Decreased color perceptionNoNoNo
Decreased visual acuityNoNoNo
Visual field lossNoNoNo

Share and Cite

MDPI and ACS Style

Trombitaș, V.; Zolog, A.; Toader, M.; Albu, S. Maxillary Antrostomy Patency Following Intraoperative Use of Spray Cryotherapy. J. Clin. Med. 2020, 9, 88. https://doi.org/10.3390/jcm9010088

AMA Style

Trombitaș V, Zolog A, Toader M, Albu S. Maxillary Antrostomy Patency Following Intraoperative Use of Spray Cryotherapy. Journal of Clinical Medicine. 2020; 9(1):88. https://doi.org/10.3390/jcm9010088

Chicago/Turabian Style

Trombitaș, Veronica, Adriana Zolog, Mioriţa Toader, and Silviu Albu. 2020. "Maxillary Antrostomy Patency Following Intraoperative Use of Spray Cryotherapy" Journal of Clinical Medicine 9, no. 1: 88. https://doi.org/10.3390/jcm9010088

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop