Next Article in Journal
Long-Term Impact of the COVID-19 Pandemic on In-Hospital Antibiotic Consumption and Antibiotic Resistance: A Time Series Analysis (2015–2021)
Next Article in Special Issue
Investigating Dual-Species Candida auris and Staphylococcal Biofilm Antiseptic Challenge
Previous Article in Journal
Heparin-Binding Protein (HBP), Neutrophil Gelatinase-Associated Lipocalin (NGAL) and S100 Calcium-Binding Protein B (S100B) Can Confirm Bacterial Meningitis and Inform Adequate Antibiotic Treatment
Previous Article in Special Issue
An In Vitro Evaluation of Denture Cleansing Regimens against a Polymicrobial Denture Biofilm Model
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Clinical Trial for Evaluating the Effectiveness and Safety of a New Dental Plaque Removal Device: Microscale Mist Unit

1
Division of Advanced Prosthetic Dentistry, Tohoku University Graduate School of Dentistry, 4-1 Seiryo-machi, Aoba-ku, Sendai 980-8575, Japan
2
Perioperative Oral Health Management, Tohoku University Graduate School of Dentistry, 4-1 Seiryo-machi, Aoba-ku, Sendai 980-8575, Japan
3
Department of Development Promotion, Clinical Research, Innovation and Education Center, Tohoku University Hospital, 1-1 Seiryo-machi, Aoba-ku, Sendai 980-8574, Japan
4
Department of Oral Health Promotion, Graduate School of Medical and Dental Sciences, Tokyo Medical and Dental University, 1-5-45 Yushima, Bunkyo-ku, Tokyo 113-8510, Japan
*
Author to whom correspondence should be addressed.
Antibiotics 2022, 11(6), 825; https://doi.org/10.3390/antibiotics11060825
Submission received: 11 May 2022 / Revised: 13 June 2022 / Accepted: 17 June 2022 / Published: 19 June 2022

Abstract

:
This study evaluates the effectiveness and safety of a microscale mist unit (MSM-UNIT) that sprays high-speed fine water droplets to remove dental plaque adhering to the oral mucosa (tongue and palate) and tooth surface. Fifteen patients who had difficulty self-managing sufficient oral care were included in this study. Effectiveness was evaluated for at least five patients’ tongues, palate mucosas, and tooth surfaces, and safety evaluation was conducted at all three sites for all patients. Effectiveness was evaluated using the rate of degree of dental plaque removal. Safety was evaluated using a numerical rating scale (NRS) for pain and symptoms of inflammation. An operator who performed treatment and an evaluator who evaluated effectiveness and safety were designated. In addition, an image judgment committee judged effectiveness. Although evaluation of the tongue varied between the evaluators and the image judgment committee, the rates of degree for all plaque removal increased in all regions. In addition, low pain NRS results and minimal symptoms of inflammation were observed and within an acceptable range. The MSM-UNIT can be used effectively and safely for removing oral plaque not only from teeth, but also from the oral mucosa.

1. Introduction

Dental plaque causes not only dental caries and periodontal disease, but also aspiration pneumonia, endocarditis, and fever [1,2]. The removal of dental plaque is reported to help prevent respiratory infections in older adults, who often require a long-term caregiver [3,4,5]. It is also reported to prevent postoperative infection of hospitalized patients, contributing to reduced hospitalization periods [6,7]. Therefore, dental plaque removal is important for both oral and general health. However, older adults who require long-term nursing care and hospitalized patients often do not have sufficient oral care, and a large amount of plaque is found to adhere to the tooth surface and oral mucosa. In particular, in bedridden older persons without oral intake who are receiving nursing care, oral membranous substances composed of inflammatory cells and bacteria are frequently observed [8,9,10]. These substances attach firmly to the oral mucosa. Plaque can be removed from the tooth surface using a toothbrush or from the oral mucosa with a sponge brush. As plaque removal using these devices is associated with a risk of aspiration pneumonia, a special technique is required that is a burden for caregivers. New methods for removing oral plaque were studied and shown to be effective, including a plasma jet [11], ultrasonic activated water [12,13], and a water jet [14]. However, the application of these devices is limited to the teeth, and there are no reports investigating the effect of these methods on the oral mucosa. Recently, air abrasion devices also became available for plaque removal [15,16,17,18,19,20], and it was recognized that their proper use will not result in harmful effects on the oral mucosa [21]. However, the use of these devices is also limited to the areas around the tooth surface and gums and requires trained skills. Moreover, because these devices require extraoral suction, they are difficult to use at the bedside. No devices have regulatory approval for removing dental plaque on the whole oral mucosa in Japan.
To overcome the problems of removing plaque film in these patients, we developed a technology for plaque removal by injecting a small amount of water droplets of average diameter (≤40 µm) that are turned into mist at high pressure (few MPa) and high speed (≥100 m/s), which we termed the “Microscale Mist Unit” (MSM-UNIT; Figure 1).
Using high-speed imaging, the plaque removal mechanism of the MSM-UNIT was verified; droplets with a high kinetic state removed the artificial plaque by pushing it aside. No harmful effects occurred because of the extremely low mass of the droplets [22]. In addition, an in vitro study demonstrated that there were no harmful effects on simulated mucosa or tooth surfaces, and the technique had the same effectiveness for plaque removal as air abrasion devices [23]. Our clinical studies (registration number: UMIN000026097, date of first registration: 16 February 2017, and registration number: UMIN000031232, date of first registration: 13 February 2018) using prototype devices confirmed the safety and effectiveness of plaque removal from the palatal mucosa and tooth surface. However, the in vitro study was not a complete nonclinical model, and prior clinical studies were conducted on only a limited number of patients and conditions. To obtain regulatory approval, additional clinical studies are needed.
Therefore, the purpose of this study is to evaluate the clinical effectiveness and safety of plaque removal using the MSM-UNIT not only on teeth, but also on the oral mucosa, and to obtain data for regulatory approval.

2. Results

This study was conducted from March 2019 to August 2019. The submission of this research was delayed because a new patent application was under process for the MSN-UNIT following the clinical trial. Written informed consent was obtained from all 17 patients, and 15 patients were enrolled. An evaluation of effectiveness was performed for 7 patients on the tooth surface (mean age 65.7 ± 7.9 years), 6 patients on the palate (mean age 72.0 ± 6.4 years), and 12 patients on the tongue (mean age 62.3 ± 12.1 years; see Table 1 and Figure 2).

2.1. Effectiveness

Figure 3 and Figure 4 show examples of the application of the MSM-UNIT.

2.2. Plaque Removal Rate by O’Leary’s PCR

The mean PCR before treatment with the MSM-UNIT was 72.3% (48.45−96.15%), whereas after treatment it was 4.08% (-3.07–11.14%). The mean removal rate of PCR was 68.22% (48.07–88.36%; Table 2).

2.3. Rate of Degree of Plaque Removal (Palate and Tongue)

The removal rate of the palate plaque with an adherence degree of “1 or less” (“none” (0) or “low” (1)) after treatment was 100.0% (47.8–100.0%) at any evaluation. However, the rate for tongue plaque with an adherence degree of “1 or less” after treatment was 41.7% (15.2−72.3%). This changed to 25.0% at 1 day after treatment and 33.3% at 1 week after treatment (Table 3).
The evaluation of the degree of plaque adhesion on the palate was consistent between evaluators and the image evaluation committee. However, the committee evaluated the degree of tongue plaque adhesion to be higher than the evaluators did.

2.4. Plaque Removal Rate by Binarization

The removal rate by binarization was 80.47% for the tooth surface and 96.3% for the palate (Table 4).

2.5. Plaque Removal Time (Teeth, Palate and Tongue)

The plaque removal times for the surface of the tooth, palate, and tongue were 163.3 ± 26.8 s, 58.2 ± 30.3 s, and 65.0 ± 51.2 s, respectively (Table 5).

2.6. Questionnaire Survey for MSM-UNIT Treatment

Of the patients tested, when comparing the MSM-UNIT with other treatment methods, 80% reported in the survey that they were “satisfied” or “slightly satisfied.” In addition, 100% of patients provided a rating higher than “average.” Additionally, 80% of patients reported on the survey that they were “satisfied” or “slightly satisfied” with the comfort provided by MSM-UNIT-based treatment, and 93.3% patients provided a rating higher than “average”. In the survey regarding pain and irritation during treatment, 26.7% patients reported that they suffered pain and irritation, although the pain and irritation were considered tolerable (Table 6).

2.7. Safety Evaluation

Four patients experienced spontaneous pain in the teeth and gingiva on day 0 (after the final injection), with a mean spontaneous pain NRS score of 0.3 ± 0.5 (maximum value: 1). Two patients experienced spontaneous pain on day 1, with a mean score of 0.1 ± 0.4 (maximum value: 1). In contrast, one patient had spontaneous pain in the palate on day 0, with a mean score of 0.1 ± 0.5 (maximum value: 2). One patient also had spontaneous pain in the tongue on day 0, with a mean score 0.1 ± 0.3 (maximum value: 1). The day after treatment, two patients experienced spontaneous pain in the tooth and gums, with a mean of 0.1 ± 0.4 (Table 7).
An increase in GI score was observed in two patients on day 0 after treatment. In addition, two patients experienced an adverse event of palate bleeding on day 0 after treatment. There were no adverse events on days 1 or 7.

3. Discussion

In this clinical trial, the MSM-UNIT demonstrated sufficient effectiveness and safety for plaque removal, not only from the tooth surface, but also from the oral mucosa.
O’Leary’s PCR method is commonly used in Japan to evaluate dental plaque on the tooth surface, and it was considered appropriate to adopt this technique for our research because it is consistent with our clinical situation and the plaque evaluation method used in this study. Few reports are published regarding plaque removal in soft tissues, and few researchers evaluated the removal effectiveness. However, in these previous studies, the effect was assessed using only subjective methods such as macroscopic evaluation. Therefore, for objective evaluation, we performed binarization on the tooth surface and palate, and all cases were judged based on an image evaluation committee as a third-party image. Therefore, we consider the method that we used in the present study to be comparatively equivalent or more objective than those used in other studies. As O’Leary’s PCR is widely used in Japan, we investigated the effectiveness of the MSM-UNIT on the teeth in terms of plaque reduction rate. Kinoshita et al. reported that gingival health can be maintained when O’Leary’s PCR was 20% or less, which is a guideline for oral hygiene evaluation [22]. In all subjects, we observed that the PCR was less than 20% within 3 min of using the MSM-UNIT. Our experimental results matched those of our previous clinical studies and nonclinical evaluations [23] and fully demonstrated the expected performance. With regard to the conventional method of cleaning teeth using a toothbrush, Conn et al. reported that O’Leary’s PCR removal rate for a dental hygienist student was approximately 30% [24]. Furthermore, Yonenaga et al. showed that the removal rate of PCR after 3 min using a wet sheet was 10%, and 8% using a sponge brush [25]. Nobre et al. showed that an electric toothbrush can remove 50.24% of plaque in older adults [26]. Therefore, because the removal rate of PCR by the MSM-UNIT was 68.22%, the MSM-UNIT can be considered to be more effective than conventional methods.
There are many reports regarding the effectiveness of oral cleaning devices for plaque removal. However, the evaluation methods are literature specific, and there is no consensus in particular on dental plaque on the oral mucosa. There are currently no medical devices intended for plaque removal on the oral mucosa, such as the palate and tongue. Therefore, this study did not have a control group, and we used a new evaluation method incorporating visual effectiveness. Removal of plaque from the oral mucosa is important for both patients in nursing homes and hospitalized patients. Yonezawa et al. reported that using a sponge brush for oral plaque removal on the oral mucosa decreased the amount of Candida albicans [27]. Yadav et al. showed that the number of bacteria on the oral mucosa was reduced by gargling chlorhexidine [28]. Tashiro et al. also reported that bacteria in the pharynx were reduced by wiping the oral mucous with a sponge brush soaked in chlorhexidine [29]. Furthermore, Nishiyama et al. showed that professional care for 20 min once per week, including mucosa and tongue cleaning, reduces the amount of mutans streptocci and Candida species [30]. In this study, the percentage of patients who had a degree of plaque adherence of “1 or less” (“none” [0] or “low” [1]) on the palate after treatment was 100.0% at any time during the evaluation, and the removal rate of binarization was 96.3% at the palate. The judgments of both the evaluators and the image evaluation committee were almost the same. Therefore, the evaluation method was reliable and suggested that the MSM-UNIT was useful and effective for removing plaque from the palate.
In contrast, the effectiveness results for the tongue did not match the expected performance. There was a discrepancy in the ratings between the evaluators and the image evaluation committee, in which the committee rated the degree of linguistic plaque adhesion higher than the evaluators did. In many cases, in order to avoid a vomiting reflex, the operator did not spray near the base of tongue. The evaluators evaluated only the area where the mist was sprayed, whereas the image evaluation committee evaluated the whole area of the tongue. This difference in evaluation area was considered to cause the discrepancy in results, indicating that the evaluation method needed to be specified in more detail. It is known that in conventional methods that apply tools for the mechanical removal of plaque, removing the tongue coating is associated not only with reduced inflammation, but also a reduction in bad breath [31,32,33]. Some studies show that chlorhexidine is useful for reducing bacteria on the oral mucosa [27,34,35]. In addition, a previous study reported that plaque removal from the tongue is effective for those on a ventilator and reduces the burden on caregivers [36]. As the evaluation methods used for plaque removal from the tongue are also literature specific, it was judged visually in this study, similar to other studies. The evaluation method in this study was also considered to be more reliable, as it included not only an evaluator, but also the image evaluation committee as a third party. The results from the sprayed areas on the tongue suggest that the method is effective for plaque removal. In addition, Berbe et al. found that the total oral care time for nursing home residents was 37 min, in which cleaning alone took 7.4 min and oral care, including the mucosa and tongue, took 20 min [37]. As a result of the MSM-UNIT requiring a shorter time to remove plaque, it is considered not only to be effective for patients at home, but also for reducing the burden on nursing home operators. Additionally, the MSM-UNIT is operated with a handpiece and a foot pedal and can be used without stress because dental workers are familiar with using this type of equipment. Therefore, the training time required to use the MSM-UNIT is considered the same as that required for conventional techniques, such as chlorhexidine swabs. In particular, our questionnaire survey showed that patients were more satisfied with the MSM-UNIT than they were with conventional methods. Although the cost of introducing and maintaining the MSM-UNIT is higher than that of swabs, the usage time (as mentioned above) is relatively low. This is a sufficient benefit for not only operators, but also for patients. Additionally, the primary feature of the MSM-UNIT is the removal of plaque using only a small amount of water. Thus, costs can be reduced because other chemicals or toothpastes are not re-quired. Therefore, given the cost/benefits of the MSM-UNIT, we consider it to be of equal or superior value to conventional techniques.
Although five adverse events were observed, these were grade 1 events with no treatment required. The most frequent adverse event was gingivitis (13.3%). The area of gingivitis was limited, and for this reason it was evaluated as “unrelated” to the MSM-UNIT. Occurrences of gingival pain (6.7%), tongue bleeding (6.7%), and oral bleeding (6.7%) were evaluated as “related” to the MSM-UNIT; however, these adverse events were transient and resulted in no clinical problems. The questionnaire survey revealed that pain and irritation were tolerable and NRS was 2 at maximum; thus, there were no clinical problems with pain.
In addition, the results were considered to be within a sufficiently acceptable range compared with the adverse events of chlorhexidine, which includes allergies, soreness, irritation, mild desquamation, and mucosal ulceration/erosions [38]. Therefore, the risk of using the device was considered to be less than that associated with conventional oral care. As there were no symptoms the next day or one week later, it is considered that treatment with the MSM-UNIT can be safely performed on the palate and tongue once a week.
Oil pulling and swabs are traditionally used for oral hygiene. No harmful effects or improvement in oral health were reported with these methods [39]. Recently, pro- and para-probiotics were tested for use in for oral hygiene, and studies report the effectiveness and safety of these oral care methods [40,41]. Although the most important type of oral healthcare is self-care, this is difficult for patients with serious medical conditions, such as those who are bedridden or have dementia. Therefore, a method of plaque removal performed by a dental worker is also needed, and the demand for this type of technique is expected to increase as the population of older people increases. The primary feature of the MSM-UNIT is the removal of plaque using only a small amount of water, thereby reducing costs due to the absence of other chemicals or toothpastes. Moreover, the method is also simpler and safer than other conventional techniques. Additionally, the MSM-UNIT can remove oral plaque easily and safely, and it may prevent aspiration pneumonia in elderly people and those in nursing homes and hospitals. The handpiece of the MSM-UNIT can be sterilized, and its other parts can be disinfected with alcohol; thus, the possibility of cross-infection with other patients is extremely low. However, the handpiece must be replaced for each patient, which is costly. Additionally, the device requires a small amount of water, and its use causes aerosol release; thus, its application might be limited because of the need for suction. To evaluate the preventive effect of aspiration pneumonia, another study should be conducted to observe the long-term prognosis using the MSM-UNIT.

4. Materials and Methods

Before starting this study, we obtained protocol consultations from the Pharmaceutical and Medical Device Agency (PMDA), a regulatory authority in Japan, and clinical trial notifications. In those consultations, it was observed that the use of the device is simple, usage methods across medical institutions have almost no influence on the results of effectiveness and safety, and it was considered not to affect the evaluation. Additionally, a split-mouse design is difficult because features of the mist can be removed and the effect might be exerted beyond the set area. Self-care is not appropriate in a control group setting because the device is used by an operator, and there is a high possibility that the subject will be biased because of changes in motivation due to study participation. In addition, in Japan, no devices have clinical approval for removing oral plaque on the whole oral mucosa. This clinical trial was conducted to obtain clinical approval for the MSM-UNIT in Japan. Therefore, from the perspective of regulatory science, using devices that are not approved in Japan in the comparison group was judged to be inappropriate due to uncertainty in term of effectiveness and safety. Additionally, the procedures used in conventional methods that use a toothbrush, tongue scraper, or sponge brush are difficult to standardize because of operator dependence. As such, it is difficult to set a control group, there is a high possibility that the control group will be biased, and before-and-after treatment comparisons within the same subject are preferable for evaluating the device’s effectiveness and safety. Therefore, this study was designed as a single-arm, open-label, single-center, within-subject clinical trial in accordance with consultation with the PMDA.
The protocol of this study was approved by the Tohoku University Hospital Institutional Review Board (reference No. 183004) in accordance with the Declaration of Helsinki. This study was consistent with the Good Clinical Practice (GCP) guideline. In addition, this study was registered on the University Hospital Medical Information Network (UMIN). The registration number was UMIN000035950 (date of first registration: 01 March 2019, https://center6.umin.ac.jp/cgi-bin/ctr/ctr_view_reg.cgi?recptno=R000040945, accessed on 21 March 2022). Inclusion criteria were as follows: (1) patient age greater than 20 years; (2) patient signed a written consent form; (3) the case was evaluated for effectiveness on the tooth surface, with the presence of at least 5 remaining teeth in one jaw and at least 10 remaining teeth in both jaws, except for the third molar; and (4) the patient was judged to have significant plaque on the tongue, palatal mucosa, tooth surface, or at least two of these sites.
The exclusion criteria of patients were as follows: (1) the case was evaluated for efficacy on the tooth surface and for the presence of malocclusion; (2) extensive tooth restoration was required during the study period; (3) presence of at least 6 mm probing pocket depth and bleeding on probing periodontitis in more than half of the teeth; (4) presence of grade 3 Miller classification of tooth mobility; (5) presence of moderate hypersensitivity; (6) presence of malignant tumor, leukoplakia, lichen planus, oral candida, tongue pain, or other diseases judged by the dentist as affecting the evaluation; (7) presence of acute inflammation; (8) the patient was unable to stop taking analgesic drugs 24 h before the start of the evaluation; (9) participation in another clinical trial; (10) presence of a severe vomiting reflex; and (11) history of aspiration pneumonia.
Fifteen patients were included in this study. The effectiveness was evaluated in at least five patients’ tongues, palate mucosas, and tooth surfaces; two or more sites were evaluated in some patients. The safety evaluation was conducted at all three sites for all patients. The primary objective of this trial was to obtain regulatory approval. Therefore, in consultation with the PMDA, we set the patients with palate-attached plaque as the worst case from a regulatory science perspective. Effectiveness and safety could be evaluated by macroscopic evaluation if at least five patients were included. Through a similar approach, effectiveness and safety could be evaluated if at least five patients were included in other parts. Therefore, the minimum sample size needed to obtain regulatory approval was fifteen patients.

Treatment Protocol

Application of the MSM-UNIT

Spray conditions were set with a water flow rate of 10 mL/min and an air pressure of 0.2 MPa. The tip of the handpiece was positioned at least 6 mm above the target and moved for 60 s so that it did not spray a single site for more than 2 s.
To eliminate bias as much as possible during the evaluation period in this clinical trial, we designated an operator who performed treatment using the MSM-UNIT and an evaluator who evaluated effectiveness and safety. The operator and evaluator were different people and did not change their role during the clinical trial period. Although the operator sprayed all parts of the tongue, palate, and tooth surface, only areas rated for a plaque adhesion degree of more than “high” were included for evaluation of effectiveness. Domains that were not evaluated for effectiveness were treated for safety evaluation. The degree of plaque adhesion was judged as “very high” (3), “high” (2), “low” (1), and “none” (0), with reference to the judgment sample (Figure 5).
Figure 6 presents a chart of the treatment flow. The treatment was conducted in sequence of the tongue, palate, and tooth surface. The treatment was stopped at the point at which the degree of plaque adhesion was rated as “none” (0) or <20% of O’Leary’s plaque control record (PCR) [42,43] within 60 s. The treatment was performed up to three times until the degree of adhesion was rated as “none” (0) or <20% of the PCR (the total treatment time was as long as 180 s). Safety evaluation domains were treated for 60 s. Palate and teeth were stained before treatment using Plaque Check Gel BR (GC). The safety assessment was conducted 1 day after (day 1) and 1 week after (day 7) the treatment.

5. Analysis

5.1. Analysis of Effectiveness Evaluation

The evaluators judged the scores by comparing sample photographs. In addition, a member of the image judgment committee evaluated whether the evaluators’ judgment was appropriate. Members of the committee had no conflicts of interest with this trial.
Multiple primary endpoints were set in the study. As a single endpoint did not provide an overall treatment effect, this trial was characterized by assessing treatment effects over multiple dimensions.

5.2. Plaque Removal Rate by O’Leary’s PCR (Teeth)

We calculated the summary statistics of the PCR and the rate of changes before and after removal (number of instances, mean, 95% confidence interval for mean, standard deviation).

5.3. Rate for Degree of Plaque Removal (Palate and Tongue)

We calculated the percentage of plaque adherence degree for “low” (1) or less (“low” (1) or “none” (0)) and 95% confidence interval of the percentage.

5.4. Plaque Removal Rate by Binarization

We analyzed images of the teeth and palate that had “high” (2) or higher plaque adhesion at the time of eligibility confirmation. The validity of the cleaning rate was preanalyzed by the image judgment committee using Adobe Photoshop CC. Fixed teeth were excluded from the analysis because they are difficult to binarize. The region of interest (ROI) was set for natural teeth, which can be confirmed for front, left-side, and right-side views. The ROI area (pixel value), plaque adherence area (pixel value), and cleanup rate were set after calibration. Summary statistics of the removal rate and calibrated removal rate for the plaque adherence area were calculated (number of instances, mean, 95% confidence interval for mean, and standard deviation).

5.5. Plaque Removal Time (Teeth, Palate and Tongue)

Summary statistics were computed for the time taken to remove all plaque from the tongue and palate and PCRs less than 20% on tooth surface.

6. Subject Satisfaction with MSM-UNIT Treatment

To compare the MSM-UNIT with other treatment methods, we administered a questionnaire survey to the subjects regarding their satisfaction with both treatment and comfort, which they rated according to five grades (“dissatisfied”, “slightly dissatisfied”, “average”, “slightly satisfied”, and “satisfied”). Additionally, a survey regarding pain and irritation during the treatment was administered. Subjects recorded the presence or absence of pain, and in the event of pain, the site and degree were rated according to four grades (“tolerable”, “tolerable within 3 min”, “tolerable within 1 min”, and” intolerable”).

Safety Assessment

The summary statistics of spontaneous pain of the teeth, gums, palate and tongue according to the numerical rating scale (NRS) were calculated. A frequency aggregation of changes in the gingival index (GI) and inflammation symptoms was also performed. Adverse events were also recorded.

7. Conclusions

The results of this study show that the MSM-UNIT device can be used to effectively and safely remove plaque from the tooth surface and oral mucosa (palate). With regard to the tongue, despite the discrepancy between the judgments of evaluators and the image judgment committee, the device was considered to be effective because of the overall reduction in plaque. Therefore, the MSM-UNIT can be used in whole oral care to effectively and safely remove plaque.

Author Contributions

Conceptualization, H.H., R.T., K.I. (Kuniyuki Izumita), C.K., M.S., A.T., T.S., K.A., K.I. (Koji Ikeda), and K.S. (Keiichi Sasaki); methodology, H.H., K.I. (Kuniyuki Izumita), R.T., M.I., T.S. (Tomoya Sato), K.S. (Kenta Shobara), Y.S., and T.H.; software, H.H., K.I. (Kuniyuki Izumita), and K.S. (Keiichi Sasaki); validation, H.H., R.T., K.I. (Kuniyuki Izumita), C.K., M.S., A.T., T.S. (Tomoko Sugawara), K.A., K.I., and K.S. (Keiichi Sasaki); formal analysis, H.H. and J.A.; investigation, H.H., K.I. (Kuniyuki Izumita), R.T., M.I., T.S. (Tomoya Sato), K.S. (Kenta Shobara), Y.S., and T.H.; resources, C.K., M.S., A.T., T.S. (Tomoko Sugawara), K.A., K.I. (Koji Ikeda), and K.S. (Keiichi Sasaki); data curation, H.H., K.I. (Kuniyuki Izumita), R.T., M.I., T.S. (Tomoya Sato), K.S. (Kenta Shobara), Y.S., and T.H.; writing—original draft preparation, H.H. and R.T.; writing—review and editing, H.H., J.A., K.I. (Koji Ikeda), and K.S. (Keiichi Sasaki); visualization, H.H., R.T., K.I. (Kuniyuki Izumita), C.K., M.S., A.T., T.S. (Tomoko Sugawara), K.A., and K.I. (Keiichi Sasaki); supervision, K.I. (Koji Ikeda) and K.S. (Keiichi Sasaki); project administration, H.H., C.K., M.S., A.T., T.S. (Tomoko Sugawara), and K.A.; funding acquisition, H.H. and K.S. (Keiichi Sasaki) All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by the Japan Agency for Medical Research and Development (AMED) Grant Number JP 19he1302008, J. MORITA MFG. CORP (Kyoto, Japan), and the Japan Society for the Promotion of Science (JSPS) Grants-in-Aid for Scientific Research <KAKENHI> Grant Number JP 20K10027.

Institutional Review Board Statement

This study was conducted according to the guidelines of the Declaration of Helsinki and approved by Tohoku University Hospital Institutional Review Board (reference No. 183004, date of approval: 21 December 2018). This study was consistent with the Good Clinical Practice (GCP) guideline. In addition, this study was registered in the University Hospital Medical Information Network (UMIN). The registration number was UMIN000035950 (date of first registration: 01 March 2019).

Informed Consent Statement

Written informed consent was obtained from all patients for participation in this study and for publication of identifying information/images.

Data Availability Statement

Restrictions apply to the availability of these data. Data were obtained from J. MORITA MFG. CORP and AMED, and are available from the authors upon reasonable request and with the permission of J. MORITA MFG. CORP and AMED.

Acknowledgments

We are deeply grateful to S. Maruyama (National Institute of Technology, Hachinohe College), Y. Iga, J. Ishimoto, M. Ohta, T. Sato, J. Okajima, S. Uehara, and S. Moriya (Institute of Fluid Science, Tohoku University) for in vivo research and helpful discussions, and to Ryuji Nakamura (Inter Scientific Research Co., Ltd.) for statistical assistance.

Conflicts of Interest

The MSM-UNIT was provided by J. MORITA MFG. CORP in accordance with a joint research contract with Tohoku University.

Sample Availability

Samples of the compounds are available from the authors.

References

  1. Hua, F.; Xie, H.; Worthington, H.V.; Furness, S.; Zhang, Q.; Li, C. Oral hygiene care for critically ill patients to prevent ventilator-associated pneumonia. Cochrane Database Syst. Rev. 2016, 10, CD008367. [Google Scholar] [CrossRef] [PubMed]
  2. Sjögren, P.; Wårdh, I.; Zimmerman, M.; Almståhl, A.; Wikström, M. Oral care and mortality in older adults with pneumonia in hospitals or nursing homes: Systematic review and meta-analysis. J. Am. Geriatr. Soc. 2016, 64, 2109–2115. [Google Scholar] [CrossRef] [PubMed]
  3. Yoneyama, T.; Yoshida, M.; Ohrui, T.; Mukaiyama, H.; Okamoto, H.; Hoshiba, K.; Ihara, S.; Yanagisawa, S.; Ariumi, S.; Morita, T.; et al. lOral care reduces pneumonia in older patients in nursing homes. J. Am. Geriatr. Soc. 2002, 50, 430–433. [Google Scholar] [CrossRef] [PubMed]
  4. Shigeishi, H.; Ohta, K.; Fujimoto, S.; Nakagawa, T.; Mizuta, K.; Ono, S.; Shimasue, H.; Ninomiya, Y.; Higashikawa, K.; Tada, M.; et al. Preoperative oral health care reduces postoperative inflammation and complications in oral cancer patients. Exp. Ther. Med. 2016, 12, 1922–1928. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  5. Liu, C.; Cao, Y.; Lin, J.; Ng, L.; Needleman, I.; Walsh, T.; Li, C. Oral care measures for preventing nursing home-acquired pneumonia. Cochrane Database Syst. Rev. 2018, 9, CD012416. [Google Scholar] [CrossRef]
  6. Kaneoka, A.; Pisegna, J.M.; Miloro, K.V.; Lo, M.; Saito, H.; Riquelme, L.F.; LaValley, M.P.; Langmore, S.E. Prevention of healthcare-associated pneumonia with oral care in individuals without mechanical ventilation: A systematic review and meta-analysis of randomized controlled trials. Infect. Control Hosp. Epidemiol. 2015, 36, 899–906. [Google Scholar] [CrossRef]
  7. de Lacerda Vidal, C.F.; Vidal, A.K.; Monteiro, J.G., Jr.; Cavalcanti, A.; Henriques, A.P.C.; Oliveira, M.; Godoy, M.; Coutinho, M.; Sobral, P.D.; Vilela, C.Â.; et al. Impact of oral hygiene involving toothbrushing versus chlorhexidine in the prevention of ventilator-associated pneumonia: A randomized study. BMC Infect. Dis. 2017, 17, 112. [Google Scholar] [CrossRef] [Green Version]
  8. Ogasawara, T.; Kawase, Y.; Isono, K.; Okada, Y.; Hashima, H.; Shen, F.C. Formative factors of membranous substances on dorsum of tongue, teeth, buccal mucosa in elderly persons requiring nursing care. Jpn. J. Geriatr. 2014, 29, 1120. (In Japanese) [Google Scholar]
  9. Kawase, Y.; Ogasawara, T.; Kawase, S.; Wakimoto, N.; Matsuo, K.; Shen, F.C.; Hasegawa, H.; Kakinoki, Y. Factors affecting the formation of membranous substances in the palates of elderly persons requiring nursing care. Gerodontology 2014, 31, 184–193. [Google Scholar] [CrossRef]
  10. Shen, F.C.; Ogasawara, T.; Shinotsuka, K.; Miyahara, K.; Isono, K.; Mochiduki, N.; Matsumura, K.; Shimada, K.; Ochiai, T.; Kakinoki, Y.; et al. Histopathological evaluation of oral membranous substance in bedridden elderly persons without oral intake in Japan. Gerodontology 2019, 36, 63–70. [Google Scholar] [CrossRef]
  11. Jablonowski, L.; Fricke, K.; Matthes, R.; Holtfreter, B.; Schlüter, R.; von Woedtke, T.; Weltmann, K.D.; Kocher, T. Removal of naturally grown human biofilm with an atmospheric pressure plasma jet: An in-vitro study. J. Biophotonics 2017, 10, 718–726. [Google Scholar]
  12. Nishikawa, T.; Yoshida, A.; Khanal, A.; Habu, M.; Yoshioka, I.; Toyoshima, K.; Takehara, T.; Nishihara, T.; Tachibana, K.; Tominaga, K. A study of the efficacy of ultrasonic waves in removing biofilms. Gerodontology 2010, 27, 199–206. [Google Scholar] [PubMed]
  13. Howlin, R.P.; Fabbri, S.; Offin, D.G.; Symonds, N.; Kiang, K.S.; Knee, R.J.; Yoganantham, D.C.; Webb, J.S.; Birkin, P.R.; Leighton, T.G.; et al. Removal of dental biofilms with an ultrasonically activated water stream. J. Dent. Res. 2015, 94, 1303–1309. [Google Scholar] [CrossRef] [PubMed]
  14. Kato, K.; Tamura, K.; Nakagaki, H. Quantitative evaluation of the oral biofilm-removing capacity of a dental water jet using an electron-probe microanalyzer. Arch. Oral. Biol. 2012, 57, 30–35. [Google Scholar] [PubMed]
  15. Flemmig, T.F.; Hetzel, M.; Topoll, H.; Gerss, J.; Haeberlein, I.; Petersilka, G.J. Subgingival debridement efficacy of glycine powder air polishing. J. Periodontol. 2007, 78, 1002–1010. [Google Scholar] [CrossRef]
  16. Sekino, S.; Ogawa, T.; Murakashi, E.; Ito, H.; Numabe, Y. Clinical and microbiological effect of frequent subgingival air pol-ishing on periodontal conditions: A split-mouth randomized controlled trial. Odontology 2020, 108, 688–696. [Google Scholar] [CrossRef]
  17. Jentsch, H.F.R.; Flechsig, C.; Kette, B.; Eick, S. Adjunctive air-polishing with erythritol in nonsurgical periodontal therapy: A randomized clinical trial. BMC Oral Health 2020, 20, 3644. [Google Scholar] [CrossRef]
  18. Wenzler, J.S.; Krause, F.; Böcher, S.; Falk, W.; Birkenmaier, A.; Conrads, G.; Braun, A. Antimicrobial impact of different air-polishing powders in a subgingival biofilm model. Antibiotics 2021, 10, 1464. [Google Scholar]
  19. Ulvik, I.M.; Sæthre, T.; Bunæs, D.F.; Lie, S.A.; Enersen, M.; Leknes, K.N. A 12-month randomized controlled trial evaluating erythritol air-polishing versus curette/ultrasonic debridement of mandibular furcations in supportive periodontal therapy. BMC Oral Health 2021, 21, 38. [Google Scholar] [CrossRef]
  20. Abdulbaqi, H.R.; Shaikh, M.S.; Abdulkareem, A.A.; Zafar, M.S.; Gul, S.S.; Sha, A.M. Efficacy of erythritol powder air-polishing in active and supportive periodontal therapy: A systematic review and meta-analysis. Int. J. Dent. Hyg. 2022, 20, 62–74. [Google Scholar] [CrossRef]
  21. Cobb, C.M.; Daubert, D.M.; Davis, K.; Deming, J.; Flemmig, T.F.; Pattison, A.; Roulet, J.F.; Stambaugh, R.V. Consensus conference findings on supragingival and subgingival air polishing. Compend. Contin. Educ. Dent. Consens Conf. Find. Supragingival Subgingival Air Pol. 2017, 38, e1–e4. [Google Scholar]
  22. Uehara, S.; Nakajima, T.; Moriya, S.; Maruyama, S.; Sato, T. Removal mechanism of artificial dental plaque by impact of micro-droplets. ECS J. Solid State Sci. Technol. 2019, 8, N20–N24. [Google Scholar] [CrossRef]
  23. Hihara, H.; Tagaino, R.; Washio, J.; Laosuwan, K.; Wicaksono, D.P.; Izumita, K.; Koide, R.; Takahashi, N.; Sasaki, K. Effectiveness and safety of a new dental plaque removal device utilizing micro mist spray for removing oral biofilm in vitro. BMC Oral Health 2021, 21, 286. [Google Scholar]
  24. Conn, R.E.; Warren-Morris, D.; Prihoda, T.J.; Hicks, B.M.; Hernandez, E.E. Comparison of two manual toothbrushes in effec-tiveness of plaque removal: A pilot study. J. Dent. Hyg. 2017, 91, 32–39. [Google Scholar] [PubMed]
  25. Yonenaga, K.; Hoshi, K.; Miyamoto, Y.; Kitahara, Y.; Kamatsuka, M.; Fujihara, Y.; Suenaga, H.; Takato, T. Investigating the efficacy of intraoral wet sheets. Tokai J. Exp. Clin. Med. 2019, 44, 15–19. [Google Scholar] [PubMed]
  26. Nobre, C.V.C.; Gomes, A.M.M.; Gomes, A.P.M.; Gomes, A.A.; Nascimento, A.P.C. Assessment of the efficacy of the utilisation of conventional and electric toothbrushes by the older adults. Gerodontology 2020, 37, 297–302. [Google Scholar] [PubMed]
  27. Yonezawa, H.; Takasaki, K.; Teraoka, K.; Asaka, T.; Sato, C.; Tsuchiya, K. Effects of tongue and oral mucosa cleaning on oral Candida species and production of volatile sulfur compounds in the elderly in a nursing home. J. Med. Dent. Sci. 2003, 50, 1–8. [Google Scholar]
  28. Yadav, S.R.; Kini, V.V.; Padhye, A. Inhibition of tongue coat and dental plaque formation by stabilized chlorine dioxide vs chlorhexidine Mouthrinse: A randomized, triple blinded study. J. Clin. Diagn. Res. 2015, 9, ZC69–ZC74. [Google Scholar] [CrossRef]
  29. Tashiro, K.; Katoh, T.; Yoshinari, N.; Hirai, K.; Andoh, N.; Makii, K.; Matsuo, K.; Ogasawara, T. The short-term effects of various oral care methods in dependent elderly: Comparison between toothbrushing, tongue cleaning with sponge brush and wiping on oral mucous membrane by chlorhexidine. Gerodontology 2012, 29, e870–e882. [Google Scholar]
  30. Nishiyama, Y.; Inaba, E.; Uematsu, H.; Senpuku, H. Effects of mucosal care on oral pathogens in professional oral hygiene to the elderly. Arch. Gerontol. Geriatr. 2010, 51, e139–e143. [Google Scholar]
  31. Outhouse, T.L.; Al-Alawi, R.; Fedorowicz, Z.; Keenan, J.V. Tongue scraping for treating halitosis. Cochrane Database Syst. Rev. 2006, 19, CD005519. [Google Scholar]
  32. Kuo, Y.W.; Yen, M.; Fetzer, S.; Lee, J.D. Toothbrushing versus toothbrushing plus tongue cleaning in reducing halitosis and tongue coating: A systematic review and meta-analysis. Nurs. Res. 2013, 62, 422–429. [Google Scholar] [CrossRef] [PubMed]
  33. Dwivedi, V.; Torwane, N.A.; Tyagi, S.; Maran, S. Effectiveness of various tongue cleaning Aids in the reduction of tongue coating and bacterial load: A comparative clinical study. J. Contemp. Dent. Pract. 2019, 20, 444–448. [Google Scholar] [PubMed]
  34. Estaji, Z.; Alinejad, M.; Hassan Rakhshani, M.H.; Rad, M. The comparison of chlorhexidine solution and swab with toothbrush and toothpaste effect on preventing oral lesions in hospitalized patients in Intensive Care Unit. Glob. J. Health Sci. 2015, 8, 211–216. [Google Scholar] [PubMed] [Green Version]
  35. Sreenivasan, P.K.; Gittins, E. The effects of a chlorhexidine mouthrinse on culturable microorganisms of the tongue and saliva. Microbiol. Res. 2004, 159, 365–370. [Google Scholar] [CrossRef]
  36. Santos, P.S.S.; Mariano, M.; Kallas, M.S.; Vilela, M.C.N. Impact of tongue biofilm removal on mechanically ventilated patients. Rev. Bras. Ter. Intensiva 2013, 25, 44–48. [Google Scholar] [CrossRef]
  37. Barbe, A.G.; Kottmann, H.E.; Hamacher, S.; Derman, S.H.M.; Noack, M.J. Efficacy and acceptance of professional dental cleaning among nursing home residents. Clin. Oral Investig. 2019, 23, 707–713. [Google Scholar] [CrossRef]
  38. James, P.; Worthington, H.V.; Parnell, C.; Harding, M.; Lamont, T.; Cheung, A.; Whelton, H.; Riley, P. Chlorhexidine mouthrinse as an adjunctive treatment for gingival health. Cochrane Database Syst. Rev. 2017, 3, CD008676. [Google Scholar]
  39. Woolley, J.; Gibbons, T.; Patel, K.; Sacco, R. The effect of coconut oil pulling on Streptococcus mutans count in saliva in comparison with chlorhexidine mouthwash. Heliyon 2020, 6, e04789. [Google Scholar] [CrossRef]
  40. Butera, A.; Gallo, S.; Maiorani, C.; Molino, D.; Chiesa, A.; Preda, C.; Esposito, F.; Scribante, A. Probiotic Alternative to Chlorhexidine in Periodontal Therapy: Evaluation of Clinical and Microbiological Parameters. Microorganisms 2020, 9, 69. [Google Scholar] [CrossRef]
  41. Butera, A.; Gallo, S.; Pascadopoli, M.; Maiorani, C.; Milone, A.; Alovisi, M.; Scribante, A. Paraprobiotics in Non-Surgical Periodontal Therapy: Clinical and Microbiological Aspects in a 6-Month Follow-Up Domiciliary Protocol for Oral Hygiene. Microorganisms 2022, 10, 337. [Google Scholar] [CrossRef] [PubMed]
  42. O’Leary, T.J.; Drake, R.B.; Naylor, J.E. The plaque control record. J. Periodontol. 1972, 43, 38. [Google Scholar] [CrossRef] [PubMed]
  43. Kinoshita, S.; Watanabe, H.; Mera, T.; Kitamura, S.; Kobayashi, M.; Osada, Y.; Izumi, Y.; Kowashi, Y.; Noguchi, T.; Ishikawa, I. Appropriate level of plaque control to maintenance of periodontal therapy (author’s transl). Nihon Shishubyo Gakkai Kaishi 1981, 23, 509–517. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Photographic images of the MSM-UNIT spraying with (a) a handpiece and (b) the main body.
Figure 1. Photographic images of the MSM-UNIT spraying with (a) a handpiece and (b) the main body.
Antibiotics 11 00825 g001
Figure 2. Flow chart of the study’s subjects.
Figure 2. Flow chart of the study’s subjects.
Antibiotics 11 00825 g002
Figure 3. Teeth, palate, and tongue application results of the MSM-UNIT. Before treatment, stained, after treatment, day 1 and day 7 are shown.
Figure 3. Teeth, palate, and tongue application results of the MSM-UNIT. Before treatment, stained, after treatment, day 1 and day 7 are shown.
Antibiotics 11 00825 g003
Figure 4. Teeth and palate photographs before and after the binarization.
Figure 4. Teeth and palate photographs before and after the binarization.
Antibiotics 11 00825 g004
Figure 5. Judgment sample of the degree of plaque adhesion. Each area was evaluated as one of four grades: “very high” (3), “high” (2), “low” (1), and “none” (0).
Figure 5. Judgment sample of the degree of plaque adhesion. Each area was evaluated as one of four grades: “very high” (3), “high” (2), “low” (1), and “none” (0).
Antibiotics 11 00825 g005
Figure 6. Chart of the treatment flow.
Figure 6. Chart of the treatment flow.
Antibiotics 11 00825 g006
Table 1. Patient data.
Table 1. Patient data.
TeethPalateTongue
Number of patients6512
Male (n)306
Female (n)356
Mean age (years)65.772.062.3
Table 2. Plaque removal rate by PCR (% Plaque removal rate by PCR (%)).
Table 2. Plaque removal rate by PCR (% Plaque removal rate by PCR (%)).
Before TreatmentAfter TreatmentAmount of Change
n666
Mean (95% confidence interval)72.30 (48.45–96.15)4.08 (−3.07–11.24)68.22 (48.07–88.36)
Standard deviation22.726.8219.20
Table 3. Evaluation of the degree of palate and tongue plaque adherence.
Table 3. Evaluation of the degree of palate and tongue plaque adherence.
None 0Low 1High 2Very High 3Low or None95% Confidence Interval
PalateBefore treatment00410.0% (0/5)0.0–52.2%
After treatment3200100.0% (5/5)47.8–100.0%
TongueBefore treatment00660.0% (0/12)0.0–26.5%
After treatment057041.7% (5/12)15.2–72.3%
Table 4. Plaque removal rate by binarization (teeth and palate).
Table 4. Plaque removal rate by binarization (teeth and palate).
TeethPalate
n65
Mean (95% confidence interval)80.47 (68.28–92.65)96.38 (92.23–100.53)
Standard deviation11.613.34
Table 5. Plaque removal time (teeth, palate, and tongue).
Table 5. Plaque removal time (teeth, palate, and tongue).
TeethPalateTongue
n6512
Mean ± standard deviation (seconds)163.3 ± 26.858.2 ± 30.365.0 ± 51.2
Table 6. Questionnaire survey results for MSM-UNIT treatment.
Table 6. Questionnaire survey results for MSM-UNIT treatment.
Satisifaction compared with other treatment methodsSatisfied53.3% (8)
Slightly26.7% (4)
Average20.0% (3)
Slightly dissatisfied0.0% (0)
Dissatisfied0.0% (0)
Not clear0.0% (0)
Other0.0% (0)
ComfortabiltitySatisfied40.0% (6)
Slightly40.0% (6)
Average13.3% (2)
Slightly dissatisfied6.7% (1)
Dissatisfied0.0% (0)
Not clear0.0% (0)
Other0.0% (0)
Pain and irritationThere was no pain and irritation73.3% (11)
There was pain and irritation26.7% (4)
TeethPalateTongue
Tolerable010
Tolerable within 3 min001
Tolerable within 1 min110
Intolerable000
Not clear0.0% (0)
Other0.0% (0)
Table 7. Spontaneous pain as rated on the NRS.
Table 7. Spontaneous pain as rated on the NRS.
Teeth/GumPalateTongue
Before treatmentMean ± standard deviation (n)0.0 ± 0.0 (15)0.0 ± 0.0 (15)0.0 ± 0.0 (15)
min, median, max0, 0.0, 00, 0.0, 00, 0.0, 0
After treatmentMean ± standard deviation (n)0.3 ± 0.5 (15)0.1 ± 0.5 (15)0.0 ± 0.0 (15)
min, median, max0, 0.0, 10, 0.0, 20, 0.0, 0
Day 1Mean ± standard deviation (n)0.1 ± 0.4 (15)0.0 ± 0.0 (15)0.1 ± 0.3 (15)
min, median, max0, 0.0, 10, 0.0, 00, 0.0, 1
Day 7Mean ± standard deviation (n)0.0 ± 0.0 (15)0.0 ± 0.0 (15)0.0 ± 0.0 (15)
min, median, max0, 0.0, 00, 0.0, 00, 0.0, 0
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Hihara, H.; Izumita, K.; Iwatsu, M.; Sato, T.; Tagaino, R.; Shobara, K.; Shinohara, Y.; Hatakeyama, T.; Kayaba, C.; Sato, M.; et al. Clinical Trial for Evaluating the Effectiveness and Safety of a New Dental Plaque Removal Device: Microscale Mist Unit. Antibiotics 2022, 11, 825. https://doi.org/10.3390/antibiotics11060825

AMA Style

Hihara H, Izumita K, Iwatsu M, Sato T, Tagaino R, Shobara K, Shinohara Y, Hatakeyama T, Kayaba C, Sato M, et al. Clinical Trial for Evaluating the Effectiveness and Safety of a New Dental Plaque Removal Device: Microscale Mist Unit. Antibiotics. 2022; 11(6):825. https://doi.org/10.3390/antibiotics11060825

Chicago/Turabian Style

Hihara, Hiroki, Kuniyuki Izumita, Misato Iwatsu, Tomoya Sato, Ryo Tagaino, Kenta Shobara, Yuta Shinohara, Takanori Hatakeyama, Chie Kayaba, Mariko Sato, and et al. 2022. "Clinical Trial for Evaluating the Effectiveness and Safety of a New Dental Plaque Removal Device: Microscale Mist Unit" Antibiotics 11, no. 6: 825. https://doi.org/10.3390/antibiotics11060825

APA Style

Hihara, H., Izumita, K., Iwatsu, M., Sato, T., Tagaino, R., Shobara, K., Shinohara, Y., Hatakeyama, T., Kayaba, C., Sato, M., Tokue, A., Sugawara, T., Ashino, K., Ikeda, K., Aida, J., & Sasaki, K. (2022). Clinical Trial for Evaluating the Effectiveness and Safety of a New Dental Plaque Removal Device: Microscale Mist Unit. Antibiotics, 11(6), 825. https://doi.org/10.3390/antibiotics11060825

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop