Next Article in Journal
Boosted Prediction of Antihypertensive Peptides Using Deep Learning
Next Article in Special Issue
Digital (R)Evolution: Open-Source Softwares for Orthodontics
Previous Article in Journal
Shock Attenuation and Electromyographic Activity of Advanced and Novice Equestrian Riders’ Trunk
Previous Article in Special Issue
Retrospective Case Series Regarding the Advantages of Cortico-Puncture (CP) Therapy in Association with Micro-Implant Assisted Rapid Palatal Expander (MARPE)
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Prototype of Augmented Reality Technology for Orthodontic Bracket Positioning: An In Vivo Study

1
School of Dentistry, College of Dentistry, China Medical University, Taichung 404, Taiwan
2
Department of Orthodontics, China Medical University Hospital Medical Center, Taichung 404, Taiwan
3
Department of Dentistry, Asia University Hospital, Taichung 413, Taiwan
4
Service System Technology Center, Intelligent Medical & Healthcare System Department, Industrial Technology Research Institute, Hsinchu 310, Taiwan
5
Department of Bioinformatics and Medical Engineering, Asia University, Taichung 413, Taiwan
*
Authors to whom correspondence should be addressed.
These authors contributed equally to this work.
Appl. Sci. 2021, 11(5), 2315; https://doi.org/10.3390/app11052315
Submission received: 8 February 2021 / Revised: 25 February 2021 / Accepted: 1 March 2021 / Published: 5 March 2021
(This article belongs to the Special Issue New Materials and Technologies in Orthodontics)

Abstract

:
To improve the accuracy of bracket placement in vivo, a protocol and device were introduced, which consisted of operative procedures for accurate control, a computer-aided design, and an augmented reality–assisted bracket navigation system. The present study evaluated the accuracy of this protocol. Methods: Thirty-one incisor teeth were tested from four participators. The teeth were bonded by novice and expert orthodontists. Compared with the control group by Boone gauge and the experiment group by augmented reality-assisted bracket navigation system, our study used for brackets measurement. To evaluate the accuracy, deviations of positions for bracket placement were measured. Results: The augmented reality-assisted bracket navigation system and control group were used in the same 31 cases. The priority of bonding brackets between control group or experiment group was decided by tossing coins, and then the teeth were debonded and the other technique was used. The medium vertical (incisogingival) position deviation in the control and AR groups by the novice orthodontist was 0.90 ± 0.06 mm and 0.51 ± 0.24 mm, respectively (p < 0.05), and by the expert orthodontist was 0.40 ± 0.29 mm and 0.29 ± 0.08 mm, respectively (p < 0.05). No significant changes in the horizontal position deviation were noted regardless of the orthodontist experience or use of the augmented reality–assisted bracket navigation system. Conclusion: The augmented reality–assisted bracket navigation system increased the accuracy rate by the expert orthodontist in the incisogingival direction and helped the novice orthodontist guide the bracket position within an acceptable clinical error of approximately 0.5 mm.

1. Introduction

Augmented reality (AR) is a technology that can accurately and reproducibly superimpose to the real-world environment. An AR system fulfills 3 features: A combination of real and virtual objects, real-time interaction, and accurate 3 dimensions of space registration of virtual and real objects. The first AR device was developed by Ivan Sutherland in 1968. He set up a head-mounted 3-dimensional display, and the observer could see a cube in the view [1].
The development of AR is attributed to Boeing in 1990. Before AR technology, Boeing’s workers were required to continuously discuss a laptop screen to ensure that the numerous wires were correctly connected. The process was exhausting and time consuming. Boeing’s engineers developed AR headsets, which helped the workers see the information projected in front of their eyes, which improved their wire construction efficiency and lowered errors [2,3]. Gradually, AR expanded to various fields, including gaming, service, factory assembly, and medical industries. In the field of oral medicine, AR is also used in oral maxillofacial surgeries, dental implant [4,5], and oral education [6]. In addition, AR can promote the development of orthodontics [3].
The problem of accurate orthodontic bracket positioning is being discussed for many decades now. In 1972, Andrews devised the straight wire (preadjusted) appliance, which the technique reduces a part of wire bending [7,8,9]. The concept of straight wire appliance is each bracket has built-in specific torque, tip, in/out, and proper offset to achieve proper alignment of the center of the slot and to allow teeth to properly settle in the ideal final positions. The most important thing when using the straight wire appliance is bracket positions.
However, inaccurate bracket positions can affect occlusal function and dental aesthetics, causing articulation disorders and grooved marginal ridges between teeth; inaccurate bracket positions can also increase the likelihood of food becoming lodged between teeth, which can inflame the gingiva, damage the alveolar bone, and lead to periodontal disease [10]. The problem of inaccurate bracket positions does not only occur because of orthodontics being performed by different clinical dentists. Even when the treatment is performed by the same dentist, bracket deviation of teeth in different quadrants is likely. Various factors can affect bracket positioning, including the clinical crown height, tooth morphology, abnormal incisor line, and occlusal interference. Therefore, making accurate orthodontic decisions is critical for clinical dentists. In the past, dentists could only rely on their experience and adjust the bracket positions until correct positioning was achieved.
Following advances in information and communications technology, digital applications in dentistry have increased, including three-dimensional (3D) intraoral scanning, cone beam computed tomography, computer-aided design and manufacturing, and the production of surgical guides. Digital dentistry has increased the quality and accuracy of dental treatment. The technique of 3D intraoral scanning can digitalize the intraoral structure, facilitating treatment planning and simulation with the aid of 3D software.
To prevent inaccurate bracket positioning and help dentists make appropriate decisions, researchers have proposed the incorporation of customized orthodontics into digital orthodontics. Advances in digital orthodontics allow the use of 3D models in customizing brackets according to the patient’s malocclusion type and individual problems. Studies [11,12,13] have focused on bracket positioning methods, including positioning methods using orthodontic surgical guides, positioning gauges, and 3D-printed guides [11,12,13].
Despite the progress of digital orthodontic techniques in recent years, the use of advanced techniques (e.g., using 3D-printed guides) for bracket positioning can incur heavy costs and thus reduce the generalizability of digital orthodontics. To solve this problem, the present study proposed an AR-assisted bracket navigation system to shift preoperational planning to clinical practice, with the aim of reducing guide production time and cost, enhancing the accuracy of bracket bonding, and achieving customized orthodontics.
To facilitate the accurate localization of bracket positioning, we developed an AR-assisted bracket navigation system. This study analyzed the accuracy of bracket placement between the conventional direct bonding technique with Boone gauge and AR-assisted bracket navigation system by the novice and the expert (Figure 1).

2. Materials and Methods

2.1. Samples and Operators

This clinical trial enrolled 4 patients (2 women and 2 men). All patients had intact central and lateral upper and lower incisors, and clinical crown heights of all teeth were available. Thirty-two teeth (8 dentitions × 4 patients) were examined. Incisors with the following conditions were excluded: (1) Limited space for bracket placement, (2) severe defects that could interfere with bracket placement, and (3) teeth with prosthesis that could hinder bracket bonding and tooth morphology. One crowded tooth was excluded because of limited space for bracket placement.
First, 31 brackets were bonded using either the AR-assisted bracket navigation system or Boone gauge and subjected to oral scan; then, the teeth were debonded and were rebonded with the other technique, and then were re-subjected to oral scan.
Bracket bonding was performed in each tooth by 2 operators: One was well trained in the orthodontic program for 3 years, and the other was an intern with only basic orthodontic knowledge and without any clinical orthodontic experience. The study was performed in the department of orthodontics, China Medical University Hospital Medical Center, Taichung, Taiwan. The study was approved by the local research ethics committee (CMUH106-REC3-146), and each participant signed an informed consent form.

2.2. AR and Device Settings

A wireless handpiece intra-oral camera (QOCA® Q-tube Wi-Fi Teeth Scope Pro, Quanta Computer Inc., Taoyuan City, Taiwan) was used, with the resolution and operation distance set to 640 × 640 pixels and 3–12 mm, respectively. The operator can visualize the view of the patient’s mouth and augmented information from the screen (Figure 2). Before starting bracket placement, all teeth were scanned, and the ideal bracket position was analyzed using the intra-oral scanner (TRIOS 3 Basic, 3Shape Dental Systems, Copenhagen, Denmark) and digital modelling software(Ortho Analyzer, 3Shape Dental Systems, Copenhagen, Denmark). Pre-adjusted edgewise plastic brackets with an 0.018-inch slot (orthoEsther MB; Tomy) were bonded on the teeth. For bracket height measurement, the Boone gauge (G&H) was used in the control group (Figure 3). With an interval of 0.5 mm, the ruler allows the measurement of bracket height at 0.35, 0.40, 0.45, and 5.0 mm. The AR-assisted bracket navigation system was adopted in the experimental group. After bracket bonding, all teeth were scanned, and the final bracket position was analyzed.

2.3. Method for Applying the AR-Assisted Bracket Navigation System

The AR-assisted bracket navigation system comprised two technical modules, namely the facial axis of the clinical crown (FACC) detection module and the bracket bonding navigation module. Collecting real-time images captured by the intraoral camera, the FACC module segmented the image of each tooth through computer-vision–based image analysis, thereby generating dental features that included the complete contour and FACC of each tooth. The bracket bonding navigation module overlapped the real-time image with the bracket bonding positions determined during preoperational planning, thereby achieving preoperational planning visualization.

2.3.1. FACC Detection Module

The FACC detection module performed morphological analysis to roughly segment the contour of the entire tooth. To accurately extract the detailed tooth contour, the GrabCut algorithm was adopted to facilitate interactive foreground extraction and fix the contour of each tooth. Specifically, the algorithm, targeting regions of interest in each tooth extracted from the morphological analysis, implemented foreground image segmentation using source and sink nodes, foreground–background separation, graph cuts, and energy function. During image segmentation, pixels were considered nodes, and these nodes comprised two types, namely source nodes and sink nodes. Source nodes represented the foreground image of regions of interest, whereas sink nodes indicated unwanted background image regions. This technique can create a great pixel difference on the edge of the target image, allowing the system to distinguish regional foregrounds from backgrounds, isolate the tooth contour, and achieve tooth segmentation [14]. After extracting the contour of each tooth using real-time imaging, we extracted the bounding box of the closed contour formulated by each tooth to detect the anatomical FACC. For example, when segmenting the maxillary teeth, the tooth zenith can be identified along the upper side of the bounding box, whereas the bottom side denotes the incisor line. By connecting the zenith and incisor line, the FACC can be detected. The FACC, as defined by Andrews (1979), serves as a reference line in straight-wire appliance design. We adopted the FACC because it is highly rediscoverable and reliable as a reference line, susceptible to the surroundings, and unlikely to change in the entire lifetime; moreover, theaxis does not require X-ray imaging in clinical practice, and can be seen by the naked eye, thereby allowing direct observation during treatments [15].

2.3.2. Bracket Bonding Navigation Module

In a limited space, the bracket bonding navigation module mapped the bracket position data (planned prior to the operation) to real-time images, during which the tooth contour and FACC information acquired by the FACC model was used, the problem of optical distortion was considered, and scale-ruler–based proportional measurement conversions were performed. The module could avoid operational interference and inconvenience caused by the use of positioning two-dimensional barcode; the module managed to transfer the bracket coordinates from a virtual space to actual space.
During scale conversion, the researchers had to identify the immovable hard tissues for the system to calculate the ratio of pixel to actual distance (Figure 4). To do so, they obtained the mean of the left-to-target and right-to-target FACC distances for each tooth (Figure 5). The present study regarded the FACC of neighboring teeth as the reference points because the FACC distance is less likely to be prone to cumulative errors caused by gingival changes and recession, missing information, and dental crowding. Furthermore, said mean could reduce unilateral measurement errors. Conversion was performed using the following equations:
P B D B = 1 2 ( P r D r + P l D l )
P B = D B × P r D l + P l D r 2 D r D l
where F denotes the FACC, B the bracket, D the distance, P the pixel, r the right tooth, and l the left tooth. The distance between the FACC of the target tooth and that of the right tooth is represented by Pr pixels (Dr mm), whereas the FACC of the target tooth and that of the left tooth are Pl pixels (Dl mm). The distance between the bracket and incisor line is denoted by PB pixels (DB mm).

2.4. Intraoral Scanner and Its Operations

An intraoral scanner (TRIOS 3 Basic, 3Shape Dental Systems, Copenhagen, Denmark) was used to record the oral status of participants. Following the manufacturer’s instructions, the scanner was calibrated prior to scanning with the lens preheated. High power suction was used to suck most of the saliva, after which the remaining saliva was dried using compression air. According to the procedures recommended by the scanner software, the scanning began with the occlusal surface from the left mandibular second molar to the right mandibular second molar. Next, the lingual surface was scanned, followed by the buccal surface. Similarly, the occlusal surface was scanned for the maxillary teeth, followed by the buccal surface and the palatal surface. When scanning the occlusal surface, the lens–tooth distance was fixed at 0–5 mm; when scanning the buccal surface and lingual surface, the camera was turned from 45° to 90°, during which the image capturing process was displayed on the monitor, thereby ensuring complete scanning without missing any blind spots. Following maxillary and mandibular teeth scanning, the centric occlusion positions were recorded, which comprised the positions of premolars and molars on both sides.
Data obtained through the aforementioned procedures were used for preoperational modeling and post-operational bracket bonding modeling. The scanner accuracy and consistency were 6.9 ± 0.9 µm and 4.5 ± 0.9 µm, respectively [16].

2.5. Pretreatment Digital Setup and Planning of Bracket Positions

The intraoral scanner was also adopted to establish intraoral digital models of participants. Specifically, pretreatment digital models were applied for a virtual setup using the digital modeling software Ortho Analyzer (3Shape Dental Systems, Copenhagen, Denmark). A virtual setup, facilitated on software, can separate each tooth and move it to the planned position. According to the software program, unwanted and nonexistent tooth positions were excluded, after which the mesial and distal positions of each tooth were marked. Subsequently, the program semiautomatically marked the gingival margin of each tooth and allowed manual adjustment of unclear margins. After confirmation, the program defined proximal contact points according to the obtained gingival margin and mesiodistal direction. According to the six keys to normal occlusion proposed by Andrews et al. (1976; i.e., molar relationship, mesiodistal crown angulation, labiolingual crown inclination, no rotations, tight contacts, and a flat occlusal plane) [17], we defined the final occlusion status. To avoid mesiodistal deviation of brackets causing crown rotation during treatment, we overlapped the Y axis with the FACC; the incisor line was regarded as a reference line for calculating the height of each bracket. The vertical positions of each bracket were then aligned with the final occlusion plane, namely Andrews’ plane [15], to ensure correct bracket position marking as planned. After bracket planning was completed using 3D digital setup software, we obtained the absolute coordinates of each bracket on the tooth crown. The teeth and brackets could then be bounded using the developed AR-assisted bracket navigation system.

2.6. Clinical Procedure

  • Place the retractor in the patient’s mouth.
  • Clean the tooth surface with a low-speed brush and a polishing paste.
  • Dry the tooth surface (Do not etch the tooth surface and use the bonding agent).
  • Apply orthodontic adhesive (Orthomite LC; SunMedical) on the bracket base.
  • Place the bracket with the Boone gauge (control group)/AR system (experiment group).
  • Remove excessive adhesive.
  • Light cure each tooth for 20 s.

2.7. Assessment of Accurate Bracket Positioning

Ortho Analyzer was used to compare the preoperational bracket position plan and bonded bracket model through coordinate system quantification. The measurement parameters required were as follows: (1) The center of the bracket P(Xp, Yp) in preoperational planning, with the preoperational planning position of each tooth as the origin; (2) the position of the bonded bracket R(Xr, Yr); and (3) the horizontal deviation (ΔXt) and vertical deviation (ΔYt) between the actual adherence position and planned position. The X axis denotes the mesiodistal direction, whereas the Y axis denotes the inciogingival direction (Figure 6). The error of measuring position deviation ranged from—0.01 to 0.01 mm, with a mean (standard deviation [SD]) of 0.01 (0.001) mm.

2.8. The Reliability of AR–Assisted Bracket Navigation System

Next, the reliability of the AR system was verified. The resolution of the intraoral scanner was 640 × 640 pixels. In the preliminary test, when the operating distance was 12 mm, 33–35 pixels were observed every 10 mm, indicating an interval of 0.285–0.30 mm per pixel. When the effective operating distance increased, the number of pixels per unit also increased, creating little interval as well as high accuracy.

2.9. Statistical Analysis

Continuous variables are presented as the medium ± interquartile range (IQR). The Shapiro–Wilk test indicated that the variables were not normally distributed. The Mann–Whitney U-test was used to compare continuous variables between the novice and expert groups. The Wilcoxon sign rank test was used to compare continuous variables between the experiment and control groups. p < 0.05 was considered statistically significant. All statistical analyses were conducted using SPSS for Windows (version 12, SPSS, Chicago, IL, USA). A power analysis for Wilcoxon-Mann-Whitney test (two groups) conducted posteriori using G*Power 3.1.9.7 indicated 95% power to detect a small effect size at a significance level of 0.05.

3. Results

3.1. The Results of Vertical Position Devation

The position deviations between the control and AR groups are presented in Table 1. The medium vertical position deviation in the control and AR groups was 0.64 ± 0.37 mm and 0.35 ± 0.15 mm, respectively (p < 0.001). The medium vertical position deviation in the control and AR groups by the novice orthodontist was 0.90 ± 0.06 mm and 0.51 ± 0.24 mm, respectively (p < 0.001), and that by the expert orthodontist was 0.40 ± 0.29 mm and 0.29 ± 0.08 mm, respectively (p < 0.001). The percentage of vertical deviation improvement between the novice and expert orthodontists was 43% (p < 0.05) and 28% (p < 0.05), respectively.

3.2. The Results of Horizontal Position Devation

The position deviations between the control and AR groups are presented in Table 1. The medium horizontal position deviation was 0.32 ± 0.18 mm and 0.26 ± 0.11 mm, respectively (p > 0.05). The medium horizontal position deviation in the control and AR groups by the novice orthodontist was 0.28 ± 0.09 mm and 0.27 ± 0.16 mm, respectively (p > 0.05), and that by the expert orthodontist was 0.36 ± 0.21 mm and 0.25 ± 0.10 mm, respectively (p > 0.05). The percentage of horizontal deviation improvement was 4% (p > 0.05) and 31% (p > 0.05), respectively.

3.3. The Effect of AR–Assisted Bracket Navigation System

The results revealed that after implementing the AR system, the vertical error was reduced by approximately 0.29 (45%) mm, whereas the horizontal error was reduced by only approximately 0.06 (18%) mm because the features between the teeth were inconspicuous. Furthermore, the novice orthodontist using the AR system achieved the near accuracy as the expert orthodontist using the Boone gauge.

4. Discussion

The ideal bracket position is vital for efficient orthodontic treatment. Many studies have discussed ideal positioning since 1976. Andrews introduced the bracketing technique of the straight wire concept, which involved placing the bracket up or down until the middle of the bracket slot base is at the same height as the mid-point of the clinical crown. [7,8,9]
In the current study, we used initial digital modelling to predict the final setup to define each volunteer’s bracket position and measure the bracket height before transferring to the AR-assisted bracket navigation system.
Various methods have been proposed for ideal bracket positioning [2,12,13,18,19,20]. They can be divided into direct and indirect bonding techniques. The direct bonding technique uses a gauge to directly measure the ideal bracket positions in oral cavity. This technique has the advantages of no interference with the guiding tray, more acceptable for crowded teeth, and immediately adjustable bracket position. However, the direct bonding technique is influenced by the measure scale of gauge, tooth morphology, and operator’s experience. The indirect bonding technique uses a transfer tray to transfer the brackets into the intra-oral teeth. They are divided into 2 stages: The lab stage, which involves locating the bracket position on the stone model and fabricating a transfer tray to duplicate the bracket position, and the clinical stage, which involves setting the tray with brackets into the patient’s mouth. Therefore, the indirect bonding technique overcomes the limitation of the limited view in the oral cavity. Nevertheless, placement errors may occur depending on the transfer tray material, operator’s finger pressure, and technician skills. Several researchers have designed many types of transfer trays, including polyvinyl siloxane trays, vacuum-formed trays, 3-dimensional-printed stent, and transfer jigs [11,13,18,21,22,23]. AR-assisted bracket navigation system combines the advantage of both bonding techniques and overcomes the disadvantage.
Aichert et al. (2012) used digital volume tomography of a computed tomography scan to overlay the orthodontist bonded procedure video image by using an AR system in vitro, and the average error with their technique was 2.1 mm [24]. By contrast, the average error in our study with novice and expert orthodontists was 0.51 mm and 0.29 mm, respectively, indicating significantly high accuracy. Our study has clinical significance because the clinically acceptable placement error is 0.5 mm. Furthermore, we used digital modeling with an intra-oral scanner to determine the bracket position, thus avoiding any radiation exposure due to computed tomography, unlike Aichertet al.’s study.
The device used a wireless handheld intra-oral camera to capture oral teeth image and sent it for data processing. The registration method used the real-time natural feature registration to superimpose the ideal bracket position of the virtual object on the tooth surface (Figure 7).
We used the real-time corner detection algorithm to achieve real-world integrity and high registration accuracy [3]. The AR-assisted bracket navigation system was displayed on the screen in front of the operator instead of a head-mounted device to reduce the load on the operator’s neck. Under acceptable error rate, the proposed system could provide more fluent user experience because there was no huge number of calculations that needed to be done within the limited time. As a result, deviations in the expert group in the vertical (incisogingival) direction were 0.40 mm and 0.29 mm for the control and AR groups, respectively, and the improvement rate was 28%. Deviations in the novice group were 0.90 mm and 0.51 mm, respectively, and the improvement rate was 43%. Notably, using the AR-assisted bracket navigation system, the accuracy of the novice orthodontist closed that of the expert orthodontist using the Boone gauge. However, no significant differences were observed in the horizontal (mesiodistal) direction regardless of the orthodontist’s experience or the system used.
The results showed no significant difference between the experimental group and the control group, and the possible reason is that the pre-treatment of root parallelism was not taken into consideration. However, the research is still valuable for clinical practice due to the fact that the horizontal deviations of the two methods were less than 0.5 mm.
The standard of 0.5 mm is regarded as the acceptable clinical limitation according to the professional standard of the American Board of Orthodontics Objective Grading System [25]. This system recommends that the deviation of alignment and marginal ridges should be at the same level or within 0.5 mm [25]. As reported by Castilla et al. (2014) [26], who investigated the linear differences between five indirect bonding techniques, the deviation ranged between 0.06 mm and 0.49 mm [26]. According to an in vivo study by Grünheid et al. (2015) [13], statistical differences were confirmed under the 0.5 mm deviation limitation. The acceptable deviation in the present study was consistent with those in the two aforementioned studies.
Intraoral camera resolution plays a crucial role in the accuracy of bracket bonding when the AR-assisted bracket navigation system is used. The higher the resolution, the more detailed the information in the unit pixel. We proposed the feature-based facial axis of the clinical crown (FACC) detection algorithm to decrease the error in mapping the augmented information to the real image. We extracted the contour of each tooth from the color image based on the difference in the signal between the hard and soft tissue in the color space. Next, on the basis of the tooth contour, the incisor line and FACC—two crucial reference lines—were detected for each tooth using the proposed algorithm. The positions of the bracket on each tooth depended on these two reference lines. Thus, the system used indirect information to ensure the accuracy of the augmented information during mapping from the virtual world to the real world.
A high accuracy in bracket positioning can reduce the need for the first- and second-order bends, thus reducing treatment time and complexity, as well as reduce the clinical chair time required for bracket rebonding and leveling, thus ensuring efficient and precise treatment. The third-order bends are not discussed in our study because they are easily influenced by the high contour of tooth morphology, adhesive thickness, and position of bracket height.
One limitation of the device was not considering the root information of the facial tooth axis of the clinical crown. Adding the root information in the AR-assisted bracket navigation system might increase the accuracy in the horizontal (mesiodistal) direction. Another limitation was the inadequate fluency and optimization of the system. The system might benefit from hardware and software upgrades, including higher graphics processing unit, high-resolution delicate micro lens, higher internet transfer speed, algorithm optimizing, and intact image extraction technology.
Future studies should combine the AR-assisted bracket navigation system with artificial intelligence models for teeth image extraction [27,28,29] and use a 5G technology for data transfer speed [30], more efficient graphics processing unit, optimized algorithm, and high-resolution delicate micro lens, thereby increasing the accuracy and reliability. This AR system can have many applications in dentistry, including temporary anchorage devicesnavigation system, root parallel information display, and Bolton analysis [31]. The present study represents just the beginning of AR application in the orthodontic field [32]. Many clinical treatments can use the AR system, which will make treatments safer and more efficient.

5. Conclusions

Using the AR-assisted bracket navigation system improved the accuracy of bracket placement and decreased the procedure time of lab stage. Specifically, the use of this system increased the accuracy rate with an expert orthodontist in the incisogingival direction and helped the novice orthodontist guide the bracket position within an acceptable clinical error of approximately 0.5 mm. The application of AR in orthodontic bracketing is just a beginning of digitalization, and the orthodontic field will benefit from numerous inventions and development ideas. In addition, the AR-assisted bracket navigation system can serve as a clinical training and education tool for novice dentists.

Author Contributions

Conceptualization, Y.-C.L., G.-A.C. and J.-H.Y.; methodology, Y.-C.L., G.-A.C., J.-T.H. and J.-H.Y.; writing—original draft preparation, Y.-C.L., G.-A.C., Y.-C.L., Y.-H.C., J.-T.H. and J.-H.Y.; writing—Y.-C.L. and G.-A.C. All authors have read and agreed to the published version of the manuscript.

Funding

The authors declare that they have not received funding.

Institutional Review Board Statement

The study was performed in the department of orthodontics, China Medical University Hospital Medical Center, Taichung, Taiwan. The study was approved by the local research ethics committee (CMUH106-REC3-146), and each participant signed an informed consent form.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

Data is contained within the article and the data presented in this study are available.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Sutherland, I.E. A head-mounted three dimensional display. In Proceedings of the December 9–11, 1968, Fall Joint Computer Conference, Part I on—AFIPS ’68 (Fall, Part I); ACM: New York, NY, USA, 1968; pp. 757–764. [Google Scholar]
  2. Caudell, T.; Mizell, D. Augmented reality: An application of heads-up display technology to manual manufacturing processes. In Proceedings of the Twenty-Fifth Hawaii International Conference on System Sciences, Kauai, HI, USA, 7–10 January 1992; pp. 659–669. [Google Scholar] [CrossRef]
  3. Jiang, J.; Huang, Z.; Qian, W.; Zhang, Y.; Liu, Y. Registration Technology of Augmented Reality in Oral Medicine: A Review. IEEE Access 2019, 7, 53566–53584. [Google Scholar] [CrossRef]
  4. Lin, Y.-K.; Yau, H.-T.; Wang, I.-C.; Zheng, C.; Chung, K.-H. A Novel Dental Implant Guided Surgery Based on Integration of Surgical Template and Augmented Reality. Clin. Implant. Dent. Relat. Res. 2013, 17, 543–553. [Google Scholar] [CrossRef] [PubMed]
  5. Pellegrino, G.; Mangano, C.; Mangano, R.; Ferri, A.; Taraschi, V.; Marchetti, C. Augmented reality for dental implantology: A pilot clinical report of two cases. BMC Oral Health 2019, 19, 1–8. [Google Scholar] [CrossRef] [PubMed]
  6. Huang, T.-K.; Yang, C.-H.; Hsieh, Y.-H.; Wang, J.-C.; Hung, C.-C. Augmented reality (AR) and virtual reality (VR) applied in dentistry. Kaohsiung J. Med. Sci. 2018, 34, 243–248. [Google Scholar] [CrossRef] [PubMed]
  7. Andrews, L.F. The straight-wire appliance. Explained and compared. J. Clin. Orthod. 1976, 10, 174–195. [Google Scholar] [PubMed]
  8. Andrews, L.F. The straight-wire appliance, origin, controversy, commentary. J. Clin. Orthod. JCO 1976, 10, 99–114. [Google Scholar] [PubMed]
  9. Andrews, L.F. The straight-wire appliance arch form, wire bending & an experiment. J. Clin. Orthod. JCO 1976, 10, 581–588. [Google Scholar]
  10. Jernberg, G.R.; Bakdash, M.B.; Keenan, K.M. Relationship between Proximal Tooth Open Contacts and Periodontal Disease. J. Periodontol. 1983, 54, 529–533. [Google Scholar] [CrossRef]
  11. Xue, C.; Xu, H.; Guo, Y.; Xu, L.; Dhami, Y.; Wang, H.; Liu, Z.; Ma, J.; Bai, D. Accurate bracket placement using a computer-aided design and computer-aided manufacturing–guided bonding device: An in vivo study. Am. J. Orthod. Dentofac. Orthop. 2020, 157, 269–277. [Google Scholar] [CrossRef] [Green Version]
  12. Koo, B.C.; Chung, C.-H.; Vanarsdall, R.L. Comparison of the accuracy of bracket placement between direct and indirect bonding techniques. Am. J. Orthod. Dentofac. Orthop. 1999, 116, 346–351. [Google Scholar] [CrossRef]
  13. Grünheid, T.; Lee, M.S.; Larson, B.E. Transfer accuracy of vinyl polysiloxane trays for indirect bonding. Angle Orthod. 2016, 86, 468–474. [Google Scholar] [CrossRef] [Green Version]
  14. Rother, C.; Kolmogorov, V.; Blake, A. “GrabCut”. ACM Trans. Graph. 2004, 23, 309–314. [Google Scholar] [CrossRef]
  15. Andrews, L.F. The Straight-Wire Appliance. Br. J. Orthod. 1979, 6, 125–143. [Google Scholar] [CrossRef] [PubMed]
  16. Chiu, A.; Chen, Y.-W.; Hayashi, J.; Sadr, A. Accuracy of CAD/CAM Digital Impressions with Different Intraoral Scanner Parameters. Sensors 2020, 20, 1157. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Andrews, L.F. The six keys to normal occlusion. Am. J. Orthod. 1972, 62, 296–309. [Google Scholar] [CrossRef]
  18. Schmid, J.; Brenner, D.; Recheis, W.; Hofer-Picout, P.; Brenner, M.; Crismani, A.G. Transfer accuracy of two indirect bonding techniques—an in vitro study with 3D scanned models. Eur. J. Orthod. 2018, 40, 549–555. [Google Scholar] [CrossRef]
  19. Ousehal, L.; Lazrak, L.; Troedhan, A.; Kurrek, A.; Wainwright, M. The accuracy of brackets placement in direct bonding technique: A comparison between the pole-like bracket positioning gauge and the star-like bracket positioning gauge. Open J. Stomatol. 2011, 1, 121–125. [Google Scholar] [CrossRef] [Green Version]
  20. Balut, N.; Klapper, L.; Sandrik, J.; Bowman, D. Variations in bracket placement in the preadjusted orthodontic appliance. Am. J. Orthod. Dentofac. Orthop. 1992, 102, 62–67. [Google Scholar] [CrossRef] [Green Version]
  21. Kalange, J.T. Prescription-Based Precision Full Arch Indirect Bonding. Semin. Orthod. 2007, 13, 19–42. [Google Scholar] [CrossRef] [Green Version]
  22. Sondhi, A. Effective and Efficient Indirect Bonding: The Sondhi Method. Semin. Orthod. 2007, 13, 43–57. [Google Scholar] [CrossRef]
  23. Moskowitz, E.M. Indirect Bonding with a Thermal Cured Composite. Semin. Orthod. 2007, 13, 69–74. [Google Scholar] [CrossRef]
  24. Aichert, A.; Wein, W.; Ladikos, A.; Reichl, T.; Navab, N. Image-Based Tracking of the Teeth for Orthodontic Augmented Reality; Springer: Berlin/Heidelberg, Germany, 2012; pp. 601–608. [Google Scholar]
  25. Casko, J.S.; Vaden, J.L.; Kokich, V.G.; Damone, J.; James, R.; Cangialosi, T.J.; Riolo, M.L.; Owens, S.E.; Bills, E.D. Objective grading system for dental casts and panoramic radiographs. Am. J. Orthod. Dentofac. Orthop. 1998, 114, 589–599. [Google Scholar] [CrossRef]
  26. Castilla, A.E.; Crowe, J.J.; Moses, J.R.; Wang, M.; Ferracane, J.L.; Covell, D.A. Measurement and comparison of bracket transfer accuracy of five indirect bonding techniques. Angle Orthod. 2014, 84, 607–614. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Hung, H.-C.; Wang, Y.-C.; Wang, Y.-C. Applications of Artificial Intelligence in Orthodontics. Taiwan J. Orthod. 2020, 32, 3. [Google Scholar]
  28. Prados-Privado, M.; Villalón, J.G.; Martínez-Martínez, C.H.; Ivorra, C. Dental Images Recognition Technology and Applications: A Literature Review. Appl. Sci. 2020, 10, 2856. [Google Scholar] [CrossRef] [Green Version]
  29. Chen, H.; Zhang, K.; Lyu, P.; Li, H.; Zhang, L.; Wu, J.; Lee, C.-H. A deep learning approach to automatic teeth detection and numbering based on object detection in dental periapical films. Sci. Rep. 2019, 9, 1–11. [Google Scholar] [CrossRef] [Green Version]
  30. Al-Falahy, N.; Alani, O.Y.K. Technologies for 5G Networks: Challenges and Opportunities. IT Prof. 2017, 19, 12–20. [Google Scholar] [CrossRef] [Green Version]
  31. Farronato, M.; Maspero, C.; Lanteri, V.; Fama, A.; Ferrati, F.; Pettenuzzo, A.; Farronato, D. Current state of the art in the use of augmented reality in dentistry: A systematic review of the literature. BMC Oral Health 2019, 19, 1–15. [Google Scholar] [CrossRef] [Green Version]
  32. Kwon, H.-B.; Park, Y.-S.; Han, J.-S. Augmented reality in dentistry: A current perspective. Acta Odontol. Scand. 2018, 76, 497–503. [Google Scholar] [CrossRef]
Figure 1. Protocol of the augmented reality–assisted bracket navigation system in the experiment. The protocol was divided into the computer engineering stage and the clinical stage, allowing convenient, precise, and concise communication with the engineer.
Figure 1. Protocol of the augmented reality–assisted bracket navigation system in the experiment. The protocol was divided into the computer engineering stage and the clinical stage, allowing convenient, precise, and concise communication with the engineer.
Applsci 11 02315 g001
Figure 2. The setting andactual clinical operation of the AR–assisted bracket navigation system.
Figure 2. The setting andactual clinical operation of the AR–assisted bracket navigation system.
Applsci 11 02315 g002
Figure 3. Control group by Boone gauge measurement.
Figure 3. Control group by Boone gauge measurement.
Applsci 11 02315 g003
Figure 4. The variables F, B, D, P, x, y, and Δ denote the facial axis of the clinical crown (FACC), bracket, distance, pixel, mesiodistal direction, incisogingival direction, and bracket offset, respectively. Through scale-ruler–based proportional measurement conversions, we mapped the bracket position data (planned prior to the operation) to real-time images.
Figure 4. The variables F, B, D, P, x, y, and Δ denote the facial axis of the clinical crown (FACC), bracket, distance, pixel, mesiodistal direction, incisogingival direction, and bracket offset, respectively. Through scale-ruler–based proportional measurement conversions, we mapped the bracket position data (planned prior to the operation) to real-time images.
Applsci 11 02315 g004
Figure 5. After image segmentation, pixel-to-mm conversion was performed using the mean of the left-to-target and right-to-target FACC distances (rather than the distance between the incisor line and gingiva, which is susceptible to gingival changes).
Figure 5. After image segmentation, pixel-to-mm conversion was performed using the mean of the left-to-target and right-to-target FACC distances (rather than the distance between the incisor line and gingiva, which is susceptible to gingival changes).
Applsci 11 02315 g005
Figure 6. Assessment method of accurate bracket positioning and using digital modeling to analyze the bracket position.
Figure 6. Assessment method of accurate bracket positioning and using digital modeling to analyze the bracket position.
Applsci 11 02315 g006
Figure 7. The registration method used real-time natural feature registration to superimpose the ideal bracket position of the virtual object on the tooth surface. The real-time corner detection algorithm was used to achieve real-world integrity and high registration accuracy.
Figure 7. The registration method used real-time natural feature registration to superimpose the ideal bracket position of the virtual object on the tooth surface. The real-time corner detection algorithm was used to achieve real-world integrity and high registration accuracy.
Applsci 11 02315 g007
Table 1. Differences in the distance between the simulated and actual post-operative bracket positions.
Table 1. Differences in the distance between the simulated and actual post-operative bracket positions.
MethodDirectionSample SizeMedium ± IQR (mm)Sample SizeNoviceExpertp Value *
Medium ± IQR (mm)Medium ± IQR (mm)
BooneX620.32 ± 0.18310.28 ± 0.090.36 ± 0.210.495
ARX620.26 ± 0.11310.27 ± 0.160.25 ± 0.100.942
p + value0.414 0.920.21
BooneY620.64 ± 0.37310.90 ± 0.060.40 ± 0.29<0.001
ARY620.35 ± 0.15310.51 ± 0.240.29 ± 0.08<0.001
p + value<0.001 <0.001<0.05
*: Mann-Whitney U test; +: Wilcoxon Signed-Rank Test; augmented reality (AR), AR-assisted bracket navigation system; X: Mesiodistal direction (mm); Y: Incisogingival direction (mm); IQR: Interquartile range.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Lo, Y.-C.; Chen, G.-A.; Liu, Y.-C.; Chen, Y.-H.; Hsu, J.-T.; Yu, J.-H. Prototype of Augmented Reality Technology for Orthodontic Bracket Positioning: An In Vivo Study. Appl. Sci. 2021, 11, 2315. https://doi.org/10.3390/app11052315

AMA Style

Lo Y-C, Chen G-A, Liu Y-C, Chen Y-H, Hsu J-T, Yu J-H. Prototype of Augmented Reality Technology for Orthodontic Bracket Positioning: An In Vivo Study. Applied Sciences. 2021; 11(5):2315. https://doi.org/10.3390/app11052315

Chicago/Turabian Style

Lo, Yu-Cheng, Guan-An Chen, Yin-Chun Liu, Yuan-Hou Chen, Jui-Ting Hsu, and Jian-Hong Yu. 2021. "Prototype of Augmented Reality Technology for Orthodontic Bracket Positioning: An In Vivo Study" Applied Sciences 11, no. 5: 2315. https://doi.org/10.3390/app11052315

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop