Next Article in Journal
Assessment of High Performance Self-Consolidating Concrete through an Experimental and Analytical Multi-Parameter Approach
Previous Article in Journal
Study on the Superhydrophobic Properties of an Epoxy Resin-Hydrogenated Silicone Oil Bulk Material Prepared by Sol-Gel Methods
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Chemical Evaluation of Energy Dispersive X-ray Spectroscopy Analysis of Different Failing Dental Implant Surfaces: A Comparative Clinical Trial

1
Department of Periodontology, Faculty of Dentistry, Kütahya Health Sciences University, Kütahya 43100, Turkey
2
Department of Periodontology, Faculty of Dentistry, Gazi University, Ankara 06500, Turkey
*
Author to whom correspondence should be addressed.
Materials 2021, 14(4), 986; https://doi.org/10.3390/ma14040986
Submission received: 6 January 2021 / Revised: 8 February 2021 / Accepted: 16 February 2021 / Published: 19 February 2021
(This article belongs to the Section Materials Chemistry)

Abstract

:
The aim of the present study is to compare two different implant surface chemistries of failing dental implants. Sixteen patients (mean age: 52 ± 8.27 with eight females and eight males) and 34 implants were included in the study. Group-I implants consisted of a blasted/etched surface with a final process surface, while Group-II implants consisted of the sandblasted acid etching (SLA) method. The chemical surface analysis was performed by the energy dispersive X-ray spectroscopy (EDX) method from coronal, middle, and apical parts of each implant. Titanium (Ti) element values were found to be 20.22 ± 15.7 at.% in Group I and 33.96 ± 13.62 at.% in Group-II in the middle of the dental implants. Aluminum (Al) element values were found to be 0.01 ± 0.002 in Group-I and 0.17 ± 0.28 at.% in Group II in the middle of the dental implants, and statistically significant differences were found between the groups for the Al and Ti elements in the middle of the dental implants (p < 0.05). There was a statistically significant difference for the Ti, Al, O, Ca, Fe, P, and Mg elements in the coronal, middle, and apical parts of the implants in the intragroup evaluation (p < 0.05). It is reported that different parts of the implants affected by peri-implant inflammation show different surface chemistries, from coronal to apical, but there is no difference in the implants with different surfaces.

1. Introduction

Peri-implantitis is an inflammatory disease characterized by alveolar bone loss and increased peri-implant pocket depth [1]. Studies have shown that surface characteristics such as roughness, surface chemistry, and topography increase osseointegration; however, the roughness of the surface makes implant surface decontamination difficult for peri-implantitis treatment. Studies have reported that the risk of peri-implantitis changes for different dental implants with different surface properties [2,3].
Studies have been reported to explain alveolar bone loss due to factors such as implant surface chemistry or corrosion in the occurrence of peri-implantitis. In a study, it was reported that titanium (Ti) is a reactive material, and a nano-thick layer of titanium oxide (TiO2) forms on the surface of the dental implant in contact with air or water [4]; this oxide layer increases the biocompatibility, material-bone interface compatibility, and corrosion resistance of the implant [5]. In a hypothesis presented by Mouhyi et al., it was reported that the formation of an acidic electrochemical environment due to excessive mechanical stress and bacterial biofilm causes the destruction of the oxide layer on the surface of the dental implant and that peri-implant fluids in direct contact with the Ti can be expected to affect this oxide layer [6]. In another hypothesis proposed by Fretwurst, it was claimed that the Ti element released from dental implants could be expected to lead to host tissue response, resulting in peri-implant bone destruction [7]. A review was conducted showing that particles released from the implant surface due to corrosion or mechanical-chemical surface processes cause an inflammatory reaction and thus alveolar bone loss [8].
There is limited evidence of the relationship between implant surface features and design as risk factors for peri-implantitis and marginal bone loss after functional loading. In previous studies, marginal bone loss was reported to be higher in implants with rough surfaces than in implants with moderately rough surfaces [9,10,11]. Another study also reported that peri-implantitis occurred in rough surface implants, and no peri-implantitis cases were recorded in machined implants [12]. However, in a 20 year follow-up study, no difference was found between the machined surface and the rough surface implants in terms of peri-implantitis [13].
Carbon (C), nitrogen (N), calcium (Ca), phosphorus (P), chlorine (Cl), sulfur (S), sodium (Na), and silicon (Si) were detected in addition to a titanium oxide layer on the implant surfaces [12,13]. It is hypothesized that these elements are released as part of an inflammatory response to the chemically degraded implant surfaces; this inflammatory response affects the healing process and provokes the dissolution of Ti [6]. In another study, it was reported that examination of the properties of the implant surface and the chemistry of failing implants would be valuable for understanding the changes caused by peri-implantitis on the implant surface [7].
The hypothesis of this study is that dental implants with different surface properties contain different chemical elements in the areas affected by peri-implantitis. This study aimed to comparatively evaluate the changing implant surface chemical properties due to peri-implantitis in dental implants subjected to different chemical surfaces.

2. Materials and Methods

2.1. Study Population and Eligibility Criteria

This study was designed as a prospective, parallel arm clinical trial, and the study design was approved by the Dumlupınar University Clinical Research Ethics Committee (Research No. 2017-2/5). The study was carried out between January 2017 (first enrollment) and April 2019 (last enrollment) in the Department of Periodontology, Faculty of Dentistry, Kütahya Health Sciences University and Gazi University. The research was conducted in accordance with the Declaration of Helsinki of 1975, revised in 2013. All patients were informed and signed consent forms.
Patients were included with the following criteria: systemically healthy, no radiotherapy or chemotherapy, no temporomandibular joint problems, psychological acceptance of surgical and prosthetic treatment, good oral hygiene, no medication for bone metabolism disorder (especially bisphosphonate), and no pregnancy or lactation.
Patients who applied to the periodontology departments in both centers who had dental implants were included in the study according to certain criteria after clinical and radiological examination and the Dental Implants Health Scale [14]. According to the scale, dental implant removal indications are as follows: (a) pain in function; (b) mobility: a tweezer was fixed at the buccal or palatinal side of the crown; the other tweezer was moved horizontally (buccolingual); and the presence and degree of mobility were evaluated according to the Miller classification [15]; (c) radiographic bone loss that was higher than ½ of the implant length; (d) the persistent presence of pus after phase I treatment.
Dental implants with the following criteria were excluded from the study: (1) peri-implant pocket depth of 5 mm or less after phase I treatment; (2) vertical bone defects; (3) periapical infection around the implant area; (4) antibiotic usage for at last 6 months.
Dental implants were examined in two parts according to their surface characteristics. Group I implant consisted of a blasted/etched surface with a final process surface, while Group II implants consisted of the sandblasted acid etching (SLA) method. Group I blasted and final process surfaces were Legacy II (Implant Direct, Thousand Oaks, CA, USA) and Bicon Integra CP (Bicon systems, Boston, MA, USA) dental implant brands, while Group II implants consisted of Straumann BL Tapered (Straumann Holding, Basel, Switzerland), XiveR S (Dentsply Sirona Implants, Mannheim, Germany), DTI (TUBITAK, Gebze, Kocaeli, Turkey), Neo Implants (Alpha Biotec Implantology, Washington, DC, USA), MIS C1 (Divident, Yehudah, Israel), and AstraTech (Denstply Sirona, Gothenburg, Sweden) implants with SLA surfaces.

2.2. Clinical and Radiographical Measurements

All clinical measurements were recorded using the Williams-type periodontal probe, and participants received the phase I treatment and oral hygiene instructions. Patients were revaluated after four weeks of phase I periodontal treatment, and the data obtained from the peri-implant region with extraction indication were as follows as outcome measurements: (1) periodontal pocket depth (PD); the distance between the gingival margin and the bottom of a pocket; (2) clinical attachment level (CAL); the distance from the neck of the implant and the bottom of the pocket; (3) implant length: the distance between the dental implant apical point and implant shoulder. Implant length was measured by a periodontal probe after the dental implant was extracted, and surface chemical analysis was performed. Clinical measurements were recorded using a periodontal probe from four points around the peri-implant region (mesiobuccal, distobuccal, mesiolingual, distolingual).
Radiographic measurements such as marginal bone loss and implant length were obtained by a digital software program [16] (Mediadent Software, The Dental Imaging Company, London, UK). Radiographic bone loss (RBL) was measured on periapical radiographs. Bone loss level was measured with software as the distance from the implant shoulder and the first bone-implant contact. For each implant, one RBL value was calculated as the mean of the mesial and distal values [17]. The implant length was evaluated as the distance between the implant shoulder and the most apical point of the implant in the software program. The bone loss/implant length ratio was measured on periapical radiographs, and values were recorded as percentages.
Occlusal trauma: Occlusion, bite papers, and primary contacts were evaluated for primary evaluation. Bruxism and myofascial pain were evaluated for chronic occlusal trauma.
Primary outcome measurements were implant surface chemical analysis. Secondary outcome measurements were the relation with chemical analysis and periodontal pocket depth, clinical attachment level, and implant length.

2.3. Retrieval Procedure for the Dental Implants

After local anesthesia was administered, it was removed using a stainless-steel forceps by rotating counterclockwise. To avoid damaging the surface on which the chemical analysis of the dental implants would be performed, it was ensured that the end of the forceps did not exceed the implant-abutment junction [13]. After removal of the dental implant, blood was removed from the surface of the implant with saline; the implant was then dehydrated with gradually ethanol solutions ranging from 70 to 99 % alcohol [13], dried at room temperature, and placed in a sterile plastic box.

2.4. Scanning Electron Microscopy and Energy Dispersive X-ray Spectrometry Analysis

All dental implants were taken from their storage boxes as delivered. They were handled with tweezers.
Images of the samples were taken using a field emission scanning electron microscope NovaTM NANOSEM 650 (FEI Company, Hillsboro, OR, USA) at the same working distance ranging between 6 and 15 mm, an acceleration voltage of 20 kV, a beam current of 650 pA, and an acquisition time of 150 live seconds. All images of dental implants were also morphologically evaluated using a calibrated scanning electron microscope (SEM) at ×250 and ×2000 (Figure 1). The samples were placed on carbon discs and carbon plaster for fixation and then placed inside the microscope chamber under vacuum conditions.
Energy dispersive X-ray spectrometry (EDX) analyses of all implants were performed on the coronal, middle, and apical regions of the implants. Additionally, chemical surface analyses with EDX were performed on the top, valley, and flank parts of the screw of each implant in these three regions. (Figure 2)

2.5. Statistical Analysis

The data were analyzed using the software program SPSS [18] for Windows v. 20.0. All parameters were analyzed by the Kolmogorov–Smirnov test for normality distribution. Continuous variables were expressed as mean ± SD and categorical variables as numbers and percentages. The groups were compared using the Mann–Whitney U test for continuous variables. Normality distributions were evaluated using the Shapiro–Wilk test for analysis within the group. Since Ti, O, C, and N are parametric data, the one-way ANOVA test was used for analysis; the Kruskal–Wallis test used for the K, Al, Ca, Cu, Cr, Fe, S, P, and Mg elements was non-parametric. Multivariate stepwise linear regression analyses were conducted using all three different models for periodontal pocket depth; the coronal, middle, and apical regions of dental implants as the dependent variables. For all the equations, the independent variables were those with p-values < 0.05 in univariate analyses (for the coronal region of implants, Mg, N, Al; for the middle region of implants; for the apical region of implants S, Al, P, N). A p-value less than 0.05 was considered statistically significant.

3. Results

A total of 16 patients, 8 females and 8 males, and 34 implants were included in the study. The mean age of the included patients was 52 ± 8.27 years, between 33 to 62 years.

3.1. Demographic Data

The survival time of the implants ranged from 18 months to 14 years, and the mean value was 4.94 ± 3.18 years. Maxillary and mandibular molar regions were the most common locations from which the implants were retrieved. Dental implants were examined in two parts according to their surface properties. Group I consisted of surfaces obtained by blasted and etched surfaces with a final process (n = 9), while Group II were the sand blasted acid etching (SLA) method (n = 25). The dental implant brand distribution is shown in Table 1.
The dental implants were evaluated for dental implant health according to clinical measurements and using the Dental Implant Health Scale [14]. Indications for retrieval of dental implants were pain in function 44.4% in Group I and 72% in Group II, pus formation recorded as 55.5% in Group I and 76% in Group II, and mobility seen in 8% in Group II. The ratio of radiographic bone loss to implant length was measured as 0.55 ± 0.39% in Group I and 0.47 ± 0.33% in Group II. (Table 2).
The mean values of the peri-implant clinical measurements are given in Table 3. The mean PD value was 5.39 ± 2.25 mm for Group I and 6.12 ± 1.76mm for Group II; the mean CAL value was 5.73 ± 2.7 mm for Group I and 6.3 ± 1.65 mm for Group II; and there were no statistically significant differences between the groups. The mean implant length was found to be 7.89 ± 2.24 mm for Group I and 9.32 ± 1.43 mm for Group II, and there were statistically significant differences between the groups (p = 0.037) (Table 2).

3.2. Surface Chemistry Analysis

The chemical surfaces of the coronal, middle, and apical regions of all dental implants were analyzed between the groups, and the results are shown in Table 3. According to the results, the Ti, O, and C elements were detected on all implant surfaces. The weighted elements were Al, Ca, N, and P, and the Fe, Cr, Mg, Cu, K, and S elements were found in very small amounts and on a small number of implant surfaces.
There were statistically significant differences in the middle region of dental implants for the Al and Ti elements as percentages of the atomic number of the atoms (at.%). Ti element values were found to be 20.22 ± 15.7 in Group I and 33.96 ± 13.62 at.% in Group II in the middle of the dental implants. Al element values were found to be 0.01 ± 0.002 at.% in Group I and 0.17 ± 0.28 at.% in Group II in the middle of the dental implants, and there were statistically significant differences found between the groups for the Al and Ti elements in middle of the dental implants (p < 0.05) (Table 3).
Intragroup analyses were done from the coronal, apical, and middle regions of the implants and are shown in Table 4. In Group I, a statistically significant difference was found between the implant parts for the Ti, O, C, Al, Ca, Fe, P, and Mg elements. In Group II, a statistically significant difference was found between the implant parts for the Ti, O, N, Al, Ca, S, Fe, P, Mg, and Cu elements (Table 3).
Multivariate stepwise linear regression analysis of the periodontal pocket depth scores for the dental implants’ coronal, middle, and apical models is presented in Table 4. For the coronal periodontal pocket depth model, the independent variables in the equation were Mg-coronal, N-coronal, and Al-coronal. The coefficient of determination R2 of the subjective age was 0.407, indicating that these three factors can explain 41% of all coronal periodontal pocket depth model variations. For the middle periodontal pocket depth model, the only independent variable was Al-middle and the coefficient of determination.
R2 was 0.169, indicating Al-middle can explain 16 % of all variations of the middle model of periodontal pocket depth. Lastly, for the apical periodontal pocket depth model, the independent variables in the equation were S-apical, Al-apical, P-apical, and N-apical. The coefficient of determination R2 of the apical model was 0.556, indicating that these four factors can explain 55 % of all apical periodontal pocket depth model variations (Table 4).

4. Discussion

In the study, a statistically significant difference was found in terms of the Ti and Al values in the evaluation of two different implant surface chemistries, but no significant difference was found in terms of other elements between the groups. Otherwise, intragroup surface chemistry evaluation between the different parts of the implants was found to be statistically different. Although the chemistry of the affected surfaces due to peri-implant inflammation was mostly similar in implants with different implant surface properties, statistically significant different chemical values were found between different regions of the implant affected by peri-implant inflammation in intra-group evaluations. These findings may also support that implant coronal to apical surfaces affected by peri-implant inflammation show different chemical compositions.
Recently, a new definition of osseointegration was reported [2]: “osseointegration is a foreign body reaction where interfacial bone is formed as a defense reaction to shield off the implant from the tissues.” Excessive hydrogen peroxide (H2O2) production occurs against implant foreign bodies, and the TiO2 layer on the surface thickens. Oxygen radicals integrate into the implant surface, and the thickening of the TiO2 layer allows integration of Ca and P ions from the alveolar bone to the TiO2 surface [19,20]. The protective oxide layer on the metal structures ensures that the ions released due to corrosion are kept at a very low level and there is no non-corrosive metal in contact with body fluids [21]. In a study, peri-implant bone and implant surfaces were evaluated by EDX analysis using human cadavers, and Ca and P were found in the peri-implant alveolar bone tissue, while only Ti was found on the implant surface [22]. The chemical analysis performed by Shibli et al. on failed implants suggested that elements such as C, Ca, Na, and P result from the absorption of dissolved ions naturally formed from body fluids [19]. It is known that bone resorption and bone remodeling occur in bone tissue in response to inflammation [23]. In the present study, Ti and O levels increased on both implant surfaces from coronal to apical. However, like the above-mentioned study, it was seen that the Ca and P values also increased. It can be said that with the increase in TiO2 thickness, Ca and P elements on the implant surface increase, and ions in the alveolar bone are the origin.
In some commercial implant systems, different implant surface modification techniques are used to increase osseointegration and reduce corrosion resistance. Sand blasting and acid etching are the most used techniques, and aluminum oxide (Al2O3) particulates can be used [24]. Sulfuric acid, hydrochloric acid, hydrofluoric acid, or combinations thereof can also be used for acid etching [25]. Ca, P, and Al as the dominant elements in the previously reported studies; therefore, it has been suggested that modification techniques could be responsible for some of these elements detected on the implant surfaces [26]. In this study, it is reported that peri-implant pocket depth is related to the Mg, N, and Al elements in the coronal region, to Al in the middle region, and to S, Al, P, and N in the apical region on SLA surfaces. The relationship between Al in all regions of the dental implants and the depth of the peri-implant pocket can be associated with Al2O3 powders in the process part of the SLA surface. Although the Al element was detected in Group I in the regression analysis performed, no statistically significant relationship was found with the peri-implant pocket depth.
Studies have reported that microorganisms such as Porphyromonas gingivalis (P. gingivalis), which causes periodontal disease, also produce volatile sulfur compounds [27] in acute infections of peri-implantitis with pus, especially red complex microorganisms [28]. Studies have also reported that especially P. gingivalis and red complex microorganisms are the predominant periodontal pathogens of failing dental implants [26,29]. Studies have reported that a large proportion of C and a lower proportion of N, Cl, and S may be relevant in some instances due to contamination of the implant during the construction process [30,31]. In a study, EDX was evaluated using various removal methods on the biofilm layer on the SLA surface of Ti discs placed in the mouth. The C, Si, S, and Ti elements were detected in the control group where only air and water were applied. It has been reported that the source of the C, S, and Si elements can be saliva and biofilm [32]. In the present study, the C element increased in both groups from the coronal to the apical region; however, statistical significance in Group I was found, and there was no statistical significance difference in Group II. The S element concentrations were found to have a statistically significance higher concentration in the coronal area compared to the apical region in both groups, independent of the implant surface properties; however, there were no statistically significant differences between the two different surface characteristics. The sulfur component present on the implant surface may be related to the end products of the microorganisms.
An in vitro study reported that microorganism and bacterial end products cause damage to the titanium oxide layer and change the chemical surfaces of the implants [25]. It has been found that multiple microorganisms such as Aggregatibacter actinomycetemcomitans (A.actinomycetemcomitans), Streptococcus salivarius (S. salivarius), Streptococcus sanguinis (S. sanguinis), and Streptococcus mutans (S. mutans) cause organic acid release from sugar metabolism and cause the corrosion of metals in contact with peri-implant crevicular fluid by making an acidic environment [28]. In some studies, the titanium oxide layer was covered with a C-rich contamination layer, and N, Ca, P, Cl, S, Na, and Si materials have also been reported [21,22]. In another study, it was suggested that the C, N, Cl, S, and Ca elements were found on some dental implant surfaces and may have been absorbed during the preparation of the implant surface [19]. A study evaluated the chemical analysis and surface roughness of different implant surfaces and reported that alumina oxide abrasives from sandblasting were found on the implant surfaces as a contaminant [33]. Dental implants made of metal alloys release potentially harmful ions such as Cr, Co, and Al due to corrosion at the bone-implant interface, and the accumulation of metallic ions can be considered as one of the reasons for implant failure [34]. In this study, especially the SLA surface, increased peri-implant pocket depth and the Al element were related. Furthermore, while the Cu element was not found in blasted surface dental implants, the Cu element was detected in the chemical analysis of SLA surfaces. The Cr element was detected on both implant surfaces, and no difference was found between the groups. When the Al element shows a significant difference in terms of peri-implantitis in the analysis between groups and is associated with the peri-implant pocket depth, the potential for long-term peri-implantitis risk should be evaluated, especially on SLA surfaces.
In another study, it was reported that the Si and P elements could be by-products of Ti production, and that Ca and Na could come from body fluids. It was also reported that Si and C could pass through plastic gloves [35]. Furthermore, it is also thought that elements such as Fe, Mg, Cu, and K, which are detected in small amounts, may be due to contamination during modification of the implant surface or during implant extraction or examination. It is known that the iron ion in hemoglobin is used for the growth of microorganisms such as A.actinomycetemcomitans in relation to Fe [36]. Another study reported that after functional loading and non-osseointegration, when failing dental implants were evaluated by EDX analysis, only Ti and Fe were detected on the surfaces of the implants; however, 38 implants had a mechanical indication for extraction, and the implants had no functional loading [37].
Different ions such as Cl in the saliva can cause metallic corrosion [21]. In a study, a biofilm layer was placed on Ti discs with an SLA surface, and the discs were washed with sterile saline, so NaCl was not included in the EDX analysis results [32]. In this study, although the Na and Cl elements were detected on the chemical surfaces of all implants, they were excluded from the study since they would not provide accurate information about NaCl because the dental implants were extracted and washed with sterile saline.
In a study, microbiological analyses of failed dental implant surfaces revealed that organic materials were observed in different regions, and EDX analysis revealed that titanium oxide and the C, O, N, Na, Ca, and P elements were detected on the surface [37]. A study was reported the chemical analysis of nine different implant systems with X-ray photoelectron spectroscopy (XPS) analysis; N, C, and O were the most common elements, and the source may be the atmosphere; it has been reported that the C ratio is particularly high on the TiUnite surface roughened by the anodization method and Osseospeed surfaces treated with hydrofluoric acid [33]. In this study, it was found that the C ratio in the coronal region was low in both groups and increased towards the apical region. Considering that the high ratio of TiO and the C element is related to osseointegration, it can be considered that the change in the implant chemical surface due to peri-implantitis may cause implant failure.
In a case report, the Ti, O, Al, N, C, F, Ca, Zn, and S elements were detected on the surface of a Ti6Al4V dental implant removed 18 years later by XPS analysis [38]. In a study, it was reported that the Ti, O, N, and Al elements were detected by deep region analysis of the implants, and it was stated that the basic elements of this implant could be N and Al in addition to Ti and O [21]. Annunziata et al. reported that commercially produced Ti can have different degrees of purity and contain elements such as O, C, and Fe as intermediate elements [39]. In a study presented by Ehrenfest et al., the identification cards of the surface properties of dental implants were evaluated, and it was reported that different pollutants were detected during the modification on many surfaces [40]. In the study, it was also mentioned that different ratios of elements in dental implants with the SLA surface obtained with the same technique were the reason for the pollution [40]. A case report was conducted showing that the N element may originate from the atmosphere [38], but in our study, the N element was found at high rates in the coronal region in both groups and could not be detected in the apical regions. Again, in the regression analysis performed, it was found that the N element was associated with the depth of the peri-implant pocket. In our study, it is thought that the N element may be associated with peri-implant inflammation. In our study, dental implants with different roughnesses and topographies were included in both implant surface groups. For this reason, the presence of different brands of implants in the groups makes it difficult to detect and evaluate elements previously specified as impurities in implant identity.
The peri-implant surface properties are important for removing the biofilm layer to resolve peri-implant inflammation, and the surface roughness and chemical composition of the implant surface can have a negative effect on plaque deposition [41]. A study compared dual acid etched surfaces and hybrid acid etched surfaces in terms of peri-implantitis risk; however, there was no statistically significant difference found between the two surfaces [42]. A study compared dual etched, titanium plasma spray, hydroxyapatite coated surfaces, and turned surfaces, and all surfaces were equally susceptible to ligature-induced peri-implantitis [43,44]. In another study, it was reported that the surfaces obtained by anodization had a greater risk of developing peri-implantitis than blasted or acid etching and blasted surfaces [45]. Different implant brands blasted, blasted with acid etching, and treated with the anodization method were evaluated in terms of surface cleanliness, and it was reported by EDX analysis that organic and inorganic contaminants such as iron, magnesium, and aluminum were found in some brands and that these contaminants are structures that disrupt the continuity of the implant surface features [46]. Furthermore, different elements such as Al, P, and N have been reported as inorganic-organic contaminations in some implant brands [46]. Especially, in the SLA group in our study, peri-implant pocket depth was found to be correlated with the Al, Mg, N, and S elements. In the present study, different elements were determined according to the articles in which implant surface identities were evaluated before, and according to our results, there were no differences between implants with different surfaces.
As a limitation, two different implant surfaces were compared in the study, but despite having the same intragroup chemical surface features, the dental implants had different macro and micro designs. Furthermore, it would be better to have resonance frequency analysis measurements done before dental implant extraction. Comparing dental implants of the same brand and surface chemistry may be better in terms of the elimination of confounding factors. When evaluating implant surface chemistry, evaluating the sterile packed surface chemistry of each implant brand and the surface chemistry after peri-implantitis may be effective for evaluating the impact of peri-implant infection on the implant surface. The length of time the implant surface is exposed to peri-implant inflammation can also affect the study results. Therefore, it will be beneficial to study the different survival times of implants with the same implant surface feature and the effect on the implant’s chemical surface.

5. Conclusions

In conclusion, contaminants such as Al, Mg, N, and S are associated with peri-implant pocket depth, especially on SLA surfaces; it is reported that the chemical surface composition of the implant from the coronal to the apical region is associated with peri-implant infection, but there were no difference chemical elements between the different implant surfaces. In further studies, the relationship between the dental implant chemical surface and peri-implant inflammation and pocket depth can be better demonstrated in dental implants of the same brand.

Author Contributions

Concept/design, B.G.; data collection, M.Y. and B.G.; methodology, B.G., A.U., H.H. and M.Y.; data analysis/interpretation, A.U.; drafting the article, H.H.; critical revision of the article, M.Y.; approval of the article, A.U.; funding, B.G.; project administration, B.G., A.U. and H.H., writing, review and editing, M.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by the Scientific Research Projects Commission of Dumlupınar University with Project Number 2017-29.

Institutional Review Board Statement

This study was designed as a prospective, parallel arm clinical trial, and the study design was approved by the Dumlupınar University Clinical Research Ethics Committee (Research No: 2017-2/5). The research was conducted in accordance with the Declaration of Helsinki of 1975, revised in 2013.

Informed Consent Statement

All patients were informed and signed consent forms.

Data Availability Statement

Data can be shared by contacting the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; nor in the decision to publish the results.

References

  1. Berglundh, T.; Armitage, G.; Araujo, M.G.; Avila-Ortiz, G.; Blanco, J.; Camargo, P.M.; Chen, S.; Cochran, D.; Derks, J.; Figuero, E.; et al. Peri-implant diseases and conditions: Consensus report of workgroup 4 of the 2017 World Workshop on the Classification of Periodontal and Peri-Implant Diseases and Conditions. J. Periodontol. 2018, 89, S313–S318. [Google Scholar] [CrossRef] [PubMed]
  2. Albrektsson, T.C.B.; Jacobsson, M.; Wennerberg, A. Osseointegration of implants—A biological and clinical overview. JSM Dent. Surg. 2017, 2, 1022. [Google Scholar]
  3. De Bruyn, H.; Christiaens, V.; Doornewaard, R.; Jacobsson, M.; Cosyn, J.; Jacquet, W.; Vervaeke, S. Implant surface roughness and patient factors on long-term peri-implant bone loss. Periodontology 2017, 73, 218–227. [Google Scholar] [CrossRef]
  4. Ratner, B.D.; Bryant, S.J. Biomaterials: Where We Have Been and Where We Are Going. Annu. Rev. Biomed. Eng. 2004, 6, 41–75. [Google Scholar] [CrossRef]
  5. Shih, Y.-R.V.; Hwang, Y.; Phadke, A.; Kang, H.; Hwang, N.S.; Caro, E.J.; Nguyen, S.; Siu, M.; Theodorakis, E.A.; Gianneschi, N.C.; et al. Calcium phosphate-bearing matrices induce osteogenic differentiation of stem cells through adenosine signaling. Proc. Natl. Acad. Sci. USA 2014, 111, 990–995. [Google Scholar] [CrossRef] [Green Version]
  6. Mouhyi, J.; Ehrenfest, D.M.D.; Albrektsson, T. The Peri-Implantitis: Implant Surfaces, Microstructure, and Physicochemical Aspects. Clin. Implant. Dent. Relat. Res. 2009, 14, 170–183. [Google Scholar] [CrossRef]
  7. Fretwurst, T.; Nelson, K.; Tarnow, D.; Wang, H.-L.; Giannobile, W. Is Metal Particle Release Associated with Peri-implant Bone Destruction? An Emerging Concept. J. Dent. Res. 2017, 97, 259–265. [Google Scholar] [CrossRef]
  8. Oliveira, M.N.; Schunemann, W.V.H.; Mathew, M.T.; Henriques, B.; Magini, R.S.; Teughels, W.; Souza, J.C.M. Can degradation products released from dental implants affect peri-implant tissues? J. Periodontal Res. 2018, 53, 1–11. [Google Scholar] [CrossRef] [PubMed]
  9. Ellegaard, B.; Baelum, V.; Karring, T. Implant therapy in periodontally compromised patients. Clin. Oral Implant. Res. 1997, 8, 180–188. [Google Scholar] [CrossRef]
  10. Albrektsson, T.; Wennerberg, A. Oral implant surfaces: Part 1—Review focusing on topographic and chemical properties of different surfaces and in vivo responses to them. Int. J. Prosthodont. 2004, 17, 536–543. [Google Scholar] [PubMed]
  11. Albrektsson, T.; Wennerberg, A. Oral implant surfaces: Part 2—Review focusing on clinical knowledge of different surfaces. Int. J. Prosthodont. 2004, 17, 544–564. [Google Scholar] [PubMed]
  12. Wennström, J.L.; Ekestubbe, A.; Gröndahl, K.; Karlsson, S.; Lindhe, J. Oral rehabilitation with implant-supported fixed partial dentures in periodontitis-susceptible subjects. A 5-year prospective study. J. Clin. Periodontol. 2004, 31, 713–724. [Google Scholar] [CrossRef]
  13. Shibli, J.A.; D’Avila, S.; Guastaldi, A.C.; Marcantonio, E. Analysis of Failed Commercially Pure Titanium Dental Implants: A Scanning Electron Microscopy and Energy-Dispersive Spectrometer X-ray Study. J. Periodontol. 2005, 76, 1092–1099. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Misch, C.E.; Perel, M.L.; Wang, H.-L.; Sammartino, G.; Galindo-Moreno, P.; Trisi, P.; Steigmann, M.; Rebaudi, A.; Palti, A.; Pikos, M.A.; et al. Implant Success, Survival, and Failure: The International Congress of Oral Implantologists (ICOI) Pisa Consensus Conference. Implant. Dent. 2008, 17, 5–15. [Google Scholar] [CrossRef] [Green Version]
  15. Miller, S.C. Textbook of Periodontia; P. Blakiston’s Son & Co., Inc.: Philadelphia, PA, USA, 1938. [Google Scholar]
  16. Mediadent Software V15; The Dental Imaging Company Ltd.: Shoreham by Sea, UK, 2017.
  17. Lombardi, T.; Berton, F.; Salgarello, S.; Barbalonga, E.; Rapani, A.; Piovesana, F.; Gregorio, C.; Barbati, G.; Di Lenarda, R.; Stacchi, C. Factors Influencing Early Marginal Bone Loss around Dental Implants Positioned Subcrestally: A Multicenter Prospective Clinical Study. J. Clin. Med. 2019, 8, 1168. [Google Scholar] [CrossRef] [Green Version]
  18. Statistical Package for the Social Sciences for Windows v. 20.0; IBM Statistical Package: Armonk, NY, USA, 13 April 2020.
  19. Wälivaara, B.; Aronsson, B.-O.; Rodahl, M.; Lausmaa, J.; Tengvall, P. Titanium with different oxides: In vitro studies of protein adsorption and contact activation. Biomaterials 1994, 15, 827–834. [Google Scholar] [CrossRef]
  20. Eriksson, C.; Lausmaa, J.; Nygren, H. Interactions between human whole blood and modified TiO2-surfaces: Influence of surface topography and oxide thickness on leukocyte adhesion and activation. Biomaterials 2001, 22, 1987–1996. [Google Scholar] [CrossRef]
  21. Chaturvedi, T.P. An overview of the corrosion aspect of dental implants (titanium and its alloys). Indian J. Dent. Res. 2009, 20, 91–98. [Google Scholar] [CrossRef] [PubMed]
  22. Abbott, J.R.; Marino, V.; Bartold, P.M. Human cadaveric histomorphological and metallurgical analysis of dental implants following 12.5 years of service. Clin. Oral Implant. Res. 2014, 25, 266–271. [Google Scholar] [CrossRef]
  23. Insua, A.; Monje, A.; Wang, H.-L.; Miron, R.J. Basis of bone metabolism around dental implants during osseointegration and peri-implant bone loss. J. Biomed. Mater. Res. Part A 2017, 105, 2075–2089. [Google Scholar] [CrossRef]
  24. Medvedev, A.; Ng, H.; Lapovok, R.; Estrin, Y.; Lowe, T.; Anumalasetty, V. Effect of bulk microstructure of commercially pure titanium on surface characteristics and fatigue properties after surface modification by sand blasting and acid-etching. J. Mech. Behav. Biomed. Mater. 2016, 57, 55–68. [Google Scholar] [CrossRef]
  25. Revathi, A.; Borrás, A.D.; Muñoz, A.I.; Richard, C.; Manivasagam, G. Degradation mechanisms and future challenges of titanium and its alloys for dental implant applications in oral environment. Mater. Sci. Eng. C 2017, 76, 1354–1368. [Google Scholar] [CrossRef]
  26. Shibli, J.A.; Vitussi, T.R.C.; Garcia, R.V.; Zenóbio, E.G.; Ota-Tsuzuki, C.; Cassoni, A.; Piattelli, A.; D’Avila, S. Implant Surface Analysis and Microbiologic Evaluation of Failed Implants Retrieved From Smokers. J. Oral Implant. 2007, 33, 232–238. [Google Scholar] [CrossRef]
  27. Yoshida, A.; Yoshimura, M.; Ohara, N.; Yoshimura, S.; Nagashima, S.; Takehara, T.; Nakayama, K. Hydrogen Sulfide Production From Cysteine and Homocysteine by Periodontal and Oral Bacteria. J. Periodontol. 2009, 80, 1845–1851. [Google Scholar] [CrossRef] [PubMed]
  28. Albertini, M.; López-Cerero, L.; O’Sullivan, M.G.; Chereguini, C.F.; Ballesta, S.; Ríos, V.; Herrero-Climent, M.; Bullón, P. Assessment of periodontal and opportunistic flora in patients with peri-implantitis. Clin. Oral Implant. Res. 2015, 26, 937–941. [Google Scholar] [CrossRef]
  29. Mombelli, A.; Feloutzis, A.G.; Brägger, U.; Lang, N.P. Treatment of peri-implantitis by local delivery of tetracycline. Clin. Oral Implant. Res. 2001, 12, 287–294. [Google Scholar] [CrossRef] [PubMed]
  30. Lee, B.-S.; Shih, K.-S.; Lai, C.-H.; Takeuchi, Y.; Chen, Y.-W. Surface property alterations and osteoblast attachment to contaminated titanium surfaces after different surface treatments: An in vitro study. Clin. Implant. Dent. Relat. Res. 2018, 20, 583–591. [Google Scholar] [CrossRef] [PubMed]
  31. Olefjord, I.; Hansson, S. Surface analysis of four dental implant systems. Int. J. Oral Maxillofac. Implant. 1993, 8, 32–40. [Google Scholar]
  32. Tastepe, C.S.; Liu, Y.; Visscher, C.M.; Wismeijer, D. Cleaning and modification of intraorally contaminated titanium discs with calcium phosphate powder abrasive treatment. Clin. Oral Implant. Res. 2012, 24, 1238–1246. [Google Scholar] [CrossRef] [Green Version]
  33. Nicolas-Silvente, A.I.; Velasco-Ortega, E.; Ortiz-Garcia, I.; Monsalve-Guil, L.; Gil, J.; Jimenez-Guerra, A. Influence of the Titanium Implant Surface Treatment on the Surface Roughness and Chemical Composition. Materials 2020, 13, 314. [Google Scholar] [CrossRef] [Green Version]
  34. Sansone, V. The effects on bone cells of metal ions released from orthopaedic implants. A review. Clin. Cases Miner. Bone Metab. 2013, 10, 34–40. [Google Scholar] [CrossRef]
  35. Han, C.-H.; Johansson, C.B.; Wennerberg, A.; Albrektsson, T. Quantitative and qualitative investigations of surface enlarged titanium and titanium alloy implants. Clin. Oral Implant. Res. 1998, 9, 1–10. [Google Scholar] [CrossRef] [PubMed]
  36. Stacy, A.; Abraham, N.; Jorth, P.; Whiteley, M. Microbial Community Composition Impacts Pathogen Iron Availability during Polymicrobial Infection. PLOS Pathog. 2016, 12, e1006084. [Google Scholar] [CrossRef]
  37. Pinto, C.M.S.d.A.; Goulart, D.R.; Asprino, L.; Olate, S.; de Moraes, M. Evaluation of Failed Implants by Metallographic and Energy Dispersive X-ray Analysis. Implant. Dent. 2018, 27, 69–73. [Google Scholar] [CrossRef] [PubMed]
  38. Monje, A.; García, R.G.; Calderón, M.F.; Oliva, M.H.; Martín, M.L.G.; Del Amo, F.S.-L.; Moreno, P.G.; Wang, H.-L.; Monje, F.; Suarez, F. Surface Topographical Changes of a Failing Acid-Etched Long-Term in Function Retrieved Dental Implant. J. Oral Implant. 2016, 42, 12–16. [Google Scholar] [CrossRef]
  39. Annunziata, M.; Guida, L. The Effect of Titanium Surface Modifications on Dental Implant Osseointegration. Craniofacial Sutures 2015, 17, 62–77. [Google Scholar] [CrossRef]
  40. Ehrenfest, D.M.; Corso, M.D.; Kang, B.S.; Leclercq, P.; Mazor, Z.; Horowitz, A.R.; Russe, P.; Oh, H.K.; Zou, D.R.; Shibli, J.A.; et al. Identification Card and Codification of the Chemical and Morphological Characteristics of 62 Dental Implant Surfaces. Part 3: Sand-Blasted/Acid-Etched (SLA Type) and Related Surfaces (Group 2A, main subtractive process). POSEIDO 2014, 2, 37–55. [Google Scholar]
  41. Teughels, W.; Assche, N.V.; Sliepen, I.; Quirynen, M. Effect of material characteristics and/or surface topography on biofilm development. Clin. Oral Implant. Res. 2006, 17, 68–81. [Google Scholar] [CrossRef]
  42. Zetterqvist, L.; Feldman, S.; Rotter, B.; Vincenzi, G.; Wennström, J.L.; Chierico, A.; Stach, R.M.; Kenealy, J.N. A Prospective, Multicenter, Randomized-Controlled 5-Year Study of Hybrid and Fully Etched Implants for the Incidence of Peri-Implantitis. J. Periodontol. 2010, 81, 493–501. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Shibli, J.A.; Martins, M.C.; Lotufo, R.F.M.; Marcantonio, E. Microbiologic and radiographic analysis of ligature-induced peri-implantitis with different dental implant surfaces. Int. J. Oral Maxillofac. Implant. 2003, 18, 383–390. [Google Scholar]
  44. Martins, M.C.; Abi-Rached, R.S.G.; Shibli, J.A.; Araujo, M.W.B.; Marcantonio, E. Experimental peri-implant tissue breakdown around different dental implant surfaces: Clinical and radiographic evaluation in dogs. Int. J. Oral Maxillofac. Implant. 2004, 19, 839–848. [Google Scholar]
  45. Albouy, J.-P.; Abrahamsson, I.; Persson, L.G.; Berglundh, T. Spontaneous progression of ligatured induced peri-implantitis at implants with different surface characteristics. An experimental study in dogs II: Histological observations. Clin. Oral Implant. Res. 2009, 20, 366–371. [Google Scholar] [CrossRef] [PubMed]
  46. Duddeck, D.U.; Albrektsson, T.; Wennerberg, A.; Larsson, C.; Beuer, F. On the Cleanliness of Different Oral Implant Systems: A Pilot Study. J. Clin. Med. 2019, 8, 1280. [Google Scholar] [CrossRef] [PubMed] [Green Version]
Figure 1. Scanning electron microscopy images of a failing dental implant: (A) Group I implant surface at ×2000 magnification; (B) Group II implant surface at ×2000 magnification; (C) EDX analysis diagram of Group I; (D) EDX analysis diagram of Group II.
Figure 1. Scanning electron microscopy images of a failing dental implant: (A) Group I implant surface at ×2000 magnification; (B) Group II implant surface at ×2000 magnification; (C) EDX analysis diagram of Group I; (D) EDX analysis diagram of Group II.
Materials 14 00986 g001
Figure 2. (a,b) SEM images on the top, valley, and flank parts of fixtures; (c) EDX analysis of the top parts; (d) EDX analysis of the valley parts; (e) EDX analysis of the flank parts of fixtures.
Figure 2. (a,b) SEM images on the top, valley, and flank parts of fixtures; (c) EDX analysis of the top parts; (d) EDX analysis of the valley parts; (e) EDX analysis of the flank parts of fixtures.
Materials 14 00986 g002
Table 1. Demographic data of the dental implants.
Table 1. Demographic data of the dental implants.
Dental Implant Location(n = 34 Dental Implants)
Right-left maxillary molar12 (35.29%)
Right-left mandibulary molar18 (52.94%)
Right-left maxillary incisors1 (2.94%)
Right-left mandibulary incisors3 (8.82%)
Implant survival year (mean ± SD; min-max year)4.94 ± 3.38 (1.5–14)
Implant commercial name and surface structure
Xive S (Dentsply Sirona Implants, Mannheim, Germany)2
Neo Implants (Alpha Biotec Implantology, Washington, DC, USA)7
Legacy II (ImplantDirect, Thousand Oaks, CA, USA)7
DTI (TUBITAK, Gebze, Kocaeli, Turkey)4
AstraTech (Denstply Sirona, Mölndal, Sweden)3
Bicon Integra CP (Bicon systems, Boston, MA, USA)2
MIS C1 (Divident, Yehudah, Israel)7
Straumann BL Tapered (Straumann Holding, Basel, Switzerland)2
Table 2. Comparison of periodontal measurements and Dental Implant Health Scale parameters.
Table 2. Comparison of periodontal measurements and Dental Implant Health Scale parameters.
Clinical MeasurementsGroup I (n = 9) Mean ± SDGroup II (n = 25) Mean ± SDp-Values
PD5.39 ± 2.256.12 ± 1.760.280
CAL5.73 ± 2.76.3 ± 1.650.216
Implant Length (mm)7.89 ± 2.249.32 ± 1.430.037
Pus55.5% (5/9)76.0% (19/25)0.355
Functional Pain44.4% (4/9)72.0% (18/25)0.237
Radiographic Bone Loss/Implant Length0.55 ± 0.390.47 ± 0.330.584
Occlusal Trauma %44.4% (4/9)24% (6/25)0.092
Mobility (Miller Class 2)08.0% (2/25)-
PI: Plaque Index, GI: Gingival Index, PD: periodontal pocket Depth, GR: gingival recession, CAL: clinical attachment level, KGW: keratinized gingival width, BOP: bleeding on probing. The Mann–Whitney U Test was performed for statistical analysis. Statistical significance was p < 0.05.
Table 3. The comparative chemical surface analysis of different regions of dental implant surfaces as atomic weight % between the groups and intragroup.
Table 3. The comparative chemical surface analysis of different regions of dental implant surfaces as atomic weight % between the groups and intragroup.
Group IGroup IIp-Values
Coronal *Middle **Apical ***p-ValuesCoronal *Middle **Apical ***p-Values
Ti6.17 ± 6.4820.22 ± 15.6923.26 ± 19.10.0493.59 ± 4.2533.96 ± 13.6233.36 ± 17.470.000* 0.22 ** 0.02 *** 0.23
O39.36 ± 19.43.8 ± 2.526.29 ± 3.00.00030.6 ± 11.173.67 ± 4.3126.29 ± 9.70.000* 0.15 ** 0.69 *** 0.84
C19.77 ± 5.0121.3 ± 9.7940.9 ± 22.080.00724.9 ± 9.722.9 ± 8.528.7 ± 16.650.247* 0.14 ** 1.00 *** 0.15
N27.86 ± 21.24000.66136.85 ± 18.937.32 ± 3.2900.000* 0.20 ** - *** 0.13
Al0.03 ± 0.0604.51 ± 2.650.0000.15 ± 0.250.16 ± 0.274.94 ± 3.80.000* 0.20 ** 0.02 *** 0.70
Ca0.02 ± 0.076.6 ± 16.012.09 ± 2.570.0010.04 ± 0.172.64 ± 2.323.6 ± 3.20.000* 0.84 ** 0.14 *** 0.16
S1.3 ± 2.870.26 ± 0.440.120.2641.32 ± 0.240.11 ± 0.150.21 ± 0.180.001* 0.33 ** 0.81 *** 0.16
K3.03 ± 3.7600.40.8533.99 ± 3.910.40.270.955* 0.59 ** -*** 0.32
Fe0.1 ± 0.161.380.420.0660.04 ± 0.080.7 ± 0.180.36 ± 0.060.001* 0.24 ** 0.22 *** 0.22
Cr0.5 ± 0.980.3400.5900.62 ± 1.080.14 ± 0.130.27 ± 0.070.537* 0.66 ** 0.31 *** -
P00.69 ± 0.931.7 ± 1.560.0000.17 ± 0.081.3 ± 1.451.77 ± 1.650.000* 0.55 ** 0.39 *** 0.96
Mg000.30.0030.1 ± 0.4200.550.001* 0.39 ** - *** 0.32
Cu000-0.46 ± 0.230.57 ± 0.681.17 ± 0.50.000* 0.55 ** - *** -
The Mann–Whitney-U test was performed for between groups (p value). One-way ANOVA and Kruskal–Wallis tests were used for intragroup comparison (p value). p- and p-values were 0.05 for statistical significance. p values indicated the significance value for between the groups: * coronal, ** middle, *** apical.
Table 4. Multiple step linear regression analysis of elements affecting the relationship between peri-implant pocket depth and implant surface chemical analysis in Group II.
Table 4. Multiple step linear regression analysis of elements affecting the relationship between peri-implant pocket depth and implant surface chemical analysis in Group II.
Peri-Implant PD ElementsBSEβtp-Value
Peri-implant PD-Coronal *
Mg12.6783.7340.493.3950.002
N0.1970.0710.3972.7770.009
Al0.1380.0550.3612.5360.017
Peri-implant PD-Middle **
Al0.2010.0790.4112.5480.016
Peri-implant PD-Apical ***
S6.0651.310.6174.6290.000
Al0.3450.080.6044.3070.000
P0.140.0510.3552.7250.011
N0.3670.1730.3112.1220.042
* F = 6.863, R = 0.638, R2 = 0.407; ** F = 6.49, R = 0.411, R2 = 0.169; *** F = 9.088, R = 0.746, R2 = 0.556; Β: partial regression coefficient; β: standard regression coefficient; SE: standard error; Mg: magnesium; N: nitrogen; Al: aluminum; S: sulfur; P: phosphorus.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Guler, B.; Uraz, A.; Hatipoğlu, H.; Yalım, M. Chemical Evaluation of Energy Dispersive X-ray Spectroscopy Analysis of Different Failing Dental Implant Surfaces: A Comparative Clinical Trial. Materials 2021, 14, 986. https://doi.org/10.3390/ma14040986

AMA Style

Guler B, Uraz A, Hatipoğlu H, Yalım M. Chemical Evaluation of Energy Dispersive X-ray Spectroscopy Analysis of Different Failing Dental Implant Surfaces: A Comparative Clinical Trial. Materials. 2021; 14(4):986. https://doi.org/10.3390/ma14040986

Chicago/Turabian Style

Guler, Berceste, Ahu Uraz, Hasan Hatipoğlu, and Mehmet Yalım. 2021. "Chemical Evaluation of Energy Dispersive X-ray Spectroscopy Analysis of Different Failing Dental Implant Surfaces: A Comparative Clinical Trial" Materials 14, no. 4: 986. https://doi.org/10.3390/ma14040986

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop