Next Article in Journal
Interphase Effect on the Macro Nonlinear Mechanical Behavior of Cement-Based Solidified Sand Mixture
Next Article in Special Issue
Cytotoxicity and Microbiological Properties of Copolymers Comprising Quaternary Ammonium Urethane-Dimethacrylates with Bisphenol A Glycerolate Dimethacrylate and Triethylene Glycol Dimethacrylate
Previous Article in Journal
Gelatin-Based Biofilms with FexOy-NPs Incorporated for Antioxidant and Antimicrobial Applications
Previous Article in Special Issue
Physicochemical and Mechanical Properties of Bis-GMA/TEGDMA Dental Composite Resins Enriched with Quaternary Ammonium Polyethylenimine Nanoparticles
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Biomechanical Evaluation of Patient-Specific Polymethylmethacrylate Cranial Implants for Virtual Surgical Planning: An In-Vitro Study

1
Clinic of Oral and Cranio-Maxillofacial Surgery, University Hospital Basel, CH-4031 Basel, Switzerland
2
Medical Additive Manufacturing Research Group (Swiss MAM), Department of Biomedical Engineering, University of Basel, CH-4123 Allschwil, Switzerland
3
Basel Institute for Clinical Epidemiology and Biostatistics, Department of Clinical Research, University Hospital Basel, University of Basel, CH-4031 Basel, Switzerland
4
Clinic of Oral and Cranio-Maxillofacial Surgery, Cantonal Hospital Aarau, CH-5001 Aarau, Switzerland
*
Author to whom correspondence should be addressed.
Materials 2022, 15(5), 1970; https://doi.org/10.3390/ma15051970
Submission received: 16 January 2022 / Revised: 19 February 2022 / Accepted: 1 March 2022 / Published: 7 March 2022

Abstract

:
Cranioplasty with freehand-molded polymethylmethacrylate implants is based on decades of experience and is still frequently used in clinical practice. However, data confirming the fracture toughness and standard biomechanical tests are rare. This study aimed to determine the amount of force that could be applied to virtually planned, template-molded, patient-specific implants (n = 10) with an implant thickness of 3 mm, used in the treatment of a temporoparietal skull defect (91.87 cm2), until the implant cracks and finally breaks. Furthermore, the influence of the weight and porosity of the implant on its force resistance was investigated. The primary outcome showed that a high force was required to break the implant (mean and standard deviation 1484.6 ± 167.7 N), and this was very strongly correlated with implant weight (Pearson’s correlation coefficient 0.97; p < 0.001). Secondary outcomes were force application at the implant’s first, second, and third crack. Only a moderate correlation could be found between fracture force and the volume of porosities (Pearson’s correlation coefficient 0.59; p = 0.073). The present study demonstrates that an implant thickness of 3 mm for a temporoparietal skull defect can withstand sufficient force to protect the brain. Greater implant weight and, thus, higher material content increases thickness, resulting in more resistance. Porosities that occur during the described workflow do not seem to reduce resistance. Therefore, precise knowledge of the fracture force of polymethylmethacrylate cranial implants provides insight into brain injury prevention and serves as a reference for the virtual design process.

1. Introduction

Reconstruction of the craniofacial skeleton’s highly complex shape is routinely achieved using various autogenous or alloplastic materials [1,2]. Alloplastic reconstructions using freehand-molded polymethylmethacrylate (PMMA) have been a gold standard in cranioplasty since World War II [1,3,4]. The use of PMMA in cranioplasty resulted from the need to improve cranioplasty techniques during World War II, and it is believed that Zander et al. were the first to use PMMA in patients [5]. Since then, the use of PMMA has been extensively studied and reports of long-term experience with this material are accumulating, making it well established in clinical practice [6]. Despite conflicting data in the literature regarding infection rates, it has remained a commonly used material to date. For example, a systematic review comparing titanium mesh, PMMA, polyetheretherketone (PEEK), and Norian implants states that PMMA implants are associated with a significantly higher infection rate [7]. Indeed, PMMA and autologous bone have been reported to have significantly higher infection rates than titanium mesh [8]. However, comparing preformed PMMA implants with intraoperatively freehand-molded ones, the preformed implants have lower infection rates and are comparable to autologous bone grafts [9]. Preformed titanium implants also have lower infection rates than intraoperatively freehand-molded PMMA implants [10]. This underlines one of the advantages of extracorporeal implant molding and leads to the production of safer implants. However, a meta-analysis showed no significant differences between PMMA, titanium mesh, and autologous bone in terms of overall complications such as infection, hematoma, dehiscence, seroma, material displacement, thermal sensitivity, bone resorption, and edema [11]. To overcome some of these complications, studies have also been conducted on coating PMMA implants to promote osseointegration of the outer surface regarding long-term fixation, implant loss rate, and morbidity [12]. Additionally, various modifications have been made to PMMA cements to provide an antibacterial effect, often associated with an initial release after implantation. Therefore, studies with new bioactive particles have been proposed to prevent infections with long-term effects [13,14]. Chronic irritation or delayed hypersensitivity reactions with PMMA have also been reported, likely due to non-polymerized residual components that are highly allergenic [15]. Residual monomers can cause toxic remote reactions leading to neurotoxicity [16]. A PMMA implant polymerized outside the body has fewer monomers and thus a lower allergenic potential. Additionally, brain and bone thermal damage could be due to heating during polymerization [17]. This extracorporeal workflow could avoid these complications.
Due to the advancements in three-dimensional (3D) printing, new methods are emerging that can further improve other techniques established in clinical practice. Conventional freehand-molding lacks precision, limiting its esthetics, and, in addition, a constant implant thickness cannot be ensured, thus altering the biomechanics. Therefore, to achieve the best possible esthetic and functional outcome, the use of virtual planning instead of freehand-molding is recommended for cranioplasties, particularly when involving the frontotemporal region [18]. Fused filament fabrication (FFF) technology using PEEK has recently entered the market but is not widely used due to cost and handling issues. PEEK is significantly more expensive than other biocompatible materials, which increases healthcare costs and is thus not economical for daily patient-specific treatment. As a result, it has not yet established itself for routine use. The prices for PEEK implants are significantly higher than for PMMA implants and are in the upper four-digit to lower five-digit range [19]. In contrast, the prices for PMMA implants according to the workflow outlined below are on average in the lower three-digit range [20]. PEEK is highly susceptible to changes in processing conditions because of its high melting temperature and semi-crystalline nature, especially in FFF technology due to the occurrence of a thermal gradient [21]. Due to processing, discrepancies between bulk crystallinity and linear crystallinity may be reflected in properties, so more knowledge is needed to improve the manufacturing process for safe implants [22]. Currently, PEEK is mainly in the development stage for in-house implant manufacturing [23,24]. The process of ordering a patient-specific implant (PSI) is time-consuming, thus preventing immediate surgical treatment. A publication in 2017 described a workflow that combines the advantages of 3D printing and molding, thus incorporating the benefits without the drawbacks of either technique [20]. At present, most surgeons have basic knowledge of 3D printing and can perform elementary digital workflows. The impression technique is simple, less expensive, and allows in-house production. This workflow has proven successful in many institutions, and such reconstructions have since been performed frequently [25]. Thus, this workflow is now part of routine clinical practice. Further studies confirmed that a similar workflow could produce highly accurate PSIs with high patient satisfaction [26]. Cranial implants, which were manufactured according to the workflow proposed in this paper, had a root mean square (RMS) of 1.128 to 0.469 mm, with a median RMS (Q1 to Q3) of 0.574 (0.528 to 0.701) mm [27]. The study demonstrated that highly accurate, PSIs are achievable with this workflow.
The strength of human cortical bone varies with age, mainly due to increased porosity and changes in bone mineralization. Cranial bone consists of a complex three-layered structure. Thus, there is a correlation between cortical thinning and age for frontal, occipital, and parietal bone, decreasing between 36% and 60% with age in females [28]. The overall average thickness of the parietal bone is about 6.69 ± 0.22 mm [29]. However, race-dependent changes in parietal skull bone thickness have also been described [30,31]. The parietal bone is not considered as strong as other cranial bones and should be well protected [32]. The biomechanics of the cranial bone varies greatly depending on, for example, method of force application, impact speed, the integrity of the skull, age, sex, and race. This illustrates that biomechanical load testing is an important method that provides clues for further improvement of this workflow to ensure patient safety by preventing brain injury. For example, the implant thickness, fracture pattern, implant size, and reconstruction region are essential determinants. No standards for testing PMMA cranial implants have been established, and confirmed data on fracture toughness, and standard biomechanical tests are scarce [33,34,35,36,37,38]. Animal studies have demonstrated that PMMA provides the greatest neuroprotection in cranioplasties compared to high-density porous polyethylene and autologous bone [37]. This is consistent with the conclusion from the literature that, according to biomechanical studies, PMMA cranioplasties are suitable for reconstructing lost skull bone to protect the brain [36]. Therefore, the purpose of this study was to evaluate the resistance of template-molded PMMA PSIs to withstand centrally and vertically applied uniaxial compressive forces applied to their external surface. The biomechanical tests were carried out with 3 mm thick implants. Our clinical experience has shown that this thickness allows good handling during fabrication, sufficient fixation of the screws and no implant fractures occurred under clinical conditions. This is also consistent with the findings in the literature that a thickness of 3 mm has high compressive and flexural strength when the composition of powder and liquid is equal, similar to the present study [38]. The results will provide valuable information relating to properties for use in virtual design.

2. Materials and Methods

In the present study, virtually planned and template-molded PMMA PSIs were evaluated. As the core material, PALACOS R (Heraeus Medical GmbH, Wehrheim, Germany), a high viscosity bone cement, was used in the fabrication process. This bone cement is a biocompatible, medically certified material and is regularly used in reconstruction in various disciplines. Ten exemplary PSIs were fabricated under similar conditions according to a workflow published in 2017 [20]. The weight and porosity properties of the PSIs were recorded. Then, a force was applied to the PSIs using a ProLine Z050TN (ZwickRoell GmbH & Co. KG, Ulm, Germany) uniaxial professional compressive testing machine until breakage. Measurements of force and breaking patterns were recorded using the testXpert II (ZwickRoell GmbH & Co. KG, Ulm, Germany) testing software.

2.1. Study Protocol

The protocol for this study incorporates the fabrication process, weight measurement, porosity measurement, and force assessment of the PSIs (Figure 1).

2.2. Fabrication Process

2.2.1. Digital Data Acquisition and Virtual Planning

Image data from a spiral computed tomography (CT) scan of a skull with a temporoparietal defect were selected. Here, a slice thickness of 1 mm shows sufficient data quality for virtual planning. The Digital Imaging and Communications in Medicine (DICOM) data were imported into the Mimics Innovation Suite v. 20.0 (Materialise NV, Leuven, Belgium) medical 3D image-based engineering software, segmented and edited. The intact contralateral side of the bone was mirrored onto the defect area. Using a surface-reconstruction algorithm and minor adjustments, the final virtually planned template of the PSIs was acquired and exported as a Standard Tessellation Language (STL) file for the printing process (Figure 2).

2.2.2. 3D Printing Process of the Template

The template as outlined in the STL file was printed using a MakerBot Replicator+ (MakerBot Industries, Brooklyn, NY, USA) desktop 3D printer using polylactic acid (PLA) filament (MakerBot filament true white, MakerBot Industries, Brooklyn, NY, USA) with an infill of 10% and a layer thickness of 0.2 mm. An FFF 3D printer offers high accuracy and can process low-cost printing materials such as PLA, which is suitable and sufficient for template production [39]. Subsequently, the support structures were removed, and minor imperfections were corrected in a post-processing step (Figure 3).

2.2.3. Fabrication Process of the Silicone Mold

The template was embedded in an additive silicone (Dublisil 30, Dreve Dentamid GmbH, Unna, Germany) to create two forms, a positive and a negative mold. The template had been coated with Vaseline to ensure its easy removal. Retention grooves at the edges ensured correct positioning (Figure 4).

2.2.4. Manufacturing Process of the PSIs

According to the manufacturer’s instructions the molds were filled with PALACOS R bone cement (Heraeus Medical GmbH, Wehrheim, Germany). Constant pressure was applied and, after an exothermic reaction occurred, the molds were separated, and the fabricated (molded) implant was removed (Figure 5).
The PMMA implant was trimmed of surplus, the sharp edges removed with a pierce, and the edges smoothed using a file. Finally, holes for drainage were made using a drill (Figure 6).

2.3. Weight Measurement

The weight was measured with a Professional-Mini Foraco (Dongguan Shi Bo Heng Electronics Co. Ltd., Dongguan, China) precision digital scale. The measurements were performed in triplicate, and the average weight of each implant was calculated (Table 1).

2.4. Porosity Measurement

To evaluate the porosities, the PMMA PSIs were scanned with a CS 9300 (Carestream Dental L.L.C., Atlanta, GA, USA) cone-beam computed tomography (CBCT) device using a volume of 17 × 13.5 cm3, 90 kV, 5.0 mA, and a voxel size of 300 µm. The DICOM data were imported into Mimics Innovation Suite v. 20.0 (Materialise NV, Leuven, Belgium), and a predefined threshold according to the density of PMMA was set to include all areas. The total volume of segmented PMMA PSIs could then be calculated. Subsequently, the individual volume of porosities for each PSI was selected, added, and subtracted from the total PSI volume (Figure 7).

2.5. Force Assessment

As support construct to ensure correct, reproducible positioning without slipping off the base, the defect area was printed and mounted to the base plate of the test machine (Figure 8).
Finally, the ten exemplary PSIs were positioned sequentially in the ProLine Z050TN (ZwickRoell GmbH & Co. KG, Ulm, Germany) material test machine. A hemispherical indenter (diameter 10 mm) was used to apply uniaxial compressive force and the implants were tested at a loading rate of 1 mm/min (Figure 9). The software recorded all relevant data, e.g., force at breakage and force at the first, second, and third crack. After the breakage of the PSIs, the different shattered parts were collected.

2.6. Statistical Analysis

Descriptive statistics, including mean, standard deviation (SD), median, minimum, maximum, and first and third quartiles, are reported for all outcomes. Pearson’s correlation testing was performed to assess the relationship of the applied forces with weight and porosity. Correlations were considered very weak for 0 ≤ |R| < 0.2, weak for 0.2 ≤ |R| < 0.4, moderate for 0.4 ≤ |R| < 0.6, strong for 0.6 ≤ |R| < 0.8, and very strong for 0.8 ≤ |R| ≤ 1.0. Statistical significance was set at p < 0.05. All statistical analysis was performed using the R statistical software (R Core Team 3.6.3, The R Foundation for Statistical Computing, Vienna, Austria).

3. Results

3.1. Quantitative Analysis

A summary of all the characteristics of this study is provided below (Table 2). The statistical results for the loading force and implant properties in terms of its weight and volume as well as the volume of porosities are reported.

3.1.1. Correlation between Force and Weight

There was a very strong correlation between the force at implant breakage and the implant weight, with a Pearson’s correlation coefficient of 0.97 and p < 0.001 (Figure 10a). Regarding the force required when the cracks occurred, there was a very strong correlation between the force at the first and third crack of the implant and a strong correlation between the force at the second crack of the implant and the weight (Figure 10b–d).

3.1.2. Correlation between Force and Volume of Porosities

There was only a moderate correlation between the force at implant breakage and the volume of porosities, with a Pearson’s correlation coefficient of 0.59 and p = 0.073 (Figure 11a). The correlation was not statistically significant. Regarding the force required when the cracks occurred, there was a very strong correlation between the force at the first crack of the implant, and a moderate non-significant correlation between the force at the second and third crack of the implant and the volume of porosities (Figure 11b–d).

3.1.3. Correlation between Volume of Porosities and Weight

A strong correlation between the implant weight and the volume of the porosities was demonstrated with a Pearson’s correlation coefficient of 0.68 and p = 0.03 (Figure 12). This indicates that implants with higher weight also appear to have a higher volume of porosities.

3.2. Qualitative Analysis

The fracture pattern showed that the cranial implants broke into no more than four parts when centrally and vertically force was applied to the external surface. Eight implants broke into three parts and two into four. The PMMA material exhibits brittle fracture behavior. A stellate fracture pattern with a rough fracture edge without splintering was observed (Figure 13). No correlation was found between the fracture pattern and the weight or volume of porosities.

4. Discussion

As a material for reconstructing cranial defects, PMMA has been commonly used for many decades [40]. Due to the need to achieve the most accurate anatomical reconstruction possible, the demand for PSIs is increasing. At present, patient-specific treatment is becoming increasingly central to daily medical practice. Due to virtual planning and 3D printing, new supporting techniques have emerged to ensure anatomical reconstruction and advance the available treatment options [41]. Currently, 3D printers can print implants according to the specific anatomy of the patient. However, 3D printing of PSIs from biocompatible materials is not yet widely used in clinical practice. This is mainly due to the high costs. Health insurance companies refuse to cover the costs of PSIs because current procedures do not undercut conventional implants in terms of cost-effectiveness. Therefore, a hybrid workflow was presented in 2017 that bridged the gap between 3D printing and molding and provided the cost-effectiveness and esthetics expected from conventionally prepared PSIs [20]. Moreover, an extracorporeal, template-based workflow is beneficial compared to freehand-molding and therefore remains of current interest and relevance. This hybrid workflow can significantly reduce the costs of PSIs, presenting a cost-effective alternative to conventional implants [20,42]. The material costs are very low for implant production according to this workflow. Based on current 2022 prices, the price of the PLA printing filament is less than 20 CHF/kg, the silicone for the mold is 40 CHF/L and the PALACOS R is 60 CHF/40 g. The material costs vary slightly depending on the implant size and amount to approximately 150 CHF for the procedure as mentioned above. However, manufacturing costs vary widely in terms of 3D printer, software and labor costs. Commercially available FFF 3D printers are currently available for less than 1000 CHF. The cost of the software depends on the annual license booked and can quickly reach a few thousand CHF. Economies of scale can be achieved through more frequent use, drastically reducing costs. Labor costs are also subject to strong geographic variations. However, the total cost of such an implant is a fraction of the price of a conventionally ordered, externally manufactured implant, which is in the upper four-digit range.
This study investigated centrally and vertically applied uniaxial force that a molded patient-specific PMMA implant can withstand. It is essential to determine whether a 3 mm thick implant made of PMMA can withstand sufficient force equivalent to the replaced bone to protect the brain from traumatic damage. Many studies have previously been conducted on the biomechanical properties of the skull, and accounts of a large variety of attributes can be found in the literature. The way the force is applied is one of the factors that determine the resistance of the skull. The peak fracture force for the temporoparietal bone in an intact cadaveric skull was 5633 ± 2095 N during blunt ballistic impact [43]. The mean fracture force during dynamic loading with an electrohydraulic tester was 7126 ± 1130 N [44]. In another study, the mean fracture force caused by a drop tower for the temporoparietal region with a circular plate was 5195 ± 1801 N and for the parietal region with a rectangular plate was 12,390 ± 3654 N [45]. These measurements were conducted on intact skulls with different methodological approaches however some authors have noted that the cranial strength decreases after graft harvesting from the outer or inner parietal bone layers [46,47]. As a result, the mechanical strength of the skull is reduced when bone integrity is disturbed after traumatic injury, and the fracture force is consequently lower. Therefore, PSIs should be compared with the fracture toughness of bone pieces of the corresponding region and not with values of an intact skull. The mean values and standard deviations for the maximum force of a bare skull bone piece were 728.2 ± 397.5 N with periosteum removed and 1034.0 ± 886.2 N with periosteum attached [48].
The defect investigated in the present study was a temporoparietal skull defect with a surface area of 91.87 cm2. This area comprises an approximately flat surface with an only slight curvature. The mean weight of the PSIs was 38.7 g, and the mean and standard deviation of force at breakage was 1484.6 ± 167.7 N. This falls within the reference range of the force for fracture of bare skull bone pieces found in the literature [48,49]. Thus, the results demonstrate that a PSI thickness of 3 mm is sufficient to resist enough force, similar to that of bare bone, to protect the brain from traumatic damage. This makes the implant significantly thinner than average parietal bone thickness, which simplifies the insertion of the implant and leaves room to compensate for cerebral edema. Planning of a thickness less than 3 mm is theoretically possible but may complicate handling, the overall impression process, and screw fixation.
The present study showed that the force resistance is proportional to the implant weight. The more material used, the higher the force resistance. Due to the manual nature of the molding process, the ten implants were not completely identical and, in some cases, had slight weight differences of a few grams. Because all of the implants had the same surface size, any increase in weight would have affected the thickness. This may be due to the varying force applied during compression of the silicone mold. This indicates that heavier implants consist of more material, resulting in greater stability, and a higher force is therefore required to break the implant. Consequently, even a small increase in implant thickness significantly increases implant resistance.
Porosities are defined as the difference between the implant volume with porosities and the implant volume without porosities. In addition to the implant thickness, the volume of porosities may also influence the mechanical stability. This study showed only a moderate correlation between force at breakage and the volume of porosities, without statistical significance. For example, implants with a higher weight also showed more porosities. The ten implants were not completely identical due to the manual nature of the molding process and, therefore, differed in porosity volume. The moderate correlation without statistical significance between force at breakage and the volume of porosities shows that implants with more porosities do not necessarily fracture more frequently. However, it is believed that higher porosity should limit fracture toughness and fatigue strength because these pores can reduce the material content along the crack plane and decrease resistance [50]. Due to porosity, the non-apparent higher susceptibility to fracture could be distorted by the minimal weight differences of the implants and the associated higher material content. Manual mixing has been described to produce types of cement with uncontrollable porosity [51]. However, the present study shows that the percentage of porosities in manual mixing is low, i.e., approximately 1–3%. Some authors recommend using a vacuum mixer to obtain the best results [52]. The manufacturer’s instructions should be followed closely to keep porosities to a minimum. Numerous factors, such as temperature, mixing time, and humidity, affect the curing time [53]. The mixing time is 30 s and should not be extended because this may increase viscosity, thus increasing the difficulty of molding. As a result, the planned thickness cannot be achieved, and the implant will become thicker as the delicate structures in the marginal areas are not reached.
Regarding the fracture pattern of the patient-specific PMMA implants, they did not shatter into many fragments upon fracture, reducing the risk of damage to underlying structures, such as brain tissue. This highlights and confirms the suitability of PMMA as a material for cranial reconstruction.
The current study is not without limitations. The duration of force application also affects stability. For example, a ballistic impact has a different effect than a slowly increasing force, as used in the present study. In this study, only forces acting vertically on the implant were measured and lateral force effects were not considered. The resistance also depends on the localization of force application. The exact region of the skull and, thus, the surface properties of the particular region will also affect stability. The surface properties of the skull differ according to increasing or decreasing curvature depending on the area. Thus, force effects on flat surfaces differ from those on curved surfaces, causing curvature effects to increase the fracture load by a factor of 2 to 3 [54]. Only the cumulative volume of porosities per implant was considered in this study, not their exact location. It is conceivable that large porosities in the area of force application promote fracture. In addition, the position of the fixation plates and screws and the placement of drill holes were not investigated. It may be beneficial to include mini-plates and screw locations in a finite element simulation to gain preoperational insight into mechanical performance, thus allowing a decision to be made about these options [33,34,35].
Due to its ease of use, practicability, and material properties, it is expected that PMMA will continue to be used in cranioplasty for many years to come. High-performance polymers such as PEEK can currently be printed, but they are uneconomical due to their high costs. As long as these new manufacturing processes remain costly, the manufacturing process described in this paper will continue to serve its purpose in daily medical applications.

5. Conclusions

In this study, the mean and standard deviation of the fracture force was determined to be 1484.6 ± 167.7 N for a template-molded PMMA cranial implant of the temporoparietal skull region with a thickness of 3 mm and a surface area of 91.87 cm2. Consequently, cranial implants that are thinner than the average parietal bone thickness while still providing equal protection for the brain can be fabricated. Thus, an implant thickness of 3 mm for a temporoparietal defect is appropriate for virtual planning, and such a constant implant thickness cannot be achieved by freehand-molding. It was determined that porosities resulting from the use of this workflow do not seem to reduce biomechanical strength. Moreover, the fracture pattern of the implants resulted in a maximum of four fragments being produced, and implants did not shatter upon fracture. These results indicate that PMMA is a suitable material for cranioplasty.
The described manufacturing process is a convenient means of fabricating template-molded PMMA implants, which are an alternative to the current, commercially available patient-specific implants. Previous studies have demonstrated this hybrid workflow’s feasibility, cost-effectiveness, and accuracy [20,27]. The outcomes of this study indicate that the PSIs produced by this process can also be assumed to be highly resistant to centrally and vertically applied uniaxial force. Thus, the current study confirmed the value of this workflow, which will continue to be favored until it is replaced by new methods, such as the likely implementation of PEEK 3D printing at the point-of-care soon.

Author Contributions

Conceptualization, B.M.; methodology, B.M.; software, B.M., F.S.H., N.S. and S.C.; validation, B.M. and S.M.; formal analysis, B.M. and F.S.H.; investigation, B.M.; resources, B.M. and F.M.T.; data curation, B.M. and N.S.; writing—original draft preparation, B.M.; writing—review and editing, B.M., M.M., F.S.H., S.M., G.R.S., N.S., S.C. and F.M.T.; visualization, B.M.; supervision, B.M. and F.M.T.; project administration, B.M.; funding acquisition, B.M. and F.M.T.; All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Department of Surgery of the University Hospital Basel (Martin Allgöwer Grant) and the IAOMS Foundation during an international exchange program as well as by the Werner Siemens Foundation (MIRACLE project). The APC was funded by the Section of Dental Medicine and Craniomaxillofacial Surgery, Centre of Competence for Military and Disaster Medicine, Swiss Army.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Not applicable.

Acknowledgments

The authors are pleased to acknowledge Fredy Schmidli, who provided valuable feedback for biomechanical testing. Material support (PALACOS R) was provided by Heraeus Medical GmbH, Wehrheim, Germany.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

3Dthree-dimensional
CBCTcone-beam computed tomography
CHFSwiss franc
CTcomputed tomography
DICOMDigital Imaging and Communications in Medicine
FFFfused filament fabrication
PEEKpolyetheretherketone
PLApolylactic acid
PMMApolymethylmethacrylate
PSIpatient-specific implant
RMSroot mean square
SDstandard deviation
STLStandard Tessellation Language

References

  1. Shah, A.M.; Jung, H.; Skirboll, S. Materials used in cranioplasty: A history and analysis. Neurosurg. Focus 2014, 36, E19. [Google Scholar] [CrossRef] [PubMed]
  2. Eppley, B.L. Craniofacial reconstruction with computer-generated HTR patient-matched implants: Use in primary bony tumor excision. J. Craniofac. Surg. 2002, 13, 650–657. [Google Scholar] [CrossRef] [PubMed]
  3. Small, J.M.; Graham, M.P. Acrylic resin for the closure of skull defects. Br. J. Surg. 1945, 33, 106–113. [Google Scholar] [CrossRef] [PubMed]
  4. Elkins, C.W.; Cameron, J.E. Cranioplasty with acrylic plates. J. Neurosurg. 1946, 3, 199–205. [Google Scholar] [CrossRef]
  5. Sanan, A.; Haines, S.J. Repairing holes in the head: A history of cranioplasty. Neurosurgery 1997, 40, 588–603. [Google Scholar] [CrossRef]
  6. Fiaschi, P.; Pavanello, M.; Imperato, A.; Dallolio, V.; Accogli, A.; Capra, V.; Consales, A.; Cama, A.; Piatelli, G. Surgical results of cranioplasty with a polymethylmethacrylate customized cranial implant in pediatric patients: A single-center experience. J. Neurosurg. Pediatr. 2016, 17, 705–710. [Google Scholar] [CrossRef] [Green Version]
  7. Oliver, J.D.; Banuelos, J.; Abu-Ghname, A.; Vyas, K.S.; Sharaf, B. Alloplastic Cranioplasty Reconstruction: A Systematic Review Comparing Outcomes with Titanium Mesh, Polymethyl Methacrylate, Polyether Ether Ketone, and Norian Implants in 3591 Adult Patients. Ann. Plast. Surg. 2019, 82 (Suppl. S4), S289–S294. [Google Scholar] [CrossRef]
  8. Matsuno, A.; Tanaka, H.; Iwamuro, H.; Takanashi, S.; Miyawaki, S.; Nakashima, M.; Nakaguchi, H.; Nagashima, T. Analyses of the factors influencing bone graft infection after delayed cranioplasty. Acta Neurochir. 2006, 148, 535–540, discussion 540. [Google Scholar] [CrossRef]
  9. Lee, S.C.; Wu, C.T.; Lee, S.T.; Chen, P.J. Cranioplasty using polymethyl methacrylate prostheses. J. Clin. Neurosci. 2009, 16, 56–63. [Google Scholar] [CrossRef]
  10. Höhne, J.; Werzmirzowsky, K.; Ott, C.; Hohenberger, C.; Hassanin, B.G.; Brawanski, A.; Schebesch, K.M. Outcomes of Cranioplasty with Preformed Titanium versus Freehand Molded Polymethylmethacrylate Implants. J. Neurol. Surg. A Cent. Eur. Neurosurg. 2018, 79, 200–205. [Google Scholar] [CrossRef]
  11. Leão, R.S.; Maior, J.R.S.; Lemos, C.A.A.; Vasconcelos, B.C.D.E.; Montes, M.A.J.R.; Pellizzer, E.P.; Moraes, S.L.D. Complications with PMMA compared with other materials used in cranioplasty: A systematic review and meta-analysis. Braz. Oral Res. 2018, 32, e31. [Google Scholar] [CrossRef] [Green Version]
  12. Dean, D.; Topham, N.S.; Rimnac, C.; Mikos, A.G.; Goldberg, D.P.; Jepsen, K.; Redtfeldt, R.; Liu, Q.; Pennington, D.; Ratcheson, R. Osseointegration of preformed polymethylmethacrylate craniofacial prostheses coated with bone marrow-impregnated poly (DL-lactic-co-glycolic acid) foam. Plast. Reconstr. Surg. 1999, 104, 705–712. [Google Scholar] [CrossRef]
  13. Russo, T.; Gloria, A.; De Santis, R.; D’Amora, U.; Balato, G.; Vollaro, A.; Oliviero, O.; Improta, G.; Triassi, M.; Ambrosio, L. Preliminary focus on the mechanical and antibacterial activity of a PMMA-based bone cement loaded with gold nanoparticles. Bioact. Mater. 2017, 2, 156–161. [Google Scholar] [CrossRef]
  14. Oei, J.D.; Zhao, W.W.; Chu, L.; DeSilva, M.N.; Ghimire, A.; Rawls, H.R.; Whang, K. Antimicrobial acrylic materials with in situ generated silver nanoparticles. J. Biomed. Mater. Res. B Appl. Biomater. 2012, 100, 409–415. [Google Scholar] [CrossRef]
  15. Gautschi, O.P.; Schlett, C.L.; Fournier, J.Y.; Cadosch, D. Laboratory confirmed polymethyl-methacrylate (Palacos)-hypersensitivity after cranioplasty. Clin. Neurol. Neurosurg. 2010, 112, 915–916. [Google Scholar] [CrossRef]
  16. Las, D.E.; Verwilghen, D.; Mommaerts, M.Y. A systematic review of cranioplasty material toxicity in human subjects. J. Craniomaxillofac. Surg. 2021, 49, 34–46. [Google Scholar] [CrossRef]
  17. Golz, T.; Graham, C.R.; Busch, L.C.; Wulf, J.; Winder, R.J. Temperature elevation during simulated polymethylmethacrylate (PMMA) cranioplasty in a cadaver model. J. Clin. Neurosci. 2010, 17, 617–622. [Google Scholar] [CrossRef]
  18. Fischer, C.M.; Burkhardt, J.K.; Sarnthein, J.; Bernays, R.L.; Bozinov, O. Aesthetic outcome in patients after polymethyl-methacrylate (PMMA) cranioplasty—A questionnaire-based single-centre study. Neurol. Res. 2012, 34, 281–285. [Google Scholar] [CrossRef] [Green Version]
  19. Zhang, J.; Tian, W.; Chen, J.; Yu, J.; Zhang, J.; Chen, J. The application of polyetheretherketone (PEEK) implants in cranioplasty. Brain Res. Bull. 2019, 153, 143–149. [Google Scholar] [CrossRef]
  20. Msallem, B.; Beiglboeck, F.; Honigmann, P.; Jaquiéry, C.; Thieringer, F. Craniofacial Reconstruction by a Cost-Efficient Template-Based Process Using 3D Printing. Plast. Reconstr. Surg. Glob. Open 2017, 5, e1582. [Google Scholar] [CrossRef] [Green Version]
  21. Zanjanijam, A.R.; Major, I.; Lyons, J.G.; Lafont, U.; Devine, D.M. Fused Filament Fabrication of PEEK: A Review of Process-Structure-Property Relationships. Polymers 2020, 12, 1665. [Google Scholar] [CrossRef]
  22. Jin, L.; Ball, J.; Bremner, T.; Sue, H.-J. Crystallization behavior and morphological characterization of poly(ether ether ketone). Polymer 2014, 55, 5255–5265. [Google Scholar] [CrossRef]
  23. Dua, R.; Rashad, Z.; Spears, J.; Dunn, G.; Maxwell, M. Applications of 3D-Printed PEEK via Fused Filament Fabrication: A Systematic Review. Polymers 2021, 13, 4046. [Google Scholar] [CrossRef]
  24. Honigmann, P.; Sharma, N.; Okolo, B.; Popp, U.; Msallem, B.; Thieringer, F.M. Patient-Specific Surgical Implants Made of 3D Printed PEEK: Material, Technology, and Scope of Surgical Application. Biomed Res. Int. 2018, 2018, 4520636. [Google Scholar] [CrossRef] [Green Version]
  25. Schön, S.N.; Skalicky, N.; Sharma, N.; Zumofen, D.W.; Thieringer, F.M. 3D-Printer-Assisted Patient-Specific Polymethyl Methacrylate Cranioplasty: A Case Series of 16 Consecutive Patients. World Neurosurg. 2021, 148, e356–e362. [Google Scholar] [CrossRef]
  26. Vlok, A.J.; Naidoo, S.; Kamat, A.S.; Lamprecht, D. Evaluation of locally manufactured patient-specific custom made implants for cranial defects using a silicone mould. S. Afr. J. Surg. 2018, 56, 38–42. [Google Scholar] [CrossRef]
  27. Chamo, D.; Msallem, B.; Sharma, N.; Aghlmandi, S.; Kunz, C.; Thieringer, F.M. Accuracy Assessment of Molded, Patient-Specific Polymethylmethacrylate Craniofacial Implants Compared to Their 3D Printed Originals. J. Clin. Med. 2020, 9, 832. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Lillie, E.M.; Urban, J.E.; Lynch, S.K.; Weaver, A.A.; Stitzel, J.D. Evaluation of Skull Cortical Thickness Changes with Age and Sex from Computed Tomography Scans. J. Bone Miner. Res. 2016, 31, 299–307. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Choi, H.J.; De Silva, R.K.; Tong, D.C.; De Silva, H.L.; Love, R.M.; Athens, J. The thickness of parietal bones in a new zealand sample of cadaveric skulls in relation to calvarial bone graft. Craniomaxillofac. Trauma Reconstr. 2013, 6, 115–120. [Google Scholar] [CrossRef] [Green Version]
  30. Hwang, K.; Kim, J.H.; Baik, S.H. Thickness map of parietal bone in Korean adults. J. Craniofac. Surg. 1997, 8, 208–212. [Google Scholar] [CrossRef] [PubMed]
  31. Pensler, J.; McCarthy, J.G. The calvarial donor site: An anatomic study in cadavers. Plast. Reconstr. Surg. 1985, 75, 648–651. [Google Scholar] [CrossRef]
  32. Siswanto, W.A.; Hua, C. Strength analysis of human skull on high speed impact. Int. Rev. Mech. Eng. 2012, 6, 1508–1514. [Google Scholar]
  33. Ridwan-Pramana, A.; Marcián, P.; Borák, L.; Narra, N.; Forouzanfar, T.; Wolff, J. Finite element analysis of 6 large PMMA skull reconstructions: A multi-criteria evaluation approach. PLoS ONE 2017, 12, e0179325. [Google Scholar] [CrossRef] [Green Version]
  34. Marcián, P.; Narra, N.; Borák, L.; Chamrad, J.; Wolff, J. Biomechanical performance of cranial implants with different thicknesses and material properties: A finite element study. Comput. Biol. Med. 2019, 109, 43–52. [Google Scholar] [CrossRef]
  35. Ridwan-Pramana, A.; Marcián, P.; Borák, L.; Narra, N.; Forouzanfar, T.; Wolff, J. Structural and mechanical implications of PMMA implant shape and interface geometry in cranioplasty—A finite element study. J. Craniomaxillofac. Surg. 2016, 44, 34–44. [Google Scholar] [CrossRef]
  36. Eppley, B.L. Biomechanical testing of alloplastic PMMA cranioplasty materials. J. Craniofac. Surg. 2005, 16, 140–143. [Google Scholar] [CrossRef]
  37. Wallace, R.D.; Salt, C.; Konofaos, P. Comparison of Autogenous and Alloplastic Cranioplasty Materials Following Impact Testing. J. Craniofac. Surg. 2015, 26, 1551–1557. [Google Scholar] [CrossRef]
  38. Archana, R.; Baldia, M.; Jeeva, J.B.; Devakumar, D.; Joseph, M. Strength analysis of Cranioplasty PMMA flap material. Mater. Today Proc. 2019, 15, 167–172. [Google Scholar] [CrossRef]
  39. Msallem, B.; Sharma, N.; Cao, S.; Halbeisen, F.S.; Zeilhofer, H.F.; Thieringer, F.M. Evaluation of the Dimensional Accuracy of 3D-Printed Anatomical Mandibular Models Using FFF, SLA, SLS, MJ, and BJ Printing Technology. J. Clin. Med. 2020, 9, 817. [Google Scholar] [CrossRef] [Green Version]
  40. Moreira-Gonzalez, A.; Jackson, I.T.; Miyawaki, T.; Barakat, K.; DiNick, V. Clinical outcome in cranioplasty: Critical review in long-term follow-up. J. Craniofac. Surg. 2003, 14, 144–153. [Google Scholar] [CrossRef]
  41. Nyberg, E.L.; Farris, A.L.; Hung, B.P.; Dias, M.; Garcia, J.R.; Dorafshar, A.H.; Grayson, W.L. 3D-Printing Technologies for Craniofacial Rehabilitation, Reconstruction, and Regeneration. Ann. Biomed. Eng. 2017, 45, 45–57. [Google Scholar] [CrossRef] [Green Version]
  42. Da Silva Júnior, E.B.; de Aragão, A.H.; de Paula Loureiro, M.; Lobo, C.S.; Oliveti, A.F.; de Oliveira, R.M.; Ramina, R. Cranioplasty with three-dimensional customised mould for polymethylmethacrylate implant: A series of 16 consecutive patients with cost-effectiveness consideration. 3D Print. Med. 2021, 7, 4. [Google Scholar] [CrossRef]
  43. Raymond, D.; Van Ee, C.; Crawford, G.; Bir, C. Tolerance of the skull to blunt ballistic temporo-parietal impact. J. Biomech. 2009, 42, 2479–2485. [Google Scholar] [CrossRef]
  44. Montava, M.; Masson, C.; Lavieille, J.P.; Mancini, J.; Soussan, J.; Chaumoitre, K.; Arnoux, P.J. Temporal bone fracture under lateral impact: Biomechanical and macroscopic evaluation. Med. Biol. Eng. Comput. 2016, 54, 351–360. [Google Scholar] [CrossRef]
  45. Allsop, D.; Perl, T.; Warner, C. Force/Deflection and Fracture Characteristics of the Temporo-parietal Region of the Human Head. In SAE Technical Paper 912907; SAE International: Warrendale, PA, USA, 1991. [Google Scholar] [CrossRef]
  46. Laure, B.; Tranquart, F.; Geais, L.; Goga, D. Evaluation of skull strength following parietal bone graft harvest. Plast. Reconstr. Surg. 2010, 126, 1492–1499. [Google Scholar] [CrossRef]
  47. Haen, P.; Dubois, G.; Goudot, P.; Schouman, T. Comparative finite element analysis of skull mechanical properties following parietal bone graft harvesting in adults. J. Craniomaxillofac. Surg. 2018, 46, 329–337. [Google Scholar] [CrossRef]
  48. Ondruschka, B.; Lee, J.H.C.; Scholze, M.; Zwirner, J.; Tong, D.; Waddell, J.N.; Hammer, N. A biomechanical comparison between human calvarial bone and a skull simulant considering the role of attached periosteum and dura mater. Int. J. Legal Med. 2019, 133, 1603–1610. [Google Scholar] [CrossRef] [PubMed]
  49. Motherway, J.A.; Verschueren, P.; Van der Perre, G.; Vander Sloten, J.; Gilchrist, M.D. The mechanical properties of cranial bone: The effect of loading rate and cranial sampling position. J. Biomech. 2009, 42, 2129–2135. [Google Scholar] [CrossRef] [PubMed]
  50. Graham, J.; Pruitt, L.; Ries, M.; Gundiah, N. Fracture and fatigue properties of acrylic bone cement: The effects of mixing method, sterilization treatment, and molecular weight. J. Arthroplast. 2000, 15, 1028–1035. [Google Scholar] [CrossRef] [PubMed]
  51. Lindén, U. Porosity in manually mixed bone cement. Clin. Orthop. Relat. Res. 1988, 231, 110–112. [Google Scholar] [CrossRef]
  52. Lidgren, L.; Drar, H.; Möller, J. Strength of polymethylmethacrylate increased by vacuum mixing. Acta Orthop. Scand. 1984, 55, 536–541. [Google Scholar] [CrossRef]
  53. PALACOS®R—High Viscosity, Radiopaque Bone Cement; Heraeus Medical GmbH: Wehrheim, Germany, 2018; Available online: https://www.heraeus.com/media/media/hme/doc_hme/products_hme/palacos_bone_cement/r_rg_mv_mvg_lv_lvg/ifu/PALACOS_R_IFU.pdf (accessed on 8 July 2021).
  54. Roberts, J.C.; Merkle, A.C.; Carneal, C.M.; Voo, L.M.; Johannes, M.S.; Paulson, J.M.; Tankard, S.; Uy, O.M. Development of a Human Cranial Bone Surrogate for Impact Studies. Front. Bioeng. Biotechnol. 2013, 1, 13. [Google Scholar] [CrossRef] [Green Version]
Figure 1. Study modules.
Figure 1. Study modules.
Materials 15 01970 g001
Figure 2. The visual output of the Standard Tessellation Language file of a patient-specific cranial plate template.
Figure 2. The visual output of the Standard Tessellation Language file of a patient-specific cranial plate template.
Materials 15 01970 g002
Figure 3. 3D printed cranial plate template fabricated from polylactic acid: (a) trimmed template; (b) trimmed template in front of skull model; (c) trimmed template in the skull model.
Figure 3. 3D printed cranial plate template fabricated from polylactic acid: (a) trimmed template; (b) trimmed template in front of skull model; (c) trimmed template in the skull model.
Materials 15 01970 g003
Figure 4. Silicone mold of the patient-specific cranial plate template.
Figure 4. Silicone mold of the patient-specific cranial plate template.
Materials 15 01970 g004
Figure 5. Molded patient-specific polymethylmethacrylate cranial implant with excess material.
Figure 5. Molded patient-specific polymethylmethacrylate cranial implant with excess material.
Materials 15 01970 g005
Figure 6. Patient-specific cranial implant fabricated from polymethylmethacrylate: (a) trimmed implant with drill holes; (b) trimmed implant in front of skull model; (c) trimmed implant in the skull model.
Figure 6. Patient-specific cranial implant fabricated from polymethylmethacrylate: (a) trimmed implant with drill holes; (b) trimmed implant in front of skull model; (c) trimmed implant in the skull model.
Materials 15 01970 g006aMaterials 15 01970 g006b
Figure 7. Visualization of porosities (black spots) in the patient-specific cranial implant (gray) fabricated from polymethylmethacrylate (implant no. 01).
Figure 7. Visualization of porosities (black spots) in the patient-specific cranial implant (gray) fabricated from polymethylmethacrylate (implant no. 01).
Materials 15 01970 g007
Figure 8. Base to prevent displacement: (a) without implant; (b) with implant.
Figure 8. Base to prevent displacement: (a) without implant; (b) with implant.
Materials 15 01970 g008
Figure 9. Experimental setup in the ProLine Z050TN machine.
Figure 9. Experimental setup in the ProLine Z050TN machine.
Materials 15 01970 g009
Figure 10. Correlation between force and weight: (a) force at breakage; (b) force at the first crack; (c) force at the second crack; (d) force at the third crack. (R = Pearson’s correlation coefficient, p = p-value of Pearson’s correlation test. One of the implants had only two cracks before it broke and was missing from the analysis of the third crack.)
Figure 10. Correlation between force and weight: (a) force at breakage; (b) force at the first crack; (c) force at the second crack; (d) force at the third crack. (R = Pearson’s correlation coefficient, p = p-value of Pearson’s correlation test. One of the implants had only two cracks before it broke and was missing from the analysis of the third crack.)
Materials 15 01970 g010
Figure 11. Correlation between force and volume of porosities: (a) force at breakage; (b) force at the first crack; (c) force at the second crack; (d) force at the third crack. (R = Pearson’s correlation coefficient, p = p-value of Pearson’s correlation test. One of the implants had only two cracks before it broke and was missing from the analysis of the third crack.)
Figure 11. Correlation between force and volume of porosities: (a) force at breakage; (b) force at the first crack; (c) force at the second crack; (d) force at the third crack. (R = Pearson’s correlation coefficient, p = p-value of Pearson’s correlation test. One of the implants had only two cracks before it broke and was missing from the analysis of the third crack.)
Materials 15 01970 g011
Figure 12. Correlation between volume of porosities and weight. (R = Pearson’s correlation coefficient, p = p-value of Pearson’s correlation test).
Figure 12. Correlation between volume of porosities and weight. (R = Pearson’s correlation coefficient, p = p-value of Pearson’s correlation test).
Materials 15 01970 g012
Figure 13. Fracture pattern of patient-specific implant fabricated from polymethylmethacrylate: (a) three-piece fracture pattern (implant no. 8); (b) four-piece fracture pattern (implant no. 10); (c) breaking edge (implant no. 8).
Figure 13. Fracture pattern of patient-specific implant fabricated from polymethylmethacrylate: (a) three-piece fracture pattern (implant no. 8); (b) four-piece fracture pattern (implant no. 10); (c) breaking edge (implant no. 8).
Materials 15 01970 g013aMaterials 15 01970 g013b
Table 1. The average weight of each polymethylmethacrylate implant.
Table 1. The average weight of each polymethylmethacrylate implant.
Implant NumberAverage Weight [g]
143.18
241.34
338.71
437.31
539.06
637.00
737.49
837.30
937.02
1038.81
Table 2. Summary of all characteristics of the study.
Table 2. Summary of all characteristics of the study.
CharacteristicMedianMinimumQ1Q3MaximumMeanSD
Force at breakage [N]1447.31293.71390.41533.81823.71484.6167.7
Force at 1st crack [N]927.0875.1898.01124.21430.21029.6203.3
Force at 2nd crack [N]1229.31000.91050.11357.91689.51237.0215.8
Force at 3rd crack [N]1399.31125.71306.91469.61747.61388.1175.0
Weight [g]38.137.037.339.043.238.72.1
Volume with porosities [mm3]28,735.327,537.827,819.929,260.033,586.629,230.01946.2
Volume without porosities [mm3]28,305.327,093.127,444.828,887.132,918.728,751.31831.1
Volume of porosities [mm3]432.5271.6375.1515.5833.3478.7164.8
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Msallem, B.; Maintz, M.; Halbeisen, F.S.; Meyer, S.; Sigron, G.R.; Sharma, N.; Cao, S.; Thieringer, F.M. Biomechanical Evaluation of Patient-Specific Polymethylmethacrylate Cranial Implants for Virtual Surgical Planning: An In-Vitro Study. Materials 2022, 15, 1970. https://doi.org/10.3390/ma15051970

AMA Style

Msallem B, Maintz M, Halbeisen FS, Meyer S, Sigron GR, Sharma N, Cao S, Thieringer FM. Biomechanical Evaluation of Patient-Specific Polymethylmethacrylate Cranial Implants for Virtual Surgical Planning: An In-Vitro Study. Materials. 2022; 15(5):1970. https://doi.org/10.3390/ma15051970

Chicago/Turabian Style

Msallem, Bilal, Michaela Maintz, Florian S. Halbeisen, Simon Meyer, Guido R. Sigron, Neha Sharma, Shuaishuai Cao, and Florian M. Thieringer. 2022. "Biomechanical Evaluation of Patient-Specific Polymethylmethacrylate Cranial Implants for Virtual Surgical Planning: An In-Vitro Study" Materials 15, no. 5: 1970. https://doi.org/10.3390/ma15051970

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop