Next Article in Journal
How Sex Hormones Affect Migraine: An Interdisciplinary Preclinical Research Panel Review
Previous Article in Journal
State of the Art in Pediatric Anesthesia: A Narrative Review about the Use of Preoperative Time
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Clinical Outcome of Multiple Platelet-Rich Plasma Injection and Correlation with PDGF-BB in the Treatment of Knee Osteoarthritis

by
Radiyati Umi Partan
1,*,
Khoirun Mukhsinin Putra
1,
Hafizzanovian Hafizzanovian
1,
Surya Darma
1,
Muhammad Reagan
1,
Putri Muthia
1,
Afifah Salshabila Radiandina
2 and
Eny Rahmawati
3
1
Division of Rheumatology, Department of Internal Medicine, Dr. Mohammad Hoesin General Hospital, Faculty of Medicine, Universitas Sriwijaya, Palembang 30126, Indonesia
2
Stem Cell & Regenerative Therapies—From Bench to Market MSc, Faculty of Life Science & Medicine, King’s College London, London WC2R 2LS, UK
3
Department of Clinical Pathology, Dr. Mohammad Hoesin General Hospital, Faculty of Medicine, Universitas Sriwijaya, Palembang 30126, Indonesia
*
Author to whom correspondence should be addressed.
J. Pers. Med. 2024, 14(2), 183; https://doi.org/10.3390/jpm14020183
Submission received: 18 January 2024 / Revised: 29 January 2024 / Accepted: 2 February 2024 / Published: 7 February 2024
(This article belongs to the Section Clinical Medicine, Cell, and Organism Physiology)

Abstract

:
(1) Background: Current treatments for knee osteoarthritis (KOA), such as intra-articular corticosteroids or hyaluronic acid (HA) injections, are controversial due to their ineffectiveness in preventing disease progression. Platelet-rich plasma (PRP) has become a promising and possible treatment for KOA. It is thought to enhance articular cartilage regeneration and reduce OA-related impairment. PRP contains growth factors such as PDGF-BB, which stimulates growth and inhibits joint damage. Based on numerous studies, after a certain amount of time, it was found that multiple PRP treatments reduced pain more than a single injection. This study evaluates the efficacy of multiple PRP (m-PRP) injections compared to multiple HA (m-HA) injections for KOA treatment, focusing on their correlation with PDGF-BB levels. (2) Methods: In this single-center, open-label, randomized, comparative clinical trial, 30 KOA patients received m-PRP and m-HA injections. VAS and WOMAC were used to evaluate clinical outcomes and PDGF-BB concentrations. (3) Results: The study analysis revealed a statistically significant reduction in pain indices. In both the m-PRP and m-HA groups after 12 weeks, m-PRP showed superior results. PDGF-BB concentrations also increased, with a strong negative correlation and statistical significance using Spearman’s rho. (4) Conclusions: Multiple PRP injections are safe and associated with elevated PDGF-BB, reduced VAS and WOMAC scores, providing the potential for articular cartilage regeneration and inhibiting knee osteoarthritis progression.

1. Introduction

Osteoarthritis (OA) is a condition characterized by the progressive deterioration of a joint. The pathological alterations observed in osteoarthritis (OA) joints include the development of fibrillation and degradation of the articular cartilage, thickening of the subchondral bone, development of osteophytes, inflammation of the synovium (synovitis), degeneration of ligaments and menisci, and hypertrophy of the joint capsule [1,2]. Osteoarthritis can result in discomfort, impaired joint function, and perhaps even disability due to joint deterioration [3,4,5]. The current treatment options for knee osteoarthritis, including the application of intra-articular corticosteroids or hyaluronic acid (HA) injections, are a subject of controversy due to several difficulties in effectively preventing the progression of the disease [6]. Intra-articular corticosteroids show temporary benefits for knee pain and impairment while also exerting adverse effects on knee structures [7,8]. The efficacy of intra-articular hyaluronic acid (IA-HA) in managing knee osteoarthritis (OA) in these individuals has raised concerns due to the contradictory recommendations seen in current clinical practice guidelines (CPGs) [9]. Hence, there is a need for new methods of treatment and improvements in osteoarthritis therapy [10,11,12]. Platelet-rich plasma (PRP) is one of the medications that have been developed for knee osteoarthritis. PRP has the potential to enhance the articular cartilage regeneration process, thereby accelerating the healing process and mitigating the advancement of OA while also minimizing OA-related impairment [11,13,14].
PRP is obtained from autologous blood and contains many mediators and growth factors that have a role in cell proliferation, migration of stem cells, angiogenesis, and a reduction in inflammation (anti-inflammation) [11,15,16]. Platelet-derived growth factor (PDGF) is an important growth factor found in PRP that plays an essential function in stimulating growth. PDGF consists of five distinct isoforms, with PDGF-BB being one of them. Within osteoarthritis, PDGF-BB functions by suppressing the apoptosis of chondrocytes and promoting the growth of fibroblasts, thereby inducing the production of a collagen matrix. Therefore, PRP has the potential to inhibit the progression of joint damage and enhance the regeneration of articular cartilage [17,18,19,20,21].
There is a lack of established protocols for the utilization of PRP in management of knee osteoarthritis (KOA). There are several PRP variants, including differences in the amount of blood collected and injected, the number of PRP preparations centrifuged, platelet activation prior to injection, the frequency of injections, and the time between injections [22,23,24]. In addition, there are several unresolved hypotheses about the application of PRP injection treatment. The number and frequency of injections needed for KOA therapy are still unresolved. Based on the numerous studies, after a certain amount of time, it was found that multiple PRP treatments reduced pain more than a single injection [25]. Presently, several clinical trials have concentrated on the comparison between multiple platelet-rich plasma (PRP) injections (m-PRP) and multiple hyaluronic acid (HA) injections (m-HA) for the treatment of knee osteoarthritis (KOA). Nevertheless, the effectiveness and safety of m-PRP and m-HA injections are still a subject of discussion in this study [26,27]. The aim of this study is to evaluate the efficacy of multiple intra-articular injections of platelet-rich plasma (m-PRP) compared to multiple intra-articular injections of hyaluronic acid (m-HA) and correlation with PDGF-BB.
This study hypothesized that administering m-PRP would be more effective in reducing VAS and WOMAC scores compared to m-HA as a result of the release of growth factors (GFs) that may have an impact on the deteriorated cartilage.

2. Materials and Methods

The research was an open-label, randomized, comparative clinical trial that met the inclusion criteria and had a 1:1 allocation. The research took place at the Rheumatology Division of Dr. Mohammad Hoesin Hospital in Palembang between July and December 2022. The Ethics Committee of Dr. Mohammad Hoesin General Hospital has approved this research (142/kepkrsmh/2022). The protocol of the research has been successfully submitted to the Clinical Trials Registry (NCT05579665).

2.1. Patient Selection and Randomization

The recruitment of consecutive research participants adhered to the KOA screening criteria set by the American College of Rheumatology (ACR) in 1990. The investigation comprised participants of all genders, aged 30 to 60 years, who had been diagnosed with grades 2 and 3 KOA using X-ray imaging and the Kellgren and Lawrence (KL) scale. Knee effusion, intra-articular injections of glucocorticoids or others like stem cell injections within three months before the study, heart or lung diseases, hematological diseases, acute or chronic infections, other autoimmune diseases, an erythrocyte sedimentation rate (ESR) > 40 mm/h, a rheumatoid factor (RF) > 1:40, hemoglobin levels < 11 g/dL, and platelet counts < 150,000/mm3 were all reasons participants were not allowed to take part. Severe pain, measured using a Visual Analog Scale (VAS) score higher than seven, was explicitly not considered. Additionally, those who reported experiencing exacerbating pain after receiving the injection, persisting even after receiving analgesic medication (1000 mg of paracetamol), were ineligible to continue without being removed from the research.
A randomization procedure was employed to divide the participants into two groups in a 1:1 ratio via block randomization. Using a random number generator that can be accessed at https://stattrek.com/statistics/random-number-generator.aspx, accessed on 23 July 2022, the randomization procedure was carried out (as of 23 July 2022). A non-clinical staff member was responsible for conducting the randomization procedure.

2.2. The Description of PRP

Autologous blood was the source of PRP (Figure 1). Peripheral venous blood + 20 mL was taken with aseptic conditions from median or antecubital vein and put into a tube with 3.2% acid citrate dextrose (ACD) anticoagulant. The blood obtained in less than 30 min was then centrifuged using a Hettich Benchtop Centrifuge Rotina 380R, manufactured by Andreas Hetich GMBH & Co. KG, Germany (2022). First, it was centrifuged at 400 RPM for 10 min, resulting in three layers (plasma, buffy coat, and sediment). The plasma and buffy coat were moved to another sterile tube, then centrifuged again with a second centrifuge at 800 RPM for 10 min. As a result of the centrifuge, the top two-thirds of the plasma were discarded, and the remaining third of the plasma mixed with the sediment at the bottom of the tube. The results of this mixing were transferred to a 2 cc syringe and then immediately injected intra-articularly into the knee. The central laboratory of Dr. Mohammad Hoesin Hospital was responsible for conducting all production procedures. The first group received weekly PRP injections given by rheumatologists for five weeks.

2.3. The Description of HA

The hyaluronic acid used for this clinical trial was Umaron, produced by PT. Pratapa Nirmala (FAHRENHEIT) in Indonesia. The content of each vial was 2 mL of sodium hyaluronate. The second group received weekly HA injections given by rheumatologists for five weeks.

2.4. Clinical Outcomes Measures

The clinical outcomes of each participant were evaluated using the Visual Analogue Scale (VAS) and the Western Ontario and McMaster University Arthritis Index (WOMAC) questionnaires. The questionnaire for WOMAC comprised 26 questions specifically crafted to measure pain, 2 questions intended to assess rigidity, and 17 questions intended to evaluate functional limitations and overall function in knee osteoarthritis patients. The VAS and WOMAC assessments were conducted before the administration of intra-articular injections and after 12 weeks. Clinical staff who were not a part of the research team evaluated VAS and WOMAC assessments.

2.5. Biochemical Assay

Concentrations of Platelet-Derived Growth Factor-BB (PDGF-BB) were quantified in platelet-rich plasma (PRP) samples. The quantitative assessment of PDGF-BB was performed using an enzyme-linked immunosorbent assay. The enzyme-linked immunosorbent assay kit offered by Cloud-Clone Corp. Katy, TX 77494, USA is designed to detect platelet-derived growth factor BB (PDGF-BB) in Homo sapiens (human) species. The test has a high level of sensitivity and exceptional specificity in detecting PDGF-BB, with a minimum detectable dosage generally below 0.113 ng/mL. The central laboratory of Dr. Mohammad Hoesin Hospital was responsible for conducting all procedures. The procedures were executed in accordance with the instructions provided by the manufacturers.

2.6. Statistical Analysis

The data analysis was conducted utilizing the IBM SPSS statistics software version 25.0 tool produced by SPSS Corp. in Chicago, IL, USA. The Kolmogorov–Smirnov and Shapiro–Wilk tests were utilized to assess the normality of the distributions. The research presented the participants’ characteristics by providing either the frequency or mean value, along with the standard deviation for data that conformed to a normal distribution. When the data exhibited a non-normal distribution, the median value was employed with the range, which encompassed the minimum and maximum values. The study utilized either the Mann–Whitney U test or the unpaired t-test. The pre- and post-scores of two similar groups were evaluated using either the paired t-test or the Wilcoxon test to see if the supplement administration resulted in a statistically significant improvement. A correlation was determined using Spearman’s rho test. A p-value below 0.05 was determined to be statistically significant. The research team analyzed and interpreted the data.

3. Results

3.1. Basic Characteristic

Thirty subjects met the inclusion criteria. As shown in Figure 2, every participant completed the study. From July to December 2022, participants underwent ongoing monitoring following their recruitment. All participants were randomly allocated into two groups: 15 people received PRP, while the remaining 15 received HA.
The basic features of the participants are detailed in Table 1. The results of the statistical analysis showed that there were no significant differences between the two groups in terms of age, symptom duration, gender, body mass index (BMI), Kellgren–Lawrence grade for knee osteoarthritis (KOA), physical activity goals, or serum 25(OH)D concentrations. The study primarily involved female participants, the majority of whom were diagnosed with Kellgren–Lawrence grade 3 osteoarthritis. Furthermore, they admitted to engaging in a lack of physical activity.

3.2. Clinical Outcomes

The assessments of m-PRP injection and m-HA injection outcomes following therapy involved both subjective and objective assessments of the patients. The VAS and WOMAC assessments were compared prior to and following the 12-week treatment period, as illustrated in Figure 3. A decrease in the average pain scores was noted in both groups after 12 weeks. In the PRP groups, the mean VAS decreased significantly from 5 to 1, the reduction mean VAS before and after 12-week treatment were −4 ± 0.67 (95% CI, mean ± SD), and the mean WOMAC scores decreased significantly from 79 to 20, the reduction mean WOMAC scores before and after 12-week treatment were −59 ± 6.26 (95% CI, mean ± SD). Moreover, in the HA groups, the mean VAS decreased significantly from 5 to 2, the reduction mean VAS before and after 12-week treatment were −3 ± 1.24 (95% CI, mean ± SD), and the mean WOMAC scores decreased only from 55 to 21, the reduction mean WOMAC scores before and after 12-week treatment were −21 ± 14.07 (95% CI, mean ± SD). The statistical analysis revealed a significant difference between both groups in the mean reduction in pain intensity before and after therapy (p < 0.05). It is evident that the decrease shown in the PRP groups was more significant compared to the decrease in the HA group.

3.3. Biochemical Results

The mean platelet count in this research was 309,000/mm3. After the process of PRP, the mean platelet count reached 501,000/mm3, indicating that the approach employed in this study resulted in a 62.14% increase in platelet concentration from whole blood to PRP. After 12 weeks of observation, it was observed that platelet-rich plasma groups displayed an increase in PDGF-BB concentrations. The mean PDGF-BB concentrations showed a rise of 462.16 ± 116.19 pg/mL (95% CI, mean ± SD) after 12 weeks. The present investigation examines the possibility of a correlation between elevations in PDGF-BB levels and alterations in VAS and WOMAC scores.
The correlation between increasing PDGF-BB concentrations and changes in VAS and WOMAC scores was analyzed using Spearman’s rho. There was a strong negative correlation and statistical significance between these two variables, as shown by Figure 4.

4. Discussion

According to this study, administering multiple PRP and multiple HA intra-articular injections is associated with decreased pain in those suffering from knee osteoarthritis. The mean VAS in the PRP group decreased significantly from 5 to 1, an 80% reduction from the initial values, following a period of 12 weeks. On the contrary, the HA group documented a mean VAS reduction from 5 to 2, which corresponds to a decrease of 60%. During the course of the 12-week duration, substantial enhancements in WOMAC scores were observed in both groups. The mean WOMAC scores in the PRP group decreased significantly from 79 to 20, representing a 75% reduction from the baseline. On the contrary, the HA group witnessed a decline of 21 points, or approximately 61%, as opposed to the initial count of 55. According to established criteria, a pain reduction of at least 30% is indicative of significant clinically relevant changes, which means that the study had a positive outcome [28,29]. The present data suggest that m-PRP is superior to the m-HA preparation used in this study. A study involving 94 patients, discovered that multiple PRP injections intra-articular at a 6-week interval for KOA enhanced clinical outcomes from 6 weeks to 1 year. A meta-analysis of 463 patients also found that patients who received the m-PRP injections had significantly lower scores on VAS and WOMAC than patients who received the m-HA injections. A RCT involving 162 participants revealed that administering multiple PRP injections is more efficacious than single injections and hyaluronic acid in treating early osteoarthritis in the knees [25,30,31].
The reduction in pain observed in OA can be due to the suppression of joint inflammation. This process is achieved by controlling the activity of NF-κB and COX-2, which are the primary components of inflammation. Additional reasons may include the suppression of NF-κB transactivation activity through the action of HGF, a crucial cytokine found in PRP α-granules, or the anti-inflammatory effect of suppressing cell chemotaxis, especially in monocytes. The study conducted by Wu et al. showed that PRP has the ability to counteract the inflammatory processes triggered by IL-1β and TNF-α. Inhibiting the expression of the genes for IL-1β, COX-2, and MMP-2 helps achieve this. Eighty-eight Sudi, as described by Lee et al., observed elevated mRNA levels of the cannabinoid receptors CB1 and CB2, which are associated with pain relief and a reduction in inflammation. This finding suggests a potential mechanism for the analgesic benefits of PRP [32,33,34].
PRP contains an autologous concentration of human platelets in a limited volume of plasma. According to prior research, the platelet concentration in PRP necessary for therapeutic administration is 1,000,000 platelets/μL. In the case where the platelet count in whole blood is 200,000 ± 75,000/μL, PRP intended for therapeutic purposes should increase by an average of 400% from its initial value [35,36,37]. Numerous protocols were investigated in order to elevate the concentration of platelets in PRP. It is crucial to differentiate between simple and double centrifugation procedures, with the latter requiring a more extensive preparation period but yielding platelet-concentrated plasma. Platelet concentrations sufficient to induce a therapeutic effect are achieved using double centrifugation techniques in all cases [22,23,35].
This study involved doing double centrifugations at two different speeds, specifically 400 RPM and 800 RPM. The results showed a significant rise in platelet counts, specifically by 62.14%, following the centrifugation process. While the therapy outcome is still distant from the desired objective, there has been a significant alleviation in patients’ discomfort. A significant quantity of platelets has been detected in PRP. Many growth factors and other proteins are contained in platelet alpha granules (α), which can attract and stimulate stem cells to the site of platelet activation, where they can also regenerate. For therapeutic purposes, including knee osteoarthritis, PRP has been utilized to mobilize and stimulate stem cells. During the joint regeneration process, PRP can stimulate synoviocytes to make more hyaluronic acid, encourage osteoblast cell proliferation and collagen production, and reduce osteoclast activity. It can also enhance the chemotaxis and proliferation of fibroblast cells in damaged joint tissue [33,38,39,40,41].
There are growth factor proteins in the PRP. These are platelet-derived growth factors (PDGF), vascular endothelial growth factors (VEGF), transforming growth factors-β (TGFβ), and epithelial growth factors (EGF). PDGF-BB is one of the growth factors included in PRP. PDGF-BB functions by activating several signaling pathways that inhibit the process of apoptosis in chondrocytes affected by OA [42,43]. This inhibition of apoptosis leads to a decrease in the progression of OA and an enhancement in cell regeneration. Normally, the levels of PDGF-BB after platelet activation should exhibit a straightforward and proportionate correlation with the quantity of platelets. As the quantity of activated platelets rises, the release of PDGF-BB by α granules likewise increases [44,45,46]. Because of the irreversibility of the development of OA, there is a need for therapy techniques that might inhibit the degenerative process. PDGF-BB can facilitate the regeneration process of deteriorating cartilage. Based on the conducted research, the results indicate a substantial association between PDGF-BB in PRP and pain reduction. The graph showing the average VAS and WOMAC scores, which decreased after the administration of PRP injection, serves as evidence for this. Increasing PDGF-BB levels was found to have a strong negative relationship with changes in VAS and WOMAC scores (Figure 4).
Figure 5 illustrates the process by which PDGF-BB may inhibit the progression of OA. Through its effects on the Erk and p38 signaling pathways, PDGF-BB can stop chondrocytes from going through apoptosis in OA. PDGF-BB induces activation of the Erk signaling cascade through its interaction with the PDGFR (Platelet-Derived Growth Factor Receptor). The phosphorylation cascade process is initiated by this binding, which eventually results in the activation of ERK. ERK activation may inhibit apoptosis by phosphorylating and deactivating proteins that promote apoptosis or by controlling the production of proteins that inhibit apoptosis [17,47,48,49]. In the P38 signaling pathway, PDGF-BB has the ability to decrease the activity of p38, resulting in a decrease in BAX protein levels. This decrease in BAX protein levels can block the release of cytochrome c from mitochondria and inhibit the activation of caspase 3. This mechanism has the ability to prevent the apoptosis of chondrocytes, thereby reducing the advancement of OA [48,50,51,52].
Several studies have shown evidence that PDGF-BB inhibits the growth of osteophytes and cartilage hypertrophy while also stimulating the healing process of cartilage and reducing inflammation. These combined actions may contribute to the protective effects of PDGF-BB in OA. Zhengchao et al. demonstrated that PDGF-BB inhibits the p38/Bax/caspase-3 pathway and upregulates Erk phosphorylation to prevent chondrocyte apoptosis in rodents. Furthermore, in a murine OA model, we discovered that PDGF-BB binding to PDGFR could stimulate chondrocyte proliferation and cartilage matrix synthesis [47,48]. PRP is a very promising biological therapy for the treatment of knee osteoarthritis. Several studies have shown effectiveness in a diverse range of difficult settings. Acquiring insight into the variables that lead to this diversity will enable physicians and researchers to effectively utilize PRP and better delineate its function in treating different clinical diseases. Some individuals experienced only minimal side effects, including moderate discomfort and mild effusion, following the injections.
The limitations of our study are the low number of subjects in each group; there was no blinding; there was no mock phlebotomy to harvest blood in the HA group. The pre-treatment groups may not have been completely comparable, as the mean pre-treatment WOMAC score was considerably greater in the PRP group. There may have been a placebo effect, as injected saline has also been shown to improve VAS and WOMAC scores [53]. The inquiry was a short follow-up, with subsequent examinations carried out exclusively within a single research facility. We were unable to evaluate the cartilage directly using high-resolution MRI or microscopic evaluation, which may have yielded more objective data for determining its effectiveness. Because of its perceived lack of effectiveness, HA is not recommended by the American College of Rheumatology or the American Academy of Orthopaedic Surgeons, although EULAR considers it an option.
Due to a lack of data on effectiveness, PRP is strongly recommended by the American College of Rheumatology [54]. PRP is only limitedly recommended by the American Academy of Orthopaedic Surgeons because of inadequate data [55]. Thus, the effectiveness of PRP for OA has not yet been established, and further research is required.

5. Conclusions

Multiple PRP injections may have demonstrated more efficacy in decreasing VAS and WOMAC scores compared to multiple HA injections. Furthermore, the concentration of PDGF-BB showed a considerable increase after a period of 12 weeks of observation. Based on these findings, the study suggests that PRP might be a reliable therapy option for KOA. Future research on PRP for knee osteoarthritis should involve conducting long-term follow-up and measuring additional growth factor concentrations.

Author Contributions

Conceptualization, R.U.P. and E.R.; methodology, H.H., K.M.P., S.D., M.R. and P.M.; software, K.M.P.; validation, R.U.P. and E.R.; formal analysis, R.U.P. and K.M.P.; investigation, H.H. and K.M.P.; resources, H.H., K.M.P. and A.S.R.; data curation, R.U.P. and K.M.P.; writing—original draft preparation, H.H. and K.M.P.; writing—review and editing, R.U.P. and K.M.P.; visualization, K.M.P.; supervision, R.U.P., S.D., M.R. and P.M.; project administration, A.S.R.; funding acquisition, R.U.P. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by Dr. Mohammad Hoesin Hospital, grant number DL.02.01/XVII.2.2/1277/2022.

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki, and approved by the Institutional Review Board (or Ethics Committee) of Dr. Mohammad Hoesin Hospital (No. 142/kepkrsmh/2022) on 19 September 2022. The research protocol has also been registered with the Clinical Trials Registry under the registration number NCT05579665 on 14 October 2022.

Informed Consent Statement

Informed permission was obtained from all patients who agreed to participate in the research.

Data Availability Statement

This study lacked the creation or analysis of any new data. Data sharing is not relevant to this subject.

Acknowledgments

The researchers would like to extend their appreciation to all people who volunteered to take part in this research project, especially the medical professionals of the Department of Internal Medicine at Sriwijaya University and the staff of Dr. Mohammad Hoesin Hospital.

Conflicts of Interest

The researchers and the hospital affirm that there are no conflicts of interest.

References

  1. Robinson, W.H.; Lepus, C.M.; Wang, Q.; Raghu, H.; Mao, R.; Lindstrom, T.M.; Sokolove, J. Low-grade inflammation as a key mediator of the pathogenesis of osteoarthritis. Nat. Rev. Rheumatol. 2016, 12, 580–592. [Google Scholar] [CrossRef]
  2. Lv, Z.; Yang, Y.X.; Li, J.; Fei, Y.; Guo, H.; Sun, Z.; Lu, J.; Xu, X.; Jiang, Q.; Ikegawa, S.; et al. Molecular Classification of Knee Osteoarthritis. Front. Cell Dev. Biol. 2021, 9, 725568. [Google Scholar] [CrossRef]
  3. Safiri, S.; Kolahi, A.A.; Smith, E.; Hill, C.; Bettampadi, D.; Mansournia, M.A.; Lu, J.; Xu, X.; Jiang, Q.; Ikegawa, S.; et al. Global, regional and national burden of osteoarthritis 1990–2017: A systematic analysis of the Global Burden of Disease Study 2017. Ann. Rheum. Dis. 2020, 79, 819–828. [Google Scholar] [CrossRef]
  4. Vos, T.; Allen, C.; Arora, M.; Barber, R.M.; Bhutta, Z.A.; Brown, A.; Carter, A.; Casey, D.C.; Charlson, F.J.; Chen, A.Z.; et al. Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990–2015: A systematic analysis for the Global Burden of Disease Study 2015. Lancet 2016, 388, 1545–1602. [Google Scholar] [CrossRef]
  5. Di Cesare, P.E.; Haudenschild, D.R.; Samuels, J.; Abramson, S.B. Pathogenesis of Osteoarthritis. In Kelley’s Textbook of Rheumatology, 10th ed.; Firestein, G.S., Budd, R.C., Gabriel, S.E., McInnes, I.B., O’Dell, J.R., Eds.; Elsevier: Philadelphia, PA, USA, 2012; Volume 2, pp. 1617–1635. [Google Scholar] [CrossRef]
  6. Miller, L.E. Towards reaching consensus on hyaluronic acid efficacy in knee osteoarthritis. Clin. Rheumatol. 2019, 38, 2881–2883. [Google Scholar] [CrossRef]
  7. Farkas, B.; Kvell, K.; Czömpöly, T.; Illés, T.; Bárdos, T. Increased chondrocyte death after steroid and local anesthetic combination. Clin. Orthop. Relat. Res. 2010, 468, 3112–3120. [Google Scholar] [CrossRef]
  8. Nakazawa, F.; Matsuno, H.; Yudoh, K.; Watanabe, Y.; Katayama, R.; Kimura, T. Corticosteroid treatment induces chondrocyte apoptosis in an experimental arthritis model in chondrocyte cultures. Clin. Exp. Rheumatol. 2002, 20, 773–781. [Google Scholar]
  9. Phillips, M.; Bhandari, M.; Grant, J.; Bedi, A.; Trojian, T.; Johnson, A.; Schemitsch, E. A Systematic Review of Current Clinical Practice Guidelines on Intra-articular Hyaluronic Acid, Corticosteroid, and Platelet-Rich Plasma Injection for Knee Osteoarthritis: An International Perspective. Orthop. J. Sport Med. 2021, 9, 23259671211030272. [Google Scholar] [CrossRef] [PubMed]
  10. Lana, J.F.S.D.; Weglein, A.; Sampson, S.E.; Vicente, E.F.; Huber, S.C.; Souza, C.V.; Ambach, M.A.; Vincent, H.; Urban-Paffaro, A.; Onodera, C.M.K.; et al. Randomized controlled trial comparing hyaluronic acid, platelet-rich plasma and the combination of both in the treatment of mild and moderate osteoarthritis of the knee. J. Stem Cells Regen. Med. 2016, 12, 69–78. [Google Scholar] [CrossRef] [PubMed]
  11. Park, Y.B.; Kim, J.H.; Ha, C.W.; Lee, D.H. Clinical Efficacy of Platelet-Rich Plasma Injection and Its Association With Growth Factors in the Treatment of Mild to Moderate Knee Osteoarthritis: A Randomized Double-Blind Controlled Clinical Trial As Compared With Hyaluronic Acid. Am. J. Sports Med. 2021, 49, 487–496. [Google Scholar] [CrossRef] [PubMed]
  12. Trojian, T.H.; Concoff, A.L.; Joy, S.M.; Hatzenbuehler, J.R.; Saulsberry, W.J.; Coleman, C.I. AMSSM scientific statement concerning viscosupplementation injections for knee osteoarthritis: Importance for individual patient outcomes. Br. J. Sports Med. 2016, 50, 84–92. [Google Scholar] [CrossRef] [PubMed]
  13. Mazzocca, A.D.; McCarthy, M.B.R.; Chowaniec, D.M.; Dugdale, E.M.; Hansen, D.; Cote, M.P.; Bradley, J.P.; Romeo, A.A.; Arciero, R.A.; Beitzel, K. The positive effects of different platelet-rich plasma methods on human muscle, bone, and tendon cells. Am. J. Sports Med. 2012, 40, 1742–1749. [Google Scholar] [CrossRef] [PubMed]
  14. Xie, X.; Zhang, C.; Tuan, R.S. Biology of platelet-rich plasma and its clinical application in cartilage repair. Arthritis Res. Ther. 2014, 16, 204–215. [Google Scholar] [CrossRef] [PubMed]
  15. Fu, C.J.; Sun, J.B.; Bi, Z.G.; Wang, X.M.; Yang, C.L. Evaluation of platelet-rich plasma and fibrin matrix to assist in healing and repair of rotator cuff injuries: A systematic review and meta-analysis. Clin. Rehabil. 2017, 31, 158–172. [Google Scholar] [CrossRef] [PubMed]
  16. Laudy, A.B.M.; Bakker, E.W.P.; Rekers, M.; Moen, M.H. Efficacy of platelet-rich plasma injections in osteoarthritis of the knee: A systematic review and meta-analysis. Br. J. Sports Med. 2015, 49, 657–672. [Google Scholar] [CrossRef]
  17. Zhu, P.; Wang, Z.; Sun, Z.; Liao, B.; Cai, Y. Recombinant platelet-derived growth factor-BB alleviates osteoarthritis in a rat model by decreasing chondrocyte apoptosis in vitro and in vivo. J. Cell Mol. Med. 2021, 25, 7472–7484. [Google Scholar] [CrossRef]
  18. Mochizuki, T.; Ushiki, T.; Watanabe, S.; Omori, G.; Kawase, T. The levels of TGFβ1, VEGF, PDGF-BB, and PF4 in platelet-rich plasma of professional soccer players: A cross-sectional pilot study. J. Orthop. Surg. Res. 2022, 17, 465. [Google Scholar] [CrossRef] [PubMed]
  19. Fredriksson, L.; Li, H.; Eriksson, U. The PDGF family: Four gene products form five dimeric isoforms. Cytokine Growth Factor Rev. 2004, 15, 197–204. [Google Scholar] [CrossRef]
  20. Cheng, P.G.; Yang, K.D.; Huang, L.G.; Wang, C.H.; Ko, W.S. Comparisons of Cytokines, Growth Factors and Clinical Efficacy between Platelet-Rich Plasma and Autologous Conditioned Serum for Knee Osteoarthritis Management. Biomolecules 2023, 13, 555. [Google Scholar] [CrossRef]
  21. Verma, R.; Kandwal, A.; Negi, G.; Chandra, H. Factors affecting the quantity and quality of platelet-rich plasma and platelet-derived growth factor-BB: An observational study. J. Bio-X Res. 2021, 4, 67–70. [Google Scholar] [CrossRef]
  22. Lansdown, D.A.; Fortier, L.A. Platelet-Rich Plasma: Formulations, Preparations, Constituents, and Their Effects. Oper. Tech. Sports Med. 2017, 25, 7–12. [Google Scholar] [CrossRef]
  23. Croisé, B.; Paré, A.; Joly, A.; Louisy, A.; Laure, B.; Goga, D. Optimized centrifugation preparation of the platelet rich plasma: Literature review. J. Stomatol. Oral. Maxillofac. Surg. 2020, 121, 150–154. [Google Scholar] [CrossRef]
  24. Amo CDel Perez-Valle, A.; Atilano, L.; Andia, I. Unraveling the Signaling Secretome of Platelet-Rich Plasma: Towards a Better Understanding of Its Therapeutic Potential in Knee Osteoarthritis. J. Clin. Med. 2022, 11, 473. [Google Scholar] [CrossRef]
  25. Görmeli, G.; Görmeli, C.A.; Ataoglu, B.; Çolak, C.; Aslantürk, O.; Ertem, K. Multiple PRP injections are more effective than single injections and hyaluronic acid in knees with early osteoarthritis: A randomized, double-blind, placebo-controlled trial. Knee Surg. Sports Traumatol. Arthrosc. 2017, 25, 958–965. [Google Scholar] [CrossRef] [PubMed]
  26. Kon, E.; Mandelbaum, B.; Buda, R.; Filardo, G.; Delcogliano, M.; Timoncini, A.; Fornasari, P.M.; Giannini, S.; Marcacci, M. Platelet-Rich Plasma Intra-Articular Injection Versus Hyaluronic Acid Viscosupplementation as Treatments for Cartilage Pathology: From Early Degeneration to Osteoarthritis. Arthroscopy 2011, 11, 1490–1501. [Google Scholar] [CrossRef] [PubMed]
  27. Filardo, G.; Di Matteo, B.; Di Martino, A.; Merli, M.L.; Cenacchi, A.; Fornasari, P.; Marcacci, M.; Kon, E. Platelet-rich plasma intra-articular knee injections show no superiority versus viscosupplementation: A randomized controlled trial. Am. J. Sports Med. 2015, 43, 1575–1582. [Google Scholar] [CrossRef] [PubMed]
  28. Huang, H.Y.; Hsu, C.W.; Lin, G.C.; Lin, H.S.; Chou, Y.J.; Liou, I.H.; Sun, S.-F. Comparing efficacy of a single intraarticular injection of platelet-rich plasma (PRP) combined with different hyaluronans for knee osteoarthritis: A randomized-controlled clinical trial. BMC Musculoskelet. Disord. 2022, 23, 954. [Google Scholar] [CrossRef] [PubMed]
  29. Dworkin, R.H.; Turk, D.C.; Wyrwich, K.W.; Beaton, D.; Cleeland, C.S.; Farrar, J.T.; Haythornthwaite, J.A.; Jensen, M.P.; Kerns, R.D.; Ader, D.N.; et al. Interpreting the Clinical Importance of Treatment Outcomes in Chronic Pain Clinical Trials: IMMPACT Recommendations. J. Pain 2008, 9, 105–121. [Google Scholar] [CrossRef]
  30. Ngarmukos, S.; Tanavalee, C.; Amarase, C.; Phakham, S.; Mingsiritham, W.; Reantragoon, R.; Leearamwat, N.; Kongkaew, T.; Tharakhet, K.; Honsawek, S.; et al. Two or four injections of platelet-rich plasma for osteoarthritic knee did not change synovial biomarkers but similarly improved clinical outcomes. Sci. Rep. 2021, 11, 23603. [Google Scholar] [CrossRef]
  31. Li, S.; Xing, F.; Yan, T.; Zhang, S.; Chen, F. Multiple Injections of Platelet-Rich Plasma Versus Hyaluronic Acid for Knee Osteoarthritis: A Systematic Review and Meta-Analysis of Current Evidence in Randomized Controlled Trials. J. Pers. Med. 2023, 13, 429. [Google Scholar] [CrossRef]
  32. Kabiri, A.; Esfandiari, E.; Esmaeili, A.; Hashemibeni, B.; Pourazar, A.; Mardani, M. Platelet-rich plasma application in chondrogenesis. Adv. Biomed. Res. 2014, 3, 138. [Google Scholar] [CrossRef]
  33. Lee, H.R.; Park, K.M.; Joung, Y.K.; Park, K.D.; Do, S.H. Platelet-rich plasma loaded hydrogel scaffold enhances chondrogenic differentiation and maturation with up-regulation of CB1 and CB2. J. Control. Release 2012, 159, 332–337. [Google Scholar] [CrossRef]
  34. Wu, C.C.; Chen, W.H.; Zao, B.; Lai, P.L.; Lin, T.C.; Lo, H.Y.; Shieh, Y.-H.; Wu, C.-H.; Deng, W.-P. Regenerative potentials of platelet-rich plasma enhanced by collagen in retrieving pro-inflammatory cytokine-inhibited chondrogenesis. Biomaterials 2011, 32, 5847–5854. [Google Scholar] [CrossRef]
  35. Su, C.A.; Jildeh, T.R.; Vopat, M.L.; Waltz, R.A.; Millett, P.J.; Provencher, M.T.; Philippon, M.J.; Huard, J. Current State of Platelet-Rich Plasma and Cell-Based Therapies for the Treatment of Osteoarthritis and Tendon and Ligament Injuries. J. Bone Jt. Surg. 2022, 104, 1406–1414. [Google Scholar] [CrossRef] [PubMed]
  36. Marx, R.E. Platelet-rich plasma (PRP): What is PRP and what is not PRP? Implant. Dent. 2001, 10, 225–228. [Google Scholar] [CrossRef] [PubMed]
  37. Nugraha, H.K.; Muljanti, M.; Hernaningsih, Y.; Nugraha, J. Platelet Rich Plasma Preparation Protocols: A Preliminary Study. Indones. J. Trop. Infect. Dis. 2016, 3, 104. [Google Scholar] [CrossRef]
  38. Jain, N.K.; Gulati, M. Platelet-rich plasma: A healing virtuoso. Blood Res. 2016, 51, 3–5. [Google Scholar] [CrossRef] [PubMed]
  39. Sundman, E.A.; Cole, B.J.; Karas, V.; Della Valle, C.; Tetreault, M.W.; Mohammed, H.O.; Fortier, L.A. The anti-inflammatory and matrix restorative mechanisms of platelet-rich plasma in osteoarthritis. Am. J. Sports Med. 2014, 42, 35–41. [Google Scholar] [CrossRef] [PubMed]
  40. Anitua, E.; Sánchez, M.; Nurden, A.T.; Zalduendo, M.M.; De la Fuente, M.; Azofra, J.; Andia, I. Platelet-released growth factors enhance the secretion of hyaluronic acid and induce hepatocyte growth factor production by synovial fibroblasts from arthritic patients. Rheumatology 2007, 46, 1769–1772. [Google Scholar] [CrossRef] [PubMed]
  41. Szwedowski, D.; Szczepanek, J.; Paczesny, Ł.; Pękała, P.; Zabrzyński, J.; Kruczyński, J. Genetics in cartilage lesions: Basic science and therapy approaches. Int. J. Mol. Sci. 2020, 21, 5430. [Google Scholar] [CrossRef] [PubMed]
  42. Cook, C.S.; Smith, P.A. Clinical Update: Why PRP Should Be Your First Choice for Injection Therapy in Treating Osteoarthritis of the Knee. Curr. Rev. Musculoskelet. Med. 2018, 11, 583–592. [Google Scholar] [CrossRef]
  43. Xiong, Y.; Gong, C.; Peng, X.; Liu, X.; Su, X.; Tao, X.; Li, Y.; Wen, Y.; Li, W. Efficacy and safety of platelet-rich plasma injections for the treatment of osteoarthritis: A systematic review and meta-analysis of randomized controlled trials. Front. Med. 2023, 10, 1204144. [Google Scholar] [CrossRef]
  44. Magalon, J.; Bausset, O.; Serratrice, N.; Giraudo, L.; Aboudou, H.; Veran, J.; Magalon, G.; Dignat-Georges, F.; Sabatier, F. Characterization and comparison of 5 platelet-rich plasma preparations in a single-donor model. Arthrosc.-J. Arthrosc. Relat. Surg. 2014, 30, 629–638. [Google Scholar] [CrossRef]
  45. Gato-Calvo, L.; Magalhaes, J.; Ruiz-Romero, C.; Blanco, F.J.; Burguera, E.F. Platelet-rich plasma in osteoarthritis treatment: Review of current evidence. Ther. Adv. Chronic Dis. 2019, 10, 2040622319825567. [Google Scholar] [CrossRef] [PubMed]
  46. Etulain, J.; Mena, H.A.; Meiss, R.P.; Frechtel, G.; Gutt, S.; Negrotto, S.; Schattner, M. An optimised protocol for platelet-rich plasma preparation to improve its angiogenic and regenerative properties. Sci. Rep. 2018, 8, 1513. [Google Scholar] [CrossRef] [PubMed]
  47. Wang, Z.; Zhu, P.; Liao, B.; You, H.; Cai, Y. Effects and action mechanisms of individual cytokines contained in PRP on osteoarthritis. J. Orthop. Surg. Res. 2023, 18, 713. [Google Scholar] [CrossRef]
  48. Xia, T.; Gao, R.; Zhou, G.; Liu, J.; Li, J.; Shen, J. Trans-Cinnamaldehyde Inhibits IL-1β-Stimulated Inflammation in Chondrocytes by Suppressing NF-κB and p38-JNK Pathways and Exerts Chondrocyte Protective Effects in a Rat Model of Osteoarthritis. BioMed Research International. BioMed Res. Int. 2019, 2019, 4039472. [Google Scholar] [CrossRef]
  49. Cai, Y.; Wang, Z.; Liao, B.; Sun, Z.; Zhu, P. Anti-inflammatory and Chondroprotective Effects of Platelet-derived Growth Factor-BB on Osteoarthritis Rat Models. J. Gerontol. A Biol. Sci. Med. Sci. 2023, 78, 51–59. [Google Scholar] [CrossRef]
  50. Fernandez-Moure, J.S.; Van Eps, J.L.; Cabrera, F.J.; Barbosa, Z.; Medrano del Rosal, G.; Weiner, B.K.; Ellsworth, W.A.; Tasciotti, E. Platelet-rich plasma: A biomimetic approach to enhancement of surgical wound healing. J. Surg. Res. 2017, 207, 33–44. [Google Scholar] [CrossRef]
  51. Hwang, H.S.; Kim, H.A. Chondrocyte apoptosis in the pathogenesis of osteoarthritis. Int. J. Mol. Sci. 2015, 16, 26035–26054. [Google Scholar] [CrossRef] [PubMed]
  52. Ji, B.; Ma, Y.; Wang, H.; Fang, X.; Shi, P. Activation of the P38/CREB/MMP13 axis is associated with osteoarthritis. Drug Des. Dev. Ther. 2019, 13, 2195–2204. [Google Scholar] [CrossRef] [PubMed]
  53. Altman, R.D.; Devji, T.; Bhandari, M.; Fierlinger, A.; Niazi, F.; Christensen, R. Clinical benefit of intra-articular saline as a comparator in clinical trials of knee osteoarthritis treatments: A systematic review and meta-analysis of randomized trials. Semin. Arthritis Rheum. 2016, 46, 151–159. [Google Scholar] [CrossRef] [PubMed]
  54. Kolasinski, S.L.; Neogi, T.; Hochberg, M.C.; Oatis, C.; Guyatt, G.; Block, J.; Callahan, L.; Copenhaver, C.; Dodge, C.; Felson, D.; et al. 2019 American College of Rheumatology/Arthritis Foundation Guideline for the Management of Osteoarthritis of the Hand, Hip, and Knee. Arthritis Rheumatol. 2020, 72, 220–233. [Google Scholar] [CrossRef] [PubMed]
  55. Jevsevar, D.S.; Brown, G.A.; Jones, D.L.; Matzkin, E.G.; Manner, P.A.; Mooar, P.; Schousboe, J.T.; Stovitz, S.; Sanders, J.O.; Bozic, K.J.; et al. The American Academy of Orthopaedic Surgeons Evidence-Based Guideline on. J. Bone Jt. Surg. 2013, 95, 1885–1886. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Illustrates the procedure for producing PRP with two sets of centrifuges. (This illustration was designed and produced on the online platform Biorender.com, accessed on 1 January 2024).
Figure 1. Illustrates the procedure for producing PRP with two sets of centrifuges. (This illustration was designed and produced on the online platform Biorender.com, accessed on 1 January 2024).
Jpm 14 00183 g001
Figure 2. Flowchart illustrating the process of screening, randomization, and determining the sample size for analysis.
Figure 2. Flowchart illustrating the process of screening, randomization, and determining the sample size for analysis.
Jpm 14 00183 g002
Figure 3. Box diagram illustrating the treatment effect of m-PRP injection and m-HA injection measurements for week 12 before and after therapy. The clinical efficacy of the treatment was evaluated using two instruments: (A) the Visual Analogue Scale (VAS) and; (B) the Osteoarthritis Index of Western Ontario and McMaster University (WOMAC). a = Wilcoxon Test; b = Mann–Whitney Test, indicating whether the difference between pre- and post-evaluations is statistically significant (p < 0.05).
Figure 3. Box diagram illustrating the treatment effect of m-PRP injection and m-HA injection measurements for week 12 before and after therapy. The clinical efficacy of the treatment was evaluated using two instruments: (A) the Visual Analogue Scale (VAS) and; (B) the Osteoarthritis Index of Western Ontario and McMaster University (WOMAC). a = Wilcoxon Test; b = Mann–Whitney Test, indicating whether the difference between pre- and post-evaluations is statistically significant (p < 0.05).
Jpm 14 00183 g003
Figure 4. A correlation between increasing PDGF-BB levels and changes in VAS (A) and WOMAC scores (B). * Spearman’s rho test; ** p < 0.05. If the value of r = 0.0 to <0.2; very weak, r = 0.2 to <0.4; weak, r = 0.4 to <0.6; moderate, r = 0.6 to <0.8; strong, r = 0.8 to 1 = very strong.
Figure 4. A correlation between increasing PDGF-BB levels and changes in VAS (A) and WOMAC scores (B). * Spearman’s rho test; ** p < 0.05. If the value of r = 0.0 to <0.2; very weak, r = 0.2 to <0.4; weak, r = 0.4 to <0.6; moderate, r = 0.6 to <0.8; strong, r = 0.8 to 1 = very strong.
Jpm 14 00183 g004
Figure 5. The role of PDGF-BB in condrocytes in inhibiting the progression of KOA. →: Stimulate : inhibition (This illustration was designed and generated using the web platform Biorender.com, accessed on 1 January 2024).
Figure 5. The role of PDGF-BB in condrocytes in inhibiting the progression of KOA. →: Stimulate : inhibition (This illustration was designed and generated using the web platform Biorender.com, accessed on 1 January 2024).
Jpm 14 00183 g005
Table 1. Basic characteristics.
Table 1. Basic characteristics.
VariableTotal
n = 30 (%)
Intervention Group
PRP (%)HA (%)
Age, y, mean ± SD 55.5 ± 6.254.3 ± 9.1
Symptom duration, mo,
mean (range)
60.4 (7–360)64.5 (4–360)
Gender
Female28 (93)14 (93)14 (93)
Male2 (7)1 (7)1 (7)
BMI
Severe Underweight (<17)
Underweight (17–18.4)000
Normal (18.5–25)3 (20)03 (20)
Overweight (25.1–27)15 (50)9 (60)6 (40)
Obese (>27)12 (30)6 (40)6 (40)
Physical Activity
Mild18 (60)12 (80)6 (40)
Moderate12 (40)3 (20)9 (60)
Severe
Kellgren Lawrence Grade
Grade 28 (27)3 (20)5 (33)
Grade 322 (73)12 (80)10 (67)
Serum 25(OH)D Level
Normal
Insufficiency10 (33)010 (67)
Deficiency20 (67)15 (100)5 (33)
Mean Pre-VAS15 (50)55
Mean Pre-Womac15 (50)7955
Mean Post-VAS (12 weeks)15 (50)12
Mean Post-Womac (12 weeks)15 (50)2021
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Partan, R.U.; Putra, K.M.; Hafizzanovian, H.; Darma, S.; Reagan, M.; Muthia, P.; Radiandina, A.S.; Rahmawati, E. Clinical Outcome of Multiple Platelet-Rich Plasma Injection and Correlation with PDGF-BB in the Treatment of Knee Osteoarthritis. J. Pers. Med. 2024, 14, 183. https://doi.org/10.3390/jpm14020183

AMA Style

Partan RU, Putra KM, Hafizzanovian H, Darma S, Reagan M, Muthia P, Radiandina AS, Rahmawati E. Clinical Outcome of Multiple Platelet-Rich Plasma Injection and Correlation with PDGF-BB in the Treatment of Knee Osteoarthritis. Journal of Personalized Medicine. 2024; 14(2):183. https://doi.org/10.3390/jpm14020183

Chicago/Turabian Style

Partan, Radiyati Umi, Khoirun Mukhsinin Putra, Hafizzanovian Hafizzanovian, Surya Darma, Muhammad Reagan, Putri Muthia, Afifah Salshabila Radiandina, and Eny Rahmawati. 2024. "Clinical Outcome of Multiple Platelet-Rich Plasma Injection and Correlation with PDGF-BB in the Treatment of Knee Osteoarthritis" Journal of Personalized Medicine 14, no. 2: 183. https://doi.org/10.3390/jpm14020183

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop