Next Article in Journal
Automated Segmentation of Microvessels in Intravascular OCT Images Using Deep Learning
Next Article in Special Issue
Synthesis of Carrier-Free Paclitaxel–Curcumin Nanoparticles: The Role of Curcuminoids
Previous Article in Journal
Organs-on-Chips Platforms Are Everywhere: A Zoom on Biomedical Investigation
Previous Article in Special Issue
Anticancer Activity, Mechanism, and Delivery of Allyl Isothiocyanate
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Meta-Analysis: A Convenient Tool for the Choice of Nose-to-Brain Nanocarriers

by
Rania M. Hathout
* and
Eman M. El-Marakby
Department of Pharmaceutics and Industrial Pharmacy, Faculty of Pharmacy, Ain Shams University, African Union Organization St., Cairo 11566, Egypt
*
Author to whom correspondence should be addressed.
Bioengineering 2022, 9(11), 647; https://doi.org/10.3390/bioengineering9110647
Submission received: 31 August 2022 / Revised: 8 October 2022 / Accepted: 10 October 2022 / Published: 3 November 2022
(This article belongs to the Special Issue Drug Delivery Systems, What's New?)

Abstract

:
Objectives: The intranasal route represents a high promising route of administration aiming for brain delivery. Yet, it represents one of the most difficult and complicated routes. Accordingly, scientists are in a continuous search for novel drug delivery vehicles such as the lipid and polymeric nanoparticles that are apt to enhance the bioavailability of the administered drugs to reach the brain. In this study, a certain number of publications were selected from different databases and literature. Meta-analysis studies using two different algorithms (DerSimonian–Laird and inverse variance) followed aiming to explore the published studies and confirm by evidence the superiority of nanocarriers in enhancing the brain bioavailability of various drugs. Furthermore, the quantitative comparison of lipid versus polymeric nanosystems was performed. Methods: The area under the curve (AUC) as an important pharmacokinetic parameter extracted from in vivo animal studies was designated as the “effect” in the performed meta-analysis after normalization. Forest plots were generated. Key findings and Conclusions: The meta-analysis confirmed the augmentation of the AUC after the comparison with traditional preparations such as solutions and suspensions. Most importantly, lipid nanoparticles were proven to be significantly superior to the polymeric counterparts.

1. Introduction

Several drug delivery researchers and formulators have attempted the nose-to-brain drug delivery as it offers several merits and advantages. The ease of administration, noninvasiveness, proximity to the target organ (the brain), and many other benefits such as the circumvention of one of the hardest barriers for drugs to penetrate, viz. the blood–brain barrier, together with the first-pass effect (liver metabolism) avoidance [1,2] are among the most important pros of this route of administration. The last two aforementioned advantages specifically lead to a remarkable increase in the drug brain bioavailability compared with other conventional pathways of drug administration such as the oral and intravenous routes [3].
To enhance drug absorption and permeability through the nasal mucosa and blood–brain barrier, several attempts have been adopted. Among these attempts are the use of permeation enhancers and drug nanocarriers. The correct selection of the nanoparticulate materials can provide a very successful means of delivering the drug molecule to the brain via the nose. Exploiting the trigeminal and olfactory nerves for the nose-to-brain delivery warrants the usage of several hydrophobic or amphiphilic nanosystems such as the solid lipid nanoparticles, nanostructured lipid carriers, lipid nanocapsules, liposomes, microemulsions, PLGA, Pullulan and chitosan polymeric nanoparticles, and gelatin as protein nanocarriers [4,5,6].
Furthermore, the controlled manner of delivery of drugs currently poses a subject of high significance at both the industrial and academic levels due to its great benefits in the therapy of serious diseases [7,8,9,10]. In a previous and recent meta-analysis study, lipid-based nanosystems were proven to be more capable of increasing the bioavailability of oral drugs after the comparison with conventional systems and formulations [11]. More recently, the use of polymeric nanoparticles was also proven to significantly increase the bioavailability of the aforementioned drugs despite its different nature and chemical structure [12]. Regarding the nose-to-brain delivery, both carrier types have their pros and cons. The lipid vehicles’ strongest advantage lies in the high affinity to the neurons and blood–brain barrier (BBB). On the other hand, the polymeric counterparts are more stable, robust, and easily modulated and conjugated [6,13,14,15].
Systematic reviewing is concerned with the obtainment of empirical evidence from some predetermined eligibility criteria aiming to answer a certain research inquiry. Informatics scientists consider systematic reviewing as a qualitative kind of informatics tool. Nevertheless, meta-analysis is considered its associated quantitative informatics synthesis tool [16]. Meta-analysis is a highly advanced statistical technique that combines the data originating from several studies and extracted from multiple sources. It augments the precision and accuracy of the research studies’ results and outcomes. Moreover, it gives profound postulations and predictions. Meta-analysis is currently accepted as a highly robust informatics tool and a very important method for analyzing and extracting important information from the available literature after data normalization [17]. Moreover, meta-analyses pose important roles in evidence-based healthcare-related issues. Meta-analysis is superior to the other types of studies such as case controls, case reports, cohort studies, and randomized controlled trials. Furthermore, meta-analysis is recognized to be at the top of the pyramid of the levels of evidence [18,19]. Meta-analysis studies offer several advantages. It enhances the statistical power due to sample pooling. Furthermore, this kind of analysis increases the weight of the obtained conclusions. Moreover, meta-analysis is a feasible and economic kind of analysis as it works by the efficient utility of the available treasure of the online resources of databases and literature [20,21,22]. Searching for the correct data and accurately following the eligible criteria are the only hurdles for this method.
Currently, the meta-analysis technique is being integrated in the drug delivery field. Its main benefits lie in comparing novel formulations or advanced drug delivery systems with a conventional counterpart on one hand and comparing several carriers and new delivery systems together on the other hand. It then introduces a new tool for the pharmaceutical industry choice of materials and carriers and helps in decision-making [11,17,23,24].
To this end, systematic reviewing and meta-analysis were used in the current study as pharmaceutics informatics tools [15,25] in order to track the influence of delivering drugs utilizing nanoparticulate systems on the area under the curve (AUC) as an in vivo pharmacokinetic parameter and important indicator of the superior bioavailability of these advanced carriers to the conventional formulations. Furthermore, an additional covariate factor was assessed, specifically the type of the used nanoparticulate system, e.g., lipids such as liposomes, solid lipid nanoparticles, and lipid nanocapsules versus the polymeric such as chitosan, PLGA, Pullulan, and zein.

2. Methods

2.1. Data Mining

The computerized collection of data was adopted utilizing databases such as Medline® and Embase® and online search engines such as Google Scholar®, SCOPUS®, ScienceDirect®, and Web of Science®.
The English keywords that were used in the search were as follows: nasal, lipid, polymer, nanocarriers, drug, natural, and synthetic. Processing the literature data and information was performed as described in the guidelines of PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses: http://www.prisma-statement.org/, accessed on 30 July 2022). The process is depicted in a flowchart diagram illustrated in Figure 1.

2.2. Inclusion Data and Criteria

The conducted meta-analysis depended on recording the area under the curve (AUC) as an essential pharmacokinetic parameter. In order for the articles to be accounted as eligible for analysis, these articles should possess certain criteria such as lying in the last ten years (decade), originating from different locations, containing diverse types of lipids and polymers, having a detailed methodology, demonstrating original kind of data, and containing a detailed discussion about the loading of drugs in nanoparticulate systems that are utilized for nose-to-brain delivery. The complete collected eligible articles were additionally extensively screened after the evaluation of the whole and the full text. All of the investigated articles should present original data and should have been published in literature databases as research articles. The mean and standard deviation of the investigated pharmacokinetic parameter, the area under the curve (AUC), should be recorded in the articles. The results of the control group dealing with the investigated drug in all the included studies should be stated. This group should be formulations containing the drug delivered in a conventional formulation via the nasal route. The data that were gathered from the articles adhering to the inclusion criteria were as follows: the name of the studied drug; the author name and year when the study was published; the number of animals utilized for the nanoparticulate system group and, additionally, the conventional formulation group; the type of animal used; the type of the used nanoparticulate system (lipid versus polymeric); and the origin of the material from which the nanoparticulate system is fabricated (natural versus synthetic). The AUC was taken as the bioavailability indicator to compare the drug-loaded nanoparticulate systems and the control (the drug conventional formulation). Various parameters of the adopted meta-analysis are depicted in Table 1.

2.3. Meta Analysis

An initial meta-analysis was performed aiming to confirm the bioavailability enhancement effect after loading the intranasal drugs on nanocarriers as depicted by the pharmacokinetic parameter, the area under the curve (AUC), demonstrating the “effect” of the study. Meta-analysis combines the results that are usually obtained from several sources and projects them into a comprehensive conclusive manner. Consequently, the “heterogeneity” was also computed.
OpenMetaAnalyst software (http://www.cebm.brown.edu/openMeta/, accessed on 30 July 2022) was used to feed the two crucial parameters: the effect size, which is the AUC, and the study sample size, which is the number of animals used in the study. The results were meta-analyzed, and the distinguishing charts of this kind of statistical analyses, the forest plots, were provided.
The crucial and solely permissible assumption of the fixed-effect model of meta-analysis stating that the only source of variation between the studies should come from sampling errors (only) was not met in the collected investigated studies of the current meta-analysis due to the variability in the number of used animals in each study. Accordingly, the overall effect size was calculated using the alternative “continuous random-effects model” and utilizing the “DerSimonian–Laird method”.
The results were further confirmed using another software: Review Manager v.5.4.1 (Cochrane Collaboration, London, UK), which utilizes another algorithm, the inverse variance for the overall effect size calculation. The continuous random-effects model was also used in this analysis.
The random-effects model is concerned with the different sources of variability occurring between all the studies. Examples of these sources in the current study include the study year, authors, differently used drugs and their variable doses, conditions of conducting the different studies, type of the utilized animals, origin of the used material, measurements method, and sample size. Therefore, and logically, the random-effects model was claimed suitable for the conducted meta-analysis. Nevertheless, heterogeneity was evaluated using two important statistical parameters: the Q statistic and I2 index. The Q statistic provides an account on the presence or, on the contrary, the absence of heterogeneity among a studies’ set that is related to all of the stated variables, whereas the I2 index is considered an indicator of the heterogeneity degree. The standardized mean difference (SMD) and its corresponding 95% confidence interval (CI) were computed and presented in the forest plot. The p-value was used as an indicator of the presence of significance. The sensitivity and robustness of the study were assessed using the statistical technique leave-one-out meta-analysis.
The effect size was computed through the following equation [12]:
E = I A U C N
where E represents the effect size, IAUC is the targeted area under the curve, and N is the number of animals used in the investigated study (the sample size).
The standard mean difference (SMD) was also computed as follows:
S M D = M e a n a M e a n b S p o o l e d
where Spooled is
n a 1 S a 2   + n b 1 S b 2 n a + n b 2
where na is the number of animals that received the nanocarrier, nb is the number of animals that were administered with the control (the drug conventional formulation), Sa is the standard deviation of the nanocarrier mean effect, whereas Sb is the standard deviation of the mean effect of the drug conventional formulation.
The weight of each study was calculated as follows:
S W = 1 S E 2
where SW is the weight of the investigated study, and SE is the standard error of the study.
For optimizing purposes, the studies that possessed odd (whether highest or lowest) weights were removed (ignored), and the results were re-meta-analyzed.
Q usually represents the amount of observed heterogeneity, whereas the I2 index presents the amount of predicted heterogeneity due to chance and is usually considered the quantitative degree of heterogeneity and is computed as follows: I 2 = 100 × Q d f Q , where df is the degrees of freedom calculated as the studies number −1.
Moreover, the investigated studies were analyzed according to two subgroup categories. The first category was (a) the polymeric nanoparticulate systems versus (b) the lipid nanoparticulate systems, and the second category included (c) the naturally originated material of the nanoparticulate systems versus (d) the synthetically originated material of the nanoparticulate systems.
It is also worth to note that the publication bias was assessed by constructing a funnel plot using Reviewer Manager v.5.4.1. software.

3. Results and Discussion

Table 1 depicts the results that were obtained from the performed meta-analysis after computing the standardized mean difference (SMD) for each of the investigated studies together with its corresponding lower and upper confidence intervals (C.I.s). The presence of the calculated C.I.s on one side of the number zero as a cutoff (i.e., either both confidence intervals are positive or both negative), as illustrated by the software-generated forest plots (Figure 2 and Figure 3), represented by the symbol of a diamond indicating the overall mean not touching the line of no effect (the zero line), implies the significance of all the results of the investigated studies [23,45].
The overall SMD estimate was considered significant as its p-values were calculated as <0.1 and <0.00001 and possessed pooled estimates of 9.2 and C.I. (6.5, 11.9) and 7.52 and C.I. (4.81, 10.23) for the results generated using OpenMetaAnalyst and Review Manager, respectively [46]. Since the values of both the upper and lower confidence intervals are higher than zero, the significance of the results was confirmed [47] and proved the existence of a true effect of the used nanocarriers on the nose-to-brain bioavailability of the included drugs as indicated by the area under the curve (AUC) as a very important pharmacokinetic parameter.
The results were validated using the leave-one-out meta-analysis (by ignoring one study at a time and reconducting the analysis). This technique has proven the high sensitivity and accuracy of the outcomes as the pooled estimate ranged from 8.3 to 10.3 for all of the performed and conducted analyses [48].
The mechanism of transport of nanoparticles via the nose-to-brain route happens through the trigeminal or olfactory neurons using endocytotic or neuronal pathways. Laser confocal scanning microscopy has previously proven that the nanocarriers within the range of 20–200 nm can follow the clathrin-coated pits. On the other hand, larger nanoparticles in the size range of 200–1000 nm can be uptaken through the caveolae-mediated endocytosis. The nanoparticles can also be transported from the endothelial cells to olfactory neurons through endocytosis or pinocytosis, and its movement takes place along the neuronal axon. This transport pathway takes place when the nanoparticle size is within the axon diameter, which is 100–700 nm. Accordingly, the intranasal delivery of nanoparticles is considered a promising platform for targeting life-threatening diseases such as the different grades of gliomas. Furthermore, regarding the nanocarrier systems, the most promising nanoparticle classes that are at the focus of research endeavors for brain-targeting are the polymer-based nanoparticles and lipid-based nanoparticulate systems [49].
The heterogeneity score of the meta-analysis was relatively high with an amount (Q) equal to 158.2 and the quantitative degree of heterogeneity (I2) scores of 89% and 81% according to the two adopted software packages. There are many sources of heterogeneity that contributed to this value, such as the difference in the year of study, the used animals, the number of these used animals, the used drug, the drug dosage, measurement types, climates and breeding conditions of the animals, and the different laboratories and researchers [50].
The variability in the kind and number of the used animals together with the type of drugs and their dosages specifically has the most significant effect on the weight of each study. Hence, optimizing the study regarding heterogeneity was attempted. The studies with odd weights, viz. possessing weights less than 2%, were excluded [51]: Ahmed et al. 2020, Patil et al. 2018, Bari et al. 2015, and Liu et al. 2018 (Table 2).
Consequently, the overall pooled estimate was amended to 7.3 (4.9, 9.6) and 6.3 (3.97, 8.79), and the heterogeneity significantly dropped to an amount of 105.0 and a degree of 87% and 80%, for OpenMetaAnalyst and Review Manager, respectively. This improvement was obvious in more homogenous bullets and confident interval lines in the generated forest plot representing the optimized meta-analysis (Figure 4 and Figure 5).
Digging more in the literature, the included studies were categorized into two novel subgroups with respect to the type of the material that was utilized to synthesize the nanocarrier or nanoparticulate system—subgroup 1: the polymeric nanoparticulate system encoded as (a); and subgroup 2: the lipid nanoparticulate system encoded as (b). A subgroup meta-analysis was performed where the subgroup (a) pooled estimate score was 4.7 and 3.61 with C.I.s (2.5, 6.9) and (1.59, 5.64) using the two adopted software packages OpenMetaAnalyst and Review Manager, respectively; on the other hand, the subgroup (b) pooled estimate score was 13.5 and 13.08 with C.I.s (7.4, 19.6) and (6.40, 19.77) utilizing the same software packages, respectively. The non-overlapping confidence intervals, which are also illustrated by the borders of the yellow or black diamond symbols generated by the two software packages depicting the two analyzed subgroups in Figure 6 and Figure 7, imply a significant difference between the two subgroups [52]. The superiority of lipid-based nanoparticulate systems in enhancing and increasing the bioavailability of their enclosed drugs compared with the polymeric-based counterparts can be attributed to the higher lipophilic properties of these carriers that exceed those of the polymeric competitors that lead to higher penetration ability into the nasal mucosa and blood–brain barrier, which, in turn, causes better bioavailability. The higher lipophilicity also imparts more affinity for the trigeminal and olfactory nerves, which are key players in the nose-to-brain delivery [53]. This important finding would consequently boost the researchers to concentrate on the type of the material used for the nose-to-brain delivery of drugs and, hence, concentrate on the use of the lipid nanoparticulate systems. Improving the stability of these systems toward oxidation and rancidity would add great assets to their high biocompatibility, safety, and toxicological profiles.
Interestingly, comparing the naturally originated nanoparticulate carriers with their synthetically driven counterparts did not show significant differences as demonstrated by the overlapping confidence intervals of the obtained overall means of both subgroups (Figure 8 and Figure 9).
These results, again, encourage the formulators to concentrate on the type and nature of the nanoparticulate carrier material rather than its origin [54].
Finally, Figure 10 represents the funnel plot generated from Review Manager v. 5.4.1. software in order to judge the presence of any publication bias. The obtained plot presented a skewed funnel, though most of the studies lie within the acceptable confidence intervals. This may be explained by the fact that, usually, researchers publish their positive results rather than their negative counterparts. In the current case, the researchers are biased to publish articles confirming the augmenting effect of the use of their prepared or synthesized nanoparticles in enhancing the brain bioavailability of drugs that are intranasally administered. Furthermore, the studies that have smaller sizes usually possess higher standard errors (as revealed by the three circular points lying outside the confidence intervals) [55].
It is worth mentioning that, experimentally, the permeation of insulin through the nasal mucosa was recently proven to be superior from solid lipid nanoparticles and outperforming the insulin encapsulated in PLGA nanoparticles by Akel et al., 2021 [56].
It is worth to note that the small data set conforming to the eligibility criteria is one of the limitations of this study. Despite the pooling and normalization effects of the meta-analysis study conduction, increasing the number of the analyzed studies would decrease the heterogeneity and publication bias [57,58].

4. Conclusions

The conducted meta-analysis study as a quantitative synthetic statistical tool study confirmed the superiority of the nanoparticulate systems over the conventional formulations systems regarding the drug bioavailability via the nose-to-brain delivery administration route. Moreover, the meta-analysis conducted in this study could prove a useful tool in identifying the optimum type of carriers for this kind of delivery as revealed by the overall standardized mean differences and their associated confidence intervals and as depicted in the forest plots generated by two different algorithm meta-analysis software packages. The optimum nanocarriers were the lipid-based nanoparticulate carrier systems, which outperformed their polymeric counterparts. As a future perspective, this study outcome would encourage scientists and drug delivery researchers to exert more efforts on improving the stability of these important carriers, which represent the main obstacle to their wide use in the medicine market despite their high bio-affinity, biocompatibility, and safety profiles. The stability problem remains the main challenge and hurdle to the development of the advanced and successful nose-to-brain drug delivery systems. No significant differences were obtained between naturally originated and synthetically driven nanoparticulate carriers. This also warrants scientists and formulators to concentrate on the choice of the type and nature of the carriers’ materials rather than their respective origins.

Author Contributions

R.M.H. was responsible for conceptualization, methodology, analysis, validation, investigation, software, resources, data curation, writing—original draft preparation, writing—review and editing, visualization, and interpretations of this manuscript. E.M.E.-M. was responsible for methodology, investigation, resources, writing—original draft preparation, visualization, and interpretations of the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

The research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Data sharing not applicable.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Giunchedi, P.; Gavini, E.; Bonferoni, M.C. Nose-to-Brain Delivery. Pharmaceutics 2020, 12, 138. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Kulkarni, A.D.; Vanjari, Y.H.; Sancheti, K.H.; Belgamwar, V.S.; Surana, S.J.; Pardeshi, C.V. Nanotechnology-Mediated Nose to Brain Drug Delivery for Parkinson’s Disease: A Mini Review. J. Drug Target. 2015, 23, 775–788. [Google Scholar] [CrossRef] [PubMed]
  3. Phukan, K.; Nandy, M.; Sharma, R.B.; Sharma, H.K. Nanosized Drug Delivery Systems for Direct Nose to Brain Targeting: A Review. Recent Patents Drug Deliv. Formul. 2016, 10, 156–164. [Google Scholar] [CrossRef] [PubMed]
  4. Abd-Algaleel, S.A.; Metwally, A.A.; Abdel-Bar, H.M.; Kassem, D.H.; Hathout, R.M. Synchronizing In Silico, In Vitro, and In Vivo Studies for the Successful Nose to Brain Delivery of an Anticancer Molecule. Mol. Pharm. 2021, 18, 3763–3776. [Google Scholar] [CrossRef] [PubMed]
  5. Hathout, R.M.; El-Ahmady, S.H.; Metwally, A.A. Curcumin or Bisdemethoxycurcumin for Nose-to-Brain Treatment of Alzheimer Disease? A Bio/Chemo-Informatics Case study. Nat. Prod. Res. 2018, 32, 2873–2881. [Google Scholar] [CrossRef] [PubMed]
  6. Hathout, R.M.; Abdelhamid, S.G.; El-Housseiny, G.S.; Metwally, A.A. Comparing Cefotaxime and Ceftriaxone in Combating Meningitis through Nose-to-Brain Delivery Using Bio/Chemoinformatics Tools. Sci. Rep. 2020, 10, 21250. [Google Scholar] [CrossRef]
  7. Shah, S.A.A.; Firlak, M.; Berrow, S.R.; Halcovitch, N.R.; Baldock, S.J.; Yousafzai, B.M.; Hathout, R.M.; Hardy, J.G. Electrochemically Enhanced Drug Delivery Using Polypyrrole Films. Materials 2018, 11, 1123. [Google Scholar] [CrossRef] [Green Version]
  8. ElMasry, S.R.; Hathout, R.M.; Abdel-Halim, M.; Mansour, S. In Vitro Transdermal Delivery of Sesamol Using Oleic Acid Chemically-Modified Gelatin Nanoparticles as a Potential Breast Cancer Medication. J. Drug Deliv. Sci. Technol. 2018, 48, 30–39. [Google Scholar] [CrossRef]
  9. Fagir, W.; Hathout, R.M.; Sammour, O.A.; ElShafeey, A.H. Self-Microemulsifying Systems of Finasteride with Enhanced Oral Bioavailability: Multivariate Statistical Evaluation, Characterization, Spray-Drying and In Vivo Studies in Human Volunteers. Nanomedicine 2015, 10, 3373–3389. [Google Scholar] [CrossRef] [Green Version]
  10. Safwat, S.; Ishak, R.A.; Hathout, R.M.; Mortada, N.D. Statins Anticancer Targeted Delivery Systems: Re-Purposing an Old Molecule. J. Pharm Pharm. 2017, 69, 613–624. [Google Scholar] [CrossRef]
  11. Nasser, N.; Hathout, R.M.; Abd-Allah, H.; Sammour, O.A. Enhancement of Oral Bioavailability of Drugs Using Lipid-Based Carriers: A Meta-Analysis Study. Drug Dev. Ind. Pharm. 2020, 46, 2105–2110. [Google Scholar] [CrossRef]
  12. Hathout, R.M. Do Polymeric Nanoparticles Really Enhance the Bioavailability of Oral Drugs? A Quantitative Answer Using Meta-Analysis. Gels 2022, 8, 119. [Google Scholar] [CrossRef] [PubMed]
  13. des Rieux, A.; Fievez, V.; Garinot, M.; Schneider, Y.J.; Préat, V. Nanoparticles as Potential Oral Delivery Systems of Proteins and Vaccines: A Mechanistic Approach. J. Control. Release 2006, 116, 1–27. [Google Scholar] [CrossRef] [PubMed]
  14. Hathout, R.M.; Metwally, A.A. Gelatin Nanoparticles. Methods Mol. Biol 2019, 2000, 71–78. [Google Scholar] [PubMed]
  15. Hathout, R.M.; Mahmoud, O.A.; Ali, D.S.; Mamdouh, M.; Metwally, A.A. Modeling Drugs-PLGA Nanoparticles Interactions Using Gaussian Processes: Pharmaceutics Informatics Approach. J. Clust. Sci. 2022, 33, 2031–2036. [Google Scholar] [CrossRef]
  16. Kassem, D.H.; Kamal, M.M. Therapeutic Efficacy of Umbilical Cord-Derived Stem Cells for Diabetes Mellitus: A Meta–Analysis study. Stem Cell Res. Ther. 2020, 11, 484. [Google Scholar] [CrossRef]
  17. Elmeligy, S.; Hathout, R.M.; Khalifa, S.A.M.; El-Seedi, H.R.; Farag, M.A. Pharmaceutical Manipulation of Citrus Flavonoids Towards Improvement of Its Bioavailability and Stability. A Mini Review and a Meta-Analysis Study. Food Biosci. 2021, 44, 101428. [Google Scholar] [CrossRef]
  18. Burns, P.B.; Rohrich, R.J.; Chung, K.C. The Levels of Evidence and their Role in Evidence-Based Medicine. Plast. Reconstr. Surg. 2011, 128, 305–310. [Google Scholar] [CrossRef] [Green Version]
  19. Fong, S.Y.; Brandl, M.; Bauer-Brandl, A. Phospholipid-Based Solid Drug Formulations for Oral Bioavailability Enhancement: A Meta-Analysis. Eur. J. Pharm. Sci 2015, 80, 89–110. [Google Scholar] [CrossRef]
  20. Hathout, R.M.; Metwally, A.A. Towards Better Modeling of Drug-Loading in Solid Lipid Nanoparticles: Molecular Dynamics, Docking Experiments and Gaussian Processes Machine Learning. Eur. J. Pharm. Biopharm. 2016, 108, 262–268. [Google Scholar] [CrossRef]
  21. Metwally, A.A.; Hathout, R.M. Computer-Assisted Drug Formulation Design: Novel Approach in Drug Delivery. Mol. Pharm. 2015, 12, 2800–2810. [Google Scholar] [CrossRef] [PubMed]
  22. Metwally, A.A.; El-Ahmady, S.H.; Hathout, R.M. Selecting Optimum Protein Nano-Carriers for Natural Polyphenols Using Chemoinformatics Tools. Phytomedicine 2016, 23, 1764–1770. [Google Scholar] [CrossRef] [PubMed]
  23. Mills, E.J.; Bansback, N.; Ghement, I.; Thorlund, K.; Kelly, S.; Puhan, M.A.; Wright, J. Multiple Treatment Comparison Meta-Analyses: A Step Forward into Complexity. Clin. Epidemiol. 2011, 3, 193–202. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Hathout, R.M. Particulate Systems in the Enhancement of the Antiglaucomatous Drug Pharmacodynamics: A Meta-Analysis Study. ACS Omega 2019, 4, 21909–21913. [Google Scholar] [CrossRef] [Green Version]
  25. Hathout, R.M.; Metwally, A.A. Pharmaceutics Informatics: Bio/Chemoinformatics in Drug Delivery. In Computer Aided Pharmaceutics and Drug Delivery: An Application Guide for Students and Researchers of Pharmaceutical Sciences; Saharan, V.A., Ed.; Springer Nature Singapore: Singapore, 2022; pp. 705–724. [Google Scholar]
  26. Muntimadugu, E.; Dhommati, R.; Jain, A.; Challa, V.G.S.; Shaheen, M.; Khan, W. Intranasal Delivery of Nanoparticle Encapsulated Tarenflurbil: A Potential Brain Targeting Strategy for Alzheimer's Disease. Eur. J. Pharm. Sci. 2016, 92, 224–234. [Google Scholar] [CrossRef]
  27. Junior, E.R.D.O.; Nascimento, T.L.; Salomão, M.A.; da Silva, A.C.G.; Valadares, M.C.; Lima, E.M. Increased Nose-to-Brain Delivery of Melatonin Mediated by Polycaprolactone Nanoparticles for the Treatment of Glioblastoma. Pharm. Res. 2019, 36, 131. [Google Scholar] [CrossRef]
  28. Shamarekh, K.S.; Gad, H.A.; Soliman, M.E.; Sammour, O.A. Development and Evaluation of Protamine-Coated PLGA Nanoparticles for Nose-To-Brain Delivery of Tacrine: In-Vitro and In-Vivo Assessment. J. Drug Deliv. Sci. Technol. 2020, 57, 101724. [Google Scholar] [CrossRef]
  29. Ahmad, N.; Ahmad, R.; Al Qatifi, S.; Alessa, M.; Al Hajji, H.; Sarafroz, M. A Bioanalytical UHPLC Based Method Used for the Quantification of Thymoquinone-Loaded-PLGA-Nanoparticles in the Treatment of Epilepsy. BMC Chem. 2020, 14, 10. [Google Scholar] [CrossRef]
  30. Esim, O.; Savaser, A.; Ozkan, C.K.; Oztuna, A.; Goksel, B.A.; Ozler, M.; Tas, C.; Ozkan, Y. Nose to Brain Delivery of Eletriptan Hydrobromide Nanoparticles: Preparation, In Vitro/In Vivo Evaluation and Effect on Trigeminal Activation. J. Drug Deliv. Sci. Technol. 2020, 59, 101919. [Google Scholar] [CrossRef]
  31. Yasir, M.; Sara, U.V.S. Solid Lipid Nanoparticles for Nose to Brain Delivery of Haloperidol: In Vitro Drug Release and Pharmacokinetics Evaluation. Acta Pharm. Sin. B 2014, 4, 454–463. [Google Scholar] [CrossRef]
  32. Yasir, M.; Sara, U.V.S.; Chauhan, I.; Gaur, P.K.; Singh, A.P.; Puri, D.; Ameeduzzafar, A. Solid Lipid Nanoparticles for Nose to Brain Delivery of Donepezil: Formulation, Optimization by Box–Behnken Design, In Vitro and In Vivo Evaluation. Artif. Cells Nanomed. Biotechnol. 2018, 46, 1–14. [Google Scholar] [CrossRef] [Green Version]
  33. Patil, N.L.; Mahajan, H.S. Quercetin Loaded Nanostructured Lipid Carriers for Nose to Brain Delivery: In Vitro and In Vivo Studies. Am. J. Adv. Drug Deliv. 2018, 6. [Google Scholar] [CrossRef]
  34. Yasir, M.; Chauhan, I.; Zafar, A.; Verma, M.; Noorulla, K.M.; Tura, A.J.; Alruwaili, N.K.; Haji, M.J.; Puri, D.; Gobena, W.G.; et al. Buspirone Loaded Solid Lipid Nanoparticles for Amplification of Nose to Brain Efficacy: Formulation Development, Optimization by Box-Behnken Design, In-Vitro Characterization and In-Vivo Biological Evaluation. J. Drug Deliv. Sci. Technol. 2021, 61, 102164. [Google Scholar] [CrossRef]
  35. Saka, R.; Chella, N.; Khan, W. Development of Imatinib Mesylate-Loaded Liposomes for Nose to Brain Delivery: In Vitro and In Vivo Evaluation. AAPS PharmSciTech 2021, 22, 192. [Google Scholar] [CrossRef]
  36. Ahmad, N. Rasagiline-Encapsulated Chitosan-Coated PLGA Nanoparticles Targeted to the Brain in the Treatment of Parkinson's Disease. J. Liq. Chromatogr. Relat. Technol. 2017, 40, 677–690. [Google Scholar] [CrossRef]
  37. Singh, S.K.; Dadhania, P.; Vuddanda, P.R.; Jain, A.; Velaga, S.; Singh, S. Intranasal Delivery of Asenapine Loaded Nanostructured Lipid Carriers: Formulation, Characterization, Pharmacokinetic and Behavioural Assessment. RSC Adv. 2016, 6, 2032–2045. [Google Scholar] [CrossRef]
  38. Haque, S.; Md, S.; Sahni, J.K.; Ali, J.; Baboota, S. Development and Evaluation of Brain Targeted Intranasal Alginate Nanoparticles for Treatment of Depression. J. Psychiatr. Res. 2014, 48, 1–12. [Google Scholar] [CrossRef]
  39. Bari, N.K.; Fazil, M.; Hassan, M.Q.; Haider, M.R.; Gaba, B.; Narang, J.K.; Baboota, S.; Ali, J. Brain Delivery of Buspirone Hydrochloride Chitosan Nanoparticles for the Treatment of General Anxiety Disorder. Int. J. Biol. Macromol. 2015, 81, 49–59. [Google Scholar] [CrossRef]
  40. Shah, B.; Khunt, D.; Misra, M.; Padh, H. Application of Box-Behnken design for optimization and development of quetiapine fumarate loaded chitosan nanoparticles for brain delivery via intranasal route. Int. J. Biol. Macromol. 2016, 89, 206–218. [Google Scholar] [CrossRef]
  41. Liu, S.; Ho, P.C. Intranasal Administration of Brain-Targeted HP-ß-CD/Chitosan Nanoparticles for Delivery of Scutellarin, A Compound with Protective Effect in Cerebral Ischaemia. J. Pharm. Pharmacol. 2017, 69, 1495–1501. [Google Scholar] [CrossRef]
  42. Sridhar, V.; Gaud, R.; Bajaj, A.; Wairkar, S. Pharmacokinetics and Pharmacodynamics of Intranasally Administered Selegiline Nanoparticles with Improved Brain Delivery in Parkinson's Disease. Nanomed. Nanotechnol. Biol. Med. 2018, 14, 2609–2618. [Google Scholar] [CrossRef]
  43. Liu, S.; Yang, S.; Ho, P.C. Intranasal Administration of Carbamazepine-Loaded Carboxymethyl Chitosan Nanoparticles for Drug Delivery to the Brain. Asian J. Pharm. Sci. 2018, 13, 72–81. [Google Scholar] [CrossRef] [PubMed]
  44. Zhu, J.; Zou, J.; Mu, C.; Yang, W.; Gu, M.; Lin, J.; Song, X.; Zheng, H.; Li, F. Intranasal Administration of Pullulan-Based NanoParticles for Enhanced Delivery of Adriamycin into the Brain: In vitro and in vivo Evaluation. Die Pharm. Int. J. Pharm. Sci. 2019, 74, 39–46. [Google Scholar]
  45. Rao, G.; Lopez-Jimenez, F.; Boyd, J.; D’amico, F.; Durant, N.H.; Hlatky, M.; Howard, G.; Kirley, K.; Masi, C.; Powell-Wiley, T.M.; et al. Methodological Standards for Meta-Analyses and Qualitative Systematic Reviews of Cardiac Prevention and Treatment Studies: A Scientific Statement from the American Heart Association. Circulation 2017, 136, e172–e194. [Google Scholar] [CrossRef] [PubMed]
  46. Greenland, S.; Senn, S.J.; Rothman, K.J.; Carlin, J.B.; Poole, C.; Goodman, S.N.; Altman, D.G. Statistical Tests, P Values, Confidence Intervals, and Power: A Guide to Misinterpretations. Eur. J. Epidemiol. 2016, 31, 337–350. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Zlowodzki, M.; Poolman, R.W.; Kerkhoffs, G.M.; Tornetta, P.; Bhandari, M.; On Behalf of the International Evidence-Based Orthopedic Surgery Working Group. How to Interpret a Meta-Analysis and Judge its Value as a Guide for Clinical Practice. Acta Orthop. 2007, 78, 598–609. [Google Scholar] [CrossRef]
  48. Patsopoulos, N.A.; Evangelou, E.; Ioannidis, J.P. Sensitivity of Between-Study Heterogeneity in Meta-Analysis: Proposed Metrics and Empirical Evaluation. Int. J. Epidemiol. 2008, 37, 1148–1157. [Google Scholar] [CrossRef] [Green Version]
  49. Sabir, F.; Ismail, R.; Csoka, I. Nose-To-Brain Delivery of Antiglioblastoma Drugs Embedded into Lipid Nanocarrier Systems: Status Quo And Outlook. Drug Discov. Today 2020, 25, 185–194. [Google Scholar] [CrossRef]
  50. Von Hippel, P.T. The heterogeneity statistic I2 can be biased in small meta-analyses. BMC Med. Res. Methodol. 2015, 15, 35. [Google Scholar] [CrossRef] [Green Version]
  51. Liberati, A.; Altman, D.G.; Tetzlaff, J.; Mulrow, C.; Gotzsche, P.C.; Ioannidis, J.P.A.; Clarke, M.; Devereaux, P.J.; Kleijnen, J.; Moher, D. The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies that Evaluate Health Care Interventions: Explanation and Elaboration. PLoS Med. 2009, 62, e1000100. [Google Scholar]
  52. Schäfer, T.; Schwarz, M.A. The Meaningfulness of Effect Sizes in Psychological Research: Differences Between Sub-Disciplines and the Impact of Potential Biases. Front. Psychol. 2019, 10, 813. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  53. Akel, H.; Csóka, I. Formulation and In Vitro Comparison Study between Lipid-Based and Polymeric-Based Nanoparticles for Nose-to-Brain Delivery of a Model Drug for Alzheimer′s Disease. Proceedings 2021, 78, 51. [Google Scholar]
  54. Hill, M.; Cunningham, R.N.; Hathout, R.M.; Johnston, C.; Hardy, J.G.; Migaud, M.E. Formulation of Antimicrobial Tobramycin Loaded PLGA Nanoparticles via Complexation with AOT. J. Funct. Biomater. 2019, 10, 26. [Google Scholar] [CrossRef]
  55. Sterne, J.A.C.; Harbord, R.M. Funnel Plots in Meta-analysis. Stata J. 2004, 4, 127–141. [Google Scholar] [CrossRef] [Green Version]
  56. Akel, H.; Csoka, I.; Ambrus, R.; Bocsik, A.; Grof, I.; Meszaros, M.; Szecsko, A.; Kozma, G.; Veszelka, S.; Deli, M.A.; et al. In Vitro Comparative Study of Solid Lipid and PLGA Nanoparticles Designed to Facilitate Nose-to-Brain Delivery of Insulin. Int. J. Mol. Sci. 2021, 22, 13258. [Google Scholar] [CrossRef] [PubMed]
  57. Hasan, S.S.; Kairuz, T.; Thiruchelvam, K.; Babar, Z.U.-D. Systematic Reviews and Meta-Analysis in Pharmacy Practice. In Pharmacy Practice Research Methods; Babar, Z.U.-D., Ed.; Springer Singapore: Singapore, 2020; pp. 237–250. [Google Scholar]
  58. Safwat, S.; Hathout, R.M.; Ishak, R.A.; Mortada, N.D. Elaborated Survey in the Scope of Nanocarriers Engineering for Boosting Chemotherapy Cytotoxicity: A Meta-Analysis Study. Int. J. Pharm. 2021, 610, 121268. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Conducted data-mining process as described in PRISMA guidelines.
Figure 1. Conducted data-mining process as described in PRISMA guidelines.
Bioengineering 09 00647 g001
Figure 2. Forest plot presenting meta-analysis of investigated studies [26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44] generated using OpenMetaAnalyst® software.
Figure 2. Forest plot presenting meta-analysis of investigated studies [26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44] generated using OpenMetaAnalyst® software.
Bioengineering 09 00647 g002
Figure 3. Forest plot presenting meta-analysis of investigated studies [26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44] generated using Review Manager v.5.4.1.® software.
Figure 3. Forest plot presenting meta-analysis of investigated studies [26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41,42,43,44] generated using Review Manager v.5.4.1.® software.
Bioengineering 09 00647 g003
Figure 4. Forest plot of optimized meta-analysis for the studies: [1,2,3,5,6,7,8,11,12,13,14,15,16,17,19], according to OpenMetaAnalyst software.
Figure 4. Forest plot of optimized meta-analysis for the studies: [1,2,3,5,6,7,8,11,12,13,14,15,16,17,19], according to OpenMetaAnalyst software.
Bioengineering 09 00647 g004
Figure 5. Forest plot of optimized meta-analysis for the studies: [1,2,3,5,6,7,8,11,12,13,14,15,16,17,19], according to Review Manager software.
Figure 5. Forest plot of optimized meta-analysis for the studies: [1,2,3,5,6,7,8,11,12,13,14,15,16,17,19], according to Review Manager software.
Bioengineering 09 00647 g005
Figure 6. Forest plot of investigated subgroups: (a) polymeric nanoparticulate systems versus (b) lipid nanoparticulate systems for the studies: [1,2,3,5,6,7,8,11,12,13,14,15,16,17,19], (OpenMetaAnalyst results).
Figure 6. Forest plot of investigated subgroups: (a) polymeric nanoparticulate systems versus (b) lipid nanoparticulate systems for the studies: [1,2,3,5,6,7,8,11,12,13,14,15,16,17,19], (OpenMetaAnalyst results).
Bioengineering 09 00647 g006
Figure 7. Forest plot of investigated subgroups: (a) polymeric nanoparticulate systems versus (b) lipid nanoparticulate systems for the studies: [1,2,3,5,6,7,8,11,12,13,14,15,16,17,19], (Review Manager results).
Figure 7. Forest plot of investigated subgroups: (a) polymeric nanoparticulate systems versus (b) lipid nanoparticulate systems for the studies: [1,2,3,5,6,7,8,11,12,13,14,15,16,17,19], (Review Manager results).
Bioengineering 09 00647 g007
Figure 8. Forest plot of investigated subgroups: (c) naturally originated material of nanoparticulate systems versus (d) synthetically originated material of nanoparticulate system for the studies: [1,2,3,5,6,7,8,11,12,13,14,15,16,17,19], (OpenMetaAnalyst).
Figure 8. Forest plot of investigated subgroups: (c) naturally originated material of nanoparticulate systems versus (d) synthetically originated material of nanoparticulate system for the studies: [1,2,3,5,6,7,8,11,12,13,14,15,16,17,19], (OpenMetaAnalyst).
Bioengineering 09 00647 g008
Figure 9. Forest plot of investigated subgroups: (c) naturally originated material of nanoparticulate systems versus (d) synthetically originated material of nanoparticulate system for the studies: [1,2,3,5,6,7,8,11,12,13,14,15,16,17,19], (Review Manager).
Figure 9. Forest plot of investigated subgroups: (c) naturally originated material of nanoparticulate systems versus (d) synthetically originated material of nanoparticulate system for the studies: [1,2,3,5,6,7,8,11,12,13,14,15,16,17,19], (Review Manager).
Bioengineering 09 00647 g009
Figure 10. Funnel plot assessing publication bias of investigated studies.
Figure 10. Funnel plot assessing publication bias of investigated studies.
Bioengineering 09 00647 g010
Table 1. Meta-Analysis of area under the curve (AUC) in studies of intranasal loaded drugs in lipid and polymeric nanoparticulate systems as compared with their controls (conventional formulations).
Table 1. Meta-Analysis of area under the curve (AUC) in studies of intranasal loaded drugs in lipid and polymeric nanoparticulate systems as compared with their controls (conventional formulations).
No.DrugYearNo. of Animals 1TypesGroup A 2Nano
Carrier
Type
Group B 3SMDLower/Upper
Confidence
Ref.
NPs Mean AUC 4AUC
SD
NPs Mean AUC 2AUC
SD
1TFL120164Sprague–Dawley Rats9468.50940.00PLGA a,d2735.16482.837.8273.749/11.905[26]
2MLT20193Wistar rats598.9024.20PCL a,d183.064.806.7842.626/10.943[27]
3Tacrine20203Wister albino rats397.1479.82PLGA a,d318.0639.011.004−0.694/2.703[28]
4Thymoquinone20206Rats115.711.83PLGA a,d4.180.26678.70447.196/110.212[29]
5Eletriptan HBr20203Wistar albino rats100.3429.13PLGA a,d82.3532.740.463−1.158/2.085[30]
6Haloperidol20146Wistar albino rats2172.3360.41SLN b,d623.168.5133.13819.832/46.443[31]
7TFL220164Sprague–Dawley Rats4981.83630.67SLN b,d2735.17482.833.4751.279/5.670[26]
8Donepezil20176Wistar Albino rats515.288.49SLN b,d177.1319.2920.93712.485/29.390[32]
9Quercetin20183Wistar rats537,0111102.33NLC b,d218,704.6671095.5231.110100.340/361.881[33]
10Buspirone20216Albino Wistar rats2998.5079.73SLN b,d1373.40542.3923.48514.022/32.949[34]
11IMB Mes20213Sprague–Dawley (SD) rats3968.3357.4Liposomes b,c2007.9232.95.1861.844/8.527[35,36]
12Asenapine20225Charles Foster (CF)
rats
560.9327.85NLC b,d209.4242.488.8344.769/12.900[37]
13Venlafaxine HCl20143Rats4476.158168.39Alginate a,c1656.09194.01512.3875.198/19.575[38]
14Buspirone HCl20153Albino Wistar rats67.470.472Thiolated
chitosan a,c
33.9480.8638.55816.683/60.432[39]
15Quetiapine fumarate20164Sprague–Dawley rats229.633.68Chitosan a,c109.2912.14.1301.677/6.582[40]
16Scutellarin20173Mice37,166.671371.67HP-ß-CD/chitosan a,c15,750508.3316.5207.037/26.003[41]
17Selegiline20183Rats6.420.19Chitosan a,c5.840.192.4360.324/4.548[42]
18Carbamazepine20183Mice1551.16739.167Carboxymethyl chitosan a,c125.16710.8339.59617.136/62.057[43]
19Adriamycin20195Wistar rats13,770.31675.5Cholesterol-modified Pullulan a,c5842.33797.335.4542.762/8.147[44]
1 Both groups had the same number of animals. 2 Nose-to-brain formulation; 3 Conventional formulation; 4 ng.h/mL. Used polymer types were denoted as subgroup “a” for polymeric and subgroup “b” for lipid. Origin of used polymers was denoted as subgroup “c” for naturally originated material and subgroup “d” for synthetically originated material. Tfl stands for Tarenflurbil. MLT stands for Melatonin. IMB Mes stands for Imatinib Mesylate.
Table 2. Calculated weights of investigated studies.
Table 2. Calculated weights of investigated studies.
Study NameWeights
TFL, Muntimadugu et al.7.0%
MLT, De Oliveria Junior et al.7.0%
Tacrine, Shamarekh et al.8.0%
Thymoquinone, Ahmed et al.0.7%
Eletriptan HBr, Esim et al.8.1%
Haloperidol, Yasir et al.2.8%
TFL2, Muntimadugu et al.7.9%
Donepezil, Yassir et al.4.6%
Quercetin, Patil et al.0.0%
Buspirone, Yasir et al.4.2%
IMB Mes, Sakachella et al.7.4%
Asenapine, Singh et al.7.0%
Venlafaxine HCl, Haque et al.5.3%
Buspirone HCl, Bari et al.1.3%
Quetiapine fumarate, Shah et al.7.8%
Scutellarin, Liu et al.4.1%
Selegiline, Sridhar et al.7.9%
Carbamazepine, Liu et al.1.3%
Adriamycin, Zhu et al.7.7%
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Hathout, R.M.; El-Marakby, E.M. Meta-Analysis: A Convenient Tool for the Choice of Nose-to-Brain Nanocarriers. Bioengineering 2022, 9, 647. https://doi.org/10.3390/bioengineering9110647

AMA Style

Hathout RM, El-Marakby EM. Meta-Analysis: A Convenient Tool for the Choice of Nose-to-Brain Nanocarriers. Bioengineering. 2022; 9(11):647. https://doi.org/10.3390/bioengineering9110647

Chicago/Turabian Style

Hathout, Rania M., and Eman M. El-Marakby. 2022. "Meta-Analysis: A Convenient Tool for the Choice of Nose-to-Brain Nanocarriers" Bioengineering 9, no. 11: 647. https://doi.org/10.3390/bioengineering9110647

APA Style

Hathout, R. M., & El-Marakby, E. M. (2022). Meta-Analysis: A Convenient Tool for the Choice of Nose-to-Brain Nanocarriers. Bioengineering, 9(11), 647. https://doi.org/10.3390/bioengineering9110647

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop