Highlights
What are the main findings?
The impacts of food and supplements on antiretroviral drugs (ARV) pharmacokinetics are varied:
- High-fat meals delay the absorption (tmax) of ARVs like abacavir and lamivudine but increase the plasma concentrations of protease inhibitors (PIs) such as darunavir and ritonavir;
- Supplements like calcium and vitamin C can reduce ARV effectiveness, while others, such as quercetin and Ginkgo biloba, show no significant effects.
What is the implication of the main finding?
- Meal timing and content can influence ARV absorption; for instance, PIs benefit from food, while others may experience delays.
- Patients should be informed about the ways in which supplements can affect ARVs, and regular monitoring is key to preventing treatment failure.
Abstract
Because pharmacokinetic changes in antiretroviral drugs (ARV), due to their concurrent administration with food or nutritional products, have become a clinical challenge, it is necessary to monitor the therapeutic efficacy of ARV in people living with the human immunodeficiency virus (PLWH). A systematic review and meta-analysis were conducted to clarify the pharmacokinetic outcomes of the interaction between supplements such as food, dietary supplements, and nutrients, and ARV. Twenty-four articles in both healthy subjects and PLWH were included in the qualitative analysis, of which five studies were included in the meta-analysis. Food–drug coadministration significantly increased the time to reach maximum concentration (tmax) (p < 0.00001) of ARV including abacavir, amprenavir, darunavir, emtricitabine, lamivudine, zidovudine, ritonavir, and tenofovir alafenamide. In addition, the increased maximum plasma concentration (Cmax) of ARV, such as darunavir, under fed conditions was observed. Area under the curve and terminal half-life were not significantly affected. Evaluating the pharmacokinetic aspects, it is vital to clinically investigate ARV and particular supplement interaction in PLWH. Educating patients about any potential interactions would be one of the effective recommendations during this HIV epidemic.
1. Introduction
The human immunodeficiency virus (HIV) infection is one of the major health challenges around the world. Approximately 33 million people have died from HIV/acquired immunodeficiency syndrome (AIDS)-related illness since the start of the HIV epidemic worldwide []. Globally, over 37 million people were living with HIV (PLWH) in 2020, of which more than 27 million were receiving HIV treatment or antiretroviral (ARV) therapy []. The commonly adopted ARV therapy includes the combined use of three or more ARVs from at least two different classes, such as nucleoside reverse transcriptase inhibitor (NRTI), non-nucleoside reverse transcriptase inhibitor (NNRTI), and protease inhibitor (PI). In adults and adolescents, tenofovir/lamivudine or tenofovir/emtricitabine is the preferred backbone, which is used in combination with a third drug, dolutegravir for post-exposure prophylaxis []. Due to the widespread use of effective ARV therapy and HIV care, about 66% of the overall infected population achieve viral suppression [].
Dietary supplements including vitamins and minerals are widely used to boost the body’s defense system in many patients with nutrient deficiencies. European Food Safety Authority stated food supplements as sources of nutrients such as vitamins and minerals, which have nutritional or physiological value for the regulation of nutritional deficiencies []. In PLWH, inadequate nutrient intake becomes a clinical concern that could potentiate treatment failure. A previous report found that PLWH did not achieve the dietary recommendations of energy and micronutrients, especially zinc and iron [,]. To meet the required level of protein and other nutrients, PLWH use a variety of supplements in addition to their normal daily treatment therapy for HIV [,]. The use of complementary medications may be quite popular since the products are easily accessible over the counter. The lifetime use of complementary and alternative medicine was 30–90% prevalent in PLWH, commonly using vitamins, minerals, and other over-the-counter supplements [].
In susceptible patients, even substantially small effects of food–drug interaction may result in therapeutic changes for some drugs with a narrow therapeutic index []. Likewise, food–drug interaction may influence the therapeutic efficacy of the drug by changing pharmacokinetic processes such as absorption, distribution, metabolism, and excretion, or pharmacodynamic physiological effects of the drug []. Given the different mechanisms of interactions between ARV and nutrients, it is critical to monitor the resulting implications that may positively or negatively affect the therapeutic outcomes. Due to the effect on pharmacokinetic parameters such as maximum plasma concentration (Cmax), area under the curve (AUC), time to reach maximum concentration (tmax), and terminal half-life (t1/2), food considerations are essential in the treatment of HIV. The effect of food on the absorption of ARV was well noted following the reduction in plasma concentration of indinavir []. Food containing high-fat contents is likely to reduce the rate and extent of the absorption of oral drugs by delaying gastric emptying, whereas some meals with high-protein contents would increase the extent of oral drug absorption by stimulating intestinal transporters and enzyme activity []. However, the effects of food on particular oral drugs may not always be of clinical importance as some interactions may not occur in all patients. Although many ARVs can be taken with food to optimize their absorption, the concurrent administration with food might result in a decreased rate of absorption, longer tmax, and declined Cmax of some ARV such as zidovudine and lamivudine; although, they were not clinically significant []. Likewise, the subtherapeutic levels of raltegravir due to concomitant use of calcium supplement in an HIV-infected patient were reported []. Unpredictable and variable drug concentrations are major problems that lead to treatment failure or adverse reactions. The possible interaction of concurrent food and ARV has become a clinical challenge in PLWH. This systematic review and meta-analysis aims to investigate the effect of food, dietary supplements, or nutrients on pharmacokinetic outcomes of ARV by comparing the pharmacokinetic parameters in either PLWH or healthy people with and without supplements. The important role of food in the ARV era is not much known in clinical settings. The extent of changes in plasma concentration–time profiles of ARV during fed and fasted conditions can evaluate the potential interaction.
2. Materials and Methods
2.1. Literature Search
According to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, a systematic literature search was conducted []. Four databases including Cochrane Library, ScienceDirect, Scopus, and PubMed were searched from the date of their inception to June 2021 to identify studies that explored supplements and ARV interactions. The search terms such as (food supplement OR dietary supplement OR nutrient supplement) AND (antiretroviral therapy OR antiretroviral drug OR non-nucleoside reverse transcriptase inhibitor OR nucleoside reverse transcriptase inhibitor OR protease inhibitor) AND (area under curve OR cytochrome P450 OR plasma concentration) were used. No filters or restrictions were applied during the search. The full search strategies are mentioned in Supplementary Material Table S1. The full protocol of this systematic review and meta-analysis was not registered.
2.2. Selection Criteria
The primary outcomes that we aimed to collect were AUC, Cmax, tmax, and t1/2 which are parameters used for primarily assessed the food effect on drug pharmacokinetics []. All articles of any language, year published, and country that reported nutrient or food supplement and ARV interactions were included to retrieve relevant studies. Only studies that reported pharmacokinetic outcomes such as AUC, Cmax, tmax, and t1/2 were included in the meta-analysis. Review articles, book chapters, conference abstracts, posters, in vitro studies, and animal studies were excluded. The search results were exported to a citation manager (Endnote 20.1., Clarivate Analytics, New York, USA). Titles and abstracts were thoroughly screened, and eligible studies were independently selected by the first two authors for inclusion in this systematic review. Specific characteristics for inclusion were studies of adult healthy people or PLWH on ARV, which discussed changes in ARV levels, concerned adverse events, or treatment failure directly resulting from the food–drug interaction (Phase I–IV clinical trials). Disagreements between the first two authors were thoroughly resolved by consensus, and further by discussing among four authors for final inclusion. The PRISMA diagram for the complete literature search is shown in Figure 1.
Figure 1.
Flow diagram for selection and inclusion of the studies.
2.3. Data Extraction
After full-text articles were screened for inclusion in the systematic review, data extraction was performed. Information such as author name, year of publication, year of study, study design, study setting, characteristics of participants, types of ARV, types of supplements, and pharmacokinetic outcomes were extracted by the first author and the data entry was judged by co-authors. Discrepancies were discussed among all authors. Any disagreement was resolved by consensus.
2.4. Quality Assessment
The risk of bias of the included studies was assessed using the different validated tools including the risk of bias assessment tools for primary and secondary medical studies [], ROBINS-I for non-randomized studies [], Cochrane Collaboration’s tool for randomized trials [], a modified Newcastle–Ottawa Quality Assessment Scale for cross-sectional studies [], a modified tool for case report described by Murad et al. [], and Cochrane risk of bias for crossover studies []. The quality assessment of included studies is mentioned in Supplementary Material Table S2.
2.5. Statistical analysis
Review Manager (RevMan version 5.4.1: The Nordic Cochrane Center, Copenhagen, Denmark) was used for conducting meta-analysis. Random effect models with the inverse variance method were used to calculate the weights of the studies. Publication bias was assessed by visually inspecting the funnel plot. The heterogeneity among studies was assessed by I2 statistics. The I2 of <25% was assumed as negligible heterogeneity, whereas that of >75% was high heterogeneity [].
3. Results
A total of 3038 articles were retrieved. After duplicates and irrelevant studies were removed by reviewing titles and abstracts, 28 articles were selected for potential inclusion. The number of records with reasons for exclusion is summarized in Figure 1. Records that possibly met the inclusion criteria were assessed for eligibility for systematic review. Finally, twenty-four articles were included in the systematic review. Thirteen articles of them were good quality and eleven articles were fair (Supplementary Material Table S2). In general, the heterogeneity was high, and the 95% confidence intervals of the pooled data were close to the most weighted and included studies whose intervals were narrow. The summary description of the included studies is characterized in Table 1.
Table 1.
Description of the included studies.
3.1. Studies Included in the Qualitative Analysis
Two-hundred and seventy-nine healthy subjects, and five-hundred and six PLWH who participated in twenty-four studies were included in the qualitative analysis (Table 1). The participants include various ethnic and racial groups such as people of European, African, and Asian descent. There were 3 randomized controlled trials, 13 cross-over studies, 2 longitudinal studies, 4 pharmacokinetic studies, 1case report, and 1cross-sectional study. Among the included studies, three studies reported the effects of grapefruit juice or Seville orange juice on ARV pharmacokinetics [,,]. While nine studies investigated the effects of food or nutrient supplement on ARV pharmacokinetics [,,,,,,,,]. The rest of the studies explored the pharmacokinetic interactions between ARV and vitamins or minerals [,,,,,], and dietary supplements [,,,,,]. Most studies showed non-significant changes in ARV pharmacokinetic parameters when co-administered with meals. However, there was a significant decrease in the extent of absorption of indinavir with liquid meals reported by Carver et al. []; protein, carbohydrate, fat, and viscosity meal treatments reduced indinavir AUC0–∞ by 68%, 45%, 34%, and 30%, respectively, while these meals decreased Cmax by 74%, 59%, 46%, and 36%, respectively. Regarding the meal compositions, fat meals resulted in the highest variability on the plasma indinavir levels. The consumption of garlic supplement decreased AUC and Cmax of saquinavir by 51% and 54%, respectively [], while other dietary supplements such as quercetin, Ginkgo extract, Ginseng extract, β-carotene did not significantly affect saquinavir, lopinavir, ritonavir, and nelfinavir pharmacokinetics [,,,]. Grapefruit juice administration increased the oral bioavailability of saquinavir [] while its concurrent intake did not lead to any change in indinavir concentrations []. A pharmacokinetic study by Slain et al. [] indicated that after a week of 1000 mg vitamin C supplementation, the steady-state indinavir plasma concentration was reduced by 20%. On the contrary, some studies have reported that the use of multivitamins or minerals did not lead to any pharmacokinetic variation in ARV such as dolutegravir and nelfinavir [,,,]. In a case report of an HIV-infected man receiving raltegravir, concomitant calcium administration resulted in virologic failure showing detectable plasma HIV-1 RNA levels []. Coadministration of protease inhibitors such as nelfinavir with β-carotene led to a significant increase not only in mean CD4%, but also in the CD4:CD8 ratio in PLWH in one study []. In addition, the study also found an increase in CD4 counts; although, it was not clinically significant.
3.2. Studies Included in the Meta-Analysis
A total of 122 participants from 5 studies were included in the meta-analysis. Studies by Moore et al. [], Yuen et al. [], Falcoz et al. [], Sekar et al. [], and Yamada et al. [] reported the pharmacokinetic outcomes of the interaction between food and ARV were eligible for meta-analysis. In general, the heterogeneity was high, and the 95% confidence intervals of the pooled data were close to the most weighted and included studies whose intervals were narrow.
Figure 2 shows the meta-analysis of the pharmacokinetic effects of food on the AUCinf of ARV. There were no significant changes in AUCinf of ARV between fasted and fed conditions (mean difference -24.64, 95% CI -141.34to 92.07, p = 0.68), with a substantial heterogeneity of 75%.
Figure 2.
Forest plot showing the mean difference in AUCinf of ARV under fasted and fed states (3TC, lamivudine; ABC, abacavir; AZT, zidovudine; COBI, cobicistat; EVG, elvitegravir; FTC, emtricitabine; TAF, tenofovir alafenamide; TDF, tenofovir).
The overall effect of food on Cmax of NRTI group shows no clinical significance between fasted and fed conditions (mean difference −0.56, 95% CI -2.31 to 1.20, p = 0.53) in fixed effect models, while Cmax of NRTI group shows a significant decrease during fed state (mean difference -204.70, 95% CI -337.14 to -72.26, p = 0.002) in random effect models with the heterogeneity value of 84%. Interestingly, there was a significant increase in the Cmax of PI group during fed state (mean difference 845.51 (110.10-1580.92, p = 0.02) as shown in Figure 3. Figure 4 indicates the overall effect of food on C24, which was not significant (mean difference −0.13, 95% CI −3.08 to 2.82, p = 0.93).
Figure 3.
Forest plot showing the mean difference in Cmax of ARV under fasted and fed states by ARV regimens (3TC, lamivudine; ABC, abacavir; AZT, zidovudine; COBI, cobicistat; CWC, croissant with coffee; DRV, darunavir; FTC, emtricitabine; HF, high fat; NRTI, nucleoside reverse transcriptase inhibitor; PI, protease inhibitor; RTV, ritonavir; TAF, tenofovir alafenamide; TDF, tenofovir).
Figure 4.
Forest plot showing the mean difference in C24 of ARV under fasted and fed states (COBI, cobicistat; EVG, elvitegravir; FTC, emtricitabine; TDF, tenofovir).
The results of the subgroup meta-analysis of pharmacokinetic changes in tmax of ARV depending upon food or supplement administration are shown in Figure 5. The overall effect in NRTI group indicates a significantly higher tmax value under fed condition (mean difference 0.67, 95% CI 0.44-0.91, p < 0.00001), showing the heterogeneity of 63%. Similarly, we found a significant increase in tmax in fed state compared to fasted condition in PI receiving groups (mean difference 1.29, 95% CI 0.81-1.77, p < 0.00001) (Figure 5). For both NRTI and PI groups, none of these show any clinically significant changes in t1/2 (Figure 6). We observed no statistical heterogeneity on t1/2 of both NRTI and PI regimens.
Figure 5.
Forest plot showing the mean difference in tmax of ARV under fasted and fed states by ARV regimens (3TC, lamivudine; ABC, abacavir; APV, amprenavir; AZT, zidovudine; COBI, cobicistat; CWC, croissant with coffee; DRV, darunavir; FTC, emtricitabine; HF, high fat; LF, low fat; NRTI, nucleoside reverse transcriptase inhibitor; PI, protease inhibitor, RTV, ritonavir; TAF, tenofovir alafenamide; TDF, tenofovir).
Figure 6.
Forest plot showing the mean difference in t1/2 of ARV under fasted and fed states by ARV regimens (3TC, lamivudine; ABC, abacavir; AZT, zidovudine; COBI, cobicistat; CWC, croissant with coffee; DRV, darunavir; FTC, emtricitabine; HF, high fat; NRTI, nucleoside reverse transcriptase inhibitor; PI, protease inhibitor; TAF, tenofovir alafenamide; TDF, tenofovir).
3.3. Publication Bias
Publication bias was assessed by visual inspection of the funnel plot, which is shown in Figure 7. It was found that there were seven missing studies for tmax. The distribution of the standard error was close to the peak of the funnel plot, which demonstrated that there may be systematic difference or publication bias between smaller and larger studies. Further statistical test for the funnel plot asymmetry was not performed since the forest plot that had the largest number of included studies included only five studies [].
Figure 7.
Funnel plot of the adjusted association between tmax and food (SE, standard error; MD, mean difference).
4. Discussion
This systematic review and meta-analysis mainly presented no significant pharmacokinetic changes in AUC, C24, and t1/2 of ARV when co-administered with food or dietary supplements. However, it can be highlighted that there was an increase in tmax of NRTI and PI under fed conditions. Of interest, the higher Cmax in fed state was observed in participants receiving the PI regimen in this study. Among the articles included in this systematic review, most of the ARV’s pharmacokinetic parameters were not clinically altered by the concurrent administration of food and other supplements such as quercetin, Ginkgo extract, vitamin supplement, Ginseng, or β-carotene.
The different classes of ARV have varied pharmacokinetic metabolisms. PIs are extensively metabolized by the cytochrome P (CYP) 450 enzymes in the liver and small intestine []. Thus, ingestion of some foods or juices that have an inhibitory effect on CYP450 may increase concentrations of PIs. Kupferschmidt et al. [] reported an increase in the bioavailability of saquinavir bioavailability after an intake of grapefruit juice, which is widely known as a CYP3A4 inhibitor []. In addition, a previous study reported an increase in AUC of atazanavir, lopinavir/ritonavir, nelfinavir, and saquinavir when ingested with food []. Under the fed condition, there was a long tmax of amprenavir from 1 to 4 h compared with the fasting state []. The tmax of darunavir under fasted conditions was approximately 1.5 h, whereas it was increased to 3-4 h after administration with food including standard breakfast, croissant with coffee, and high-fat breakfast. Similarly, the median tmax of 2 h of ritonavir without food extended to 4 or 5 h when food was administered concurrently []. Regarding the changes in plasma concentration of PI such as darunavir, Sekar et al. [] reported the increased Cmax by about 30% under fed condition compared with the fasted state. Another class of ARV, NNRTIs such as efavirenz and nevirapine are also metabolized by several liver CYP isoenzymes []. The administration of efavirenz with high fat or high caloric meal was associated with the increased mean AUC by 28% and mean Cmax by 29%, respectively, compared to fasted conditions []. Most NRTIs are degraded by liver enzymes from the purine or pyrimidine nucleoside salvage pathway, depending upon the NRTI analogs []. Since they are not extensively metabolized by CYP450 [], they have less interaction with food or other drugs. The delayed absorption of abacavir, lamivudine, and zidovudine was noted by Yuen et al. [] an hour later in median tmax under fed conditions compared to fasted conditions. Similarly, Moore et al. [] observed the slower tmax of lamivudine and zidovudine by 30 min and 45 min, respectively, after the administration of combined tablets with a high-fat meal. The mean tmax of emtricitabine and tenofovir alafenamide under standard breakfast was 2 h and 1 h, respectively, which was longer than those under fasted conditions [,]. The concurrent administration of integrase inhibitors (IIs) and polyvalent cations such as magnesium and calcium should be monitored since these cations may bind with ARV, which leads to decreased plasma levels. Although Buchanan et al. [] reported no clinical significance, dolutegravir, according to its medication package insert, should be taken 2 h before or 6 h after administering a cation containing antacids or laxatives, sucralfate, oral iron supplements, oral calcium supplements, or buffered medications [,].
The impacts of vitamin and mineral supplements on ARVs were mostly investigated in IIs [,,,] and some PIs [,]. Co-administration of 1200 mg calcium carbonate and 324 mg ferrous fumarate with dolutegravir during fasted conditions decreased in AUC0–∞, Cmax, and C24 of dolutegravir by respective 37% to 39% and 54% to 57% due to chelation with polyvalent cations []. However, coadministration of these divalent cations and dolutegravir under fed conditions counteracted such the interaction []. Moreover, Roberts et al. [] reported subtherapeutic raltegravir levels when co-administered with 1000 mg calcium carbonate. Nonetheless, information on the time interval between raltegravir and calcium intake or whether they were administered under fed or fasted conditions were not reported. Given that calcium supplement is necessary for the prevention of osteoporosis, especially in PLWH [], future studies investigating the magnitude of such interaction between raltegravir and calcium supplement under fasted and fed conditions should be conducted. If the fed condition can counteract the interaction, calcium supplements may be co-administered with raltegravir. Concerning the impacts of vitamin and mineral supplements on PIs, while the divalent calcium ion did not significantly alter nelfinavir and its active metabolite M8 concentrations [], co-administration with vitamin C significantly decreased steady-state indinavir concentrations []. This could be explained by the inductive property of vitamin C on CYP isoenzymes observed in animal studies [,,,,]. However, another study reported no significant effect of vitamin C on CYP3A4, the primary enzyme used to metabolize indinavir activity []. Based on the contradictory effects of vitamin C on CYP3A4, further studies are needed to confirm the results.
Concerning the impacts of various dietary supplements, different classes of ARVs were investigated, mostly the PIs. Piscitelli et al. [] reported that garlic supplement significantly decreased the extent of saquinavir absorption, as indicated by the decrease in AUC0–8, Ctrough, and Cmax. No definite underlying mechanism could be drawn from this study, but the authors proposed that it could be due to the induction of CYP450, or P-glycoprotein (P-gp) produced by long-term use of garlic. Nonetheless, evidence has shown that the effects of garlic on CYP3A4 are controversial as some in vitro studies reported that garlic had an inhibitory effect on CYP3A4 []. While other studies showed no significant effect of garlic on CYP3A4 [,]. Given that garlic supplements might have a negative effect on saquinavir exposure, garlic supplementation should be avoided in patients receiving treatment with saquinavir.
Quercetin, an inhibitor of various CYP450 including CYP3A4 as well as P-gp, could theoretically be used as a booster of saquinavir levels [,]. However, DiCenzo et al. [] did not find significant effects of quercetin on saquinavir concentrations. The nonsignificant effect of quercetin could partially be explained by the intersubject and intrasubject variability. Given that only ten subjects were included in the study by DiCenzo et al. [], further studies are required to confirm such results.
Ginkgo biloba, another widely used dietary supplement, has been shown to induce CYP3A activity [,]. However, Robertson et al. [] reported no significant effects of Ginkgo biloba extract on lopinavir and ritonavir pharmacokinetics. These could be explained by the inhibitory effect of co-administered ritonavir on CYP3A. Nevertheless, the impacts of Ginkgo biloba extract on un-boosted protease inhibitors were not investigated in that study, and hence coadministration of Ginkgo biloba extract with un-boosted PI is not theoretically recommended. Similar to the effect of Ginkgo biloba, Panax ginseng has shown an inductive effect on CYP3A, which in turn may reduce PI concentrations []. However, the two-week administration of Panax ginseng did not alter lopinavir and ritonavir pharmacokinetics []. The same reason concerning the inhibitory effect of concurrently administered ritonavir could be applied here. Therefore, a similar recommendation on the use of Panax ginseng and un-boosted PI to that of Ginkgo biloba extract is proposed.
Inconclusive effects of β-carotene on CYP3A4 have been reported from in vitro studies, as one study found an inhibitory effect [], while another reported an inductive property []. A clinical study investigating the impacts of β-carotene supplementation at the dose of 25,000 IU twice daily on nelfinavir and its active metabolite M8, which is metabolized by respective CYP2C19 and CYP3A4, indicated no clinically significant effect []. This implies that PLWH receiving ARVs that are substrates of CYP2C19 or CYP3A4 may be able to use β-carotene as a dietary supplement. However, it should be noted that these findings were based only on 15 HIV-infected subjects. Further prospective studies investigating the impact of β-carotene on other CYP2C19 and CYP3A4 substrates may be warranted.
This study has some limitations. The included studies did not report the component of fruit juices, i.e., whether the juice contained pulp or additives. This information may be crucial since these compositions might not be pharmaceutically inert. Since most studies were conducted with different ARV drugs and different supplements, only limited studies were included for meta-analysis. Only food (meal) and ARV pharmacokinetic interaction in healthy subjects were analyzed due to the limited number of studies with supplements and ARV pharmacokinetic interaction. Additionally, caution should be taken when the stratified results are interpreted as the minimal number of studies for subgroup analysis should be more than 10 []. Some studies from the qualitative analysis could not be included in the meta-analysis because of the diverse types of supplements among studies. The number of participants in each study was relatively small, and there may also have been interpatient or intrapatient variability. Furthermore, most studies were conducted in different regions with different study designs. Moreover, our systematic review may not be generalizable to all nutrient or food supplements as we did not focus on some products, e.g., probiotics or prebiotics, which may have effects on ARV pharmacokinetics. Of note, the heterogeneity across studies may also affect the results due to the potential effects of some factors such as gender, comorbidities, food compositions, dosage regimen, and duration of treatment.
This study found new information on the potential impact of supplement use on ARV pharmacokinetics. The study highlighted the decreased absorption of NRTIs such as abacavir, emtricitabine, and PIs such as ritonavir and darunavir after co-administration with food. The increased tmax and plasma concentration of some ARV such as darunavir due to ARV–food interaction can suggest nutrition monitoring in relation to HIV and ARV treatment. As a further matter, due to the diversity of supplements, further research that considers not only the variability of interactions but the likelihood of an individual patient to develop potential outcomes should be examined. Improving awareness of therapeutic monitoring followed by pharmacokinetic evaluation of specific interaction should be implemented because there is extensive use of supplements in the HIV population.
5. Conclusions
This study pointed out the delayed absorption of NRTIs such as abacavir, emtricitabine, lamivudine, zidovudine, tenofovir alafenamide, and PIs including amprenavir, darunavir, and ritonavir under fed conditions including low-fat and high-fat meals. The higher plasma concentration of PI such as darunavir and cobicistat was also observed in a fed state. Considering the effects of various products on drug-metabolizing enzymes, more evidence in pharmacokinetic fields is required. So far, it is still necessary to investigate the potential interactions of ARV and particular supplement or complementary products in PLWH. Further pharmacokinetic studies are highly recommended to explore the potential pharmacokinetic interaction between food and ARV that might affect therapeutic outcomes. Physicians and healthcare providers need to be aware of the potential interaction between prescribed ARV and any mineral supplements that may lead to virologic failure or delayed absorption due to chelation. Since even a small change in plasma drug level can affect therapeutic efficacy, PLWH on ARV should be educated or given information on supplement use.
Supplementary Materials
The following are available online at https://www.mdpi.com/article/10.3390/nu14030520/s1, Table S1: Search terms for study screening, Table S2: The quality assessment of included studies.
Author Contributions
Conceptualization and methodology, T.S., D.T. and N.L.; software, D.T. and N.L.; validation, T.S., D.T., J.M. and N.L.; analysis, T.S. and D.T.; supervision, T.S. and N.L.; draft manuscript preparation, T.S. and D.T.; writing and editing, T.S., D.T., J.M. and N.L. All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
Not applicable.
Conflicts of Interest
The authors declare no conflict of interest for this work.
References
- Centers for Disease Control and Prevention. International Statistics. Available online: https://www.cdc.gov/hiv/statistics/overview/index.html (accessed on 15 December 2021).
- HIV.gov. Global Statistics. Available online: https://www.hiv.gov/hiv-basics/overview/data-and-trends/global-statistics (accessed on 15 December 2021).
- World Health Organization. Consolidated Guidelines on HIV Prevention, Testing, Treatment, Service Delivery and Monitoring: Recommendations for a Public Health Approach; World Health Organization: Geneva, Switzerland, 2021.
- European Food Safety Authority. Food Supplements. Available online: https://www.efsa.europa.eu/en/topics/topic/food-supplements (accessed on 15 December 2021).
- Castleman, T.; Seumo-Fosso, E.; Cogill, B. Food and Nutrition Implications of Antiretroviral Therapy in Resource Limited Settings; Food and Nutrition Technical Assistance Project, Academy for Educational Development: Washington, DC, USA, 2004. [Google Scholar]
- Tonui, K.K.; Njogu, E.; Onyango, A.C. Dietary intake of HIV-seropositive clients attending Longisa County Hospital Comprehensive Care Clinic, Bomet County, Kenya. S. Afr. J. Clin. Nutr. 2020, 33, 53–57. [Google Scholar] [CrossRef]
- Singhal, N.; Austin, J. A Clinical Review of Micronutrients in HIV Infection. J. Int. Assoc. Physicians AIDS Care 2002, 1, 63–75. [Google Scholar] [CrossRef] [PubMed]
- Koethe, J.R.; Chi, B.H.; Megazzini, K.M.; Heimburger, D.C.; Stringer, J.S.A. Macronutrient supplementation for malnourished HIV-infected adults: A review of the evidence in resource-adequate and resource-constrained settings. Clin. Infect. Dis. 2009, 49, 787–798. [Google Scholar] [CrossRef] [PubMed][Green Version]
- Lorenc, A.; Robinson, N. A review of the use of complementary and alternative medicine and HIV: Issues for patient care. AIDS Patient Care STDs 2013, 27, 503–510. [Google Scholar] [CrossRef] [PubMed]
- Schmidt, L.E.; Dalhoff, K. Food-drug interactions. Drugs 2002, 62, 1481–1502. [Google Scholar] [CrossRef] [PubMed]
- Esteves, F.; Rueff, J.; Kranendonk, M. The central role of cytochrome P450 in xenobiotic metabolism—A brief review on a fascinating enzyme family. J. Xenobiotics 2021, 11, 7. [Google Scholar] [CrossRef]
- Carver, P.L.; Fleisher, D.; Zhou, S.Y.; Kaul, D.; Kazanjian, P.; Li, C. Meal Composition effects on the oral bioavailability of indinavir in HIV-infected patients. Pharm. Res. 1999, 16, 718–724. [Google Scholar] [CrossRef]
- Deng, J.; Zhu, X.; Chen, Z.; Fan, C.H.; Kwan, H.S.; Wong, C.H.; Shek, K.Y.; Zuo, Z.; Lam, T.N. A review of food–drug interactions on oral drug absorption. Drugs 2017, 77, 1833–1855. [Google Scholar] [CrossRef]
- Moore, K.H.P.; Shaw, S.; Laurent, A.L.; Lloyd, P.; Duncan, B.; Morris, D.M.; O’Mara, M.J.; Pakes, G.E. Lamivudine/zidovudine as a combined formulation tablet: Bioequivalence compared with lamivudine and zidovudine administered concurrently and the effect of food on absorption. J. Clin. Pharmacol. 1999, 39, 593–605. [Google Scholar] [CrossRef]
- Roberts, J.L.; Kiser, J.J.; Hindman, J.T.; Meditz, A.L. Virologic failure with a raltegravir-containing antiretroviral regimen and concomitant calcium administration. Pharmacother. J. Hum. Pharmacol. Drug Ther. 2011, 31, 1042. [Google Scholar] [CrossRef]
- Page, M.J.; McKenzie, J.; Bossuyt, P.; Boutron, I.; Hoffmann, T.; Mulrow, C.; Shamseer, L.; Tetzlaff, J.; Akl, E.; Brennan, S.E.; et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ 2021, 372, n71. [Google Scholar] [CrossRef] [PubMed]
- Koziolek, M.; Alcaro, S.; Augustijns, P.; Basit, A.W.; Grimm, M.; Hens, B.; Hoad, C.L.; Jedamzik, P.; Madla, C.M.; Maliepaard, M.; et al. The mechanisms of pharmacokinetic food-drug interactions–A perspective from the UNGAP group. Eur. J. Pharm. Sci. 2019, 134, 31–59. [Google Scholar] [CrossRef] [PubMed]
- Ma, L.-L.; Wang, Y.-Y.; Yang, Z.-H.; Huang, D.; Weng, H.; Zeng, X.-T. Methodological quality (risk of bias) assessment tools for primary and secondary medical studies: What are they and which is better? Mil. Med. Res. 2020, 7, 7. [Google Scholar] [CrossRef] [PubMed]
- Sterne, J.A.C.; Hernán, M.A.; Reeves, B.C.; Savović, J.; Berkman, N.D.; Viswanathan, M.; Henry, D.; Altman, D.G.; Ansari, M.T.; Boutron, I.; et al. ROBINS-I: A tool for assessing risk of bias in non-randomised studies of interventions. BMJ 2016, 355, i4919. [Google Scholar] [CrossRef]
- Higgins, J.P.T.; Thompson, S.G.; Deeks, J.J.; Altman, D.G. Measuring inconsistency in meta-analyses. BMJ 2003, 327, 557–560. [Google Scholar] [CrossRef]
- Herzog, R.; Álvarez-Pasquin, M.J.; Díaz, C.; del Barrio, J.L.; Estrada, J.M.; Gil, Á. Are healthcare workers’ intentions to vaccinate related to their knowledge, beliefs and attitudes? A systematic review. BMC Public Health 2013, 13, 154. [Google Scholar] [CrossRef]
- Murad, M.H.; Sultan, S.; Haffar, S.; Bazerbachi, F. Methodological quality and synthesis of case series and case reports. BMJ Evid. Based Med. 2018, 23, 60–63. [Google Scholar] [CrossRef]
- Ding, H.; Hu, G.L.; Zheng, X.Y.; Chen, Q.; Threapleton, D.E.; Zhou, Z.H. The method quality of cross-over studies involved in Cochrane Systematic Reviews. PLoS ONE 2015, 10, e0120519. [Google Scholar] [CrossRef]
- Kupferschmidt, H.H.T.; Fattinger, K.E.; Ha, H.R.; Follath, F.; Krähenbühl, S. Grapefruit juice enhances the bioavailability of the HIV protease inhibitor saquinavir in man. Br. J. Clin. Pharmacol. 1998, 45, 355–359. [Google Scholar] [CrossRef]
- Yuen, G.J.; Lou, Y.; Thompson, N.F.; Otto, V.R.; Allsup, T.L.; Mahony, W.B.; Hutman, H.W. Abacavir/lamivudine/zidovudine as a combined formulation tablet: Bioequivalence compared with each component administered concurrently and the effect of food on absorption. J. Clin. Pharmacol. 2001, 41, 277–288. [Google Scholar] [CrossRef]
- Penzak, S.R.; Acosta, E.P.; Turner, M.; Edwards, D.J.; Hon, Y.Y.; Desai, H.D.; Jann, M.W. Effect of Seville orange juice and grapefruit juice on indinavir pharmacokinetics. J. Clin. Pharmacol. 2002, 42, 1165–1170. [Google Scholar] [CrossRef] [PubMed]
- Falcoz, C.; Jenkins, J.M.; Bye, C.; Hardman, T.C.; Kenney, K.B.; Studenberg, S.; Fuder, H.; Prince, W.T. Pharmacokinetics of GW433908, a prodrug of amprenavir, in healthy male volunteers. J. Clin. Pharmacol. 2002, 42, 887–898. [Google Scholar] [CrossRef] [PubMed]
- Piscitelli, S.C.; Burstein, A.H.; Welden, N.; Gallicano, K.D.; Falloon, J. The effect of garlic supplements on the pharmacokinetics of saquinavir. Clin. Infect. Dis. 2002, 34, 234–238. [Google Scholar] [CrossRef] [PubMed]
- Slain, D.; Amsden, J.R.; Khakoo, R.A.; Fisher, M.A.; Lalka, D.; Hobbs, G.R. Effect of high-dose vitamin C on the steady-state pharmacokinetics of the protease inhibitor indinavir in healthy volunteers. Pharmacotherapy 2005, 25, 165–170. [Google Scholar] [CrossRef]
- Mouly, S.J.; Matheny, C.; Paine, M.F.; Smith, G.; Lamba, J.; Lamba, V.; Pusek, S.N.; Schuetz, E.G.; Stewart, P.W.; Watkins, P.B. Variation in oral clearance of saquinavir is predicted by CYP3A5*1 genotype but not by enterocyte content of cytochrome P450 3A5. Clin. Pharmacol. Ther. 2005, 78, 605–618. [Google Scholar] [CrossRef]
- DiCenzo, R.; Frerichs, V.; Larppanichpoonphol, P.; Predko, L.; Chen, A.; Reichman, R.; Morris, M. Effect of quercetin on the plasma and intracellular concentrations of saquinavir in healthy adults. Pharmacother. J. Hum. Pharmacol. Drug Ther. 2006, 26, 1255–1261. [Google Scholar] [CrossRef]
- Sekar, V.; Kestens, D.; Spinosa-Guzman, S.; de Pauw, M.; de Paepe, E.; Vangeneugden, T.; Lefebvre, E.; Hoetelmans, R.M.W. The effect of different meal types on the pharmacokinetics of darunavir (TMC114)/ritonavir in HIV-negative healthy volunteers. J. Clin. Pharmacol. 2007, 47, 479–484. [Google Scholar] [CrossRef]
- Robertson, S.M.; Davey, R.T.; Voell, J.; Formentini, E.; Alfaro, R.M.; Penzak, S.R. Effect of Ginkgo biloba extract on lopinavir, midazolam and fexofenadine pharmacokinetics in healthy subjects. Curr. Med. Res. Opin. 2008, 24, 591–599. [Google Scholar] [CrossRef]
- Patel, P.; Song, I.; Borland, J.; Patel, A.; Lou, Y.; Chen, S.; Wajima, T.; Peppercorn, A.; Min, S.S.; Piscitelli, S.C. Pharmacokinetics of the HIV integrase inhibitor S/GSK1349572 co-administered with acid-reducing agents and multivitamins in healthy volunteers. J. Antimicrob. Chemother. 2011, 66, 1567–1572. [Google Scholar] [CrossRef]
- Calderón, M.M.; Chairez, C.L.; Gordon, L.A.; Alfaro, R.M.; Kovacs, J.A.; Penzak, S.R. Influence of Panax ginseng on the steady state pharmacokinetic profile of lopinavir-ritonavir in healthy volunteers. Pharmacother. J. Hum. Pharmacol. Drug Ther. 2014, 34, 1151–1158. [Google Scholar] [CrossRef]
- Song, I.; Borland, J.; Arya, N.; Wynne, B.; Piscitelli, S. Pharmacokinetics of dolutegravir when administered with mineral supplements in healthy adult subjects. J. Clin. Pharmacol. 2015, 55, 490–496. [Google Scholar] [CrossRef] [PubMed]
- Buchanan, A.M.; Holton, M.; Conn, I.; Davies, M.; Choukour, M.; Wynne, B.R. Relative bioavailability of a dolutegravir dispersible tablet and the effects of low- and high-mineral-content water on the tablet in healthy adults. Clin. Pharmacol. Drug Dev. 2017, 6, 577–583. [Google Scholar] [CrossRef] [PubMed]
- Yamada, H.; Ikushima, I.; Nemoto, T.; Ishikawa, T.; Ninomiya, N.; Irie, S. Effects of a nutritional protein-rich drink on the pharmacokinetics of elvitegravir, cobicistat, emtricitabine, tenofovir alafenamide, and tenofovir compared with a standard meal in healthy Japanese male subjects. Clin. Pharmacol. Drug Dev. 2017, 7, 132–142. [Google Scholar] [CrossRef] [PubMed]
- Yonemura, T.; Okada, N.; Sagane, K.; Okamiya, K.; Ozaki, H.; Iida, T.; Yamada, H.; Yagura, H. Effects of milk or apple juice ingestion on the pharmacokinetics of elvitegravir and cobicistat in healthy Japanese male volunteers: A randomized, single-dose, three-way crossover study. Clin. Pharmacol. Drug Dev. 2018, 7, 737–743. [Google Scholar] [CrossRef]
- Jensen-Fangel, S.; Justesen, U.S.; Black, F.T.; Pedersen, C.; Obel, N. The use of calcium carbonate in nelfinavir-associated diarrhoea in HIV-1-infected patients. HIV Med. 2003, 4, 48–52. [Google Scholar] [CrossRef]
- Sheehan, N.L.; van Heeswijk, R.P.G.; Foster, B.C.; Akhtar, H.; Singhal, N.; Seguin, I.; DelBalso, L.; Bourbeau, M.; Chauhan, B.M.; Boulassel, M.-R.; et al. The Effect of β-carotene supplementation on the pharmacokinetics of nelfinavir and its active metabolite M8 in HIV-1-infected patients. Molecules 2012, 17, 688–702. [Google Scholar] [CrossRef]
- Abdissa, A.; Olsen, M.F.; Yilma, D.; Tesfaye, M.; Girma, T.; Christiansen, M.; Hagen, C.; Wiesner, L.; Castel, S.; Aseffa, A.; et al. Lipid-based nutrient supplements do not affect efavirenz but lower plasma nevirapine concentrations in Ethiopian adult HIV patients. HIV Med. 2015, 16, 403–411. [Google Scholar] [CrossRef]
- Munkombwe, D.; Muungo, T.L.; Michelo, C.; Kelly, P.; Chirwa, S.; Filteau, S. Lipid-based nutrient supplements containing vitamins and minerals attenuate renal electrolyte loss in HIV/AIDS patients starting antiretroviral therapy: A randomized controlled trial in Zambia. Clin. Nutr. ESPEN 2016, 13, e8–e14. [Google Scholar] [CrossRef]
- Daskapan, A.; Dijkema, D.; de Weerd, D.A.; Bierman, W.F.W.; Kosterink, J.G.W.; van der Werf, T.S.; Alffenaar, J.-W.C.; Stienstra, Y. Food intake and darunavir plasma concentrations in people living with HIV in an outpatient setting. Br. J. Clin. Pharmacol. 2017, 83, 2325–2329. [Google Scholar] [CrossRef]
- Cochrane Handbook for Systematic Reviews of Interventions. Recommendations on Testing for Funnel Plot Asymmetry. Available online: https://handbook-5-1.cochrane.org/chapter_10/10_4_3_1_recommendations_on_testing_for_funnel_plot_asymmetry.htm (accessed on 15 December 2021).
- Barry, M.; Gibbons, S.; Back, D.; Mulcahy, F. Protease inhibitors in patients with HIV disease. Clin. Pharmacokinet. 1997, 32, 194–209. [Google Scholar] [CrossRef]
- Kiani, J.; Imam, S.Z. Medicinal importance of grapefruit juice and its interaction with various drugs. Nutr. J. 2007, 6, 33. [Google Scholar] [CrossRef] [PubMed]
- Boffito, M.; Acosta, E.; Burger, D.; Fletcher, C.V.; Flexner, C.; Garaffo, R.; Gatti, G.; Kurowski, M.; Perno, C.F.; Peytavin, G.; et al. Part 1 Current status and future prospects of therapeutic drug monitoring and applied clinical pharmacology in antiretroviral therapy. Antivir. Ther. 2005, 10, 375–392. [Google Scholar] [PubMed]
- Usach, I.; Melis, V.; Peris, J.-E. Non-nucleoside reverse transcriptase inhibitors: A review on pharmacokinetics, pharmacodynamics, safety and tolerability. J. Int. AIDS Soc. 2013, 16, 18567. [Google Scholar] [CrossRef] [PubMed]
- SUSTIVA®. (Efavirenz) Capsules and Tablets. Available online: https://www.accessdata.fda.gov/drugsatfda_docs/label/2008/020972s030,021360s019lbl.pdf (accessed on 15 December 2021).
- Holec, A.D.; Mandal, S.; Prathipati, P.K.; Destache, C.J. Nucleotide reverse transcriptase inhibitors: A thorough review, present status and future perspective as HIV therapeutics. Curr. HIV Res. 2017, 15, 411–421. [Google Scholar] [CrossRef]
- Annex, I. Summary of Product Characteristics. Available online: https://www.ema.europa.eu/en/documents/product-information/descovy-epar-product-information_en.pdf (accessed on 15 December 2021).
- Highlights of Prescribing Information. Available online: https://www.accessdata.fda.gov/drugsatfda_docs/label/2013/204790lbl.pdf (accessed on 15 December 2021).
- Starup-Linde, J.; Rosendahl, S.B.; Storgaard, M.; Langdahl, B. Management of osteoporosis in patients living with HIV—A systematic review and meta-analysis. JAIDS J. Acquir. Immune Defic. Syndr. 2020, 83, 1–8. [Google Scholar] [CrossRef]
- Mori, T.; Itoh, S.; Ohgiya, S.; Ishizaki, K.; Kamataki, T. Regulation of CYP1A and CYP3A mRNAs by ascorbic acid in guinea pigs. Arch. Biochem. Biophys. 1997, 348, 268–277. [Google Scholar] [CrossRef]
- Zannoni, V.G.; Flynn, E.J.; Lynch, M. Ascorbic acid and drug metabolism. Biochem. Pharmacol. 1972, 21, 1377–1392. [Google Scholar] [CrossRef]
- Sato, P.H.; Zannoni, V.G. Stimulation of drug metabolism by ascorbic acid in weanling guinea pigs. Biochem. Pharmacol. 1974, 23, 3121–3128. [Google Scholar] [CrossRef]
- Rikans, L.E.; Smith, C.R.; Zannoni, V.G. Ascorbic acid and cytochrome P-450. J. Pharmacol. Exp. Ther. 1978, 204, 702–713. [Google Scholar]
- Netke, S.P.; Roomi, M.W.; Tsao, C.; Niedzwiecki, A. Ascorbic acid protects guinea pigs from acute aflatoxin toxicity. Toxicol. Appl. Pharmacol. 1997, 143, 429–435. [Google Scholar] [CrossRef]
- van Heeswijk, R.P.G.; Cooper, C.L.; Foster, B.C.; Chauhan, B.M.; Shirazi, F.; Seguin, I.; Phillips, E.J.; Mills, E. Effect of high-dose vitamin C on hepatic cytochrome P450 3A4 activity. J. Hum. Pharmacol. Drug Ther. 2005, 25, 1725–1728. [Google Scholar] [CrossRef] [PubMed]
- Foster, B.C.; Foster, M.S.; VandenHoek, S.; Krantis, A.; Budzinski, J.W.; Arnason, J.T.; Gallicano, K.D.; Choudri, S. An in vitro evaluation of human cytochrome P450 3A4 and P-glycoprotein inhibition by garlic. J. Pharm. Pharm. Sci. 2001, 4, 176–184. [Google Scholar] [PubMed]
- Ho, B.E.; Shen, D.D.; McCune, J.S.; Bui, T.; Risler, L.; Yang, Z.; Ho, R.J.Y. Effects of garlic on cytochromes P450 2C9- and 3A4-mediated drug metabolism in human hepatocytes. Sci. Pharm. 2010, 78, 473–481. [Google Scholar] [CrossRef] [PubMed]
- Jacek, H.; Rentsch, K.M.; Steinert, H.C.; Pauli-Magnus, C.; Meier, P.J.; Fattinger, K. No effect of garlic extract on saquinavir kinetics and hepatic CYP3A4 function measured by the erythromycin breath test. Clin. Pharmacol. Ther. 2004, 75, P80. [Google Scholar] [CrossRef]
- Obach, R.S. Inhibition of human cytochrome P450 enzymes by constituents of St. John’s Wort, an herbal preparation used in the treatment of depression. J. Pharmacol. Exp. Ther. 2000, 294, 88–95. [Google Scholar] [PubMed]
- Limtrakul, P.; Khantamat, O.; Pintha, K. Inhibition of P-glycoprotein function and expression by kaempferol and quercetin. J. Chemother. 2005, 17, 86–95. [Google Scholar] [CrossRef]
- Shinozuka, K.; Umegaki, K.; Kubota, Y.; Tanaka, N.; Mizuno, H.; Yamauchi, J.; Nakamura, K.; Kunitomo, M. Feeding of Ginkgo biloba extract (GBE) enhances gene expression of hepatic cytochrome P-450 and attenuates the hypotensive effect of nicardipine in rats. Life Sci. 2002, 70, 2783–2792. [Google Scholar] [CrossRef]
- Kubota, Y.; Kobayashi, K.; Tanaka, N.; Nakamura, K.; Kunitomo, M.; Umegaki, K.; Shinozuka, K. Interaction of Ginkgo biloba extract (GBE) with hypotensive agent, nicardipine, in rats. In Vivo 2003, 17, 409–412. [Google Scholar]
- Malati, C.Y.; Robertson, S.M.; Hunt, J.D.; Chairez, C.; Alfaro, R.M.; Kovacs, J.A.; Penzak, S.R. Influence of Panax ginseng on cytochrome P450 (CYP)3A and P-glycoprotein (P-gp) activity in healthy participants. J. Clin. Pharmacol. 2012, 52, 932–939. [Google Scholar] [CrossRef]
- Foster, B.; Francovic, A.; Drouin, C.; Akhtar, H.; Cameron, W. Trans-b-carotene and retinoids can effect human cytochrome p450 3a4-mediated metabolism (Abstract tupeb4564). In Proceedings of the XIV International AIDS Conference, Barcelona, Spain, 7–12 July 2002. [Google Scholar]
- Sczech, R.; Landes, N.; Pfluger, P.; Kluth, D.; Schweigert, F.J. Carotenoids and their metabolites are naturally occurring activators of gene expression via the pregnane X receptor. Eur. J. Nutr. 2004, 43, 336–343. [Google Scholar]
- Higgins, J.P.; Thomas, J.; Chandler, J.; Cumpston, M.; Li, T.; Page, M.J.; Welch, V.A. Cochrane Handbook for Systematic Reviews of Interventions; John Wiley & Sons: Chichester, UK, 2019. [Google Scholar]
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations. |
© 2022 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).