Pulmonary Vascular Permeability and Extravascular Lung Water Index in Patients with Liver Cirrhosis and Septic Shock
Abstract
:1. Introduction
2. Methods
2.1. Patient Information, Data Collection, and Definitions
2.2. Patients
2.3. Laboratory Investigations
2.4. Disease Severity Scores
2.5. Measurements of and Hemodynamic Parameters
2.6. Statistical Analysis
3. Results
4. Discussion
5. Conclusions
Author Contributions
Funding
Institutional Review Board Statement
Informed Consent Statement
Data Availability Statement
Conflicts of Interest
Abbreviations
References
- Fernandez, J.; Gustot, T. Management of bacterial infections in cirrhosis. J. Hepatol. 2012, 56 (Suppl. S1), S1–S12. [Google Scholar] [CrossRef]
- Wang, B.; Cai, L.; Lin, B.; He, Q.; Ding, X. Effect of Pulse Indicator Continuous Cardiac Output Monitoring on Septic Shock Patients: A Meta-Analysis. Comput. Math. Methods Med. 2022, 2022, 8604322. [Google Scholar] [CrossRef]
- Martin, G.S.; Eaton, S.; Mealer, M.; Moss, M. Extravascular lung water in patients with severe sepsis: A prospective cohort study. Crit. Care 2005, 9, R74–R82. [Google Scholar] [CrossRef]
- Li, C.; Wang, S.; Wang, H.; Wu, Y.; Ma, J.; Li, W.; Duan, J. The effects of hemodynamic monitoring using the PiCCO system on critically ill patients. Am. J. Transl. Res. 2021, 13, 10578–10585. [Google Scholar]
- Craig, T.R.; Duffy, M.J.; Shyamsundar, M.; McDowell, C.; McLaughlin, B.; Elborn, J.S.; McAuley, D.F. Extravascular lung water indexed to predicted body weight is a novel predictor of intensive care unit mortality in patients with acute lung injury. Crit. Care Med. 2010, 38, 114–120. [Google Scholar] [CrossRef]
- Mallat, J.; Pepy, F.; Lemyze, M.; Barrailler, S.; Gasan, G.; Tronchon, L.; Thevenin, D. Extravascular lung water indexed or not to predicted body weight is a predictor of mortality in septic shock patients. J. Crit. Care 2012, 27, 376–383. [Google Scholar] [CrossRef]
- Jozwiak, M.; Silva, S.; Persichini, R.; Anguel, N.; Osman, D.; Richard, C.; Teboul, J.-L.; Monnet, X. Extravascular lung water is an independent prognostic factor in patients with acute respiratory distress syndrome. Crit. Care Med. 2013, 41, 472–480. [Google Scholar] [CrossRef]
- Kushimoto, S.; Taira, Y.; Kitazawa, Y.; Okuchi, K.; Sakamoto, T.; Ishikura, H.; Endo, T.; Yamanouchi, S.; Tagami, T.; Yamaguchi, J.; et al. The clinical usefulness of extravascular lung water and pulmonary vascular permeability index to diagnose and characterize pulmonary edema: A prospective multicenter study on the quantitative differential diagnostic definition for acute lung injury/acute respiratory distress syndrome. Crit. Care 2012, 16, R232. [Google Scholar]
- Jozwiak, M.; Teboul, J.L.; Monnet, X. Extravascular lung water in critical care: Recent advances and clinical applications. Ann. Intensive Care 2015, 5, 38. [Google Scholar] [CrossRef]
- Zhang, Z.; Lu, B.; Ni, H. Prognostic value of extravascular lung water index in critically ill patients: A systematic review of the literature. J. Crit. Care 2012, 27, 420.e1–420.e8. [Google Scholar] [CrossRef]
- Iwakiri, Y.; Shah, V.; Rockey, D.C. Vascular pathobiology in chronic liver disease and cirrhosis—Current status and future directions. J. Hepatol. 2014, 61, 912–924. [Google Scholar] [CrossRef] [PubMed]
- Claesson-Welsh, L. Vascular permeability—The essentials. Upsala J. Med. Sci. 2015, 120, 135–143. [Google Scholar] [CrossRef] [PubMed]
- Fukumura, D.; Gohongi, T.; Kadambi, A.; Izumi, Y.; Ang, J.; Yun, C.-O.; Buerk, D.G.; Huang, P.L.; Jain, R.K. Predominant role of endothelial nitric oxide synthase in vascular endothelial growth factor-induced angiogenesis and vascular permeability. Proc. Natl. Acad. Sci. USA 2001, 98, 2604–2609. [Google Scholar] [CrossRef] [PubMed]
- Huglo, D.; De Botton, S.; Canva-Delcambre, V.; Colombel, J.F.; Wallaert, B.; Steinling, M.; Marchandise, X. Simultaneous determination of pulmonary and intestinal permeability in patients with alcoholic liver cirrhosis. Eur. J. Nucl. Med. 2001, 28, 1505–1511. [Google Scholar] [PubMed]
- Jimenez, J.V.; Garcia-Tsao, G.; Saffo, S. Emerging concepts in the care of patients with cirrhosis and septic shock. World J. Hepatol. 2023, 15, 497–514. [Google Scholar] [CrossRef] [PubMed]
- Singer, M.; Deutschman, C.S.; Seymour, C.W.; Shankar-Hari, M.; Annane, D.; Bauer, M.; Bellomo, R.; Bernard, G.R.; Bernard, G.R.; Coopersmith, C.M.; et al. The Third International Consensus Definitions for Sepsis and Septic Shock (Sepsis-3). JAMA 2016, 315, 801–810. [Google Scholar] [CrossRef]
- Dellinger, R.P.; Levy, M.M.; Rhodes, A.; Annane, D.; Gerlach, H.; Opal, S.M.; Sevransky, J.E.; Sprung, C.L.; Douglas, I.S.; Jaeschke, R.; et al. Surviving Sepsis Campaign: International guidelines for management of severe sepsis and septic shock: 2012. Crit. Care Med. 2013, 41, 580–637. [Google Scholar] [CrossRef]
- Litton, E.; Morgan, M. The PiCCO monitor: A review. Anaesth. Intensive Care 2012, 40, 393–409. [Google Scholar] [CrossRef] [PubMed]
- Pugh, R.N.; Murray-Lyon, I.M.; Dawson, J.L.; Pietroni, M.C.; Williams, R. Transection of the esophagus for bleeding esophageal varices. Br. J. Surg. 1973, 60, 646–649. [Google Scholar] [CrossRef]
- Kamath, P.S.; Wiesner, R.H.; Malinchoc, M.; Kremers, W.; Therneau, T.M.; Kosberg, C.L.; D’Amico, G.; Dickson, R.E.; Rolland, E.; Kim, R.W. A model to predict survival in patients with end-stage liver disease. Hepatology 2001, 33, 464–470. [Google Scholar] [CrossRef]
- Ho, Y.-P.; Chen, Y.-C.; Yang, C.; Lien, J.-M.; Chu, Y.-Y.; Fang, J.-T.; Chiu, C.-T.; Chen, P.-C.; Tsai, M.-H. Outcome prediction for critically ill cirrhotic patients: A comparison of APACHE II and Child-Pugh Scoring System. J. Intensive Care Med. 2004, 19, 105–110. [Google Scholar] [CrossRef]
- Wehler, M.; Kokoska, J.; Reulbach, U.; Hahn, E.G.; Strauss, R. Short-term prognosis in critically ill patients with cirrhosis assessed by prognostic scoring systems. Hepatology 2001, 34, 255–261. [Google Scholar] [CrossRef] [PubMed]
- Vincent, J.L.; Sakr, Y.; Sprung, C.L.; Ranieri, V.M.; Reinhart, K.; Gerlach, H.; Moreno, R.; Carlet, J.; Le Gall, J.-R.; Payen, D.; et al. Sepsis in European intensive care units: Results of the SOAP study. Crit. Care Med. 2006, 34, 344–353. [Google Scholar] [CrossRef]
- Kaur, H.; Premkumar, M. Diagnosis and Management of Cirrhotic Cardiomyopathy. J. Clin. Exp. Hepatol. 2022, 12, 186–199. [Google Scholar] [CrossRef] [PubMed]
- Jagdish, R.K.; Maras, J.S.; Sarin, S.K. Albumin in Advanced Liver Diseases: The Good and Bad of a Drug! Hepatology 2021, 74, 2848–2862. [Google Scholar] [CrossRef]
- Maiwall, R.; Kumar, A.; Pasupuleti, S.S.R.; Hidam, A.K.; Tevethia, H.; Kumar, G.; Sahney, A.; Mitra, L.G.; Sarin, S.K. A randomized controlled trial comparing 20% albumin to plasmalyte in patients with cirrhosis and sepsis-induced hypotension [ALPS trial]. J. Hepatol. 2022, 77, 670–682. [Google Scholar] [CrossRef]
- China, L.; Freemantle, N.; Forrest, E.; Kallis, Y.; Ryder, S.D.; Wright, G.; Portal, A.J.; Salles, N.B.; Gilroy, D.W.; O’Brien, A.; et al. A Randomized Trial of Albumin Infusions in Hospitalized Patients with Cirrhosis. N. Engl. J. Med. 2021, 384, 808–817. [Google Scholar] [CrossRef] [PubMed]
- Wong, F.; Pappas, S.C.; Curry, M.P.; Reddy, K.R.; Rubin, R.A.; Porayko, M.K.; Gonzalez, S.A.; Mumtaz, K.; Lim, N.; Simonetto, D.A.; et al. Terlipressin plus Albumin for the Treatment of Type 1 Hepatorenal Syndrome. N. Engl. J. Med. 2021, 384, 818–828. [Google Scholar] [CrossRef]
- Chung, F.T.; Kuo, C.H.; Wang, C.H.; Lin, S.M. Thrombin worsens extravascular lung water and outcomes of septic patients with acute respiratory distress syndrome: A case control study. Medicine 2023, 102, e36200. [Google Scholar] [CrossRef]
- Li, J.; Tan, M.; Yang, T.; Huang, Q.; Shan, F. The paracrine isthmin1 transcriptionally regulated by C/EBPβ exacerbates pulmonary vascular leakage in murine sepsis. Am. J. Physiol. Cell Physiol. 2024, 326, C304–C316. [Google Scholar] [CrossRef]
All (n = 83) | 28-Day Non-Survival (n = 36) | 28-Day Survival (n = 47) | p Value | |
---|---|---|---|---|
Age (years) | 51 (46–63) | 57 (43–63) | 50 (47–64) | 0.887 |
Sex (M/F) | 72/11 | 31/5 | 41/6 | 0.881 |
CI D1 (L/min/m2) | 4.49 ± 1.70 | 4.63 ± 1.53 | 4.39 ± 1.83 | 0.514 |
CI D2 (L/min/m2) | 4.38 ± 1.73 | 4.61 ± 1.87 | 4.21 ± 1.60 | 0.300 |
ITBVI D1 (mL/m2) | 949 ± 240 | 973 ± 245 | 931 ± 237 | 0.442 |
ITBVI D2 (mL/m2) | 967 ± 260 | 965 ± 255 | 969 ± 266 | 0.933 |
Fluid balance D1 (mL) | 1282 ± 1853 | 1622 ± 1623 | 1022 ± 1990 | 0.145 |
Fluid balance D2 (mL) | 825 ± 1819 | 1420 ± 1901 | 368 ± 1630 | 0.008 |
Accumulated fluid balance (mL) | 2107 ± 2987 | 3042 ± 2946 | 1390 ± 2845 | 0.012 |
aEVLWI D1 (mL/kg) | 10.40 (8.00–15.80) | 11.20 (8.50–18.78) | 10.10 (7.80–13.90) | 0.075 |
aEVLWI D2 (mL/kg) | 11.80 (8.30–17.10) | 14.90 (8.83–23.58) | 10.40 (7.90–14.70) | 0.013 |
ΔaEVLWI (mL/kg) | 0.91 ± 4.60 | 1.31 ± 6.68 | 0.60 ± 1.87 | 0.492 |
pEVLWI D1 (mL/kg) | 11.28 (8.83–18.26) | 12.54 (9.75–21.60) | 11.15 (7.54–15.69) | 0.096 |
pEVLWI D2 (mL/kg) | 12.55 (9.18–21.1) | 15.56 (9.56–24.38) | 11.45 (8.81–15.95) | 0.020 |
ΔpEVLWI (mL/kg) | 1.34 ± 5.07 | 1.91 ± 7.40 | 0.91 ± 1.93 | 0.374 |
PVPI D1 | 2.00 (1.70–2.80) | 2.40 (1.80–3.35) | 2.00 (1.60–2.30) | 0.042 |
PVPI D2 | 2.20 (1.803.10) | 2.90 (1.93–3.90) | 1.90 (1.70–2.30) | 0.001 |
ΔPVPI | 0.20 (0.84) | 0.36 ± 1.10 | 0.08 ± 0.44 | 0.117 |
Maximal NE dose (μg/min) | 22.90 ± 18.71 | 28.36 ± 22.66 | 17.10 ± 10.96 | 0.013 |
Bilirubin D1 (mg/dL) | 8.41 ± 8.76 | 11.47 ± 9.46 | 6.08 ± 7.48 | 0.005 |
Bilirubin D2 (mg/dL) | 9.23 ± 8.42 | 13.24 ± 9.59 | 5.90 ± 5.51 | <0.001 |
INR D1 | 2.17 ± 0.70 | 2.39 ± 0.74 | 2.00 ± 0.63 | 0.014 |
INR D2 | 2.16 ± 0.86 | 2.49 ± 1.04 | 1.91 ± 0.59 | 0.007 |
Albumin D1 (g/dL) | 2.54 ± 0.53 | 2.50 ± 0.52 | 2.57 ± 0.54 | 0.549 |
Albumin D2 (g/dL) | 2.73 ± 0.45 | 2.74 ± 0.54 | 2.72 ± 0.37 | 0.879 |
Child–Pugh score D1 | 11.25 ± 2.04 | 11.97 ± 1.93 | 10.63 ± 1.95 | 0.005 |
Child–Pugh score D2 | 11.11 ± 2.01 | 11.77 ± 1.86 | 10.60 ± 1.99 | 0.009 |
SOFA score D1 | 13.72 ± 3.19 | 15.48 ± 2.41 | 12.18 ± 3.00 | <0.001 |
SOFA score D2 | 13.99 ± 3.38 | 15.89 ± 2.81 | 12.51 ± 3.06 | <0.001 |
APACHE II D1 | 28.56 ± 6.61 | 30.58 ± 5.59 | 26.82 ± 6.99 | 0.016 |
APACHE II D2 | 27.53 ± 7.34 | 30.91 ± 6.76 | 24.89 ± 6.73 | <0.001 |
MELD D1 | 29.41 ± 7.86 | 32.06 ± 7.28 | 27.11 ± 7.70 | 0.007 |
MELD D2 | 29.49 ± 7.90 | 33.11 ± 7.36 | 26.67 ± 7.17 | <0.001 |
CRP D1 (mg/L) | 73.13 (40.13–111.18) | 73.805 (41.17–109.60) | 66.85 (37.69–137.21) | 0.915 |
CRP D2 (mg/L) | 75.02 (41.52–118.445) | 63.54 (40.07–113.43) | 77.90 (42.64–143.44) | 0.500 |
PCT D1 (ng/mL) | 5.15 (1.55–17.60) | 2.95 (1.20–12.59) | 5.88 (1.94–21.35) | 0.237 |
PCT D2 (ng/mL) | 6.18 (1.93–18.77) | 4.82 (1.66–8.58) | 11.78 (3.15–19.88) | 0.055 |
Leukocyte D1 (×109/L) | 14.88 ± 10.19 | 17.71 ± 12.98 | 12.54 ± 6.40 | 0.039 |
Leukocyte D2 (×109/L) | 15.02 ± 8.31 | 16.20 ± 9.07 | 14.09 ± 7.63 | 0.288 |
Lactate D1 (mg/dL) | 38.70 (21.20–77.15) | 60.70 (35.38–122.63) | 22.25 (16.92–53.88) | <0.001 |
Lactate D2 (mg/dL) | 31.15 (18.45–57.80) | 41.65 (24.7–135.53) | 24.95 (16.43–36.08) | 0.001 |
Need for MV (%) | 76/83 (91.6%) | 34/36 (94.4%) | 42/47 (89.4%) | 0.693 |
Pneumonia (%) | 57/83 (68.7%) | 26/36 (72.2%) | 31/47 (66%) | 0.542 |
ARDS (%) | 10/83 (12.0%) | 9/36 (25.0%) | 1/47 (2.1%) | 0.002 |
Massive pleural effusion (%) | 5/83 (6%) | 5/36 (13.9%) | 0/47 (0%) | 0.013 |
Sensitivity | Specificity | PPV | NPV | Accuracy | |
---|---|---|---|---|---|
PVPI D2 | 71.67% | 82.61% | 91.49% | 52.78% | 74.70% |
pEVLWI D2 | 63.89% | 70.21% | 62.16% | 71.74% | 67.47% |
High PVPI D2 (>2.65) (n = 23) | Low PVPI D2 (<2.65) (n = 60) | p Value | |
---|---|---|---|
Age (years) | 54 (41–62) | 51 (47–65) | 0.756 |
Sex (M/F) | 18/5 | 54/6 | 0.158 |
CI D2 (L/min/m2) | 4.56 ± 2.11 | 4.31 ± 1.57 | 0.569 |
ITBVI D2 (mL/m2) | 965 ± 258 | 968 ± 262 | 0.964 |
aEVLWI D2 (mL/kg) | 22.60 (17.60–29.40) | 9.90 (7.70–12.53) | <0.001 |
pEVLWI D2 (mL/kg) | 24.24 (18.42–28.45) | 10.845 (7.67–13.04) | <0.001 |
PVPI D2 | 3.9 (3.2–5.8) | 1.85 (1.70–2.30) | <0.001 |
Accumulated fluid balance (mL) | 2875 ± 2717 | 1812 ± 3055 | 0.148 |
Child–Pugh score D2 | 11.22 ± 1.783 | 11.07 ± 2.11 | 0.769 |
SOFA score D2 | 15.83 ± 2.33 | 13.25 ± 3.47 | <0.001 |
APACHE II D2 | 31.61 ± 6.39 | 25.88 ± 7.10 | 0.001 |
MELD D2 | 29.7 ± 7.21 | 29.4 ± 8.21 | 0.882 |
CRP D2 (mg/L) | 89.89 (44.46–151.66) | 56.51 (31.50–105.34) | 0.016 |
PCT D2 (ng/mL) | 3.04 (1.22–5.82) | 5.07 (1.19–10.40) | 0.733 |
Leukocyte D2 (×109/L) | 13.79 ± 9.39 | 15.57 ± 7.82 | 0.405 |
Lactate D2 (mg/dL) | 26.55 (21.8–96.48) | 29.4 (15.65–75.05) | 0.238 |
Need for MV (%) | 23/23 (100%) | 53/60 (88.3%) | 0.182 |
Pneumonia (%) | 21/23 (91.3%) | 36/60 (60%) | 0.007 |
ARDS (%) | 10/23 (43.5%) | 0/60 (0%) | <0.001 |
Massive pleural effusion (%) | 1/23 (4.3%) | 4/60 (6.7%) | 1.000 |
28-day mortality (%) | 19/23 (82.6%) | 17/60 (28.3%) | <0.001 |
Parameter | Beta Coefficient | Standard Error | Odds Ratios (95%CI) | p |
---|---|---|---|---|
Univariate logistic regression | ||||
Age (years) | −0.002 | 0.017 | 0.998 (0.965–1.031) | 0.883 |
Sex (M/F) | 0.097 | 0.651 | 1.102 (0.308–3.945) | 0.881 |
MAP D2 (mmHg) | −0.019 | 0.015 | 0.981 (0.953–1.010) | 0.191 |
Albumin D2 (g/dL) | 0.036 | 0.484 | 1.036 (0.401–2.678) | 0.941 |
Bilirubin D2 (mg/dL) | 0.095 | 0.033 | 1.100 (1.032–1.173) | 0.003 |
INR D2 | 1.221 | 0.412 | 3.390 (1.512–7.603) | 0.003 |
Hepatic encephalopathy | 0.616 | 0.476 | 1.852 (0.728–4.712) | 0.196 |
Ascites | −0.598 | 0.585 | 0.550 (0.175–1.730) | 0.307 |
Serum creatinine D2 (mg/dL) | 0.100 | 0.109 | 1.105 (0.892–1.369) | 0.359 |
Sodium D2 (mEq/L) | 0.034 | 0.029 | 1.035 (0.977–1.096) | 0.244 |
Potasium D2 (mEq/L) | 0.450 | 0.254 | 1.568 (0.953–2.581) | 0.077 |
aEVLWI D2 (mL/kg) | 0.103 | 0.035 | 1.109 (1.034–1.188) | 0.004 |
pEVLWI D2 (mL/kg) | 0.078 | 0.030 | 1.081 (1.019–1.147) | 0.009 |
PVPI D2 | 0.556 | 0.206 | 1.743 (1.163–2.612) | 0.007 |
Child–Pugh score D2 | 0.311 | 0.123 | 1.365 (1.072–1.738) | 0.012 |
APACHE II D2 | 0.146 | 0.044 | 1.157 (1.061–1.262) | 0.001 |
MELD D2 | 0.120 | 0.035 | 1.127 (1.051–1.208) | 0.001 |
CRP D2 (mg/L) | −0.003 | 0.003 | 0.997 (0.990–1.004) | 0.344 |
PCT D2 (ng/mL) | −0.012 | 0.015 | 0.988 (0.960–1.018) | 0.429 |
Lactate D2 (mg/dL) | 0.018 | 0.007 | 1.018 (1.005–1.032) | 0.006 |
Multivariate logistic regression (Model 1) | ||||
PVPI D2 | 0.561 | 0.221 | 1.753 (1.136–2.704) | 0.011 |
Bilirubin D2 (mg/dL) | 0.136 | 0.051 | 1.146 (1.036–1.268) | 0.008 |
Lactate D2 (mg/dL) | 0.017 | 0.007 | 1.017 (1.004–1.030) | 0.010 |
Multivariate logistic regression (Model 2) | ||||
pEVLWI D2 | 0.093 | 0.037 | 1.098 (1.020–1.181) | 0.012 |
Bilirubin D2 (mg/dL) | 0.124 | 0.050 | 1.133 (1.027–1.249) | 0.012 |
Lactate D2 (mg/dL) | 0.019 | 0.007 | 1.019 (1.005–1.033) | 0.007 |
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2024 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Share and Cite
Peng, K.-W.; Chang, M.-L.; Chien, R.-N.; Chen, Y.-C.; Tian, Y.-C.; Peng, Y.-S.; Huang, H.-C.; Fang, J.-T.; Lee, F.-Y.; Yang, C.-W.; et al. Pulmonary Vascular Permeability and Extravascular Lung Water Index in Patients with Liver Cirrhosis and Septic Shock. J. Clin. Med. 2024, 13, 3796. https://doi.org/10.3390/jcm13133796
Peng K-W, Chang M-L, Chien R-N, Chen Y-C, Tian Y-C, Peng Y-S, Huang H-C, Fang J-T, Lee F-Y, Yang C-W, et al. Pulmonary Vascular Permeability and Extravascular Lung Water Index in Patients with Liver Cirrhosis and Septic Shock. Journal of Clinical Medicine. 2024; 13(13):3796. https://doi.org/10.3390/jcm13133796
Chicago/Turabian StylePeng, Kang-Wei, Ming-Ling Chang, Rong-Nan Chien, Yung-Chang Chen, Ya-Chung Tian, Yun-Shing Peng, Hui-Chun Huang, Ji-Tseng Fang, Fa-Yauh Lee, Chih-Wei Yang, and et al. 2024. "Pulmonary Vascular Permeability and Extravascular Lung Water Index in Patients with Liver Cirrhosis and Septic Shock" Journal of Clinical Medicine 13, no. 13: 3796. https://doi.org/10.3390/jcm13133796
APA StylePeng, K.-W., Chang, M.-L., Chien, R.-N., Chen, Y.-C., Tian, Y.-C., Peng, Y.-S., Huang, H.-C., Fang, J.-T., Lee, F.-Y., Yang, C.-W., & Tsai, M.-H. (2024). Pulmonary Vascular Permeability and Extravascular Lung Water Index in Patients with Liver Cirrhosis and Septic Shock. Journal of Clinical Medicine, 13(13), 3796. https://doi.org/10.3390/jcm13133796