Next Article in Journal
Synthesizing Electronic Health Records for Predictive Models in Low-Middle-Income Countries (LMICs)
Next Article in Special Issue
The Microbiological Burden of Short-Term Catheter Reuse in Individuals with Spinal Cord Injury: A Prospective Study
Previous Article in Journal
Pathophysiology of Work-Related Neuropathies
Previous Article in Special Issue
Prediction of Lower Urinary Tract, Sexual, and Bowel Function, and Autonomic Dysreflexia after Spinal Cord Injury
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Urodynamics Are Essential to Predict the Risk for Upper Urinary Tract Damage after Acute Spinal Cord Injury

1
Department of Neuro-Urology, Balgrist University Hospital, University of Zürich, 8008 Zürich, Switzerland
2
Swiss Paraplegic Research, 6207 Nottwil, Switzerland
3
Department of Health Sciences and Medicine, University of Lucerne, 6002 Lucerne, Switzerland
4
Department of Urology, Cantonal Hospital Lucerne, 6000 Lucerne, Switzerland
5
Department of Urology, Cantonal Hospital Aarau, 5001 Aarau, Switzerland
6
Department of Neuro-Urology, Clinic for Urology, University Hospital Bonn, 53127 Bonn, Germany
7
Department of Urology, Winterthur Cantonal Hospital, 8400 Winterthur, Switzerland
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
These authors contributed equally to this work (Shared senior author).
Biomedicines 2023, 11(6), 1748; https://doi.org/10.3390/biomedicines11061748
Submission received: 24 May 2023 / Revised: 12 June 2023 / Accepted: 15 June 2023 / Published: 17 June 2023
(This article belongs to the Special Issue Bench to Bedside in Neuro-Urology)

Abstract

:
We used clinical parameters to develop a prediction model for the occurrence of urodynamic risk factors for upper urinary tract (UUT) damage during the first year after acute spinal cord injury (SCI). A total of 97 patients underwent urodynamic investigation at 1, 3, 6, and 12 months after acute SCI, within the framework of a population-based longitudinal study at a single university SCI center. Candidate predictors included demographic characteristics and neurological and functional statuses 1 month after SCI. Outcomes included urodynamic risk factors for UUT damage: detrusor overactivity combined with detrusor sphincter dyssynergia, maximum storage detrusor pressure (pDetmax) ≥ 40 cmH2O, bladder compliance < 20 mL/cmH2O, and vesicoureteral reflux. Multivariable logistic regression was used for the prediction model development and internal validation, using the area under the receiver operating curve (aROC) to assess model discrimination. Two models showed fair discrimination for pDetmax ≥ 40 cmH2O: (i) upper extremity motor score and sex, aROC 0.79 (95% CI: 0.69–0.89), C-statistic 0.78 (95% CI: 0.69–0.87), and (ii) neurological level, American Spinal Injury Association Impairment Scale grade, and sex, aROC 0.78 (95% CI: 0.68–0.89), C-statistic 0.76 (95% CI: 0.68–0.85). We identified two models that provided fair predictive values for urodynamic risk factors of UUT damage during the first year after SCI. Pending external validation, these models may be useful for clinical trial planning, although less so for individual-level patient management. Therefore, urodynamics remains essential for reliably identifying patients at risk of UUT damage.

1. Introduction

One of the most frequent sequelae of spinal cord injury (SCI) is neurogenic lower urinary tract dysfunction (NLUTD), which represents a considerable social and economic burden [1,2,3]. NLUTD is associated with urological morbidity, such as urosepsis, urinary incontinence, and the risk of deteriorating renal function and has a significant negative impact on health-related quality of life [1,2]. Consequently, recovery of bladder function is often identified as one of the top priorities in patients with SCI [4]. Due to the potential for changes in neurological and lower urinary tract (LUT) function during the first year after SCI, neuro-urological management aims to maintain or improve upper urinary tract (UUT) and LUT function and to identify and treat patients with risk factors for urological morbidity [5]. In order to achieve these aims, emphasis is placed on ensuring efficient bladder emptying and maintaining safe storage pressures [5]. There is an established body of evidence indicating that high maximum detrusor pressure (pDetmax), ≥40 cmH2O, during the storage phase is a key risk factor for UUT complications and renal failure [6,7,8,9]. The gold standard to assess LUT symptoms, evaluate and monitor LUT function and storage pressures, identify patients with a risk for UUT deterioration, and also to guide and monitor treatment, is video-urodynamic investigation [2,10]. However, urodynamic investigation (UDI) is perceived to have some disadvantages: it is relatively invasive, it requires specialized equipment and expertise, and it is associated with high financial costs [11].
Prognostic models for urological outcomes could support clinical decision-making, thereby promoting stratified management [12], and potentially reducing the dependence on UDIs. The prediction of future outcomes provided by prognostic models also can support patient counseling and planning, as well as allow for patient stratification in randomized controlled trials [12]. A simple model using lower extremity motor score (LEMS), a clinical parameter derived from International Standards for Neurological Classification of Spinal Cord Injury (ISNCSCI) assessments, was proposed by the European Multicenter Study on Spinal Cord Injury (EMSCI) study group to predict urinary continence and complete bladder emptying 1 year after a traumatic SCI [13]. This predictive model was validated using external data from the National SCI Database (NSCID, Birmingham, AL USA) [14]. Currently, there are no prognostic models to identify patients with an acute SCI who are at elevated risk of upper urinary tract damage. As early identification of such patients is essential for proactive and individualized urological management within the first year after SCI, we aimed to develop a clinical prediction model for established urodynamic risk factors for urological morbidity, i.e., detrusor overactivity combined with detrusor sphincter dyssynergia (DO–DSD), pDetmax ≥ 40 cmH2O during the storage phase, bladder compliance < 20 mL/cmH2O, and vesicoureteral reflux (VUR).

2. Materials and Methods

2.1. Patients

This patient cohort and its urological evaluation and management have previously been described in detail [15,16]. The population is composed of patients that participated in the prospective, longitudinal, and population-based EMSCI study (www.emsci.org (accessed on 23 May 2023)) between January 2014 and December 2019 and underwent video-UDI at a SCI-specialized university hospital in Switzerland. Inclusion criteria were patients aged ≥ 18, with an acute SCI from a single traumatic or ischemic event, who had their first neurological assessment within 40 days after a SCI. Exclusion criteria were a severe craniocerebral injury or cognitive impairment, polyneuropathy, or pre-existing dementia. The participants underwent assessments at 1 month (days 16–40), 3 months (days 70–98), 6 months (days 150–186), and 12 months (days 300–546) after SCI. Written informed consent was obtained from all participants and the local ethics committee (PB_2016-00293, EK-03/2004) approved the study.

2.2. Neuro-Urological Evaluation and Management

Neuro-urological assessments were performed as described previously [1]. Video-UDI was conducted according to the International Continence Society (ICS) recommendation on good urodynamic practice [17], preferably in a sitting position, using a multichannel urodynamic system, as same-session repeat filling cystometry and pressure flow study. ICS recommendations for definitions, methods, and units were applied [18]. In order to minimize the risk of assessor bias, all UDIs were randomly assigned to two expert neuro-urologists for evaluation on a per-patient basis [16]. Urological management was in line with the European Association of Urology (EAU) Guidelines on Neuro-Urology [2], and a table describing the bladder emptying method and use of medications with a potential effect on the bladder at each timepoint can be found in a previous open access publication from our group [15].

2.3. Predictive Measures

The Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis (TRIPOD) statement was used to guide model development and reporting [19]. Generally, prognostic modeling approaches focus on identifying the combination of independent factors that most accurately predicts which patients will experience the outcome of interest [12,19]. In this case, the outcomes of interest were the unfavorable urodynamic parameters: DO–DSD, pDetmax ≥ 40 cmH2O during the storage phase, bladder compliance < 20 mL/cmH2O, and VUR. As this dataset contains a relatively small number of subjects, an evidence-based strategy was used to select a limited number of candidate predictors, as opposed to relying on data-driven procedures for model selection. Values for predictors were taken from the one-month post-SCI timepoint to allow for early identification of high-risk patients. Candidate predictors included demographic characteristics (age and sex), and commonly used measures for neurological status, and functional independence. In particular, predictors from the EMSCI models [13] were examined (in the results reported as models 1 and 2), as it would be ideal to have a common prognostic model that provides an excellent prediction of an elevated risk of upper urinary tract damage, in addition to urinary continence and complete bladder emptying. Furthermore, predictors previously identified as potentially relevant using this dataset were included in the current analysis [16]. Predictors that might be subject to external influences one month after SCI, such as acute care referral patterns, were not included as candidates (e.g., bladder emptying method). Neurological and functional evaluation used the ISNCSCI [20] and the Spinal Cord Independence Measure Version III (SCIM III) [21] assessments. The ISNCSCI provided data on a neurological level, SCI severity (American Spinal Injury Association Impairment Scale (AIS) grade), upper extremity motor score (UEMS), LEMS, and light-touch scores [20]. The SCIM assesses functional independence in patients with SCI and is divided into three subdomains: self-care, respiration, and sphincter management and mobility [21].

2.4. Statistical Analyses

Univariable testing included Chi-squared and Fisher’s exact tests for categorical variables and nonparametric tests (Kruskal–Wallis) for continuous variables, as all had non-normal distributions. Logistic regression models were used to evaluate candidate predictors of storage, pDetmax ≥ 40 cmH2O. Further analysis based on logistic regression modeling was not applied to DO–DSD, VUR, or any unfavorable urodynamic parameter due to the presence of complete or quasi-complete separation (i.e., less than two patients were ascribed to a given outcome category for any categorical variable including sex, AIS grade, and neurological level). Model discrimination was evaluated using the area under the receiver operating characteristic curve (aROC). AIS grades B and C were combined to provide stable estimates due to the small number of subjects in these categories; this category combination was based on the cross-tabulation of AIS grade against the outcome of interest, with post hoc likelihood ratio tests used for confirmation. For continuous variables (age, UEMS, LEMS, SCIM respiration, and sphincter management subscale), the statistical support for a nonlinear relationship was also evaluated using multivariable fractional polynomials [22]. For model selection, candidate predictors were examined individually and in combination using logistic regression models with a visual inspection of the ROC curves, along with supplementary Lasso regression to confirm the variable selection and account for multicollinearity. Internal validation was performed using a bootstrapping approach (1000 iterations) [23], optimism-corrected C-statistics were used to evaluate model discrimination, the scale Brier score was used to indicate overall model performance, and the expected-to-observed ratio was used to assess model calibration [24].
To evaluate the prognostic discrimination of the models (as opposed to cross-sectional prediction), additional regression analyses were performed, which only included patients who had not already reached the endpoint (pDetmax ≥ 40 cmH2O) at the 1-month follow-up. The primary analyses used results derived from models implementing multiple imputations (MIs) with chained equations to account for missing data [25,26]. Sensitivity analysis additionally accounted for loss-to-UDI-follow-up and included models with inverse probability weights (IPWs), as well as an “informed” imputation model based on further information from the clinical record—usually clinical visits without UDI (see Supplementary Material: Part S1a.-c., Table S1, and Figure S1 for missing data methodology). A final sensitivity analysis was run to test the performance of the models using a different outcome—pDetmax ≥ 40 cmH2O or the use of antimuscarinics within the first year after SCI. This extreme scenario gives insight into the generalizability of these models to contexts where access to treatment is limited or not as timely. Statistical analyses were performed in Stata (versions 16.1 and 17.0, College Station, TX, USA).

3. Results

3.1. Study Population and Prevalence of Unfavorable Urodynamic Parameters

The study population consisted of 97 patients who underwent at least 1 UDI after an acute SCI, of whom 73 (75%) returned for 12-month assessments. Of the 24 patients who were lost-to-UDI follow-up before the 12-month UDI, 4 patients declined further care, 8 were transferred to another clinic, 3 died, and for 9, the reason was unclear. Patient characteristics are shown stratified, according to the 12-month follow-up status in Table 1. In the univariable analysis, none of the candidate predictors were associated with a missed 12-month follow-up assessment; however, a missed 12-month assessment was associated with DO–DSD, pDetmax ≥ 40 cmH2O, and the occurrence of any unfavorable urodynamic parameter. Table 2 presents the results for DO–DSD, storage pDetmax ≥ 40 cmH2O, VUR, and any unfavorable urodynamics parameter within the first year after a SCI, stratified, according to the predictor variables. As the prevalence of DO–DSD, and by extension any unfavorable UDI parameter, was very high, the prevalence of VUR was very low, and there were no cases of bladder compliance < 20 mL/cmH2O; thus, the remaining prognostic modeling analyses focused on the pDetmax ≥ 40 cmH2O outcome.
In total, 38/97 patients (39%) had a pDetmax ≥ 40 cmH2O within one year after SCI, and 55% of these patients (21/38) already had reached this endpoint at the 1-month UDI (n = 7 missed the 1-month UDI). A total of 61 patients were treated with antimuscarinics during the first year after SCI, 29 of whom did not develop pDetmax ≥ 40 cmH2O. None of the patients were using antimuscarinics, beta-3 adrenergic agonists, or onabotulinumtoxinA at the time of the 1-month UDI. An ‘informed’ outcome status was derived for 13/20 patients who were lost to follow-up without reaching the outcome for use in the sensitivity analysis (Supplement S1c.). Most of the informed loss-to-follow-up cases (12/13) were clinically judged to have a low risk of developing pDetmax ≥ 40 cmH2O.

3.2. Model Performance and Internal Validation

Model 1 used LEMS as the sole predictor [13]. The multiple imputation model with all observations (n = 97) did not provide adequate discrimination, with an aROC value of 0.53 (95% CI: 0.40–0.66) (Figure 1, Table S2), nor did the model excluding the 21 patients who had already reached a pDetmax ≥ 40 cmH2O at the one-month time-point (n = 76), aROC 0.57 (95% CI: 0.41–0.75). Model 2 (LEMS, highest light touch score in the S3 dermatome, and the SCIM respiratory–sphincter subscale) [13] also resulted in poor discrimination, aROC 0.65 (0.52–0.78) (Figure 1, Table S2). Full logistic regression results (adjusted odds ratios) from models 1–4 are presented in Supplementary Table S3.
A model that included UEMS and sex (model 3) showed fair discrimination, aROC 0.79 (95% CI: 0.69–0.89); further, observations that already had a pDetmax ≥ 40 cmH2O at the first measurement were excluded 0.73 (95% CI: 0.60–0.86) (Figure 1, Table S2). Internal validation resulted in an optimism–corrected C-statistic of 0.78 (95% CI: 0.69–0.87), the scaled Brier score was 22.3%, and the expected-to-observed ratio was 0.997. Similarly, a model that included neurological level, AIS grade one month after SCI, and sex (model 4), showed fair discrimination, aROC 0.78 (95% CI: 0.68–0.89), and remained in the fair range after excluding the observations, which had already reached the endpoint at baseline aROC 0.73 (0.60–0.87) (Figure 1, Table S2). Internal validation resulted in a C-statistic of 0.76 (95% CI: 0.68–0.85), a scaled Brier score of 17.3%, and an expected-to-observed ratio of 0.995. The predicted probability of reaching the outcome according to models 3 and 4 is displayed in Figure 2, full logistic regression results are presented in the Supplementary documents (Table S3).
The most commonly selected model using the data-driven approach, Lasso regression, included sex, UEMS, and AIS grade and showed good discrimination with an aROC of 0.80 (95% CI: 0.70–0.90). However, internal validation revealed that the optimism–corrected C-statistic was 0.78 (95% CI: 0.69–0.87), the scaled Brier score was 21.7%, and the expected-to-observed ratio was 0.997, indicating that this model also provides ‘fair’ performance in the current dataset.

3.3. Sensitivity Analyses

Sensitivity analyses using complete cases analysis, IPWs and ‘informed’ outcome assignments yielded similar results to the primary analyses in terms of model discrimination (Table S2). Further sensitivity analyses investigating the discrimination of the four models for the outcome pDetmax ≥ 40 cmH2O or starting antimuscarinics within the first year after SCI resulted in very similar aROC values and confidence intervals (Supplementary Material: Table S4 (regression output) and Table S5 (aROC results)).

4. Discussion

4.1. Main Findings

We aimed to develop a clinical model to predict the occurrence of urodynamic risk factors for UUT damage within the first year after SCI. While LEMS is highly predictive of urinary incontinence and complete bladder emptying one year after SCI [13], it did not adequately predict the pDetmax ≥ 40 cmH2O outcome. We identified two potential prognostic models based on the noninvasive, inexpensive, clinical routine ISNCSCI assessment: (i) UEMS and sex; (ii) neurological level, AIS grade, and sex. However, both models showed only a ‘fair’ predictive performance.

4.2. Findings in the Context of Existing Evidence

Timely identification of urodynamic risk factors, especially high pDetmax (≥ 40 cmH2O) during the storage phase, which allows the consecutive initiation of antimuscarinic therapy as a first-line treatment, is a cornerstone of urological management after SCI [5]. A reliable prognostic model could play a critical role in targeting patients who are likely to need intervention [12]. However, to the best of our knowledge, no such models currently exist. The need for an early-phase prognostic model is highlighted by recent studies using the current patient cohort, whereby a study found that 39% of the patients exhibited pDetmax ≥ 40 cmH2O within the first year after a SCI [15]. High storage pDetmax (≥40 cmH2O) was first identified, during a UDI performed 1 or 3 months after SCI, in 82% of the affected patients [16]. Of note, in the first year after a SCI, none of the patients in this cohort developed a low-compliance bladder [15,16]. Whether this is due to the treatment based on urodynamic findings or the short follow-up period could be addressed in future research. Furthermore, research that focuses on preventing the development of NLUTD after SCI gained importance during the last decade. Pilot studies in patients with acute SCI have shown that early bilateral sacral neuromodulation and transcutaneous tibial nerve stimulation potentially prevent the development of neurogenic detrusor overactivity (DO) and urinary incontinence [27], and higher detrusor pressure [28], respectively. These pilot studies served as a foundation for larger clinical trials aiming to conclusively evaluate the effect of early sacral neuromodulation [29] and transcutaneous tibial nerve stimulation [30] on the prevention of neurogenic DO. While the EMSCI LEMS models were found to be highly predictive of urinary continence and complete bladder emptying at one year after an acute SCI [13,14], based on the current results, we cannot recommend their use for identifying patients at risk of high pDetmax during the storage phase.

4.3. Implications—Practice

Optimization of patient counseling and patient-tailored urological management could be facilitated by a prognostic model that identifies patients with risk factors for UUT damage. Currently, there are no guidelines for a standardized UDI follow-up schedule during the first year after a SCI, although a UDI is considered the gold standard to objectively assess LUT function and to identify urodynamic risk factors that are associated with long-term urological complications and morbidity and represent a risk of UUT deterioration [2,5,6,7,8,9]. In the present study, we utilized a standardized UDI follow-up schedule consisting of a UDI at four predefined timepoints after a SCI; however, the UDI availability was limited in some settings. Our results indicate that males, persons with lower UEMS, cervical SCI, and AIS grades A, B, and C SCIs might potentially need more frequent UDI follow-ups after a SCI since they are at higher risk of high storage pDetmax and/or need antimuscarinic treatment. Therefore, management of these high-risk patients in specialized centers is highly warranted. As the models reported here only provide fair prediction, they do not provide sufficient information for individual-level patient diagnosis. Even in the model for volitional voiding proposed by the EMSCI group with excellent prediction [13], there was a substantial proportion of patients (17%) with a LEMS of 50 who could not void volitionally, while 1.5% of those with a LEMS of 0 could void volitionally [14]. These findings highlight the importance of UDIs to objectively assess LUT function, and consequently, counsel patients.

4.4. Implications—Research

One important application of prognostic models is for risk stratification in clinical trials, especially in fields such as SCI, with limited patient numbers, whereby such models can improve the study design and analysis of clinical trials [12]. An especially important direction for future research would be an investigation into the predictive value of the 1-month UDI.

4.5. Strengths and Limitations

To the best of our knowledge, this is the first attempt to produce a prognostic model for the occurrence of urodynamic risk factors of UUT damage after a SCI. In the current study, the urodynamic investigations took place irrespective of the spinal shock status. This is in contrast to some guidelines that recommend performing UDIs after the resolution of spinal shock [10,31] since the detrusor might present with hypocontractility or acontractility during the spinal shock phase. However, early investigations can be beneficial since the duration of the spinal shock period is not well defined [5], and during the early phase after SCI, a high percentage of patients already show unfavorable urodynamic parameters [15,32]. Although the standardized UDI schedule identified more patients with the outcomes during the first year after SCI compared to what has previously been described in the literature, loss-to-follow-up and symptom-based antimuscarinic treatment could still lead to an overall underestimation of risk. However, sensitivity analyses showed that model performance was similar when persons who had antimuscarinics were also included. Moreover, loss-to-follow-up could lead to misleading results regarding the predictive power of the candidate predictors and suggests that the missing at random assumption underlying multiple imputations is unlikely to be fulfilled. However, the ‘informed’ sensitivity analyses with outcomes assigned based on further data from the clinical record, indicated that the modeling results are robust, in regard to loss-to-follow-up. Additionally, the study used the established cut-off for the risk of UUT deterioration of a storage pDetmax ≥ 40 cmH2O [6], although in the SCI population, evidence for this cut-off value is limited and contradictory, implying this cut-off might be too low [33] or too high [34]. Furthermore, no further specification of the type of neurogenic DO (phasic, terminal, compound, or sustained DO) or the quantification of DO (for example, measurement of the area under the curve or the DO index) [35] was utilized. However, these concepts harbor limitations and are, therefore, not implemented as standard in most neuro-urological units because current software to measure the area under the curve cannot exclude artifacts in urodynamic traces, while for the DO index, no standardized values are available [35]. A major limitation of this study was the small sample size, which precluded a thorough investigation of many of the targeted outcomes. Furthermore, it was not possible to include lag effects and change scores, despite the fact that clinical management is in the context of time-updated information. Finally, especially considering that a large proportion of the population already reached the outcomes at the first UDI timepoint, this study was not adequately powered to investigate the predictive value of the UDI findings from the 1-month timepoint.

5. Conclusions

Our study identified two clinical models that provided a fair, yet insufficient, prediction of the occurrence of high pDetmax (≥40 cmH2O) during the storage phase using data from routine neurological assessments of patients with SCI. We also showed that LEMS is not an adequate predictor of high storage pDetmax. Further prognostic model development research is warranted, as such models provide important support for the optimization of clinical practice, including patient consultations and planning. Models using sex, UEMS, SCI severity, and neurological level might provide adequate prognostic values for high storage pDetmax, to improve the design and analysis of clinical trials, provided that they can first be validated with an external dataset. Therefore, UDI remains an essential tool for the identification of patients with acute SCI and at risk of UUT deterioration due to high detrusor pressures during the storage phase.

Supplementary Materials

The following supporting information can be downloaded at: https://www.mdpi.com/article/10.3390/biomedicines11061748/s1, Table S1: Missing data in variables selected for imputation; Figure S1: Histograms showing the distribution of propensity scores for persons who missed the 12-month follow-up and persons who returned for 12-month follow-up; Table S2: Model performance—area under the receiver operating characteristic curve (aROC), using four different strategies to account for loss-to-follow-up; Table S3: Predictors of maximum detrusor pressure during the storage phase (pDetmax) ≥ 40 cmH2O during the first year after SCI; Table S4: Sensitivity analysis: Predictors of maximum detrusor pressure during the storage phase (pDetmax) ≥ 40 cmH2O or antimuscarinic use during the first year after SCI; Table S5: Sensitivity analysis: Model testing—area under the receiver operating characteristic curve (aROC) for maximum detrusor pressure during the storage phase (pDetmax) ≥ 40 cmH2O, or antimuscarinic use.

Author Contributions

Study conception and design: V.B., C.E.A., M.K. (Marko Kozomara), M.D.L., M.W.G.B., T.M.K.; Data collection: V.B., M.B., O.G., S.K., S.C.K., M.K. (Miriam Koschorke), L.L., U.M., H.S., U.S., L.S., J.T.; Analysis of urodynamic investigation: V.B., M.K. (Marko Kozomara); Statistical analysis: C.E.A., M.W.G.B.; Interpretation of the data: V.B., C.E.A., M.K. (Marko Kozomara), M.B., O.G., S.K., S.C.K., M.K. (Miriam Koschorke), L.L., U.M., H.S., U.S., L.S., J.T., M.D.L., M.W.G.B., T.M.K.; Drafting the manuscript: V.B., C.E.A.; with support from M.K. (Marko Kozomara), M.W.G.B., T.M.K.; Critical revision of the manuscript: V.B., C.E.A., M.K. (Marko Kozomara), M.B., O.G., S.K., S.C.K., M.K. (Miriam Koschorke), L.L., U.M., H.S., U.S., L.S., J.T., M.D.L., M.W.G.B., T.M.K. All authors have read and agreed to the published version of the manuscript.

Funding

This research was supported by the Swiss National Science Foundation (SNSF, 179644; Veronika Birkhäuser, Collene E. Anderson, Miriam Koschorke, Martina D. Liechti, Martin W.G. Brinkhof, Thomas M. Kessler).

Institutional Review Board Statement

The study was conducted in accordance with the Declaration of Helsinki and approved by the local ethics committee, Zürich Cantonal Ethics Committee (PB_2016-00293, EK-03/2004) on 22 April 2004.

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this article are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest. The funding body did not play a role in the design of the study, the analysis and interpretation of data or in writing the manuscript.

References

  1. Panicker, J.N.; Fowler, C.J.; Kessler, T.M. Lower urinary tract dysfunction in the neurological patient: Clinical assessment and management. Lancet Neurol. 2015, 14, 720–732. [Google Scholar] [CrossRef]
  2. Groen, J.; Pannek, J.; Diaz, D.C.; Del Popolo, G.; Gross, T.; Hamid, R.; Karsenty, G.; Kessler, T.M.; Schneider, M.; Blok, B. Summary of European Association of Urology (EAU) guidelines on neuro-urology. Eur. Urol. 2016, 69, 324–333. [Google Scholar] [CrossRef]
  3. Ma, V.Y.; Chan, L.; Carruthers, K.J. Incidence, prevalence, costs, and impact on disability of common conditions requiring rehabilitation in the United States: Stroke, spinal cord injury, traumatic brain injury, multiple sclerosis, osteoarthritis, rheumatoid arthritis, limb loss, and back pain. Arch. Phys. Med. Rehabil. 2014, 95, 986–995. [Google Scholar]
  4. Simpson, L.A.; Eng, J.J.; Hsieh, J.T.; Wolfe, D.L.; Spinal Cord Injury Rehabilitation Evidence Scire Research Team. The health and life priorities of individuals with spinal cord injury: A systematic review. J. Neurotrauma 2012, 29, 1548–1555. [Google Scholar]
  5. Welk, B.; Schneider, M.P.; Thavaseelan, J.; Traini, L.R.; Curt, A.; Kessler, T.M. Early urological care of patients with spinal cord injury. World J. Urol. 2018, 36, 1537–1544. [Google Scholar] [CrossRef]
  6. McGuire, E.J.; Woodside, J.R.; Borden, T.A.; Weiss, R.M. Prognostic value of urodynamic testing in myelodysplastic patients. J. Urol. 2002, 167 Pt 2, 1049–1053. [Google Scholar] [CrossRef]
  7. Shin, J.C.; Lee, Y.; Yang, H.; Kim, D.H. Clinical significance of urodynamic study parameters in maintenance of renal function in spinal cord injury patients. Ann. Rehabil. Med. 2014, 38, 353–359. [Google Scholar] [CrossRef]
  8. Shingleton, W.B.; Bodner, D.R. The development of urologic complications in relationship to bladder pressure in spinal cord injured patients. J. Am. Paraplegia Soc. 1993, 16, 14–17. [Google Scholar] [CrossRef]
  9. Lawrenson, R.; Wyndaele, J.J.; Vlachonikolis, I.; Farmer, C.; Glickman, S. Renal failure in patients with neurogenic lower urinary tract dysfunction. Neuroepidemiology 2001, 20, 138–143. [Google Scholar] [CrossRef]
  10. Ginsberg, D.A.; Boone, T.B.; Cameron, A.P.; Gousse, A.; Kaufman, M.R.; Keays, E.; Kennelly, M.J.; Lemack, G.E.; Rovner, E.S.; Souter, L.H.; et al. The AUA/SUFU guideline on adult neurogenic lower urinary tract dysfunction: Diagnosis and evaluation. J. Urol. 2021, 206, 1097–1105. [Google Scholar] [CrossRef]
  11. Abedi, A.; Sayegh, A.S.; Ha, N.T.; La Riva, A.; Perez, L.C.; Kohli, P.; Abedi, A.; Jen, R.P.; Ginsberg, D.A.; Kreydin, E.I. Health care economic burden of treatment and rehabilitation for neurogenic lower urinary tract dysfunction: A systematic review. J. Urol. 2022, 208, 773–783. [Google Scholar] [CrossRef]
  12. Steyerberg, E.W.; Moons, K.G.; van der Windt, D.A.; Hayden, J.A.; Perel, P.; Schroter, S.; Riley, R.D.; Hemingway, H.; Altman, D.G.; PROGRESS Group. Prognosis Research Strategy (PROGRESS) 3: Prognostic model research. PLoS Med. 2013, 10, e1001381. [Google Scholar] [CrossRef] [Green Version]
  13. Pavese, C.; Schneider, M.P.; Schubert, M.; Curt, A.; Scivoletto, G.; Finazzi-Agrò, E.; Mehnert, U.; Maier, D.; Abel, R.; Röhrich, F.; et al. Prediction of bladder outcomes after traumatic spinal cord injury: A longitudinal cohort study. PLoS Med. 2016, 13, e1002041. [Google Scholar] [CrossRef] [Green Version]
  14. Elliott, C.S.; Dallas, K.B.; Zlatev, D.; Comiter, C.V.; Crew, J.; Shem, K. Volitional voiding of the bladder after spinal cord injury: Validation of bilateral lower extremity motor function as a key predictor. J. Urol. 2018, 200, 154–160. [Google Scholar] [CrossRef]
  15. Kozomara, M.; Birkhäuser, V.; Anderson, C.E.; Bywater, M.; Gross, O.; Kiss, S.; Knüpfer, S.C.; Koschorke, M.; Leitner, L.; Mehnert, U.; et al. Neurogenic Lower Urinary Tract Dysfunction in the First Year After Spinal Cord Injury: A Descriptive Study of Urodynamic Findings. J. Urol. 2023, 209, 225–232. [Google Scholar] [CrossRef]
  16. Anderson, C.E.; Kozomara, M.; Birkhäuser, V.; Bywater, M.; Gross, O.; Kiss, S.; Knüpfer, S.C.; Koschorke, M.; Leitner, L.; Mehnert, U.; et al. Temporal development of unfavourable urodynamic parameters during the first year after spinal cord injury. BJU Int. 2023, 131, 503–512. [Google Scholar] [CrossRef]
  17. Rosier, P.F.; Schaefer, W.; Lose, G.; Goldman, H.B.; Guralnick, M.; Eustice, S.; Dickinson, T.; Hashim, H. International Continence Society good urodynamic practices and terms 2016: Urodynamics, uroflowmetry, cystometry, and pressure-flow study. Neurourol. Urodyn. 2017, 36, 1243–1260. [Google Scholar] [CrossRef]
  18. Gajewski, J.B.; Schurch, B.; Hamid, R.; Averbeck, M.; Sakakibara, R.; Agrò, E.F.; Dickinson, T.; Payne, C.K.; Drake, M.J.; Haylen, B.T. An International Continence Society (ICS) report on the terminology for adult neurogenic lower urinary tract dysfunction (ANLUTD). Neurourol. Urodyn. 2018, 37, 1152–1161. [Google Scholar] [CrossRef]
  19. Collins, G.S.; Reitsma, J.B.; Altman, D.G.; Moons, K.G.M. Transparent Reporting of a Multivariable Prediction Model for Individual Prognosis or Diagnosis (TRIPOD): The TRIPOD Statement. Eur. Urol. 2015, 67, 1142–1151. [Google Scholar] [CrossRef] [Green Version]
  20. Krassioukov, A.; Biering-Sørensen, F.; Donovan, W.; Kennelly, M.; Kirshblum, S.; Krogh, K.; Alexander, M.S.; Vogel, L.; Wecht, J. International standards to document remaining autonomic function after spinal cord injury. J. Spinal. Cord. Med. 2012, 35, 201–210. [Google Scholar] [CrossRef] [Green Version]
  21. Catz, A.; Itzkovich, M.; Tesio, L.; Biering-Sorensen, F.; Weeks, C.; Laramee, M.T.; Craven, B.C.; Tonack, M.; Hitzig, S.L.; Glaser, E.; et al. A multicenter international study on the Spinal Cord Independence Measure, version III: Rasch psychometric validation. Spinal. Cord. 2007, 45, 275–291. [Google Scholar] [CrossRef]
  22. Royston, P.; Sauerbrei, W. Multivariable Model-Building. A Pragmatic Approach to Regression Analysis Based on Fractional Polynomials for Modelling Continous Variables; Wiley Series in Probability and Statistics; Wiley: Chichester, UK, 2008. [Google Scholar]
  23. Fernandez-Felix, B.; García-Esquinas, E.; Muriel, A.; Royuela, A.; Zamora, J. Bootstrap internal validation command for predictive logistic regression models. Stata J. 2021, 21, 498–509. [Google Scholar] [CrossRef]
  24. Steyerberg, E.W.; Vickers, A.J.; Cook, N.R.; Gerds, T.; Gonen, M.; Obuchowski, N.; Pencina, M.J.; Kattan, M.W. Assessing the performance of prediction models: A framework for traditional and novel measures. Epidemiology 2010, 21, 128–138. [Google Scholar] [CrossRef] [Green Version]
  25. Sterne, J.A.; White, I.R.; Carlin, J.B.; Spratt, M.; Royston, P.; Kenward, M.G.; Wood, A.M.; Carpenter, J.R. Multiple imputation for missing data in epidemiological and clinical research: Potential and pitfalls. BMJ 2009, 338, b2393. [Google Scholar] [CrossRef]
  26. Spratt, M.; Carpenter, J.; Sterne, J.A.; Carlin, J.B.; Heron, J.; Henderson, J.; Tilling, K. Strategies for multiple imputation in longitudinal studies. Am. J. Epidemiol. 2010, 172, 478–487. [Google Scholar] [CrossRef]
  27. Sievert, K.D.; Amend, B.; Gakis, G.; Toomey, P.; Badke, A.; Kaps, H.P.; Stenzl, A. Early sacral neuromodulation prevents urinary incontinence after complete spinal cord injury. Ann. Neurol. 2010, 67, 74–84. [Google Scholar] [CrossRef]
  28. Stampas, A.; Gustafson, K.; Korupolu, R.; Smith, C.; Zhu, L.; Li, S. Bladder neuromodulation in acute spinal cord injury via transcutaneous tibial nerve stimulation: Cystometrogram and autonomic nervous system evidence from a randomized control pilot trial. Front. Neurosci. 2019, 13, 119. [Google Scholar] [CrossRef]
  29. Redshaw, J.D.; Lenherr, S.M.; Elliott, S.P.; Stoffel, J.T.; Rosenbluth, J.P.; Presson, A.P.; Myers, J.B. Protocol for a randomized clinical trial investigating early sacral nerve stimulation as an adjunct to standard neurogenic bladder management following acute spinal cord injury. BMC Urol. 2018, 18, 72. [Google Scholar] [CrossRef]
  30. Birkhäuser, V.; Liechti, M.D.; Anderson, C.E.; Bachmann, L.M.; Baumann, S.; Baumberger, M.; Birder, L.A.; Botter, S.M.; Büeler, S.; Cruz, C.D.; et al. TASCI-transcutaneous tibial nerve stimulation in patients with acute spinal cord injury to prevent neurogenic detrusor overactivity: Protocol for a nationwide, randomised., sham-controlled, double-blind clinical trial. BMJ Open 2020, 10, e039164. [Google Scholar] [CrossRef]
  31. Kreydin, E.; Welk, B.; Chung, D.; Clemens, Q.; Yang, C.; Danforth, T.; Gousse, A.; Kielb, S.; Kraus, S.; Mangera, A.; et al. Surveillance and management of urologic complications after spinal cord injury. World J. Urol. 2018, 36, 1545–1553. [Google Scholar] [CrossRef]
  32. Bywater, M.; Tornic, J.; Mehnert, U.; Kessler, T.M. Detrusor Acontractility after Acute Spinal Cord Injury-Myth or Reality? J. Urol. 2018, 199, 1565–1570. [Google Scholar] [CrossRef]
  33. Çetinel, B.; Önal, B.; Can, G.; Talat, Z.; Erhan, B.; Gündüz, B. Risk factors predicting upper urinary tract deterioration in patients with spinal cord injury: A retrospective study. Neurourol. Urodyn. 2017, 36, 653–658. [Google Scholar] [CrossRef]
  34. Swatesutipun, V.; Tangpaitoon, T. The safety cutoff storage pressure for preventing upper urinary tract damage in neurogenic bladder from spinal cord pathology and risk factor analysis. Neurourol. Urodyn. 2022, 41, 991–1001. [Google Scholar] [CrossRef]
  35. Hashim, H.; Ellis-Jones, J.; Swithinbank, L.; Woodward, M.; Small, D.; Frank, J.D.; Abrams, P. Trying to predict ‘dangerous’ bladders in children: The area under the curve concept. J. Pediatr. Urol. 2005, 1, 343–347. [Google Scholar] [CrossRef]
Figure 1. Area under the receiver operating curve (aROC) for prediction of maximum detrusor pressure (pDetmax) during the storage phase ≥ 40 cmH2O. Top: Models 1(blue) and 2 (red): Including all observations (a); omitting observations that had pDetmax ≥ 40 cmH2O at baseline (1 month after SCI) (b); bottom: Models 3 (white) and 4 (black): Including all observations (c); omitting observations that had pDetmax ≥ 40 cmH2O at baseline (d). Model 1: lower extremity motor score (LEMS); model 2: LEMS, highest light touch score of the S3 dermatome, Spinal Cord Independence Measure (SCIM) III respiratory–sphincter subscale; model 3: upper extremity motor score (UEMS) and sex; model 4: neurological level, American Spinal Injury Association Impairment Scale (AIS) grade and sex. The green line indicates the random classifier level, aROC=0.50.
Figure 1. Area under the receiver operating curve (aROC) for prediction of maximum detrusor pressure (pDetmax) during the storage phase ≥ 40 cmH2O. Top: Models 1(blue) and 2 (red): Including all observations (a); omitting observations that had pDetmax ≥ 40 cmH2O at baseline (1 month after SCI) (b); bottom: Models 3 (white) and 4 (black): Including all observations (c); omitting observations that had pDetmax ≥ 40 cmH2O at baseline (d). Model 1: lower extremity motor score (LEMS); model 2: LEMS, highest light touch score of the S3 dermatome, Spinal Cord Independence Measure (SCIM) III respiratory–sphincter subscale; model 3: upper extremity motor score (UEMS) and sex; model 4: neurological level, American Spinal Injury Association Impairment Scale (AIS) grade and sex. The green line indicates the random classifier level, aROC=0.50.
Biomedicines 11 01748 g001
Figure 2. Predicted probability of maximum detrusor pressure (pDetmax) ≥ 40 cmH2O during the storage phase occurring in the first year after spinal cord injury (SCI), according to models 3 (a) and 4 (b). Both models showed fair discrimination (aROC 0.78–0.79). AIS: American Spinal Injury Association Impairment Scale (AIS) grade; UEMS: upper extremity motor score.
Figure 2. Predicted probability of maximum detrusor pressure (pDetmax) ≥ 40 cmH2O during the storage phase occurring in the first year after spinal cord injury (SCI), according to models 3 (a) and 4 (b). Both models showed fair discrimination (aROC 0.78–0.79). AIS: American Spinal Injury Association Impairment Scale (AIS) grade; UEMS: upper extremity motor score.
Biomedicines 11 01748 g002
Table 1. Characteristics of the study population, overall, and stratified according to the availability of a 12-month urodynamic investigation (UDI) follow-up. Baseline variables reflect patient status within 40 days of a spinal cord injury (SCI) and outcome variables indicate the observation of the respective urodynamic parameter at any timepoint within the 1st year after a SCI.
Table 1. Characteristics of the study population, overall, and stratified according to the availability of a 12-month urodynamic investigation (UDI) follow-up. Baseline variables reflect patient status within 40 days of a spinal cord injury (SCI) and outcome variables indicate the observation of the respective urodynamic parameter at any timepoint within the 1st year after a SCI.
Characteristic (% Missing)Overall
Population,
N = 97
12-Month UDI
Present,
N = 73
Missed 12-Month UDI,
N = 24
Baseline continuous variablesMedian
(Q1–Q3)
Median
(Q1–Q3)
Median
(Q1–Q3)
p-value
Age at SCI (0)57 (42–69)56 (45–69)60 (40–72)0.56
Lower extremity motor score (LEMS) (5)33 (1–48)32 (2–48)40 (0–47)0.98
Upper extremity motor score (UEMS) (5)50 (38–50)50 (41–50)50 (27–50)0.69
SCIM Score (2)36 (22–68)37 (22–74)31 (22–59)0.55
SCIM Respiratory-Sphincter Subscale (2)15 (12–25)15 (15–25)14 (10–25)0.32
Baseline categorical variablesn (%)n (%)n (%)p-value
Sex (0) 0.36
Female33 (34)23 (32)10 (42)
Male64 (66)50 (68)14 (58)
Lesion etiology (0) 0.17
Traumatic spinal cord injury75 (77)54 (74)21 (87)
Ischemic spinal cord injury22 (23)19 (26)3 (13)
Neurological Level (5) a 0.88
Cervical (C1–C8)43 (44)33 (45)10 (41)
Thoracic (T1–T12)37 (38)28 (38)9 (38)
Lumbar (L1–L5)17 (18)12 (17)5 (21)
SCI Severity (5) a 0.64
AIS A21 (22)18 (25)3 (13)
AIS B10 (10)7 (10)3 (13)
AIS C16 (16)12 (16)4 (16)
AIS D50 (52)36 (49)14 (58)
S3 light touch score (6) 0.45
Absent25 (26)21 (29)4 (17)
Altered 46 (47)33 (45)13 (54)
Normal20 (21)14 (19)6 (25)
Outcomevariablesn (%)n (%)n (%)p-value
DO–DSD (0) b <0.01
No12 (12)5 (7)7 (29)
Yes85 (88)68 (93)17 (71)
pDetmax ≥ 40 cmH2O (0) b <0.001
No59 (61)39 (53)20 (83)
Yes38 (39)34 (47)4 (17)
Vesicoureteral reflux (1) b 0.12
No89 (92)66 (90)23 (96)
Yes7 (7)7 (10)0 (0)
Any unfavorable UDI parameter (1) b <0.01
No9 (9)3 (4)6 (25)
Yes87 (90)70 (96)17 (71)
a When baseline data were missing, patients were assigned to a group based on information from the next testable timepoint; b indicating status at the time of loss-to-follow-up for individuals with missed 12-month UDIs. AIS: American Spinal Injury Association Impairment Scale grade: DO–DSD: detrusor overactivity with detrusor sphincter dyssynergia; pDetmax: maximum detrusor pressure (storage phase); S: sacral; SCIM: Spinal Cord Independence Measure Version III.
Table 2. Unfavorable urodynamic parameters stratified according to predictor characteristics. Bladder compliance < 20 mL/cmH2O did not occur among the patients in this dataset.
Table 2. Unfavorable urodynamic parameters stratified according to predictor characteristics. Bladder compliance < 20 mL/cmH2O did not occur among the patients in this dataset.
Characteristic (% Missing)No DO–DSDDO–DSD No pDetmax ≥ 40 cmH2OpDetmax
≥ 40 cmH2O
No VURVUR No Unfavorable UDI ParametersUnfavorable
UDI Parameters
Outcomen = 5n = 85 n = 39n = 38 n = 66n = 7 n = 3n = 87
Continuous variablesMedian
(Q1–Q3)
Median
(Q1–Q3)
p-valueMedian
(Q1–Q3)
Median
(Q1–Q3)
p-valueMedian
(Q1–Q3)
Median
(Q1–Q3)
p-valueMedian
(Q1–Q3)
Median
(Q1–Q3)
p-value
Age at SCI (0)35 (34–67)57 (47–71)0.3655 (36–71)57 (45–66)0.7356 (49–70)57 (32–69)0.9035 (34–67)57 (45–71)0.32
LEMS (5)28 (0–50)32 (2–47)0.9632 (5–48)25 (0–50)0.6733 (3–50)5 (0–16)0.05450 (0–50)31 (2–47)0.41
UEMS (5)48 (15–50)50 (36–50)0.4650 (47–50)45 (21–50)<0.0150 (39–50)50 (20–50)0.9250 (48–50)50 (35–50)0.43
SCIM Respiratory-Sphincter subscale (2)62 (21–96)34 (22–59)0.4238 (26–74)35 (14–68)0.2638 (23–74)27 (20–45)0.4592 (31–100)34 (21–58)0.091
Categorical variablesn (%)n (%)p-valuen (%)n (%)p-valuen (%)n (%)p-valuen (%)n (%)p-value
Sex (0) 0.65 <0.0001 0.42 >0.99
Female1 (20)31 (36) 20 (51)3 (8) 22 (33)1 (14) 1 (33)31 (36)
Male4 (80)54 (64) 19 (49)35 (92) 44 (67)6 (86) 2 (67)56 (64)
Lesion etiology (0) >0.99 0.021 0.18 >0.99
Traumatic spinal cord injury4 (80)64 (75) 25 (64)33 (87) 47 (71)7 (100) 2 (67)66 (76)
Ischemic spinal cord injury1 (20)21 (25) 14 (36)5 (13) 19 (29)0 (0) 1 (33)21 (24)
Neurological Level (5) a 0.38 0.23 0.51 >0.99
Cervical (C1–C8)4 (80)36 (42) 14 (36)21 (55) 31 (47)2 (29) 2 (67)38 (44)
Thoracic (T1–T12)1 (20)34 (40) 17 (44)12 (32) 25 (38)3 (42) 1 (33)34 (39)
Lumbar (L1–L5)0 (0)15 (18) 8 (20)5 (13) 10 (15)2 (29) 0 (0)15 (17)
SCI Severity (5) a 0.10 0.40 0.10 0.61
AIS A3 (60)18 (21) 10 (26)8 (21) 15 (23)3 (43) 1 (33)20 (23)
AIS B/C0 (0)23 (27) 8 (20)13 (34) 16 (24)3 (43) 0 (0)23 (26)
AIS D2 (40)44 (52) 21 (54)17 (45) 35 (53)1 (14) 2 (67)44 (51)
S3 light touch score (6) 0.27 0.60 0.13 0.065
Absent2 (40)23 (27) 11 (28)10 (26) 17 (26)1 (14) 1 (33)24 (28)
Altered 1 (20)42 (49) 20 (51)16 (42) 32 (48)2 (29) 0 (0)43 (49)
Normal2 (40)15 (18) 6 (15)9 (24) 12 (18)0 (0) 2 (67)15 (17)
a When baseline data were missing, patients were assigned to a group based on information from the next testable timepoint; AIS: American Spinal Injury Association Impairment Scale grade: DO–DSD: detrusor overactivity with detrusor sphincter dyssynergia; LEMS: lower extremity motor score; pDetmax: maximum detrusor pressure (storage phase); S: sacral; SCI: spinal cord injury; SCIM: Spinal Cord Independence Measure Version III; UDI: urodynamic investigation; UEMS: upper extremity motor score; VUR: vesicoureteral reflux.
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Birkhäuser, V.; Anderson, C.E.; Kozomara, M.; Bywater, M.; Gross, O.; Kiss, S.; Knüpfer, S.C.; Koschorke, M.; Leitner, L.; Mehnert, U.; et al. Urodynamics Are Essential to Predict the Risk for Upper Urinary Tract Damage after Acute Spinal Cord Injury. Biomedicines 2023, 11, 1748. https://doi.org/10.3390/biomedicines11061748

AMA Style

Birkhäuser V, Anderson CE, Kozomara M, Bywater M, Gross O, Kiss S, Knüpfer SC, Koschorke M, Leitner L, Mehnert U, et al. Urodynamics Are Essential to Predict the Risk for Upper Urinary Tract Damage after Acute Spinal Cord Injury. Biomedicines. 2023; 11(6):1748. https://doi.org/10.3390/biomedicines11061748

Chicago/Turabian Style

Birkhäuser, Veronika, Collene E. Anderson, Marko Kozomara, Mirjam Bywater, Oliver Gross, Stephan Kiss, Stephanie C. Knüpfer, Miriam Koschorke, Lorenz Leitner, Ulrich Mehnert, and et al. 2023. "Urodynamics Are Essential to Predict the Risk for Upper Urinary Tract Damage after Acute Spinal Cord Injury" Biomedicines 11, no. 6: 1748. https://doi.org/10.3390/biomedicines11061748

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop