1. Introduction
Vancomycin remains a mainstay of therapy for the treatment of methicillin-resistant
Staphylococcus aureus (MRSA) infections. To minimize the risk of nephrotoxicity and to ensure therapeutic effectiveness of vancomycin in the treatment of severe MRSA infections, therapeutic drug monitoring (TDM) is recommended to maintain the 24 h area under the curve (AUC
24) between 400 and 600 mg·h/L [
1]. According to the 2020 consensus guideline for vancomycin monitoring, the preferred method for estimating AUC
24 is through analysis of peak and trough concentrations using Bayesian software programs [
1]. Measuring two concentrations, rather than one, requires additional resources in staffing, incurs additional laboratory costs, and can negatively affect patient satisfaction. The guideline acknowledges that AUC
24 estimates via Bayesian analysis of a single trough concentration may be sufficient in some populations; however, the adequacy of a single-level is uncertain in patients with obesity [
1].
Patients with a body mass index (BMI) greater than 40 kg/m
2 are not well represented in studies that support single-level, Bayesian estimates of vancomycin AUC
24 [
2,
3,
4]. Investigations of trough-only AUC estimates specifically in populations with obesity using Bayesian analysis have produced mixed results [
5,
6,
7]. A variety of a priori models and fitting procedures were used in these studies, suggesting that the accuracy of AUC
24 estimates based on a single concentration may depend on the population model or the fitting routine utilized in the Bayesian analysis. The 2020 consensus guideline does not identify a preferred a priori model for Bayesian estimation in patients with obesity, nor does it recommend a process for model development [
1].
Recent comparisons of different a priori models in patients with obesity have focused on the accuracy in predicting individual concentrations, typically random or trough concentrations, rather than AUC
24 values [
8,
9]. From these comparisons have emerged two models with better predictive accuracy in patients with BMI ≥ 40 kg/m
2, the Hughes model and the Carreno model, with the Hughes model supported by a large dataset (47,965 patients with BMI ≥ 40 kg/m
2) [
8,
9]. In this large retrospective review by the makers of InsightRx
® (San Francisco, CA, USA), the a priori predicted concentrations of the Hughes model were within 20% of the measured concentrations more frequently than the other ten models, reaching statistical significance in 38 out of 40 comparisons across four age groups. To date, no studies have evaluated the agreement between one- and two-concentration AUC
24 estimates using the Hughes model.
The purpose of this retrospective study was to characterize the level of agreement between two-concentration and one-concentration AUC24 estimates in a population with BMI ≥ 40 kg/m2, using commercial software and the Hughes model as the population model in the Bayesian analysis. In addition, the study aimed to characterize the impact of the population model (Carreno vs. Hughes) on the two-concentration Bayesian AUC24 estimates.
2. Materials and Methods
A single-center, retrospective reanalysis of vancomycin concentrations in adults was conducted at a community hospital in Missoula, Montana, to evaluate the feasibility of monitoring vancomycin therapy with a single concentration in patients with BMI ≥ 40 kg/m2. In February 2021, the pharmacy-led vancomycin protocol was updated to recommend measurement of two vancomycin concentrations in the first 48 h for patients with BMI ≥ 40 kg/m2. Only one concentration was measured for patients with BMI < 40 kg/m2. Per protocol, both concentrations were to be analyzed with a Bayesian software program (InsightRx®), and a dosing regimen was to be ordered to achieve a 24 h, steady-state AUC (AUC24,SS) between 400 and 600 mg·h/L. Throughout the study period, concentrations were fit using the maximum a posteriori (MAP) Bayesian fitting routine with a linear gradient weighting scheme for measured concentrations.
Measurement of true peak and trough concentrations was not required by the protocol, which allowed pharmacists to order one concentration with morning labs, drawn approximately at 0500. Because vancomycin doses at the hospital are ordered at standard dosing times of 0900 and 2100 (except for the first dose), the morning lab draw is often a random level in the middle of the dosing interval. When a random concentration was drawn with morning labs, the protocol did not dictate the timing of the second vancomycin concentration. Frequently the second level would be ordered closer to a peak or a trough concentration. Pharmacists also had the option of ordering a true peak concentration and a true trough concentration, which was more consistent with the 2020 consensus guideline [
1]. The concentration obtained at the shortest post-dose interval was designated the “large concentration,” whereas the concentration at the longest post-dose interval was designated the “small concentration.” Serum vancomycin concentrations were determined by particle-enhanced turbidimetric inhibition immunoassay (Atellica CH Vancomycin Assay, Siemens Healthineers, Tarrytown, NY, USA) on the Atellica CH Analyzer.
Patients were eligible for inclusion if they received an order for “vancomycin per pharmacy” after implementation of the new protocol in February 2021 but before end of data collection on 28 February 2025. Patients in the pediatric, obstetric, labor, or neonatal intensive care units were excluded. Other exclusion criteria included BMI < 40 kg/m2, fewer than two vancomycin concentrations measured, renal replacement therapy, transfer from an outside facility with uncertain dosing prior to admission, suspected laboratory errors, levels drawn during vancomycin infusion, or greater than 24 h between measured concentrations.
In the patient record in InsightRx® (ver 1.71), all doses, levels, and serum creatinine concentrations recorded after the second vancomycin concentration were removed from the record. Doing so ensured that the AUC24,SS estimate was determined only from information available up to the measurement of the second vancomycin concentration. The AUC24,SS estimated from the analysis of both concentrations, AUC24,SS (two-conc), was recorded using the dosing regimen ordered by the pharmacist at the time the concentrations were first assessed. The larger concentration was then removed from the analysis to determine the AUC24,SS estimate based on only the smaller concentration, AUC24,SS (small-conc). Similarly, AUC24,SS (large-conc) was determined by removing the smaller concentration from the analysis. The quality of the fit reported by InsightRx® (good, intermediate, or poor) was noted for each of the three analyses.
During the period of data collection from February 2021 to February 2025, the Bayesian population model used by InsightRx® to estimate the AUC24 transitioned from the Carreno model to the Hughes model. The Hughes model became the hospital standard in July of 2023. Therefore, when recording AUC24,SS values from existing records created before July 2023, it was necessary to change the population model to the Hughes model. When available in the patient medical record, the AUC24,SS (two-conc) using the older Carreno model was also recorded for comparison with the AUC24,SS (two-conc) using the newer Hughes model. The two models could not be compared for all patients because the Carreno model is no longer available in InsightRx®, so vancomycin dosing encounters after July 2023 were not included in this subgroup analysis.
The percent differences between the two-concentration and one-concentration estimates of AUC
24,SS were calculated using the following equation
Similarly to other studies, the agreement between the two-concentration and one-concentration estimates of AUC
24,SS was characterized using the proportion of encounters for which the percent difference was between −20% and 20% [
8,
10], with 95% confidence intervals computed using the Wilson score method. A percent difference of ±20% represents the maximum difference for which the two-concentration and one-concentration AUC
24,SS estimate could both be in the therapeutic range of 400–600 mg·h/L (i.e., if the one-concentration AUC
24,SS is 500 mg·h/L and the two-concentration AUC
24,SS is either 400 or 600 mg·h/L). The large concentration AUC
24,SS estimates and the small concentration AUC
24,SS estimates were analyzed separately.
As a secondary analysis of bias, paired AUC
24,SS values were compared with a two-sided Wilcoxon signed-rank test (α = 0.05), while the ±20% percent-difference criterion remained the primary agreement metric given the 400–600 mg·h/L therapeutic window. Correlation between the two-concentration and one-concentration AUC
24,SS estimates was also assessed using linear regression and Pearson’s correlation coefficient to facilitate comparison with other studies [
2,
4,
5,
6,
7].
The McNemar–Bowker test was used to compare the distribution of fit quality assessments across the three categories (good, intermediate, poor) when analyzing either two concentrations or one concentration (large or small). Linear regression was used to explore the effect of the following variables on the percent difference between the two- and one-concentration AUC estimates: BMI, weight, age, creatinine clearance, time difference between concentrations, time of large concentration relative to the end of the infusion, time of small concentration relative to the previous dose, and time relative to the start of therapy. Variables with p < 0.25 in univariable analysis were entered into the multivariable regression, where significance was defined as p < 0.05 for association with percent difference.
Agreement between the two-concentration and one-concentration estimates of AUC24,SS was also investigated for the subgroup of encounters for which both peak and trough concentrations were measured. A peak concentration was defined as a level measured at a time after the end of the infusion that was less than 25% of the dosing interval. A trough concentration was defined as a level measured at a time after the dose that was greater than 75% of the dosing interval. Standard peak (1–2 h post-infusion) and trough (1 h pre-dose) definitions were intentionally broadened to maximize inclusion of dosing encounters with substantial differences in concentration values. In addition, the percent difference between the two-concentration AUC24,SS estimate using the Hughes model and the two-concentration AUC24,SS estimate using the Carreno model was calculated and agreement was characterized using the proportion of differences within ±20%.
Descriptive statistics and linear regression were calculated using Microsoft Excel 2021. Statistical analyses were performed using R (version 4.5.1; R Foundation for Statistical Computing, Vienna, Austria). To promote transparency in study design, data collection, and analysis, the reporting followed guidelines outlined in the Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) checklist.
3. Results
In the four-year period of data collection, the pharmacist-managed vancomycin protocol was ordered during 1501 hospital encounters. Ultimately, 82 different hospital encounters (79 unique patients) were included in the final analysis. Reasons for exclusion are shown in
Figure 1, with a BMI < 40 kg/m
2 being the most common reason for exclusion. Out of the 82 encounters included, 22 encounters (22 unique patients) had both a peak and trough concentration measured. Similarly, 44 dosing encounters (42 unique patients) had an available AUC
24,SS (two conc) estimate based on both the Hughes model and the Carreno model.
The mean age (SD) of patients in the full dataset was 56.6 (13.5) years with near equal representation of men and women (
Table 1). The majority of patients (64.6%) had a BMI between 40 and 50 kg/m
2. Twenty-two patients (26.8%) had a serum creatinine greater than 1.2 mg/dL at the time levels were measured, with 9 (11%) in acute kidney injury (AKI), defined as a serum creatinine of 0.5 mg/dL or more above baseline. Only 15 patients (18.3%) were critically ill and 7 (8.5%) were diagnosed with septic shock. The mean (SD) daily dose was 2413 (356) mg and the most common dosing interval was every 12 h (63.4%). Using the Hughes model, the median (IQR) AUC
24,SS was 522 (477–553) mg·h/L for the two-concentration fit, 511 (473–551) mg·h/L for the small-concentration fit, and 545 (475–592) mg·h/L for the large-concentration fit. The magnitude of the vancomycin concentrations and the time of measurement relative to the previous dose are shown in
Figure 2.
3.1. Two-Concentration AUC24,SS Compared to the Small-Concentration AUC24,SS Using the Hughes Model
The AUC
24,SS estimates from the small-concentration fit were strongly correlated with the AUC
24,SS estimates from the two-concentration fit with a Pearson’s coefficient of 0.83 (
Figure S1a). The mean percent difference between AUC
24,SS (two conc) and AUC
24,SS (small conc) showed a small but significant bias of 2.9% (95% CI: 0.14 to 3.8%); however, the median AUC values were not significantly different by the Wilcoxon signed rank test (
p = 0.14). For 97.5% of encounters (95% CI: 91.5 to 99.3%), the percent difference was within ±20% (
Figure 3a). Fit quality assessments between the two-concentration and small-concentration analyses were significantly different (
p = 0.0005,
Figure S2). The small-concentration fits were judged be “good” more frequently than the two-concentration fits (97.6% vs. 76.8%) and less commonly graded as “poor” (1.2% vs. 4.9%). Linear regression analysis revealed no apparent relationship between percent difference and patient BMI,
p = 0.26 (
Figure 3a). No other variables were significantly correlated with percent difference in the univariate analysis (
Figures S4 and S5). While several variables met the inclusion threshold for the multivariate model (
p < 0.25), none became significantly associated with percent difference once included (
Table S1).
Two encounters had much larger percent differences than the rest of the dataset, over 40%. Specific details about these two patients are shown in
Table 2. For encounter #68, the smaller concentration was unexpectedly low at 4.4 mg/L after three doses totaling 3000 mg. Consequently, the fit to the small concentration was judged to be poor by the Bayesian software. For encounter #40, the large concentration was unexpectedly high, producing a poor fit to the two concentrations. However, the fit to the smaller concentration was considered good. On the day concentrations were measured, the serum creatinine was double the baseline value of 0.85 mg/dL, which may have contributed to the intermediate fit quality. Interestingly, the same patient received vancomycin therapy four months earlier and the percent difference between AUC
24,SS (two conc) and AUC
24,SS (small conc) for the previous encounter was 2.75%. The patient had no evidence of AKI at the previous encounter.
Eight other patients were also experiencing AKI at the time concentrations were measured. For all 8 patients, the percent difference between AUC24,SS (two conc) and AUC24,SS (small conc) was within ±20%. The fit quality assessments from the small-concentration fit were concordant with the two-concentration for 7 out of 8 encounters.
For the subset of encounters with both a peak and trough concentration measured (N = 22), the mean percent difference between AUC
24,SS (two conc) and AUC
24,SS (small conc) was −0.28% (95% CI: −1.7 to 2.3%). The median difference in AUC values was not significant (
p = 0.45). The AUC
24,SS (two conc) and AUC
24,SS (small conc) estimates were more strongly correlated (R
2 = 0.96) in the peak/trough subgroup than in the full dataset (
Figure S1b). For 100% of encounters (95% CI: 85.1 to 100%), the percent difference was within ±20% (
Figure 3b). The largest absolute percent difference observed was 14.1%.
3.2. Two-Concentration AUC24,SS Compared to the Large-Concentration AUC24,SS Using the Hughes Model
The AUC
24,SS estimates from the large-concentration fit were strongly correlated with the AUC
24,SS estimates from the two-concentration fit with a Pearson’s coefficient of 0.83 (
Figure S1c)
. The mean percent difference between AUC
24,SS (two conc) and AUC
24,SS (large conc) was −3.1% (95% CI: −4.7 to −1.5%) and the difference in median AUC values was significant (
p = 0.0006). However, 97.5% (95% CI: 91.5 to 99.3%) of encounters were within ±20% (
Figure 3c). Fit quality assessments between the two-concentration and large-concentration analyses were significantly different (
p = 0.001,
Figure S3). As with the small-concentration fits, the large-concentration fits were judged be “good” more frequently than the two-concentration fits (95.1% vs. 76.8%) and less commonly graded as “poor” (0% vs. 4.9%).
For 8 of 9 encounters with AKI, the percent difference between AUC24,SS (two conc) and AUC24,SS (small conc) was within ±20%. For the other encounter, a percent difference of 22.7% was observed in a patient with septic shock who had a SCr of 1.2 mg/dL at the time of the first measured concentration, which then increased to 2.38 mg/L ten hours after the time of the second concentration. The fit quality assessments from the large-concentration fit were concordant with the two-concentration fit for 7 out of 9 encounters.
Once again, linear regression analysis revealed no apparent relationship between percent difference and patient BMI with a
p-value of 0.48 (
Figure 3c). Three variables were significantly associated with percent difference in the univariate analysis (CrCL FFM, time of trough after dose, time of peak after dose), but when combined with age in the multivariate analysis, no single variable reached statistical significance (
Figures S4 and S5,
Table S2). However, the overall multivariate model was statistically significant (
p = 0.002), indicating that the combination of variables explained a meaningful portion of the variance.
For the subset of encounters with both a peak and trough concentration measured (N = 22), the mean percent difference between AUC
24,SS (two conc) and AUC
24,SS (large conc) was −4.4% (95% CI: −8.5 to −0.3%). The difference in the median AUC estimates was significant (
p =0.012). The correlation between AUC
24,SS estimates did not improve in the peak/trough subgroup (R
2 = 0.80,
Figure S1d). The percent difference was within the range of ±20% for 95.5% of encounters (95%CI: 78.2 to 99.3%), as shown in
Figure 3d.
3.3. Two-Concentration AUC24,SS from the Hughes Model Compared to Two-Concentration AUC24,SS from the Carreno Model
The two-concentration AUC
24,SS estimates using the Hughes model were only weakly correlated with the two-concentration estimates using the Carreno model (R
2 = 0.108,
Figure S1e). The AUC
24,SS from the two-concentration fit using the Carreno model was available for 44 patients. The mean percent difference between AUC
24,SS (two conc) using the Hughes model and AUC
24,SS (two conc) using the Carreno model was 15.6% (CI: 9.3 to 21.9%). Only for 59.1% of encounters (95% CI: 44.4 to 72.3%) did the percent difference fall within ±20% (
Figure 4a). Most out-of-range encounters (17/18) had a positive percent difference above 20%, with a maximum percent difference of 73.7%.
Thirteen encounters in the peak/trough subgroup also had an AUC
24,SS (two conc) estimate using the Carreno model. For these 13 patients, the mean percent difference between AUC
24,SS (two conc) using the Hughes model and AUC
24,SS (two conc) using the Carreno model was 22.9% (95% CI: 9.2 to 36.8%). The percent difference was within the range of ±20% for 38.5% of encounters (95%CI: 17.8 to 64.4%), as shown in
Figure 4b.
4. Discussion
The purpose of this retrospective review was to determine if a single vancomycin concentration, analyzed with a Bayesian pharmacokinetic software program, would be sufficient to estimate AUC24,SS in patients with a BMI ≥ 40 kg/m2. Although measuring both peak and trough concentrations in patient populations with varying volumes of distribution is recommended by the 2020 consensus guideline, this is not always practical. Given the time and resources required to collect vancomycin concentrations in a hospital with limited phlebotomy staff, this study aimed to determine whether the additional lab draw could be eliminated and the timing of a one-concentration monitoring strategy optimized.
The results of this review provide support for estimating vancomycin AUC
24,SS with a single concentration. For over 95% of encounters, the difference between the two-concentration and one-concentration AUC
24,SS estimates was within 20%. Similar results were observed in the subset of 22 patients for which measured concentrations met peak and trough criteria. On average, the one-concentration AUC
24,SS estimate was better when the smaller concentration was analyzed, suggesting that concentrations measured later in the dosing interval will produce more reliable AUC estimates. This might simply be explained by the fact that smaller concentrations have less proportional error and are assigned greater weight in the Bayesian fit [
11].
It is important to acknowledge what could be missed with single-level monitoring of vancomycin. For two outliers, the two-concentration AUC24,SS was substantially greater than the one-concentration estimate, which would result in unnecessary vancomycin exposure. One of these patients had rapidly changing renal function, while a surprisingly low concentration was measured in the other patient, resulting in a poor fit. Both the labile renal function and poor fit would have prompted closer examination and more frequent monitoring in these two patients, and it is unlikely that dosing decisions for these patients would have been based on a single level. Measuring a second concentration would be prudent in these situations. A second level is also advisable when dosing at the extremes of the therapeutic range, where the margin for error is narrow.
Single-level monitoring also appears less effective in detecting situations where measured concentrations are not well fit by the Hughes population model. This is not surprising, since two concentrations place stricter constraints on the concentration–time curve and reduce the model’s ability to fit the observed data. The fit quality was judged to be intermediate or poor in 19 (23%) of the two-concentration fits in the full dataset. In the most favorable scenario—when the larger concentration was used—the one-concentration analysis identified an intermediate or poor fit in only 5% of dosing encounters. According to InsightRx®, intermediate or poor fits indicate that the measured concentrations are unlikely or very unlikely in the Bayesian population model and should prompt greater scrutiny and/or more intense monitoring. In our sample, 15 encounters (17%) with suboptimal fit would not have been flagged for enhanced review if only a single concentration had been used.
The change from the Carreno model to the Hughes model in the middle of the review period allowed for a comparison of the two-concentration AUC24,SS estimates produced by the two models. The difference in AUC estimates varied widely, with only 59.1% agreement between the two models. On average, the two-concentration AUC estimates from the Hughes model were significantly larger than the two-concentration AUC estimates from Carreno model. Consequently, over 40% of the dosing regimens selected to produce a therapeutic AUC24,SS with the Carreno model would have been considered supratherapeutic by the Hughes model. This finding suggests that the population model used by the Bayesian software is more influential than the number of concentrations analyzed when estimating AUC. Furthermore, obtaining two concentrations does not ensure concordance of AUC estimates across different models developed in patients in obesity. This underscores the need for caution when comparing AUC estimates generated by pharmacokinetic programs that apply different population models.
Our results are similar to those reported by Covington et al. [
7]. In their study of 31 patients with BMI ≥ 30 kg/m
2, the trough-only AUC
24 estimate was not significantly different from the two-concentration AUC
24 estimate. For only one patient did the percent difference in AUC
24 appear to exceed 20% with an absolute difference of 216 mg·h/L. Key methodological differences include Covington et al.’s use of true peak and trough measurements, the use of a one-compartment model in DoseMeRx
®, and the estimation of AUC
24 at end of the sampling interval rather than projecting to steady state [
7].
Other studies comparing one- and two-concentration vancomycin AUC estimates in patients with obesity have reported significant bias and imprecision with the one-concentration AUC estimate [
5,
6]. In the first study, a one-concentration model was used to fit the single trough concentration while a two-compartment model was used to fit both concentrations, which could explain the significant difference in AUC estimates [
5]. In the second study, three out of the four models tested were not developed in a population of patients with obesity [
6]. However, the fourth model (Carreno model) was developed from and tested in 12 patients with BMI ≥ 40 kg/m
2 using a richly sampled dosing interval (5 levels per patient). For the Carreno model, the mean percent error of the trough-only AUC estimate compared to the reference AUC was substantial (12.5%), with large uncertainty (95% CI: −18.9 to 43.8%). An even larger difference was observed between the mean one-concentration and two-concentration AUC estimates [
6].
It is unclear why, in the aforementioned study, the Carreno model produced one-concentration AUC estimates that showed less agreement with the two-concentration estimates. Unlike the model used in our study (Hughes) and the model used in the study by Covington et al. (Adane), the Carreno model was developed using a non-parametric adaptive grid, and the assay variance was modified with an adaptive gamma scalar [
7,
11,
12]. Doing so may have weighted measured concentrations more than the population covariates, resulting in a greater impact on the estimated AUC with additional fit concentrations. Another possible explanation is that the Adane and Hughes models better describe the concentration versus time curve in patients with obesity, because they both include weight as a covariate in the volume of distribution [
11,
12]. However, recent evidence suggests that the Carreno model is better than the Adane model in predicting vancomycin concentrations in patients with obesity, while the Hughes model outperformed both [
8,
9].
Strengths of this study include a relatively large sample of patients with BMI ≥ 40 kg/m2, exceeding that of similar investigations. This study also reports the agreement between the two-concentration AUC estimate and the peak-only AUC estimate. Previous studies in patients with obesity only reported agreement with the trough-only AUC estimate. Additionally, the comparison was based on projected steady-state AUC24 values, which are generally used to guide dosing decisions, rather than pre-steady state values. Sufficient data was also collected to explore the influence of multiple variables on percent difference. Notably, this is the first study of its kind to assess fit quality in both one- and two-concentration analyses.
This study has several limitations. Power calculations were not conducted to determine if the study size was sufficient to reveal a difference between the one- and two-concentration estimates. The definitions of peak and trough concentrations were broader than historical criteria. Even then, only 22 encounters included both a peak and a trough concentration, while 11 encounters had neither. Consequently, the difference between one-concentration and two-concentration AUC24,SS is likely underestimated. In addition, of the 185 eligible patients with BMI ≥ 40 kg/m2, 78 were excluded because fewer than two concentrations were measured, which could be a source of bias.
Due to the retrospective design, the study could not assess how one- versus two-concentration analyses would influence actual dosing decisions by clinical pharmacists. Similarly, this retrospective reanalysis of vancomycin levels was unable to assess the impact of single-level monitoring of vancomycin on clinical or nephrotoxic outcomes in patients with BMI ≥ 40 kg/m2. Also, software updates over the four-year period cannot be ruled out as a contributor to the difference between the Carreno and Hughes AUC24,SS estimates. However, all user-defined settings, other than the model, remained the same throughout the study period. Finally, this was a single-center study using only one commercial software program and may not be generalizable to other institutions or other software programs.