Next Article in Journal
Metabolite Profile of Treatment-Naive Metabolic Syndrome Subjects in Relation to Cardiovascular Disease Risk
Next Article in Special Issue
Facilitated Qualitative Determination of Insulin, Its Synthetic Analogs, and C-Peptide in Human Urine by Means of LC–HRMS
Previous Article in Journal
Targeted Metabolic Profiles of the Leaves and Xylem Sap of Two Sugarcane Genotypes Infected with the Vascular Bacterial Pathogen Leifsonia xyli subsp. xyli
Previous Article in Special Issue
The Plasticity of Pancreatic β-Cells
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Modeling Between-Subject Variability in Subcutaneous Absorption of a Fast-Acting Insulin Analogue by a Nonlinear Mixed Effects Approach

Department of Information Engineering, University of Padova, I35131 Padova, Italy
*
Author to whom correspondence should be addressed.
Metabolites 2021, 11(4), 235; https://doi.org/10.3390/metabo11040235
Submission received: 26 February 2021 / Revised: 6 April 2021 / Accepted: 7 April 2021 / Published: 12 April 2021
(This article belongs to the Special Issue Insulin: A Life-Saving Hormone and Key Regulator of Metabolism)

Abstract

:
Despite the great progress made in insulin preparation and titration, many patients with diabetes are still experiencing dangerous fluctuations in their blood glucose levels. This is mainly due to the large between- and within-subject variability, which considerably hampers insulin therapy, leading to defective dosing and timing of the administration process. In this work, we present a nonlinear mixed effects model describing the between-subject variability observed in the subcutaneous absorption of fast-acting insulin. A set of 14 different models was identified on a large and frequently-sampled database of lispro pharmacokinetic data, collected from 116 subjects with type 1 diabetes. The tested models were compared, and the best one was selected on the basis of the ability to fit the data, the precision of the estimated parameters, and parsimony criteria. The selected model was able to accurately describe the typical trend of plasma insulin kinetics, as well as the between-subject variability present in the absorption process, which was found to be related to the subject’s body mass index. The model provided a deeper understanding of the insulin absorption process and can be incorporated into simulation platforms to test and develop new open- and closed-loop treatment strategies, allowing a step forward toward personalized insulin therapy.

Graphical Abstract

1. Introduction

The biological variability of insulin absorption and insulin action is the main obstacle to the optimal management of insulin treatment in type 1 (T1D) and type 2 diabetes (T2D). In fact, subcutaneous injections of the same exact insulin dose may greatly differ between different individuals or even in the same individual on different occasions [1]. From the masterwork of Binder in 1969 [2], several other papers were published aiming to investigate the reasons behind this variability. They overall agreed that the factors shaping the insulin concentration profile in blood are all those that influence insulin diffusion in the tissues, including the concentration, volume, and associated state (hexameric, dimeric, or monomeric) of injected insulin, the site and depth of injection, tissue blood flow, and skin temperature [3,4,5,6,7], but also, factors like the level of antibody binding seem to play a major role [8]. The considerable between-subject variability (BSV) and within-subject variability (WSV) complicate the tuning of the treatment performed by healthcare professionals, leading to dangerous glucose excursions, which are the main causes of acute and long-term diabetes complications.
Modeling the BSV and WSV of the subcutaneous kinetics of fast-acting insulin analogues represents an important step in understanding this phenomenon, which may help in better simulating the complex behavior of the glucose regulatory system and, in turn, improving both T1D and T2D management. The estimation of the variability present in a biological process is conventionally performed by the so-called “standard two-stage” method, which consists, first, of estimating the model parameters in each subject of the population and, then, assessing the mean vector and the covariance matrix [9], the latter being a quantitative measurement of the population variability. However, by doing so, the variability is usually overestimated. Moreover, the population estimates are not used to improve the individual ones, thus neglecting that a biological process shows a similar behavior in all the subjects who underwent the same experiment. Then, in the posterior analysis, one usually tries to detect some independent subject characteristics, normally referred to as covariates, that are, to some extent, related to the variability present in the process. However, this analysis does not employ the precision of the individual parameters in estimating the overall variability [10] and provides only a hint at the covariates to take into account, without investigating their actual contribution in the biological process [11].
A better approach to overcome these issues is nonlinear mixed effects (NLME) modeling. In this framework, subjects are assumed to be random realizations of a population whose distribution is shaped around some parameters (the so-called fixed effects). These population parameters are then employed to support the estimation of individual parameters, which are described using the deviation of each subject from the population value (random effects). All the available information is thereby employed in the estimation process. In addition to that, the estimation process can take advantage of prior information employing a Bayesian approach, which is known to be advantageous, especially in the case of a relatively small number of samples. Moreover, the NLME approach allows improving the model predictive power by introducing possible covariates in order to explain the portion of variability that is directly related to some macroscopic subject characteristic. In this way, the effective contribution of covariates to the population variability is estimated along with all the other model parameters. An final advantage comes from the possibility to use data coming from different studies even in the case of missing information or slightly different adopted protocols. By doing so, the features detected in the model are more robust since the influence of the setup of each study is reduced.
Recently, a model of subcutaneous absorption of fast-acting insulin analogues was developed and validated on a large database using standard modeling techniques [12,13]. Here, we aimed to apply the NLME modeling technique to such a model in order to describe the BSV present in the pharmacokinetics of subcutaneous absorption of lispro, a fast-acting insulin analogue. In doing so, we tried also to personalize the model by the use of subject covariates. Such a model will become an important component of the University of Virginia (UVa)/Padova T1D Simulator [14], an in silico platform accepted by the Food and Drug Administration (FDA) as a substitute for preclinical trials for certain insulin treatments, including closed-loop algorithms for artificial pancreas [15], recently used as an ideal test bench for the development and evaluation of glucose sensors [16] and novel insulin analogues [17,18]. Furthermore, the presented model could be incorporated also in the recently proposed Padova T2D simulator [19], allowing optimizing insulin therapy in this population. The incorporation into the simulators of a model that explicitly accounts for BSV would decrease the gap between the simulation environment and the real subject behavior, improving the in silico optimization of personalized insulin treatment. Finally, a model like this could also be employed in the development of model-based algorithms for subcutaneous insulin dosing in patients with T1D, like the model predictive controllers developed by the University of Cambridge [20] and by the collaboration between the Universities of Pavia, Padova, and Virginia [21].

2. Materials and Methods

2.1. Database and Protocols

We used data of 116 subjects with T1D from 3 clinical studies (Figure 1). All the subjects underwent a single subcutaneous injection of a fast-acting insulin analogue (lispro). The database contained also information about the demographic (age) and anthropometric (body weight (BW), body height (BH), body mass index (BMI), and body surface area (BSA)) features of the subjects. All the observed measurements below the quantification limit (BQL) were discarded from the analysis, together with very unreliable measurements due to issues with insulin assays. All studies were performed at the Profil Institute for Metabolic Research in Neuss, Germany, in accordance with the principles of the Declaration of Helsinki and the local Ethics Committee. All patients signed an informed consent prior to study start. The three studies are briefly described below, and more detailed information about the database and the adopted protocols are available in [12].

2.1.1. Study 1

In the first study [22] (Figure 1, Panel A), forty-two T1D subjects (age = 42 ± 11 years, body weight = 74 ± 10 kg, height = 175 ± 8 cm) underwent a euglycemic clamp and received a subcutaneous injection of 12 U of insulin lispro at around noon ( t = 0 ), after an overnight fast. During the clamp, glucose infusions were used to keep blood glucose stable at around 100 mg/dL and avoid the patient entering a hypoglycemic state during the experiment. The blood samples were collected at t = 0, 3, 7, 10, 15, 20, 25, 30, 45, 60, 90, 120, 150, 180, 210, 240, 300, 360, 420, and 480 min to measure glucose and insulin levels. A specific radio immunoassay was used for the determination of insulin lispro levels (BQL equal to 5 μ U/mL).

2.1.2. Study 2

In the second study [12] (Figure 1, Panel B), thirty-seven T1D subjects (age = 47 ± 12 years, body weight = 80 ± 8 kg, height = 180 ± 5 cm) underwent a euglycemic clamp and received a subcutaneous injection of 0.2 U/kg of insulin lispro at around noon ( t = 0 ), after an overnight fast. During the clamp, glucose infusions were used to keep blood glucose stable at around 100 mg/dL and avoid the patient entering a hypoglycemic state during the experiment. The blood samples were collected at t = 0, 4, 8, 12, 16, 20, 25, 30, 35, 40, 45, 50, 55, 60, 70, 80, 90, 105, 120, 135, 150, 180, 210, 240, 300, 360, 420, 480, 540, 600, 660, and 720 min to measure glucose and insulin levels. A radio immunoassay was used for the determination of insulin lispro levels (BQL equal to 5.5 μ U/mL).

2.1.3. Study 3

In the third study [12] (Figure 1, Panel C), thirty-seven T1D subjects (age = 44 ± 13 years, body weight = 81 ± 10 kg, height = 180 ± 8 cm) consumed a standardized meal and received a subcutaneous injection of 0.2 U/kg of insulin lispro at around noon ( t = 0 ), after an overnight fast. The meal was served to maintain high blood glucose level and avoid the subject entering a hypoglycemic state during the experiment. The blood samples were collected at t = 0, 4, 8, 12, 16, 20, 25, 30, 35, 40, 45, 50, 55, 60, 70, 80, 90, 105, 120, 135, 150, 180, 210, 240, 270, 300, 360, 420, and 480 min to measure glucose and insulin levels. A radio immunoassay was used for the determination of insulin lispro levels (BQL equal to 5.6 μ U/mL).

2.2. The Nonlinear Mixed Effects Model

In this work, we used an NLME model to describe the BSV of subcutaneous absorption of a fast-acting insulin analogue. A fundamental ingredient of this approach is the availability of a large database preferably including also subject’s demographic and anthropometric data, known as covariates, which could be used to assess the influence, if any, of such factors on individual data (Figure 2, left panels). The NLME model here developed consisted of two sub-models: a structural model (the so-called intra-individual model, here composed by a set of differential equations, Equation (3)) describing the physiological process of interest and a stochastic model (the so-called inter-individual model, Equations (4) and (5)) describing the between-subject variability in the physiological process of interest, eventually including some covariates (Figure 2, central panel). Finally, the unexplained source of variance was assumed to be the measurement error noise, which was also described by a proper error model (Equation (7)). The general form of an NLME model is given by the following set of equations:
z j = f j ( x j , ψ j ) + v j
ψ j = d ( c j , θ , η j )
where: z j is the measurement vector for the jth subject, x j is a vector incorporating variables such as time and injected dose, f j is a vector function describing the relation among z j , x j , and ψ j , the set of model parameters, while v j is the intra-individual error vector. In addition, d j is a ψ -dimensional vector function describing the relation between ψ j and c j , the covariates vector, θ , the population parameters (fixed effects), and η j , the inter-individual error (random effects). Once having defined its structure, the NLME model was identified using the insulin concentration data of the three datasets, together with subject covariates. The identification process provided an estimate of the fixed effects ( θ ^ ) and of the variability of the random effects in the population ( Ω ^ ), as well as the individual parameter estimates ( ψ j ^ ). These estimates were finally used to obtain the data fits (Figure 2, right panels).

2.2.1. Physiological Model of Insulin Kinetics

Here, the physiological model of insulin kinetics (Equation (3)) was the linear three-compartment model (Figure 3) recently proposed by Schiavon et al. [12] for insulin lispro. The first two compartments, I s c 1 and I s c 2 , represent insulin masses in the subcutis, in a non-monomeric and monomeric state, respectively. From the former, insulin can either be absorbed in the plasma insulin compartment I p with a rate constant k a 1 (min 1 ) or decomposed into monomers with a rate constant k d (min 1 ). From the latter, insulin can only be absorbed in the plasma insulin compartment I p with a rate constant k a 2 (min 1 ). Finally, insulin is degraded, usually by liver and kidneys, and this process is represented in the model by the rate constant k e (min 1 ). The dose is injected in the I s c 1 compartment, while measurements are collected from the plasma compartment I p , which has a distribution volume of V I (L/kg). The model accounts also for a subject-specific delay in the insulin absorption through the parameter τ (min). The equations of the model are:
I ˙ s c 1 ( t ) = ( k a 1 + k d ) I s c 1 ( t ) + u ( t τ ) I ˙ s c 2 ( t ) = k a 2 I s c 2 ( t ) + k d I s c 1 ( t ) I ˙ p ( t ) = k e I p + k a 1 ( t ) I s c 1 ( t ) + k a 2 I s c 2 ( t ) y ( t ) = I p ( t ) / V I

2.2.2. Model of the Parameter Variability

The model of the parameter variability (Equation (2)) is represented by a set of equations describing the BSV of the physiological parameters (Equations (4) and (5)). In this work, several models of increasing complexity were tested and compared. They all share the following basic assumptions:
ψ j = θ exp ( η j )
η j N ( 0 , Ω )
i.e., the distribution of the random effects η j is assumed to be Gaussian, so that the physiological parameters belong to a log-normal distribution. In addition, the stochastic model can include some covariates of the subjects to explain the dependency of the parameter on the subject characteristics:
ψ i , j = θ i exp ( β k , i ( c k , j c k ¯ ) + η i , j )
where c k , j is the kth covariate of the jth subject and c k ¯ is the reference value for that covariate (here set to the mean value of our database). For each covariate added to the model, a coefficient β k , i has to be estimated. Using the deviation from a reference value instead of the raw value of the covariate is a common strategy [11], which brings two main advantages: The first advantage is that if there is any subject with a missing covariate value, the reference value can be attributed to them, so that this subject does not influence the estimation of the associated coefficient β k , i , and their data can still be used to estimate the population parameters; however, this procedure could bias the estimates in the case of missing values. Anyway, this was not the case here, since all the information was available from the database. The second advantage is that the parameter β k , i can be interpreted more easily as the contribution made to the model parameter ψ i by a unitary deviation of c k from the reference value. Finally, it is possible to introduce some correlations between the model parameters by appropriately defining the covariance matrix Ω of the random effects η . For each correlation introduced in the covariance matrix, a parameter ρ i 1 , i 2 has to be estimated. The variability models to test were chosen applying a Pearson’s correlation test to the estimated parameters in order to detect the most correlated covariate-parameter pairs and random effects. In this work, a set of 14 variability models incorporating different combinations of correlations between the random effects and covariates was considered.

2.2.3. Measurement Error Model

The model for the measurement error is:
v ( t ) = a 2 + b 2 y ( t ) 2 ϵ ( t )
where the variable y ( t ) is the output of the physiological model, i.e., the plasma insulin concentration, and ϵ ( t ) is a Gaussian random variable, i.e., ϵ ( t ) N ( 0 , 1 ) . For small values of y ( t ) , v ( t ) presents an almost constant standard deviation (a), while, for high values of y ( t ) , v ( t ) has almost a constant coefficient of variation (b). Of note, since the three studies adopted different protocols and utilized different insulin assays, the error model was identified separately for each database. Therefore, a total of 6 error parameters were estimated: a 1 and b 1 for the first study, a 2 and b 2 for the second, and a 3 and b 3 for the third.

2.3. Parameter Estimation

The physiological model is a priori non-uniquely identifiable, since the rate parameters k d and k a 2 are interchangeable. To overcome this issue, it was assumed k d k a 2 , without loss of generality. To implement this inequality in the model, we defined α = k d k a 2 and assumed that it belongs to a log-normal distribution, so that α > 0 . Therefore, the unknown parameters to be estimated are the 6 fixed effects of the physiological model ( τ , V I , α , k a 1 , k a 2 , and k e ), the 6 standard deviations of the random effects, describing the BSV of the physiological parameters ( ω τ , ω V I , ω α , ω k a 1 , ω k a 2 , and ω k e ), the 6 parameters related to the measurement error ( a 1 , b 1 , a 2 , b 2 , a 3 , and b 3 ), and possibly coefficient β k , i to account for covariates and ρ i 1 , i 2 to account for correlations in the random effects. Hence, for each model, a minimum of 18 population parameters were identified.
For model identification and validation, we used the software Monolix (Monolix 2020R1 [23], ©Lixoft, Antony, France), which implements the stochastic approximation of expectation maximization (SAEM) in combination with a Markov chain Monte Carlo (MCMC) method to estimate the maximum likelihood of the NLME model parameters [24]. The fixed effects were initialized to the median of the parameter estimates found in [12] and the standard deviation of the random effects w to 0.1, while all the other parameters were left to their default initial values. As done in [12], a priori information on the volume of distribution V I [25] was added to improve the a posteriori identifiability of this parameter. The Fisher information matrix was estimated with the Metropolis–Hastings algorithm (an MCMC method) and the likelihood through an importance sampling method [23].

2.4. Model Assessment and Comparison

Model performance was assessed in terms of the residual distribution, the physiological plausibility of the parameters, the precision of the estimates, and the parsimony criteria. In particular, the goodness of the individual fits was checked by the visual inspection of the data vs. individual predictions. In addition, residual distribution provided by the individual weighted residuals (IWRES), defined as the difference between the measurement z ( t ) and the model prediction y ^ ( t ) weighted by the standard deviation of the error v ( t ) :
IWRES = z ( t ) y ^ ( t ) a 2 + b 2 y ^ ( t ) 2
was compared to a standard Gaussian distribution. Moreover, Monolix allows checking the normality of the IWRES with a Shapiro–Wilk (SW) test. However, the performed SW test is inadequate if the sample size is large (the software documentation itself claims this point [23]). To avoid this issue, the Shapiro–Wilk test was applied on the residuals of each subject to assess normality, while the runs test was used to assess randomness. This analysis was performed in R (R 4.0.3 [26], ©The R Foundation, Vienna, Austria) with a significance level p = 0.05 . The distributions of the kinetic parameters were then checked to be physiologically plausible. The precision of the estimates was obtained from the inverse of the Fisher information matrix I F ( θ ^ ) and summarized by reporting the average relative standard error (RSE) and number of parameters with RSE > 50%. The RSE for the parameter θ i is calculated as:
RSE ( θ ^ i ) = C i , i ( θ ^ ) θ ^ i
where C i , i ( θ ^ ) is the ith diagonal element of the covariance matrix of the parameters:
C ( θ ^ ) = J T I F ( θ ^ ) 1 J
and the transformation using the Jacobian J is necessary since I F ( θ ^ ) is obtained with the likelihood computed using the normally transformed parameters θ ^ . Moreover, the Bayesian information criterion corrected for the NLME model (BICc) [27] was used to compare models that produced a satisfactory score in all the previous metrics:
BICc = 2 ln ( L z ( θ ^ ) ) + ln ( N ) P R + ln ( n t o t ) P F
where L z ( θ ^ ) is the likelihood reached by the NLME model on the measurement data z , N is the number of subjects, P R is the number of estimated parameters of the variability model (i.e., the standard deviations of the random effects ω , possible correlations ρ , and eventual covariates β ), and P F is the number of fixed effects parameters of the physiological model ( θ ) plus the number of error coefficients (a and b), while n t o t is the total number of measurements. Finally, correlation analysis among random effects, as well as random effects and subjects’ covariates (or a logarithmic transformation thereof) was performed to test if parameters ρ i 1 , i 2 or β k , i , respectively, deserved to be introduced into the model.

3. Results

3.1. Comparison of the Variability Models

As shown in Table 1, all the attempted models provided acceptable residuals, with at least 89.7% and 87.8% of the subjects that passed the Shapiro–Wilk test and the runs test, respectively. Moreover, the models provided also physiologically plausible estimates. Therefore, for the selection of the best model, we used the precision of the estimates and the parsimony criterion. Models 4, 5, 8, 12, and 14 were discarded since they provided either a too high mean RSE or at least one parameter with RSE > 50%. Among the remaining models, Model 11 was the one providing the lowest BICc, and therefore, it was selected as the most parsimonious one. Compared with the models reported in Table 1, this model provides the second best BICc, the third best average precision of the estimates, as well as independent residuals and physiologically plausible estimates of the parameters.

3.2. Selected Model of the Parameter Variability

Here, the formulas of the variability Model 11 are reported:
ψ : τ = τ p o p exp ( η τ ) V I = V I p o p exp ( η V I ) α = α p o p exp ( η α ) k a 1 = k a 1 p o p exp ( η k a 1 ) k a 2 = k a 2 p o p exp ( β B M I , k a 2 ( B M I B M I ¯ ) + η k a 2 ) k e = k e p o p exp ( η k e )
with the following covariance matrix of the random effects η :
Ω = ω τ 2 0 0 0 0 0 0 ω V I 2 0 0 ω V I ω k a 2 ρ V I , k a 2 ω V I ω k e ρ V I , k e 0 0 ω α 2 0 0 0 0 0 0 ω k a 1 2 0 0 0 ω V I ω k a 2 ρ V I , k a 2 0 0 ω k a 2 2 ω k a 2 ω k e ρ k a 2 , k e 0 ω V I ω k e ρ V I , k e 0 0 ω k a 2 ω k e ρ k a 2 , k e ω k e 2
It is worth noting that all the physiological parameters were assumed non-negative and modeled as log-normal random variables. In addition, the model includes the BMI as a covariate in the equation of the parameter k a 2 through the parameter β B M I , k a 2 and the correlation between the random effects of the parameters V I , k a 2 , and k e through the parameters ρ V I , k a 2 , ρ k a 2 , k e , and ρ k a 2 , k e , respectively.

3.3. Validation of the Selected Model

Model prediction of the plasma insulin concentration was satisfactory, as can be seen in the left-hand panels of Figure 4, where data vs. model prediction of one representative subject for each of the three studies is reported. Moreover, the distributions of the IWRES obtained for each study compared well against a standard Gaussian distribution (Figure 4, right panels). With the selected model, 91.4% of the subjects passed the Shapiro–Wilk test for normality, and 88.5% percent passed the runs test for randomness.
In Table 2, the estimates of the population parameters are reported together with their precision expressed as the RSE. The parameters were estimated with a mean RSE of 9.11%, and no parameter reported an RSE > 50%. The quantiles of the distributions of the estimated individual parameters are reported in Table 3. All the individual parameter estimates were within physiological plausible ranges and compared well against the fixed effects of the population parameters. This is also shown in Figure 5 where the distributions of the estimated individual parameters are reported: in the left panels, the estimates of the individual parameters of the physiological model are compared with their theoretical distribution (i.e., the log-normal distribution derived from Equation (12) by knowing the estimated fixed effects reported in Table 2), while in the right panels, the estimates of the random effects η are compared with a standard Gaussian distribution. A final overview of the model performance can be done using a visual predictive check (VPC, Figure 6). In this graph, the percentiles of data obtained from multiple MCMC simulations of the final model (displayed as 90% prediction intervals, blue and red bands) are compared with the percentiles of the observed data (black lines). The VPC shows that the model was able to reproduce both the average trend (50th percentile, red band), as well as the variability (10th and 90th percentiles, blue bands) of the observed data well. The presence of outliers (red circles) in the bottom part of the graph is most likely due to having discarded BQL data from the original dataset, having thus introduced a bias in the computation of the empirical percentiles, which were, therefore, slightly overestimated.

4. Discussion

Despite the progress made in insulin preparation, the timing and dosing of insulin therapy are still inadequate to achieve optimal glucose control in T1D, mainly due to the high variability in the absorption process. The dosing regimens are currently tuned by the physician by a trail-and-error approach, which could lead to dangerous fluctuations in the blood glucose levels of the patient. Hence, a model able to describe that variability would be a powerful tool to optimize and personalize insulin initiation and titration.
In this work, a reliable NLME model describing absorption of fast-acting insulin analogues from a subcutaneous injection was presented. This model was given by the combination of the compartmental kinetic model developed in [12] with a new model describing the parameter variability, which represents an important step forward toward the description of BSV of subcutaneous insulin absorption. The model was identified on a large database of 116 T1D subjects using the Monolix built-in SAEM and MCMC algorithms. The model was able to reproduce the measurement data well, with an IWRES distribution that followed a standard Gaussian distribution in all three studies. In support of this, ninety-one-point-four percent of subjects passed the Shapiro–Wilk test to assess the normality of the residuals, while 88.8% passed the runs test to assess the randomness. The 22 model parameters were estimated with good precision: the mean RSE was equal to 9.11%, and no RSE was greater than 50%. Furthermore, the distributions of the individual parameters were within the physiological ranges and close to the values reported in [12]. The final validation step using the VPC (Figure 6) showed how well the model was able to capture both the typical trend and the variability of the absorption process.
The final covariance matrix of the random effects Ω (Equation 13) was suggested and then confirmed by the posterior correlation analysis performed on the estimated random effects. From the results of Model 1, the ρ V I , k a 2 correlation was detected (correlation = 0.40, p-value < 10 5 ), then from Model 2, the ρ V I , k e and ρ k a 2 , k e correlations were detected (correlation = −0.30 and −0.27, respectively, both p-values < 0.01 ), and finally, from Model 3 and on, no significant correlation between the random effects was detected (all p-values > 0.05).
Conversely, the detection of covariates to be introduced into the model was not that straightforward. For instance, although Pearson’s correlation test strongly suggested the introduction of the covariate BMI in the variability model of V I (Model 5), this did not bring any additional information since V I is already expressed in liters per kilograms of BW, and the BMI directly derives from the BW, leading to poor precision in the estimation of β B M I , V I . The final model (Model 11) included the covariate BMI that directly explained a portion of the variance of the parameter k a 2 , which is the fractional rate of absorption from the subcutaneous space to the circulation, in agreement with the posterior statistical analysis performed in [12]. In the NLME framework, it was then possible to estimate the contribution of a deviation from the BMI reference value to the parameter k a 2 through the parameter β B M I , k a 2 : for each unit of BMI, the logarithm of k a 2 decreased by a factor of −0.087. This negative relation between the BMI and k a 2 seems physiologically reasonable since the higher the BMI of the subjects, the thicker is their skin and adipose layer and therefore the higher will be the time taken for insulin to be absorbed through the subcutaneous tissue into plasma. All the attempts to further improve the final model failed, even if Model 14 was close to succeeding. This model was identical to Model 11 with the addition of the log-transformed age in the variability model of τ . However, the parameter β ln ( A G E ) , τ was estimated with an RSE of 59.7%, and therefore, this model was discarded. Nevertheless, this could still indicate a hidden contribution of age in the delay of insulin absorption, which was not detected by our analysis. Actually, the parameter τ summarizes a complex kinetic, which is sometimes described with one or more compartments in the physiological model [12] and that may hide a parameter highly correlated with age. Moreover, the delay could also be influenced by the experimental setup, which differed among the three studies, and the relation could even be nonlinear, such as the skin thickness, which presents an inversion of the trend with age increasing [28].
In the literature, different error models for insulin assays have been proposed, for example: the standard deviation of the measurement error was assumed constant in [12], proportional to the observed insulin in [29], and a combination of a constant and a proportional factor in [30]. The combined error model that we selected (Equation (7)) was confirmed by the fact that the error coefficients a and b were not fixed, but estimated alongside all the other model parameters with good precision and by the IWRES distributions that followed a standard Gaussian curve (Figure 4), suggesting this error model for each of the three studies forming the database.
Possible limitations of this study were that the model was identified only on insulin lispro as representative of commercially available insulin compounds and that, in all the experiments, each subject underwent a single subcutaneous injection of lispro, while multiple daily injection therapy requires the injection of different types of insulin administered more times in a day. Moreover, the analysis of the WSV was not allowed since each subject was examined only once, as per the protocols. In addition, a relatively small number of covariates was analyzed: only three of them were independent (age, BW, and height), and only a log-transformation was tested along with the raw value. Furthermore, one can argue that the estimated variability could be an underestimation of the variability present in day-to-day life since, during inpatient studies, factors like physical activity, which can also influence insulin absorption [5], were absent. The above limitations may be overcome in future studies designed to further validate and improve the model, e.g., testing the model on other databases where different types of insulin analogues are utilized or where different protocols are adopted that may allow modeling the WSV of the process, thus providing a more robust tool for the optimization of insulin treatment. Finally, the same methodologies can be applied to describe the BSV present in the absorption of long-acting insulin analogues and insulin action in order to estimate the whole variability present in the glucose-insulin system, from insulin absorption to glucose response. All the analysis was performed using Monolix (proprietary software, free for academic users [23]) and a minor part using R (open-source software [26]); nevertheless, the analysis could be performed entirely with R or using other software, e.g., NONMEM (proprietary software, NONMEM [31], ©ICON, Dublin, Ireland).

5. Conclusions

In this work, an NLME model aiming to describe the BSV that affects subcutaneous absorption of fast-acting insulin analogues was proposed. The model was built by adding, to an already existing physiological model, a stochastic model describing the BSV of model parameters and their relationship with subject covariates. The model, selected among a collection of 14 models, was able to accurately predict insulin appearance in plasma from subcutaneous injection, as well as to provide an estimate of the BSV. This will help in better understanding the factors that influence the subcutaneous absorption of insulin analogues. Together with the mathematical modeling of the BSV, another step forward made by this work is the identification of a correlation between the BMI and the rate of insulin absorption from subcutaneous tissue into plasma. Actually, being able to account for subject variability and to detect useful covariates will pave the way for precision medicine in the field of diabetes, providing a customized approach to the disease for each patient. Furthermore, this model will be useful in the development of algorithms for subcutaneous insulin delivery implemented in insulin pump devices [20,21] and will be an important component of in silico platforms, like the UVa/Padova T1D Simulator [14,15,16,17,18,19]. The incorporation into the simulator of models that account for subject variability would allow for more realistic simulations, providing great benefits on the way to the development and approval of new insulin compounds. In this way, the dosing regimens could be optimized, improving the insulin therapy of millions of diabetic patients, in a cost-effective way.

Author Contributions

E.F. developed the model, performed the analysis, contributed to the discussion, and wrote the manuscript. M.S. developed the model, supervised the analysis, contributed to the discussion, and edited the manuscript. C.D.M. developed the model, supervised the analysis, contributed to the discussion, and edited the manuscript. C.D.M. is the guarantor of this work and, as such, had full access to all the data in the study and takes responsibility for the integrity of the data and the accuracy of the data analysis. All authors read and agreed to the published version of the manuscript.

Funding

This study was supported by MIUR (Italian Minister for Education) under the initiative “Departments of Excellence” (Law 232/2016) and University of Padova under the initiative “SID-Networking Project 2019”.

Institutional Review Board Statement

The studies were conducted at the Profil Institute for Metabolic Research in Neuss, Germany, in accordance with the Declaration of Helsinki, and the protocol was approved by the local Ethics Committee (project identification codes: NCT01235039 (Study 1), NCT02146651 (Study 2), and NCT02344992 (Study 3)).

Informed Consent Statement

All subjects gave their informed consent for inclusion before they participated in the study.

Data Availability Statement

Restrictions apply to the availability of these data. Data was obtained from Alan Krasner (Biodel Inc.), Olivier Soula (Adocia) and Gregory Meiffren (Adocia) and are available from the authors with the permission of Alan Krasner (Biodel Inc.), Olivier Soula (Adocia) and Gregory Meiffren (Adocia).

Acknowledgments

The authors would like to thank Alan Krasner from Biodel Inc. and Olivier Soula and Gregory Meiffren from Adocia for providing the data.

Conflicts of Interest

The authors declare no conflict of interest.

Abbreviations

The following abbreviations are used in this manuscript:
BHBody height
BICcBayesian information criterion corrected for NLME models
BMIBody mass index
BQLBelow the quantification limit
BSABody surface area
BSVBetween subject variability
BWBody weight
FDAFood and Drug Administration
IWRESIndividual weighted residuals
MCMCMarkov chain Monte Carlo
NLMENonlinear mixed effects
RSERelative standard error
SAEMStochastic approximation of expectation maximization
T1DType 1 diabetes
T2DType 2 diabetes
UVaUniversity of Virginia
VPCVisual predictive check
WSVWithin-subject variability

References

  1. Heinemann, L. Variability of Insulin Absorption and Insulin Action. Diabetes Technol. Ther. 2002, 4, 673–682. [Google Scholar] [CrossRef]
  2. Binder, C. Absorption of Injected Insulin. Acta Pharmacol. Toxicol. 1969, 27, 1–83. [Google Scholar] [CrossRef]
  3. Berger, M.; Cüppers, H.J.; Hegner, H.; Jörgens, V.; Berchtold, P. Absorption Kinetics and Biologic Effects of Subcutaneously Injected Insulin Preparations. Diabetes Care 1982, 5, 77–91. [Google Scholar] [CrossRef]
  4. Hildebrandt, P.; Sejrsen, P.; Nielsen, S.L.; Birch, K.; Sestoft, L. Diffusion and polymerization determines the insulin absorption from subcutaneous tissue in diabetic patients. Scand. J. Clin. Lab. Investig. 1985, 45, 685–690. [Google Scholar] [CrossRef] [PubMed]
  5. Fernqvist, E.; Linde, B.; Östman, J.; Gunnarsson, R. Effects of physical exercise on insulin absorption in insulin-dependent diabetics. A comparison between human and porcine insulin. Clin. Physiol. 1986, 6, 489–497. [Google Scholar] [CrossRef] [PubMed]
  6. Brange, J.; Owens, D.R.; Kang, S.; Vølund, A. Monomeric Insulins and Their Experimental and Clinical Implications. Diabetes Care 1990, 13, 923–954. [Google Scholar] [CrossRef] [PubMed]
  7. Kang, S.; Brange, J.; Burch, A.; Vølund, A.; Owens, D.R. Subcutaneous Insulin Absorption Explained by Insulin’s Physicochemical Properties: Evidence From Absorption Studies of Soluble Human Insulin and Insulin Analogues in Humans. Diabetes Care 1991, 14, 942–948. [Google Scholar] [CrossRef]
  8. Chen, J.W.; Frystyk, J.; Lauritzen, T.; Christiansen, J.S. Impact of insulin antibodies on insulin aspart pharmacokinetics and pharmacodynamics after 12-week treatment with multiple daily injections of biphasic insulin aspart 30 in patients with type 1 diabetes. Eur. J. Endocrinol. 2005, 153, 907–913. [Google Scholar] [CrossRef] [Green Version]
  9. Ette, E.I.; Williams, P.J. Population Pharmacokinetics II: Estimation Methods. Ann. Pharmacother. 2004, 38, 1907–1915. [Google Scholar] [CrossRef] [PubMed]
  10. Vicini, P.; Cobelli, C. The iterative two-stage population approach to IVGTT minimal modeling: Improved precision with reduced sampling. Am. J. Physiol. Endocrinol. Metab. 2001, 280, E179–E186. [Google Scholar] [CrossRef] [Green Version]
  11. Denti, P.; Bertoldo, A.; Vicini, P.; Cobelli, C. IVGTT glucose minimal model covariate selection by nonlinear mixed-effects approach. Am. J. Physiol. Endocrinol. Metab. 2010, 298, E950–E960. [Google Scholar] [CrossRef] [PubMed]
  12. Schiavon, M.; Dalla Man, C.; Cobelli, C. Modeling Subcutaneous Absorption of Fast-Acting Insulin in Type 1 Diabetes. IEEE Trans. Biomed. Eng. 2018, 65, 2079–2086. [Google Scholar] [CrossRef] [PubMed]
  13. Schiavon, M.; Visentin, R.; Giegerich, C.; Klabunde, T.; Cobelli, C.; Dalla Man, C. Modeling Subcutaneous Absorption of Long-Acting Insulin Glargine in Type 1 Diabetes. IEEE Trans. Biomed. Eng. 2020, 67, 624–631. [Google Scholar] [CrossRef] [PubMed]
  14. Dalla Man, C.; Micheletto, F.; Lv, D.; Breton, M.; Kovatchev, B.; Cobelli, C. The UVa/Padova Type 1 Diabetes Simulator: New Features. J. Diabetes Sci. Technol. 2014, 8, 26–34. [Google Scholar]
  15. Kovatchev, B.; Breton, M.; Dalla Man, C.; Cobelli, C. In Silico Preclinical Trials: A Proof of Concept in Closed-Loop Control of Type 1 Diabetes. J. Diabetes Sci. Technol. 2009, 3, 44–55. [Google Scholar] [CrossRef] [Green Version]
  16. Edelman, S.V. Regulation Catches Up to Reality: Nonadjunctive Use of Continuous Glucose Monitoring Data. J. Diabetes Sci. Technol. 2017, 11, 160–164. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Visentin, R.; Giegerich, C.; Jäger, R.; Dahmen, R.; Boss, A.; Grant, M.; Dalla Man, C.; Cobelli, C.; Klabunde, T. Improving Efficacy of Inhaled Technosphere Insulin (Afrezza) by Postmeal Dosing: In-silico Clinical Trial with the UVa/Padova Type 1 Diabetes Simulator. Diabetes Technol. Ther. 2016, 18, 574–585. [Google Scholar] [CrossRef] [PubMed]
  18. Schiavon, M.; Visentin, R.; Giegerich, C.; Sieber, J.; Dalla Man, C.; Cobelli, C.; Klabunde, T. In Silico Head-to-Head Comparison of Insulin Glargine 300 U/mL and Insulin Degludec 100 U/mL in Type 1 Diabetes. Diabetes Technol. Ther. 2020, 22, 553–561. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  19. Visentin, R.; Cobelli, C.; Dalla Man, C. The Padova Type 2 Diabetes Simulator from Triple-Tracer Single-Meal Studies: In Silico Trials Also Possible in Rare but Not-So-Rare Individuals. Diabetes Technol. Ther. 2020, 22, 892–903. [Google Scholar] [CrossRef]
  20. Hovorka, R.; Allen, J.M.; Elleri, D.; Chassin, L.J.; Harris, J.; Xing, D.; Kollman, C.; Hovorka, T.; Larsen, A.M.F.; Nodale, M.; et al. Manual closed-loop insulin delivery in children and adolescents with type 1 diabetes: A phase 2 randomised crossover trial. Lancet 2010, 375, 743–751. [Google Scholar] [CrossRef] [Green Version]
  21. Kovatchev, B.; Cobelli, C.; Renard, E.; Anderson, S.; Breton, M.; Patek, S.; Clarke, W.; Bruttomesso, D.; Maran, A.; Costa, S.; et al. Multinational Study of Subcutaneous Model-Predictive Closed-Loop Control in Type 1 Diabetes Mellitus: Summary of the Results. J. Diabetes Sci. Technol. 2010, 4, 1374–1381. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  22. Heinemann, L.; Nosek, L.; Flacke, F.; Albus, K.; Krasner, A.; Pichotta, P.; Heise, T.; Steiner, S. U-100, pH-Neutral formulation of VIAject®: Faster onset of action than insulin lispro in patients with type 1 diabetes. Diabetes Obes. Metab. 2012, 14, 222–227. [Google Scholar] [CrossRef]
  23. Documentation of Monolix, Version 2020R1. Available online: http://monolix.lixoft.com/ (accessed on 9 April 2021).
  24. Kuhn, E.; Lavielle, M. Maximum Likelihood Estimation in Nonlinear Mixed Effects Models. Comput. Stat. Data Anal. 2005, 49, 1020–1038. [Google Scholar] [CrossRef]
  25. Campioni, M.; Toffolo, G.; Basu, R.; Rizza, R.A.; Cobelli, C. Minimal model assessment of hepatic insulin extraction during an oral test from standard insulin kinetic parameters. Am. J. Physiol. Endocrinol. Metab. 2009, 297, E941–E948. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. Documentation of R, Version 4.0.3. Available online: https://www.r-project.org/other-docs.html (accessed on 15 January 2021).
  27. Delattre, M.; Lavielle, M.; Poursat, M.A. A note on BIC in mixed-effects models. Electron. J. Stat. 2014, 8, 456–475. [Google Scholar] [CrossRef]
  28. Derraik, J.; Rademaker, M.; Cutfield, W.; Pinto, T.; Tregurtha, S.; Faherty, A.; Peart, J.; Drury, P.; Hofman, P. Effects of Age, Gender, BMI, and Anatomical Site on Skin Thickness in Children and Adults with Diabetes. PLoS ONE 2014, 9, e86637. [Google Scholar] [CrossRef]
  29. Wilinska, M.E.; Chassin, L.J.; Schaller, H.C.; Schaupp, L.; Pieber, T.R.; Hovorka, R. Insulin kinetics in type-1 diabetes: Continuous and bolus delivery of rapid acting insulin. IEEE Trans. Biomed. Eng. 2005, 52, 3–12. [Google Scholar] [CrossRef]
  30. Toffolo, G.M.; Campioni, M.; Basu, R.; Rizza, R.; Cobelli, C. A minimal model of insulin secretion and kinetics to assess hepatic insulin extraction. Am. J. Physiol. Endocrinol. Metab. 2006, 290, E169–E176. [Google Scholar] [CrossRef]
  31. Website of NONMEM. Available online: https://www.iconplc.com/innovation/nonmem/ (accessed on 9 April 2021).
Figure 1. Plasma insulin concentration ( μ U/mL) in Study 1 (A), Study 2 (B), and Study 3 (C). Blue lines represent individual profiles, black lines the mean profile of each dataset, and dashed lines the BQL of each dataset.
Figure 1. Plasma insulin concentration ( μ U/mL) in Study 1 (A), Study 2 (B), and Study 3 (C). Blue lines represent individual profiles, black lines the mean profile of each dataset, and dashed lines the BQL of each dataset.
Metabolites 11 00235 g001
Figure 2. Schematic representation of the NLME approach. The central panel represents an NLME model: it consists of a structural model of the system coupled with a model of the parameter variability. Feeding the NLME model with a large database containing also subject covariates, one can obtain both the population and the individual models better fitting the data.
Figure 2. Schematic representation of the NLME approach. The central panel represents an NLME model: it consists of a structural model of the system coupled with a model of the parameter variability. Feeding the NLME model with a large database containing also subject covariates, one can obtain both the population and the individual models better fitting the data.
Metabolites 11 00235 g002
Figure 3. Compartmental representation of the model describing the subcutaneous absorption of fast-acting insulin [12]. Model compartments are represented with circles, and the fluxes are indicated with arrows. Signals u and y represent the subcutaneous insulin administration and plasma insulin concentration, respectively.
Figure 3. Compartmental representation of the model describing the subcutaneous absorption of fast-acting insulin [12]. Model compartments are represented with circles, and the fluxes are indicated with arrows. Signals u and y represent the subcutaneous insulin administration and plasma insulin concentration, respectively.
Metabolites 11 00235 g003
Figure 4. Evaluation of the goodness of the predictions of Model 11. Left panels: the fit of the model for three representative subjects, one for each study. Blue dots indicate plasma insulin measurements, and black dashed lines represent the model predictions. Right panels: the distributions of the IWRES in each study, compared with a standard Gaussian distribution (black line).
Figure 4. Evaluation of the goodness of the predictions of Model 11. Left panels: the fit of the model for three representative subjects, one for each study. Blue dots indicate plasma insulin measurements, and black dashed lines represent the model predictions. Right panels: the distributions of the IWRES in each study, compared with a standard Gaussian distribution (black line).
Metabolites 11 00235 g004
Figure 5. Parameter distributions of Model 11. Left panels: individual parameter distributions compared with the corresponding theoretical distributions (black line). Right panels: random effect distributions compared with a standard Gaussian (black line).
Figure 5. Parameter distributions of Model 11. Left panels: individual parameter distributions compared with the corresponding theoretical distributions (black line). Right panels: random effect distributions compared with a standard Gaussian (black line).
Metabolites 11 00235 g005
Figure 6. Visual predictive check obtained with the selected variability model (Model 11). The 90% prediction intervals of the 10th (blue lower area), 50th (red central area), and 90th (blue upper area) percentiles are compared with the 10th, 50th, and 90th empirical percentiles (black solid lines). Outliers are marked with red circles.
Figure 6. Visual predictive check obtained with the selected variability model (Model 11). The 90% prediction intervals of the 10th (blue lower area), 50th (red central area), and 90th (blue upper area) percentiles are compared with the 10th, 50th, and 90th empirical percentiles (black solid lines). Outliers are marked with red circles.
Metabolites 11 00235 g006
Table 1. Summary of the tested  models of the parameter variability, ordered by ascending number of parameters. From left to right: model number; the additional parameter β k , i used to introduce the covariate c k in the variability model of ψ i ; the additional parameter ρ i 1 , i 2 used to introduce a correlation between the random effects of the parameters ψ i 1 and ψ i 2 ; the estimate precision expressed as the mean RSE and the number of parameters showing RSE > 50%; percentages of the subjects that passed the Shapiro–Wilk (SW) test and the runs test; the value of the BICc. The selected model is highlighted in gray.
Table 1. Summary of the tested  models of the parameter variability, ordered by ascending number of parameters. From left to right: model number; the additional parameter β k , i used to introduce the covariate c k in the variability model of ψ i ; the additional parameter ρ i 1 , i 2 used to introduce a correlation between the random effects of the parameters ψ i 1 and ψ i 2 ; the estimate precision expressed as the mean RSE and the number of parameters showing RSE > 50%; percentages of the subjects that passed the Shapiro–Wilk (SW) test and the runs test; the value of the BICc. The selected model is highlighted in gray.
ModelCovariateCorrelationNumber ofPrecision of the Estimates% of Subjects that Passed:BICc
NumberCoefficientsParametersParametersMean RSERSE >50%SW TestRuns Test
1--188.29089.789.714,535.48
2- ρ V I , k a 2 199.57092.288.814,523.40
3- ρ V I , k a 2 ρ V I , k e ρ k a 2 , k e 219.35090.588.814,494.36
4 β ln ( A G E ) , τ ρ V I , k a 2 ρ V I , k e ρ k a 2 , k e 2211.11190.588.814,510.54
5 β B M I , V I ρ V I , k a 2 ρ V I , k e ρ k a 2 , k e 2232.24191.488.814,506.42
6 β B M I , k e ρ V I , k a 2 ρ V I , k e ρ k a 2 , k e 2210.95090.588.814,505.33
7 β B S A , k a 2 ρ V I , k a 2 ρ V I , k e ρ k a 2 , k e 2210.48090.589.714,495.18
8 β B M I , τ ρ V I , k a 2 ρ V I , k e ρ k a 2 , k e 2211.61190.588.814,487.14
9 β B W , k a 2 ρ V I , k a 2 ρ V I , k e ρ k a 2 , k e 229.58091.489.714,484.42
10 β ln ( B W ) , k a 2 ρ V I , k a 2 ρ V I , k e ρ k a 2 , k e 228.59091.488.814,477.76
11 β B M I , k a 2 ρ V I , k a 2 ρ V I , k e ρ k a 2 , k e 229.11091.488.814,476.86
12 β B M I , τ ; β B M I , k a 2 ρ V I , k a 2 ρ V I , k e ρ k a 2 , k e 2311.01191.487.914,481.72
13 β B H , k a 2 ; β B W , k a 2 ρ V I , k a 2 ρ V I , k e ρ k a 2 , k e 2310.03091.488.814,478.24
14 β B M I , k a 2 ; β ln ( A G E ) , τ ρ V I , k a 2 ρ V I , k e ρ k a 2 , k e 2310.67191.487.914,475.43
Table 2. Estimated population parameters of the model and their corresponding RSE.
Table 2. Estimated population parameters of the model and their corresponding RSE.
Estimates of the population parameters
Parameter Estimated Value Unit of Measurement RSE
Fixed effects τ p o p 5.62min7.5
V I p o p 0.135L/kg3.58
α p o p 0.0155min 1 10.5
k a 1 p o p 0.000134min 1 36.9
k a 2 p o p 0.0128min 1 3.43
k e p o p 0.113min 1 3.33
β B M I , k a 2 −0.0865m 2 /kg13.6
Standard deviations
of the
random effects
ω τ 0.731dimensionless8.81
ω V I 0.319dimensionless7.17
ω α 1.02dimensionless7.98
ω k a 1 1.86dimensionless11.8
ω k a 2 0.322dimensionless7.23
ω k e 0.303dimensionless6.51
Correlations
between
random effects
ρ V I , k a 2 0.681dimensionless8.19
ρ V I , k e −0.579dimensionless11.1
ρ k a 2 , k e −0.506dimensionless14
Error model
parameters
a 1 1.96 μ U/mL8.85
b 1 0.0773dimensionless7.66
a 2 2.33 μ U/mL5.47
b 2 0.0516dimensionless5.79
a 3 2.77 μ U/mL5.17
b 3 0.0559dimensionless5.76
Table 3. Summary of the individual parameter distributions obtained from model identification. From left to right: the minimum, the first quartile ( 25 % ), the median, the third quartile ( 75 % ), and the maximum value.
Table 3. Summary of the individual parameter distributions obtained from model identification. From left to right: the minimum, the first quartile ( 25 % ), the median, the third quartile ( 75 % ), and the maximum value.
Estimates of the individual parameters
Parameter Min Q1 Median Q2 Max Unit of Measurement
τ 0.7484.035.9810.521.9min
V I 0.07410.1210.1460.170.29L/kg
α 0.003640.009680.01920.03340.116min 1
k a 1 0.0000790.0001180.0001320.0001660.00824min 1
k a 2 0.004180.01070.01360.01690.0313min 1
k e 0.0460.09740.1120.130.195min 1
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Faggionato, E.; Schiavon, M.; Dalla Man, C. Modeling Between-Subject Variability in Subcutaneous Absorption of a Fast-Acting Insulin Analogue by a Nonlinear Mixed Effects Approach. Metabolites 2021, 11, 235. https://doi.org/10.3390/metabo11040235

AMA Style

Faggionato E, Schiavon M, Dalla Man C. Modeling Between-Subject Variability in Subcutaneous Absorption of a Fast-Acting Insulin Analogue by a Nonlinear Mixed Effects Approach. Metabolites. 2021; 11(4):235. https://doi.org/10.3390/metabo11040235

Chicago/Turabian Style

Faggionato, Edoardo, Michele Schiavon, and Chiara Dalla Man. 2021. "Modeling Between-Subject Variability in Subcutaneous Absorption of a Fast-Acting Insulin Analogue by a Nonlinear Mixed Effects Approach" Metabolites 11, no. 4: 235. https://doi.org/10.3390/metabo11040235

APA Style

Faggionato, E., Schiavon, M., & Dalla Man, C. (2021). Modeling Between-Subject Variability in Subcutaneous Absorption of a Fast-Acting Insulin Analogue by a Nonlinear Mixed Effects Approach. Metabolites, 11(4), 235. https://doi.org/10.3390/metabo11040235

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop