Next Article in Journal
Unveiling the Comorbidities of Chronic Diseases in Serbia Using ML Algorithms and Kohonen Self-Organizing Maps for Personalized Healthcare Frameworks
Previous Article in Journal
Mid- to Long-Term Survival of Geriatric Patients with Primary Septic Arthritis of the Shoulder: A Retrospective Study over a Period of 20 Years
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Measures of Patient-Reported Expectations, Acceptance, and Satisfaction Using Automated Insulin Delivery Systems: A Review

by
Marco Marigliano
1,*,†,
Enza Mozzillo
2,†,
Valentina Mancioppi
1,
Francesca Di Candia
2,
Francesco Maria Rosanio
2,
Annalisa Antonelli
3,
Ilaria Nichelatti
4,
Claudio Maffeis
1,
Stefano Tumini
3 and
Roberto Franceschi
4
1
Department of Surgery, Dentistry, Pediatrics and Gynecology, Section of Pediatric Diabetes and Metabolism, University and Azienda Ospedaliera Universitaria Integrata of Verona, 37126 Verona, Italy
2
Department of Translational Medical Science, Section of Pediatrics, Regional Center of Pediatric Diabetes, Federico II University of Naples, 80138 Naples, Italy
3
Department of Maternal and Child Health, UOSD Regional Center of Pediatric Diabetology, Chieti Hospital, 66100 Chieti, Italy
4
Pediatric Diabetology Unit, Pediatric Department, S.Chiara General Hospital of Trento, Azienda Provinciale per i Servizi Sanitari, 38122 Trento, Italy
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
J. Pers. Med. 2023, 13(7), 1031; https://doi.org/10.3390/jpm13071031
Submission received: 6 April 2023 / Revised: 10 June 2023 / Accepted: 14 June 2023 / Published: 22 June 2023
(This article belongs to the Section Mechanisms of Diseases)

Abstract

:
In people with type 1 diabetes, Automated Insulin Delivery (AID) systems adjust insulin delivery in response to sensor glucose data and consist of three components: an insulin pump, a continuous glucose sensor, and an algorithm that determines insulin delivery. To date, all the available AID systems require users to announce carbohydrate intake and deliver meal boluses, as well as respond to system alarms. The use of AID devices both initially and over time may be influenced by a variety of psychological factors. Analysis of patient-related outcomes should be taken into account, while recruiting applicants for the systems who are motivated and have realistic expectations in order to prevent AID dropout. We report an up-to-date summary of the available measures and semi-structured interview content to assess AID expectations, acceptance, and satisfaction using the AID systems. In conclusion, we suggest, before and after starting using AID systems, performing a specific evaluation of the related psychological implications, using validated measures and semi-structured interviews, that allows diabetes care providers to tailor their education approach to the factors that concern the patient at that time; they can teach problem-solving skills and other behavioral strategies to support sustained use of the AID system.

1. Introduction

The first hybrid closed-loop (HCL) system, with automated insulin delivery but still requiring user inputs, was approved for the treatment of Type 1 Diabetes (T1D) by the U.S. Food and Drug Administration in September 2016. Closed-loop (CL) systems, also referred to as Automated insulin delivery (AID) systems or artificial pancreas (AP) systems, adjust insulin delivery in response to sensor glucose data and consist of three components: an insulin pump, a continuous glucose sensor, and an algorithm that translates in real time the information it receives from the real-time CGM and computes the amount of insulin to be delivered by the insulin pump [1]. Different algorithms are available; they are safe and allow youths with T1D to achieve optimal glucose control reducing glycated hemoglobin (HbA1c) by 0.3–0.7%, reducing the time below range (<70 mg/dL), and increasing the time in range (70–180 mg/dL, TIR) [1,2]. The psychological benefits associated with the use of AID technology usually include improved QoL and quality of sleep, reduced diabetes distress, reduced fear of hypoglycemia, and improved safety, flexibility, and satisfaction [2].
Although the new generation systems have benefited from continued evolution, barriers related to the three components of the AID system are still reported, and the main issues are [3,4,5,6,7]:
-
For continuous subcutaneous insulin infusion (CSII): painful catheter insertion, set obstructions, altered body shape and problems with social acceptance, dissatisfaction with the size and appearance of the pump, and physical discomfort and limitations during physical activity or while bathing;
-
For continuous glucose monitoring (CGM): skin irritation, inaccurate readings, excessive exposure to device alarms (in particular, false or unnecessary ones) that cause daily activity interruptions and poor or interrupted sleep, limitations in remote monitoring access for parents, and frustrations with technical glitches;
-
For the algorithm: system-mandated exits, which are a system-initiated reversion to open-loop insulin, have been reported as leading to user frustration and device discontinuation [2].
These disadvantages of diabetes technology are usually reported as barriers to its adoption, and sometimes these might be reasons to discontinue AID systems [2].
Candidate selection for initiating this diabetes technology could be based on how engaged an adolescent with T1D or, for children, their caregivers are with diabetes management, in terms of the time of sensor usage, attending a certain threshold of medical visits per year, or achieving a target HbA1c or TIR [2]. Vice versa, the data from the literature demonstrated that patients with a higher baseline HbA1c had the greatest benefit in glucose control, using these advanced diabetes technologies [2].
Multiple psychosocial and behavioral factors can influence the initial and persistent use of AID systems [8,9]. Analysis of youths’ and parents’ attitudes towards an AID system can be evaluated through the following aspects according to the Technology Acceptance Model (TAM) [10]:
-
Intention to use it, which is the subjective probability that one will use the AP;
-
The perceived usefulness of AID, which is the degree to which the patient thinks that the AP would facilitate glucose control. Its determinants are the quality of care (the degree of glucose control), the consequences of the AP (healthcare cost and required time investment, quality of life), the importance of the AP towards glucose control, the influence of relatives (subjective norm), and the perceived image in a peer group if using the AP;
-
The perceived ease of use is the degree to which the patient believes that using the AP would be free of effort. The determinants are the self-efficacy to operate the AP, the need for training (external control), the use of the features of the currently used insulin pump (proxy for intrinsic motivation), and the anxiety at the time of starting the new treatment.
-
Trust in the AP manufacturer and features of the AP system are additional factors.
Considering these concepts could help to enroll candidates for AID systems who are motivated, have realistic expectations of what the devices can and cannot do, and receive training on system use [2,11]. Users transitioning to an AID system should be prepared to allow at least a one-month adjustment period [2]. To date, all the available AID systems require users to announce carbohydrate intake and deliver meal boluses, as well as respond to system alarms. Therefore, to eliminate the need for diabetes self-management behaviors is an unrealistic expectation. Furthermore, persons with diabetes and their caregivers should be advised that the glucose values will improve above all during the night but still have some variability during the day, especially after meals. Adjustments to modifiable pump settings, such as the insulin to carbohydrate ratios, are needed to optimize the time in range [2]. These obstacles and any fears should be acknowledged and discussed with youth with T1D and their caregivers, and the advantages should be carefully explained.
Semi-structured interviews based on the TAM as well as different measures to assess the expected AID acceptance have been developed and reported in the literature [10,12,13,14,15,16]. Likewise, once diabetes technology use has begun, persistence with use is critical for treatment success. After starting use of the AID systems, the assessment of the benefits and hassles through semi-structured interviews and questionnaires become fundamental elements. These could be used to evaluate the patients’ acceptance of the AID and to predict the continued use, in particular after gaining experience in AID management [7,16,17,18]. Moreover, treatment satisfaction is considered an important factor in predicting adherence to an AID system, and a questionnaire on diabetes technology and closed-loop satisfaction are available [19,20,21].
This review aims to provide an up-to-date summary of the available measures and semi-structured interview content, to assess the patient-reported expectations, acceptance, and satisfaction with the AID systems.

2. Search Strategy

We searched electronic databases (Pubmed, EMBASE, and Web of Science) for studies published between 1 January 2010 and 1 January 2023. The search terms or “MESH” (MEdical Subject Headings) for this review included different combinations: “artificial pancreas” or “AP” or “automated insulin delivery” or “AID” or “hybrid closed loop” or “closed loop” or “HCL” or “AHCL” AND “expectation” or “intention” or “acceptance” or “perception” or “satisfaction” or “psychol*” AND “measure” or “instrument“ or “interview” or “questionnaire”.
We included studies on youths and adults with T1D, observational ones (cohort or cross-sectional studies) or clinical trials. We excluded case reports or studies with less than 10 pediatric participants. Languages other than English were not a priori exclusion criteria. For each study, in the full paper, we evaluated the reference details, the population and study characteristics, the methodology used (measures and/or semi-structured interviews), the outcomes measured, and the results.

3. Summary of the Literature Analysis

In total, 95 studies were identified following the literature review, after duplicates were removed. After reviewing the titles and abstracts, 49 additional records were excluded. A total of 46 full-text manuscripts was assessed for eligibility: after full text examination, 20 studies were excluded, and a final number of 26 studies was included in this review (Table 1).
Among the selected studies, thirteen were RCT, seven cross-sectional, five prospective longitudinal, and one retrospective in design. The number of patients enrolled in the studies was between 12 and 50 in seventeen studies, 51 to 100 in two studies, and 101 to 1503 in five studies.
In Table 1, we report a summary of the available literature on the measures exploring the AID expectations before transitioning to AID, acceptance after the AID experience, and satisfaction, and here below, we present the characteristics of the questionnaires and the main results.

3.1. Measures Exploring Expectations and Acceptance

“Artificial Pancreas Acceptance”, INSPIRE, DSAT, and “Experience with bionic pancreas” are the four measures that were administered to children, adolescents, and adults in the studies we analyzed.

3.1.1. “Artificial Pancreas Acceptance” Measure

In 2011, Van Bon et al. developed and validated the first questionnaire to examine patients’ perceptions regarding future artificial pancreas (AP) systems in adults with T1D using CSII [10]. This questionnaire was based on the TAM, an instrument used to study acceptance or intention to use new computer systems to improve job performance [22,23]. Using factor and reliability analysis, the number of items in the “AP acceptance” measure was reduced from 34 to 15. The 15 items explore four areas: intention to use (the subjective probability that one will use the AP, items 1–2), perceived usefulness (the expected improvement in glucose control, items 3–10), perceived ease of use (the expectation that the AP can be easily handled, items 11–13), trust (the administration of correct insulin dose and the reliability of the glucose measurement, item 14). Answers were given on a 7-point Likert scale. The majority of patients in this study reported they intended to use an AP system and believed it would be useful, easy to use, and worthy of trust [10]. This measure was also used by Ziegler et al. in 2015 to assess the level of acceptance of the MD-Logic AP in adolescents [21]. The questionnaire was administered before and after four consecutive nights; participants reported significantly higher perceived ease of use of the AP, and the other acceptance scales remained on a high level. Prior to the trial’s launch, the participants were generally upbeat about the potential advantages of the AID systems, and by the study’s conclusion, the majority of participants said they planned to keep using AP systems.
The same “Artificial Pancreas Acceptance” measure was administered to parents of young children, after a 7-day camp, and they intended to use AP long term and felt that it was likely to improve glucose control [13].
Recently, in two more studies in children using the “Artificial Pancreas Acceptance” measure [10], both the parents as well as the patients, after the AP experience, reported higher scores for acceptance with an AID system [24,25]. The only item that received a lower score was related to the CGM device [25].
Bevier et al. in 2014 developed another “Artificial Pancreas Acceptance” questionnaire to assess the perceptions of adults who had already participated in an AP trial [14]. The 34-item survey contained 8 current treatment satisfaction questions, 11 TAM questions, and 15 questions assessing clinical trial patients’ motivation. A 5-point Likert scale was used. More than 85% of respondents were interested in using an AP system once it was commercially available. In total, 66.6% strongly agreed that an AP system could improve their blood glucose control, and 63.9% strongly agreed that an AP system could improve their quality of life.
Based on the above presented questionnaires, in 2019, Oukes et al. developed a new questionnaire that contained 40 items: 2 items exploring intention to use, 38 items about the (1) technology readiness of the person with T1DM (optimism, innovativeness, discomfort, and insecurity), (2) perceived product characteristics (usefulness, complexity, and compatibility) based on the TAM, and (3) influence of the social environment (social influence) [15]. This survey was administered online among adults with T1D on different treatment modalities, and the items were assessed on a 7-point Likert scale. The authors found that the intention to use the AP was related to the product characteristics, was related less to the technology readiness, and was not influenced by the social context.

3.1.2. “INSPIRE” Measure

The Insulin delivery Systems: Perceptions, Ideas, Reflections, and Expectations (INSPIRE) measure was validated in a study in 2019 [26] in youths and adults, most with CSII, and positive expectancies were reported. The “youth” measure includes 27 items, and the “parent” one includes 30 items. In two RCT studies on the AP versus the SAP in children and adolescents [27,28], the INSPIRE measure revealed a positive user experience in one study [27], while no change was detected in the other comparing the two groups [28].

3.1.3. “DSAT” Measure

The Diabetes-Specific Attitudes about Technology Use (DSAT) measure was created and validated in a study on 1503 adults with T1D using different technology devices (Glucose meters, CGM, and CSII). This measure consists of six questions that asked participants to rate on a 5-point Likert scale their attitudes about diabetes technology (“Diabetes technology has made my life easier”, “diabetes technology has made managing my health easier”, “I am lucky to live in a time with so much diabetes technology”, etc.) [18]. The authors found that the patients using any type of more advanced diabetes technology, such as pump therapy, CGM, or SAP, demonstrated more positive attitudes about diabetes technology [18]. Adolescents’ attitudes about diabetes technology were not different between those using AID systems and the CSII, while the satisfaction improved with the advanced hybrid closed-loop (AHCL) vs. the hybrid closed-loop (HCL) [29,30].

3.1.4. “Experience with Bionic Pancreas” Measure

The validation of the Bionic Pancreas questionnaire, which was created for a study released in 2016, is still ongoing [16]. The 38 items explore blood glucose management, device burden, and overall satisfaction. This questionnaire was used in a study in adults on Tandem Tslim X2 with Control IQ system, and evaluations at 3 and 7 weeks after starting reported high user satisfaction, trust, and ease of use [31]. The AID system’s sensor accuracy, improved diabetes management, decreased extreme blood glucose levels, and enhanced sleep quality all contributed to the high level of trust that users had in it. Using the same AID system, in a 5-day overnight closed-loop study, children and parents reported greater perceived benefits and fewer perceived burdens compared to the sensor-augmented pump (SAP) [32].

3.1.5. Measures Not Validated

The “Closed-loop experience questionnaire” consists of two parts. Part A lists six questions about the closed-loop experience during the study using a numerical scale from 1 to 5, from “Strongly Agree” to “Strongly Disagree”. For each answer, a mean score is calculated. Questions are reverse scored (except for question 3); so, a higher score denotes more satisfaction with the closed-loop system. Part B consists of three open-ended questions with room for suggestions for new features about the system’s perceived advantages and disadvantages. The questionnaire has not been validated. The day and night HCL enhanced glucose control and sleep quality in children by reducing the amount of time needed to manage stress and diabetes. The size of the devices, battery performance, connectivity issues, and alarms were identified as areas for improvement, as reported in response to the open questions [17]. Similar results were reported in preschool and school-aged children after the switch from an SAP to a do-it-yourself AID system, AndroidAPS [33].
Taushmann et al. in 2016 developed a questionnaire to evaluate patient-reported outcomes (PROs) in 12 adolescents after a trial with a closed-loop system [34]. The survey was composed of seven questions, with four closed questions and three open questions (what they like/did not like/additional features they suggest). Most of the participants expressed positive attitudes and experiences with the closed-loop system; they were confident with the CL system regulating their blood sugar and insulin delivery, most of them stated they spent less time managing diabetes, and their sleep was improved. The main issues were the number and size of the devices, alarms, connectivity, CGM calibration, and sensor life [34].
Forlenza et al. in 2019 developed a 38-item “Technology Acceptance Questionnaire” to evaluate children’s experience with Tandem Control IQ; the responses were quantified on a 5-point Likert Scale. The 24 participants had favorable subjective responses to the system; they referred to less time thinking about diabetes, the device was easy to use, it was useful in managing diabetes, and they could trust the device [7].

3.1.6. Semi-Structured Interviews for Expectations and Acceptance

Table 1 includes the list of studies reporting semi-structured interviews on the subject of this review. Semi-structured interviews have been used in different studies to explore the perceptions of children and adolescents, and their parents, regarding expectations and acceptance of AP systems, before [8,19,35] and after taking part in closed-loop studies [19,20,36,37]. The majority of the participants reported they planned to utilize AP systems when they were available after the study [19]. The reported psychological and physical benefits were improved glycemic control, a better quality of life, a reduced mental burden of diabetes, reduced anxiety, improved sleep, and a feeling of safety [20,36]. The size, visibility, possible presence of a type 1 diabetes “marker”, likely ineffectiveness of the devices, and challenges with calibration, alerts, and connectivity problems were cited as hurdles to using the AP systems [19,20,36]. Overall, users trusted the system more to manage diabetes overnight than to handle meals and exercise [37].
Table 1. Summary of the available measures exploring AID expectations, acceptance, and satisfaction; studies reporting semi-structured interview are listed. Abbreviations: d: day, w: week, y: years, T1D: type 1 diabetes, MDI: multiple daily injections, CSII: continuous subcutaneous insulin infusion, CGM: continuous glucose monitoring, SAP: sensor-augmented pump, LGS: low glucose suspend, PLGM: predictive low-glucose monitoring, AID: automated insulin delivery, AP: artificial pancreas, BP: bionic pancreas, CIQ: Control IQ, DTQ: diabetes technology questionnaire, DTSQ: diabetes treatment satisfaction questionnaire; IU: intention to use, PU: perceived usefulness, PE: perceived ease of use, T: trust, RCT: randomized controlled trial.
Table 1. Summary of the available measures exploring AID expectations, acceptance, and satisfaction; studies reporting semi-structured interview are listed. Abbreviations: d: day, w: week, y: years, T1D: type 1 diabetes, MDI: multiple daily injections, CSII: continuous subcutaneous insulin infusion, CGM: continuous glucose monitoring, SAP: sensor-augmented pump, LGS: low glucose suspend, PLGM: predictive low-glucose monitoring, AID: automated insulin delivery, AP: artificial pancreas, BP: bionic pancreas, CIQ: Control IQ, DTQ: diabetes technology questionnaire, DTSQ: diabetes treatment satisfaction questionnaire; IU: intention to use, PU: perceived usefulness, PE: perceived ease of use, T: trust, RCT: randomized controlled trial.
ReferencePopulation
and Study Design
Questionnaire Used Outcome MeasuredResults
Van Bon et al., 2011
[10]
132 adults on CSII
(mean age 43 y)
Cross-sectional
Artificial Pancreas Acceptance, validated in this studyFuture
Expectancies/Acceptance
High scores on IU, PU, PE, and T
Ziegler et al., 2015
[21]
40 adolescents (10–18 y)
on CSII
RCT crossover: CSII + rtCGM (4 d) vs. CSII + overnight closed loop (4 d)
Artificial Pancreas Acceptance
AP satisfaction questionnaire, validated in this study
Before and after ExperienceAfter: higher IU, PU, PE, and T
Higher satisfaction
Troncone et al., 2016
[13]
30 children (5–9 y) on CSII
34 parents; 7-day camp
RCT crossover: CSII + rtCGM (3 d) vs. CSII + overnight closed loop (3 d)
Artificial Pancreas Acceptance, for parents Semi-structured interview based on TAM DTSQ (parent)Before and after ExperienceParents, after: high IU, PU, and PE
Von dem Berge et al., 2022
[25]
38 children (2–14 y)
on CSII with or without CGM
RCT:
670 G with Guardian 3 sensor (8 w) vs. SAP and PLGM (8 w)
Artificial Pancreas Acceptance
DISABKIDS questionnaire (diabetes satisfaction and burden)
After ExperienceHigh scores for acceptance and satisfaction
Renard et al., 2019
[24]
24 prepubertal children (7–12 y) on CSII and their parents
RCT closed loop (48 h)
vs. SAP with LGS (48 h)
Artificial Pancreas Acceptance, only childBefore and after ExperienceAfter: significantly improved AP acceptance
Bevier et al., 2014
[14]
36 adults, 89% on CSII (46.6 ± 12.5 y), who had already participated in an AP trialCross-sectionalAP participants’ technology acceptance, validation study Future
Expectancies/Acceptance
High scores on IU, PU, and PE
Oukes et al., 2019
[15]
602 T1D adults
(39.1 ± 16.0; 45.8 ± 13.5 y)
MDI, CSII, and CSII + CGM
Cross-sectional
AP acceptance questionnaire (40 items), validation study Future
Expectancies/Acceptance
High IU, related to AID characteristics and not to readiness or social influence
Weissberg-Benchell et al., 2016
[16]
19 children (6–11 y) on CSII
RCT crossover: CSII + rtCGM (5 d) vs. CSII + overnight closed loop (5 d)
Experience with the Bionic Pancreas questionnaire Before and after ExperiencePositive and negative key areas were reported
Bisio et al., 2020
[32]
13 children (7–10 y, mean 9.1 ± 0.9 y) on CSII
and caregivers
Prospective: Tandem CIQ (4 w)
vs. SAP (4 w)
Experience with the Bionic Pancreas questionnaire, parents Before and after ExperienceAfter, parents reported greater perceived benefits and fewer perceived burdens
Pinsker et al., 2021
[31]
1435 adults on Tandem CIQ
(45.5 ± 16.6 y)
Prospective evaluations at +3 and +7 w after starting CIQ
Two open ended questions
Technology acceptance survey
(adapted from “Experience with BP”)
After ExperienceHigh user satisfaction, trust, and ease of use
Weissberg-Benchell et al., 2019
[26]
291 youths (8–17 y)
150 parents of youths ages 3–17 y 159 adults
From the T1D Exchange Registry, 70% on CSII
Cross-sectional
Insulin delivery Systems: Perceptions, Ideas, Reflections and Expectations (INSPIRE), validation studyFuture
Expectancies/Acceptance
The questionnaire measured positive expectancies
Kudva et al., 2021
[27]
48 adolescents (14–18 y), 80% on CSII, 70% on CGM,
and caregivers
RCT 2:1: closed loop n = 28 (6 m)
vs. SAP n = 30 (6 m)
Technology EXPECTATIONS surveyTechnology ACCEPTANCE survey adaptated from “Experience with the Bionic Pancreas questionnaire”
INSPIRE
Before and after ExperiencePositive expectations for the device before and after the trial
After: higher scores on the INSPIRE meant positive user experience of participants
Cobry et al., 2021
[28]
101 children (6–13 y,
11.2 ± 2.1 y)
on CSII (80%) and CGM (92%)
and parents
RCT 3:1: Tandem CIQ n = 78 (28 w) vs. SAP n = 23 (28 w)
INSPIRE child/parents Before and after ExperienceNo change comparing the two groups
Naranjo et al., 2016
[18]
1503 adults (35.3 ± 14.77 y)
38% on CSII + BGM
32% on CSII + CGM
25% on MDI + BGM
5% on MDI + CGM
Cross-sectional
DSAT questionnaire, validation studyExpectationsPatients using any type of more advanced diabetes technology, such as pump therapy, CGM, or SAP, demonstrated more positive attitudes about diabetes technology
Hood et al., 2021
[29]
113 adolescents and young adults (19 ± 4 y)
on CSII or MDI
RCT: AHCL (55)
vs. HCL (57)
(28 w)
Technology attitude (DSAT)
At baseline and during followup
Before and after ExperienceTechnology attitude about diabetes technology was not different
After: satisfaction improved with AHCL
Hood et al., 2022
[30]
98 children and adolescents (6–18 y, 12.7 ± 2.8 y) on CSII and parents
RCT: AHCL n = 48 (6 m)
vs. CSII n = 50 with or without CGM (6 m)
Technology attitude (DSAT)
Focus group
Before and after ExperienceNo psychosocial benefit
Musolino et al., 2019
[17]
20 children (1–7 y) on CSII
and caregiver
Day and night HCL (Cambridge FlorenceM) Prospective for 3 w
Closed-loop Experience Questionnaire, to caregiversAfter ExperienceHCL users were satisfied Positive: reduced hypoglycemia, more stable glycemic control, felt reassured, improved sleep quality, and alarms
Negative: size, battery performance, connectivity issues, and alarms
Petruzelkova et al., 2021
[33]
8 preschool (3–7 y) and 18 school-aged children (8–14 y) in SAP and their caregivers (6 m)
Switch to AndroidAPS HCL
Retrospective analysis
Closed-loop Experience QuestionnaireAfter ExperienceHigh scores in ease of use, trust, and positive key areas
Taushmann et al., 2016
[34]
12 adolescents (15 ± 3) in CSII with suboptimal control and parents
RCT crossover:
Closed-loop Dana + Free Style Navigator II (3 w)
vs. SAP without LGS (3 w)
Questionnaire not validated After ExperiencePositive: PU, T, and improved sleep
Negative: number and size of the devices, alarms, and connectivity issues
Forlenza et al.,
2019
[7]
24 children (6–12 y) on CSII
RCT: Tandem CIQ (3 d)
vs. SAP (3 d)
Technology acceptance questionnaire (TAQ), not validatedAfter ExperienceAfter: Positive responses for acceptance
Barnard et al., 2014
[19]
15 adolescents (12–18 y)
on CSII
and 13 parents
RCT crossover:
CSII + rtCGM (21 d)
vs. CSII + overnight closed-loop (21 d)
Semi-structured interviews
DTQ
Before and after ExperienceHigh IU
Reported benefits and concern/barriers
Increased satisfaction
Barnard et al., 2017
[20]
26 children and adolescents (6–18 y)
on CSII
RCT crossover:
CSII + rtCGM (12 w)
vs. CSII + overnight closed-loop (12 w)
Semi-structured qualitative interviews
DTQ
Before and after ExperienceReported benefits and concern/barriers
Increased satisfaction
Iturralde et al., 2017
[36]
17 adults, 15 adolescents
on 670 G pump in a diabetes camp (4–5 d)
Prospective
Focus groups After ExperiencePerceived benefits: improved glycemic control, anticipated reduction in long-term complications, better quality of life, and reduced mental burden of diabetes
Hassles and limitations: unexpected tasks for the user, difficulties wearing the system, concerns about controlling highs, and reminders of diabetes
Tanenbaum et al., 2020
[37]
17 adults, 15 adolescents
on 670 G pump in a diabetes camp (4–5 d)
Prospective
Focus groupsAfter ExperienceTrust in HCL was context-dependent; overall, users trusted the system more to manage diabetes overnight than to handle meals and exercise
Naranjo et al., 2017
[8]
35 adolescents
16 children
65 parents
(113 adults)
With and without AID knowledge
75% on CSII
Cross-sectional
Semi-structured interviewsExpectationsThree themes were identified as critical for uptake of automated insulin delivery: considerations of trust and control, system features, and concerns and barriers to adoption
Garza et al., 2018
[35]
113 adults, 35 adolescents/young adults, 16 children
Most on CSII (72%)
Cross-sectional
Semi-structured interviews
Focus group
ExpectationsThere is an expectation that AID will alleviate diabetes-specific worry and burden
There is also hope that this system may reduce day-to-day stress
AID will improve family relationships

3.2. Measures to Assess Satisfaction with AP

In some studies, treatment satisfaction with AID, assessed after an experience with the system, predicted adherence to the device, and a questionnaire on diabetes technology and closed-loop satisfaction have been included in association with the AP acceptance measure and/or semi-structured interviews as reported above [19,20,21].

3.2.1. “DTQ” and “DTSQ” Measures

The Diabetes Technology Questionnaire (DTQ) is a validated measure that covers similar content to the qualitative interviews on AID systems but in a questionnaire format, and participants have to rate the package of diabetes technology they are using. It includes 30 items, which assess the impact of and satisfaction with the technology. Each item is scored on a 5-point scale: 1 (very much a problem) to 5 (not at all a problem), with scores ranging from 30 to 150. Participants are asked to rate their agreement or disagreement with statements regarding the specific complement of diabetes technologies (i.e., insulin pump, continuous glucose monitor, and closed loop system). The DTQ yields separate scores for the ‘current’ (How much is this a problem now?) and ‘change’ (How has it changed compared to before the study?) subscales.
In the studies we analyzed, the DTQ results showed a favorable impact of the closed-loop system and satisfaction with it, and a high level of satisfaction was associated with an increased acceptance of AID systems [19,20]. Satisfaction was also evaluated by the DTQ in many more studies that we did not analyze because they did not assess patients’ expectations and acceptance [38,39,40,41,42].
The Diabetes Treatment Satisfaction Questionnaire Status (DTSQs) is not specific for technology, but it is widely used to investigate treatment satisfaction. The DTSQ change (DTSQc) is used to overcome the potential ceiling effects seen with the DTSQ if, at baseline, the scores are already high. The DTSQ-parent is a 14-item measure, whereas the DTSQ-participants includes 30 items. High scores imply high positive satisfaction with and the influence of the device/system of interest [38]. In the study we analyzed, the DTSQ in parents indicated general satisfaction with and trusting views of using AP systems in children during a camp experience [13].

3.2.2. “Satisfaction with Use of an Artificial Pancreas” Measure

This is a validated satisfaction questionnaire specifically developed for closed-loop studies, and it consists of 14 items and 5 subscales: Perceived Usefulness of Alarms, Trust, Ease of Use, Satisfaction, and Freedom. Items are answered on a 5-point Likert scale. A higher score indicates a higher degree of satisfaction with the AP [21].
In Ziegler et al. 2015, the patients who frequently utilized CGM prior to commencing the AP reported increased satisfaction with and a higher overall acceptance of an AP, and the authors suggested that to enable future success with CL systems, one should implement a longer CGM experience prior to starting the AID, because this might give the patient sufficient knowledge to understand other issues related to the CL systems [21]. CL satisfaction was related to age, with lower satisfaction regarding the “Ease of Use” of the AP in children than in adolescents and adults.

4. Conclusions

According to the recent International Society for Pediatric and Adolescent Diabetes 2022 guidelines, technological advances in insulin delivery, glucose monitoring, and, in more recent years, AID systems should be available for all youth with T1D and tailored to individual wishes and needs [2]. Psychological aspects such as expectation, acceptance, and satisfaction should be considered important factors in predicting adherence to an AID system. To date, discontinuation of AID devices has been estimated at up to 30% in youth, and they discontinue most likely within the first 1–3 months of use [43,44].
We reported an up-to-date summary of measures that could be used to assess these PROs. Among the measures to explore the expectancies and acceptance of AID, the “AP acceptance” or “INSPIRE” are validated and are the most used in adults, children, and adolescents [10,21,24,25,26,27,28]. The “DSAT” measure evaluates attitudes about diabetes technology and is not specific for AID systems, while the “Experience with Bionic Pancreas” is not still validated, as well as the “Closed-loop experience questionnaire” and the “Technology Acceptance Questionnaire”. The semi-structured interviews reporting the content we presented contribute to analyzing the reported psychological and physical benefits and barriers.
Among the measures to evaluate the experience with an AP, the DTQ questionnaire, the DTSQ, and the “Satisfaction questionnaire” developed by Ziegler et al. in 2015 have been validated and may contribute to identifying the critical factors for the continued use of an AID system [21].
Along with the daily routine, psychological and physical benefits and barriers could arise, as reported in the studies we analyzed, and could compromise the achievement of optimal glucose control and/or lead to a drop from the AID system. For these reasons, it is important for clinicians to provide realistic expectations with a balanced view of the positives and negatives before AID application; less knowledge about AID devices could result in excessively optimistic expectations and a subsequent greater risk of dissatisfaction with this diabetes technology. Subsequently, the impact of this technology requires a specific evaluation of the related psychological implications with validated measures and semi-structured interviews, as reported in this review, above all in the first three months of followup; therefore, diabetes care providers could tailor their education approach to the factors that concern the patient at that time, and they can teach problem-solving skills and other behavioral strategies to support the sustained use of the AID systems. The current technologies often struggle to control the glycemic variations resulting from everyday life, and systematic training of a person on AID systems is essential.
Future challenges in closed-loop technology include the development of fully closed-loop systems that do not require user input for meal announcements or carbohydrate counting and improve glycemic control during and after exercise. Further miniaturization and integration of devices and prolonged sensor life should enhance the usability of CL systems.

Author Contributions

R.F., E.M., M.M. and S.T., conceived the study and made a substantial contribution to the design of this literature review. V.M., F.D.C., F.M.R., A.A. and I.N. conducted the full paper analysis. R.F., E.M., M.M., S.T. and C.M., wrote the manuscript. C.M. and S.T. revised the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

All databases generated for this study are included in the article.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Cherubini, V.; Bonfanti, R.; Casertano, A.; De Nitto, E.; Iannilli, A.; Lombardo, F.; Maltoni, G.; Marigliano, M.; Bassi, M.; Minuto, N.; et al. Time In Range in Children with Type 1 Diabetes Using Treatment Strategies Based on Nonautomated Insulin Delivery Systems in the Real World. Diabetes Technol. Ther. 2020, 22, 509–515. [Google Scholar] [CrossRef] [PubMed]
  2. Sherr, J.L.; Schoelwer, M.; Dos Santos, T.J.; Reddy, L.; Biester, T.; Galderisi, A.; van Dyk, J.C.; Hilliard, M.E.; Berget, C.; DiMeglio, L.A. ISPAD Clinical Practice Consensus Guidelines 2022: Diabetes Technologies: Insulin Delivery. Pediatr. Diabetes 2022, 23, 1406–1431. [Google Scholar] [CrossRef] [PubMed]
  3. Rabbone, I.; Minuto, N.; Bonfanti, R.; Marigliano, M.; Cerutti, F.; Cherubini, V.; d’Annunzio, G.; Frongia, A.P.; Iafusco, D.; Ignaccolo, G.; et al. Insulin Pump Failures in Italian Children with Type 1 Diabetes: Retrospective 1-Year Cohort Study. Diabet. Med. 2017, 34, 621–624. [Google Scholar] [CrossRef] [PubMed]
  4. The Diabetes Research in Children Network (DirecNet) Study Group. Youth and Parent Satisfaction with Clinical Use of the GlucoWatch G2 Biographer in the Management of Pediatric Type 1 Diabetes. Diabetes Care 2005, 28, 1929–1935. [Google Scholar] [CrossRef] [Green Version]
  5. Franceschi, R.; Micheli, F.; Mozzillo, E.; Cauvin, V.; Liguori, A.; Soffiati, M.; Giani, E. Intermittently Scanned and Continuous Glucose Monitor Systems: A Systematic Review on Psychological Outcomes in Pediatric Patients. Front. Pediatr. 2021, 9, 660173. [Google Scholar] [CrossRef]
  6. Mozzillo, E.; Marigliano, M.; Troncone, A.; Maffeis, C.; Morotti, E.; Di Candia, F.; Fedi, L.; Iafusco, D.; Zanfardino, A.; Cauvin, V.; et al. Italian Translation and Validation of the CGM Satisfaction Scale Questionnaire. Acta Diabetol. 2023, 60, 673–679. [Google Scholar] [CrossRef]
  7. Forlenza, G.P.; Ekhlaspour, L.; Breton, M.; Maahs, D.M.; Wadwa, R.P.; DeBoer, M.; Messer, L.H.; Town, M.; Pinnata, J.; Kruse, G.; et al. Successful At-Home Use of the Tandem Control-IQ Artificial Pancreas System in Young Children during a Randomized Controlled Trial. Diabetes Technol. Ther. 2019, 21, 159–169. [Google Scholar] [CrossRef]
  8. Naranjo, D.; Suttiratana, S.C.; Iturralde, E.; Barnard, K.D.; Weissberg-Benchell, J.; Laffel, L.; Hood, K.K. What End Users and Stakeholders Want from Automated Insulin Delivery Systems. Diabetes Care 2017, 40, 1453–1461. [Google Scholar] [CrossRef] [Green Version]
  9. Franceschi, R.; Mozzillo, E.; Di Candia, F.; Maines, E.; Leonardi, L.; Girardi, M.; Fedi, L.; Rosanio, F.M.; Marcovecchio, M.L. A systematic review on the impact of commercially available hybrid closed loop systems on psychological outcomes in youths with type 1 diabetes and their parents. Diabet. Med. 2023; in press. [Google Scholar] [CrossRef]
  10. Van Bon, A.C.; Brouwer, T.B.; von Basum, G.; Hoekstra, J.B.L.; De Vries, J.H. Future Acceptance of an Artificial Pancreas in Adults with Type 1 Diabetes. Diabetes Technol. Ther. 2011, 13, 731–736. [Google Scholar] [CrossRef]
  11. Elleri, D.; Acerini, C.L.; Allen, J.M.; Hayes, J.; Pesterfield, C.; Wilinska, M.E.; Dunger, D.B.; Hovorka, R. Parental Attitudes Towards Overnight Closed-Loop Glucose Control in Children with Type 1 Diabetes. Diabetes Technol. Ther. 2010, 12, 35–39. [Google Scholar] [CrossRef] [PubMed]
  12. Van Bon, A.C.; Kohinor, M.J.E.; Hoekstra, J.B.L.; von Basum, G.; DeVries, J.H. Patients’ Perception and Future Acceptance of an Artificial Pancreas. J. Diabetes Sci. Technol. 2010, 4, 596–602. [Google Scholar] [CrossRef] [PubMed]
  13. Troncone, A.; Bonfanti, R.; Iafusco, D.; Rabbone, I.; Sabbion, A.; Schiaffini, R.; Galderisi, A.; Marigliano, M.; Rapini, N.; Rigamonti, A.; et al. Evaluating the Experience of Children with Type 1 Diabetes and Their Parents Taking Part in an Artificial Pancreas Clinical Trial over Multiple Days in a Diabetes Camp Setting. Diabetes Care 2016, 39, 2158–2164. [Google Scholar] [CrossRef] [Green Version]
  14. Bevier, W.C.; Fuller, S.M.; Fuller, R.P.; Rubin, R.R.; Dassau, E.; Doyle, F.J.; Jovanovič, L.; Zisser, H.C. Artificial Pancreas (AP) Clinical Trial Participants’ Acceptance of Future AP Technology. Diabetes Technol. Ther. 2014, 16, 590–595. [Google Scholar] [CrossRef] [Green Version]
  15. Oukes, T.; Blauw, H.; van Bon, A.C.; DeVries, J.H.; von Raesfeld, A.M. Acceptance of the Artificial Pancreas: Comparing the Effect of Technology Readiness, Product Characteristics, and Social Influence Between Invited and Self-Selected Respondents. J. Diabetes Sci. Technol. 2019, 13, 899–909. [Google Scholar] [CrossRef] [Green Version]
  16. Weissberg-Benchell, J.; Hessler, D.; Polonsky, W.H.; Fisher, L. Psychosocial Impact of the Bionic Pancreas during Summer Camp. J. Diabetes Sci. Technol. 2016, 10, 840–844. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  17. Musolino, G.; Dovc, K.; Boughton, C.K.; Tauschmann, M.; Allen, J.M.; Nagl, K.; Fritsch, M.; Yong, J.; Metcalfe, E.; Schaeffer, D.; et al. Reduced Burden of Diabetes and Improved Quality of Life: Experiences from Unrestricted Day-and-night Hybrid Closed-loop Use in Very Young Children with Type 1 Diabetes. Pediatr. Diabetes 2019, 20, 794–799. [Google Scholar] [CrossRef] [Green Version]
  18. Naranjo, D.; Tanenbaum, M.L.; Iturralde, E.; Hood, K.K. Diabetes Technology: Uptake, Outcomes, Barriers, and the Intersection with Distress. J. Diabetes Sci. Technol. 2016, 10, 852–858. [Google Scholar] [CrossRef] [Green Version]
  19. Barnard, K.D.; Wysocki, T.; Allen, J.M.; Elleri, D.; Thabit, H.; Leelarathna, L.; Gulati, A.; Nodale, M.; Dunger, D.B.; Tinati, T.; et al. Closing the Loop Overnight at Home Setting: Psychosocial Impact for Adolescents with Type 1 Diabetes and Their Parents. BMJ Open Diabetes Res. Care 2014, 2, e000025. [Google Scholar] [CrossRef] [Green Version]
  20. Barnard, K.D.; Wysocki, T.; Ully, V.; Mader, J.K.; Pieber, T.R.; Thabit, H.; Tauschmann, M.; Leelarathna, L.; Hartnell, S.; Acerini, C.L.; et al. Closing the Loop in Adults, Children and Adolescents with Suboptimally Controlled Type 1 Diabetes under Free Living Conditions: A Psychosocial Substudy. J. Diabetes Sci. Technol. 2017, 11, 1080–1088. [Google Scholar] [CrossRef] [Green Version]
  21. Ziegler, C.; Liberman, A.; Nimri, R.; Muller, I.; Klemenčič, S.; Bratina, N.; Bläsig, S.; Remus, K.; Phillip, M.; Battelino, T.; et al. Reduced Worries of Hypoglycaemia, High Satisfaction, and Increased Perceived Ease of Use after Experiencing Four Nights of MD-Logic Artificial Pancreas at Home (DREAM4). J. Diabetes Res. 2015, 2015, 590308. [Google Scholar] [CrossRef] [Green Version]
  22. Davis, F.D. Perceived usefulness, perceived ease of use, and user acceptance of information technology. MIS Q. 1989, 13, 319–340. [Google Scholar] [CrossRef] [Green Version]
  23. Pavlou, P.A. Consumer acceptance of electronic commerce: Integrating trust and risk with the technology acceptance model. Int. J. Electron. Commerce 2003, 7, 101–134. [Google Scholar]
  24. Renard, E.; Tubiana-Rufi, N.; Bonnemaison-Gilbert, E.; Coutant, R.; Dalla-Vale, F.; Farret, A.; Poidvin, A.; Bouhours-Nouet, N.; Abettan, C.; Storey-London, C.; et al. Closed-Loop Driven by Control-to-Range Algorithm Outperforms Threshold-Low-Glucose-Suspend Insulin Delivery on Glucose Control Albeit Not on Nocturnal Hypoglycaemia in Prepubertal Patients with Type 1 Diabetes in a Supervised Hotel Setting. Diabetes Obes. Metab. 2019, 21, 183–187. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Von dem Berge, T.; Remus, K.; Biester, S.; Reschke, F.; Klusmeier, B.; Adolph, K.; Holtdirk, A.; Thomas, A.; Kordonouri, O.; Danne, T.; et al. In-home Use of a Hybrid Closed Loop Achieves Time-in-range Targets in Preschoolers and School Children: Results from a Randomized, Controlled, Crossover Trial. Diabetes Obes. Metab. 2022, 24, 1319–1327. [Google Scholar] [CrossRef]
  26. Weissberg-Benchell, J.; Shapiro, J.B.; Hood, K.; Laffel, L.M.; Naranjo, D.; Miller, K.; Barnard, K. Assessing Patient-reported Outcomes for Automated Insulin Delivery Systems: The Psychometric Properties of the INSPIRE Measures. Diabetes Med. 2019, 36, 644–652. [Google Scholar] [CrossRef] [Green Version]
  27. Kudva, Y.C.; Laffel, L.M.; Brown, S.A.; Raghinaru, D.; Pinsker, J.E.; Ekhlaspour, L.; Levy, C.J.; Messer, L.H.; Kovatchev, B.P.; Lum, J.W.; et al. Patient-Reported Outcomes in a Randomized Trial of Closed-Loop Control: The Pivotal International Diabetes Closed-Loop Trial. Diabetes Technol. Ther. 2021, 23, 673–683. [Google Scholar] [CrossRef]
  28. Cobry, E.C.; Kanapka, L.G.; Cengiz, E.; Carria, L.; Ekhlaspour, L.; Buckingham, B.A.; Hood, K.K.; Hsu, L.J.; Messer, L.H.; Schoelwer, M.J.; et al. Health-Related Quality of Life and Treatment Satisfaction in Parents and Children with Type 1 Diabetes Using Closed-Loop Control. Diabetes Technol. Ther. 2021, 23, 401–409. [Google Scholar] [CrossRef] [PubMed]
  29. Hood, K.K.; Laffel, L.M.; Danne, T.; Nimri, R.; Weinzimer, S.A.; Sibayan, J.; Bailey, R.J.; Schatz, D.; Bratina, N.; Bello, R.; et al. Lived Experience of Advanced Hybrid Closed-Loop Versus Hybrid Closed-Loop: Patient-Reported Outcomes and Perspectives. Diabetes Technol. Ther. 2021, 23, 857–861. [Google Scholar] [CrossRef] [PubMed]
  30. Hood, K.K.; Garcia-Willingham, N.; Hanes, S.; Tanenbaum, M.L.; Ware, J.; Boughton, C.K.; Allen, J.M.; Wilinska, M.E.; Tauschmann, M.; Denvir, L.; et al. Lived Experience of CamAPS FX Closed Loop System in Youth with Type 1 Diabetes and Their Parents. Diabetes Obes. Metab. 2022, 24, 2309–2318. [Google Scholar] [CrossRef]
  31. Pinsker, J.E.; Müller, L.; Constantin, A.; Leas, S.; Manning, M.; McElwee Malloy, M.; Singh, H.; Habif, S. Real-World Patient-Reported Outcomes and Glycemic Results with Initiation of Control-IQ Technology. Diabetes Technol. Ther. 2021, 23, 120–127. [Google Scholar] [CrossRef] [PubMed]
  32. Bisio, A.; Brown, S.A.; McFadden, R.; Pajewski, M.; Yu, P.L.; DeBoer, M.; Schoelwer, M.J.; Bonner, H.G.; Wakeman, C.A.; Cherñavvsky, D.R.; et al. Sleep and diabetes-specific psycho-behavioral outcomes of a new automated insulin delivery system in young children with type 1 diabetes and their parents. Pediatr. Diabetes 2021, 22, 495–502. [Google Scholar] [CrossRef] [PubMed]
  33. Petruzelkova, L.; Jiranova, P.; Soupal, J.; Kozak, M.; Plachy, L.; Neuman, V.; Pruhova, S.; Obermannova, B.; Kolouskova, S.; Sumnik, Z. Pre-school and School-aged Children Benefit from the Switch from a Sensor-augmented Pump to an AndroidAPS Hybrid Closed Loop: A Retrospective Analysis. Pediatr. Diabetes 2021, 22, 594–604. [Google Scholar] [CrossRef]
  34. Tauschmann, M.; Allen, J.M.; Wilinska, M.E.; Thabit, H.; Acerini, C.L.; Dunger, D.B.; Hovorka, R. Home Use of Day-and-Night Hybrid Closed-Loop Insulin Delivery in Suboptimally Controlled Adolescents with Type 1 Diabetes: A 3-Week, Free-Living, Randomized Crossover Trial. Diabetes Care 2016, 39, 2019–2025. [Google Scholar] [CrossRef] [Green Version]
  35. Garza, K.P.; Jedraszko, A.; Weil, L.E.G.; Naranjo, D.; Barnard, K.D.; Laffel, L.M.B.; Hood, K.K.; Weissberg-Benchell, J. Automated Insulin Delivery Systems: Hopes and Expectations of Family Members. Diabetes Technol. Ther. 2018, 20, 222–228. [Google Scholar] [CrossRef]
  36. Iturralde, E.; Tanenbaum, M.L.; Hanes, S.J.; Suttiratana, S.C.; Ambrosino, J.M.; Ly, T.T.; Maahs, D.M.; Naranjo, D.; Walders-Abramson, N.; Weinzimer, S.A.; et al. Expectations and Attitudes of Individuals with Type 1 Diabetes after Using a Hybrid Closed Loop System. Diabetes Educ. 2017, 43, 223–232. [Google Scholar] [CrossRef]
  37. Tanenbaum, M.L.; Iturralde, E.; Hanes, S.J.; Suttiratana, S.C.; Ambrosino, J.M.; Ly, T.T.; Maahs, D.M.; Naranjo, D.; Walders-Abramson, N.; Weinzimer, S.A.; et al. Trust in Hybrid Closed Loop among People with Diabetes: Perspectives of Experienced System Users. J. Health Psychol. 2020, 25, 429–438. [Google Scholar] [CrossRef] [PubMed]
  38. Bradley, C. Diabetes treatment satisfaction questionnaire. In Handbook of Psychology and Diabetes: A Guide to Psychological Measurement in Diabetes Research and Practice; Bradley, C., Ed.; Harwood Academic Publishers: Chur, Switzerland, 1994; pp. 111–132. [Google Scholar]
  39. Abraham, M.B.; de Bock, M.; Smith, G.J.; Dart, J.; Fairchild, J.M.; King, B.R.; Ambler, G.R.; Cameron, F.J.; McAuley, S.A.; Keech, A.C.; et al. Effect of a Hybrid Closed-Loop System on Glycemic and Psychosocial Outcomes in Children and Adolescents with Type 1 Diabetes: A Randomized Clinical Trial. JAMA Pediatr. 2021, 175, 1227. [Google Scholar] [CrossRef]
  40. Cobry, E.C.; Hamburger, E.; Jaser, S.S. Impact of the Hybrid Closed-Loop System on Sleep and Quality of Life in Youth with Type 1 Diabetes and Their Parents. Diabetes Technol. Ther. 2020, 22, 794–800. [Google Scholar] [CrossRef]
  41. Petrovski, G.; Al Khalaf, F.; Campbell, J.; Day, E.; Almajaly, D.; Hussain, K.; Pasha, M.; Umer, F.; Hamdan, M.; Khalifa, A. Glycemic Outcomes of Advanced Hybrid Closed Loop System in Children and Adolescents with Type 1 Diabetes, Previously Treated with Multiple Daily Injections (MiniMed 780G System in T1D Individuals, Previously Treated with MDI). BMC Endocr. Disord. 2022, 22, 80. [Google Scholar] [CrossRef]
  42. Gianini, A.; Suklan, J.; Skela-Savič, B.; Klemencic, S.; Battelino, T.; Dovc, K.; Bratina, N. Patient Reported Outcome Measures in Children and Adolescents with Type 1 Diabetes Using Advanced Hybrid Closed Loop Insulin Delivery. Front. Endocrinol. 2022, 13, 967725. [Google Scholar] [CrossRef] [PubMed]
  43. Lal, R.A.; Basina, M.; Maahs, D.M.; Hood, K.; Buckingham, B.; Wilson, D.M. One Year Clinical Experience of the First Commercial Hybrid Closed-Loop System. Diabetes Care 2019, 42, 2190–2196. [Google Scholar] [CrossRef] [PubMed]
  44. Berget, C.; Messer, L.H.; Vigers, T.; Frohnert, B.I.; Pyle, L.; Wadwa, R.P.; Driscoll, K.A.; Forlenza, G.P. Six months of hybrid closed loop in the real-world: An evaluation of children and young adults using the 670G system. Pediatr. Diabetes 2020, 21, 310–318. [Google Scholar] [CrossRef] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Marigliano, M.; Mozzillo, E.; Mancioppi, V.; Di Candia, F.; Rosanio, F.M.; Antonelli, A.; Nichelatti, I.; Maffeis, C.; Tumini, S.; Franceschi, R. Measures of Patient-Reported Expectations, Acceptance, and Satisfaction Using Automated Insulin Delivery Systems: A Review. J. Pers. Med. 2023, 13, 1031. https://doi.org/10.3390/jpm13071031

AMA Style

Marigliano M, Mozzillo E, Mancioppi V, Di Candia F, Rosanio FM, Antonelli A, Nichelatti I, Maffeis C, Tumini S, Franceschi R. Measures of Patient-Reported Expectations, Acceptance, and Satisfaction Using Automated Insulin Delivery Systems: A Review. Journal of Personalized Medicine. 2023; 13(7):1031. https://doi.org/10.3390/jpm13071031

Chicago/Turabian Style

Marigliano, Marco, Enza Mozzillo, Valentina Mancioppi, Francesca Di Candia, Francesco Maria Rosanio, Annalisa Antonelli, Ilaria Nichelatti, Claudio Maffeis, Stefano Tumini, and Roberto Franceschi. 2023. "Measures of Patient-Reported Expectations, Acceptance, and Satisfaction Using Automated Insulin Delivery Systems: A Review" Journal of Personalized Medicine 13, no. 7: 1031. https://doi.org/10.3390/jpm13071031

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop