Abstract
Background and Objectives: We compared professional role with digital-use/efficiency phenotype as explanations of perceived digital benefit in anaesthesia and intensive care. Materials and Methods: Cross-sectional survey data from 161 professionals were analysed. Latent class analysis used 12 indicators of technology/educational-resource use and perceived operational efficiency; four benefit items remained external outcomes. Although BIC favoured two classes, a three-class exploratory solution was retained using aBIC, entropy, bootstrap testing, class size and interpretability. Nested logistic models with seniority retained in every model, likelihood-ratio tests and Shapley partitioning of McFadden’s pseudo-R2 compared role and phenotype; pre-planned sensitivity analyses re-estimated the comparison under two- and four-class solutions, with classification-error (BCH) correction and with use-only indicators, and discrimination was internally validated by bootstrap. Descriptive decomposition and Rasch/DIF analyses were exploratory. Results: The three phenotypes (n = 83, 44 and 34; entropy of 0.815) crossed professional boundaries (Cramér’s V = 0.439). Phenotype did not improve seniority-and-role models for broad benefit (likelihood ratio 2.4, p = 0.301) or high uncertainty (2.8, p = 0.248), whereas adding role to seniority-and-phenotype models improved fit (23.6 and 26.2; both p < 0.001); this pattern was unchanged across all sensitivity specifications. Role received 68.3% and 62.3% of the Shapley-partitioned pseudo-R2, versus 11.9% and 11.4% for phenotype. Exploratory decompositions provided little evidence of an indirect association through adoption breadth or phenotype. Rasch analysis suggested patient safety was easiest and managerial benefit hardest to endorse; person separation reliability was 0.07, and DIF contrasts were descriptive. Conclusions: In this sample, professional role carried more explanatory information about perceived benefit than the exploratory phenotype, and this ranking was robust to class enumeration and classification-error correction. The phenotype findings remain exploratory, and cross-sectional associations do not establish causation.
1. Introduction
The digital transformation of anaesthesia and intensive care is now understood as a sociotechnical process rather than a technical one, in which the workforce determines whether a deployed system delivers value or is quietly abandoned [1]. Frameworks of technology acceptance have shown repeatedly that perceived usefulness and perceived ease of use, rather than the objective capabilities of a system, govern sustained use [2], and that these constructs behave differently in healthcare from the commercial settings in which they were developed [3]. Syntheses published since the pandemic confirm that these determinants remain decisive: an umbrella review of barriers and facilitators to health professionals’ use of digital technologies identified usability, workflow fit, training and organisational support, rather than the technology itself, as the recurrent determinants of sustained use [4], a conclusion echoed by recent systematic reviews of technology acceptance in healthcare [5] and by the WHO Global Strategy on Digital Health 2020–2025, which treats workforce readiness as a precondition for digital transformation [6]. When an institution evaluates its own digital maturity, it therefore measures two things at once: what its staff actually do with the available tools, and what they believe those tools accomplish. The relation between the two is usually assumed rather than examined.
Professional role is a plausible starting point for examining these differences because nurses, residents and specialists encounter digital systems through different tasks, responsibilities and decision rights. However, role may not be the only meaningful unit of analysis. Individuals within the same professional category may differ substantially in the technologies and educational resources they use and in the operational efficiencies they perceive. Grouping respondents solely by title can therefore obscure cross-cutting patterns of digital engagement that may be more closely related to benefit appraisal.
That choice is defensible but not self-evident. The diffusion-of-innovations literature describes adopter categories defined by behaviour rather than by occupational title, and predicts that individuals within the same occupational group will distribute themselves across those categories [7]. Interpretive reviews of health-information-technology implementation similarly locate the determinants of adoption in local work systems, incentives and exposure rather than in professional identity as such [8]. If that is correct, the respondents in a single department should form engagement profiles that partially cross the nurse–physician boundary, and those profiles might carry information about appraisal that professional category alone does not.
Studies of nursing staff report heterogeneity in attitudes toward electronic records and identify computer experience, perceived usefulness, training, and work context as correlates [9,10]. More recent evidence points the same way: documentation burden is measured and experienced differently by physicians and nurses [11]; nurses exposed to recent electronic health record implementations with insufficient training report more stress, time pressure and cognitive failures [12]; and reviews of nurses’ digital competence emphasise that skills, role expectations and system design jointly shape how nurses experience the same tools [13]. These studies do not by themselves establish a nurse–physician contrast, but they show why occupational groups may encounter the same technology differently. Work-system models place the person within a configuration of tasks, tools, organisation and environment [14]. Professional role may therefore act as a proxy for different digital work systems, while phenotype may capture cross-cutting patterns within those systems.
The clinical setting also matters. Anaesthesia and intensive care are among the most data-intensive hospital environments, and the range of tools available to their staff has widened rapidly since 2020 to include artificial intelligence (AI)-based applications for risk prediction, monitoring and decision support in the intensive care unit and along the perioperative pathway [15,16,17]. Surveys of intensivists and anaesthesiologists report broadly favourable but conditional attitudes toward such tools, with recurring concerns about transparency, workflow integration and accountability [18,19,20]. Whether a digital tool is perceived as beneficial therefore appears to depend on who uses it and in which task context, which is the question the present study addresses.
Evidence on digital efficiency in intensive care has so far been generated mainly at the level of systems rather than of the people who use them. A randomised comparison of paper and electronic documentation found that a clinical information system reduced nursing documentation time from 20.5% to 14.4% of total nursing time, with the recovered time redirected to direct patient care [21], and a review of critical care information systems concluded that such time savings are consistent for nurses but inconsistent for physicians [22]. Implementation of an intensive care information system has been associated with a shorter length of stay [23], and an electronic rounding checklist reduced provider workload and errors [24]. At the same time, a survey of 535 intensive care nurses and physicians found that usability differed markedly across eight commercial systems [25], and a recent qualitative study of intensive care staff catalogued 86 distinct usability problems, most of them concerning information presentation and documentation steps [26]. These studies establish that the efficiency and burden of the same tools differ by task and by user group, in keeping with the fit between individual, task and technology described by the FITT framework [27], but they do not ask whether the patterns of use and perceived efficiency reported by individual staff members, modelled as latent profiles, explain how those staff members appraise digital benefit, or whether such profiles carry information beyond professional role. The present study addresses that gap with a symmetric, pre-specified comparison of role and phenotype in a single anaesthesia and intensive care department, in a Central and Eastern European health system from which staff perspectives on digitalisation have rarely been reported. Its significance is practical: if engagement profiles explain appraisal beyond role, training and implementation support should be targeted at profiles; if role dominates, they should be organised around role-specific tasks and information needs.
These accounts lead to different associational expectations. If the digital-use/efficiency phenotype contributes information beyond professional role, the phenotype should improve models that already contain role and seniority. If professional role contributes information beyond phenotype, the reverse increment should be larger. Either pattern could reflect differences in tasks, access, exposure type or visibility of system outputs; the cross-sectional design cannot identify an immutable role effect or a causal mechanism. The practical value of the comparison is therefore to identify where explanatory information is concentrated and which mechanisms warrant prospective testing.
This study analyses respondent-level survey data from 161 anaesthesia and intensive care professionals to determine which construct provides greater explanatory information for perceived digital benefit: professional role or a latent digital-use/efficiency phenotype. Four hypotheses were specified in advance and are listed below; the analysis and the results section that address each hypothesis are given in Section 2.4.
H1 (cross-cutting phenotypes).
The 12 class indicators would yield at least two substantively interpretable digital-use/efficiency phenotypes, each containing members of more than one professional group.
H2 (phenotype beyond role).
Phenotype would improve models of benefit appraisal that already contain seniority and professional role.
H3 (role beyond phenotype).
Professional role would improve models of benefit appraisal that already contain seniority and phenotype.
H4 (indirect association).
Technology-adoption breadth or the posterior probability of class 1 (comprehensive-adopter) membership would show a statistical indirect association linking physician status to appraisal.
The latent class enumeration (H1) and the symmetric role-versus-phenotype model comparisons (H2 and H3) were primary; Shapley partitioning was secondary; the descriptive decomposition (H4) and the Rasch/DIF analyses were exploratory.
2. Materials and Methods
2.1. Study Design, Participants and Original Dataset
This single-centre cross-sectional study analysed original survey data collected from anaesthesia and intensive care personnel in a tertiary-level emergency hospital during a period of active digital infrastructure expansion. Data were collected between 4 April and 30 June 2022 in a single wave, with one administration per person; no earlier survey had been conducted in the department, so all respondents were first-time participants. All 214 personnel working in the department during the survey window (73 nurses, 78 residents and 63 specialist physicians) were invited, and participation was voluntary and anonymous. Of the 176 questionnaires returned (82.2% of those invited), 15 were excluded before analysis because at least one of the 12 class-defining indicators or one of the four benefit-appraisal items had been left blank (nine nurses, four residents and two specialists); no questionnaire was excluded for any other reason, and no imputation was performed. The analytic dataset therefore contains 161 complete questionnaires (75.2% of those invited) from 55 nurses (75.3% of invited nurses), 62 residents (79.5%) and 44 specialist physicians (69.8%). Among these 161 records, the only item-level missingness was in the daily-tool-use item (three respondents), which was handled by complete-case analysis in the analyses that used it. The full questionnaire is provided in Appendix A. For analyses contrasting nurses with physicians, residents and specialists were combined as physicians (n = 106). All reported analyses used these respondent-level records.
The analytic dataset retained each participant’s responses for professional role, seniority, daily digital-tool use, the four benefit-appraisal items, use of individual technologies and educational resources, the three barrier items and the five resource-efficiency items. Seniority was coded in four ordered bands: 0–5, 6–10, 11–20, and more than 20 years. Because residents were concentrated in lower seniority bands, role and seniority were treated as related adjustment variables; their coefficients were interpreted as conditional associations rather than independent causal effects. Composite indices and subsequent analyses were calculated from the respondent-level observations (Table 1).
2.2. Survey Instrument, Indicators, Composite Measures and the Separation of Predictors from Outcomes
The questionnaire (Appendix A) was developed by the research team in 2021 for a departmental assessment of digital maturity, because no validated instrument covered the specific inventory of systems and educational resources available in the department. Item content was derived from the perceived-usefulness and facilitating-conditions constructs of technology-acceptance theory [2,3], from the workforce domain of the WHO digital health strategy [6] and from the departmental inventory of deployed systems. Content validity was assessed by a panel of five experts (two intensivists, one anaesthesia nurse, one medical informatician and one hospital manager), who rated the relevance of each item on a four-point scale; all retained items had an item-level content validity index of at least 0.80, and the scale-level index (averaging method) was 0.93 [28]. The instrument was piloted with 12 staff members who were not part of the analytic sample, leading to minor wording changes and to the addition of the ‘cannot appraise’ option for the four benefit items. Because the seven use items and the five perceived-efficiency items are binary checklists rather than reflective scales, internal consistency is reported descriptively only: the Kuder–Richardson KR-20 coefficient was 0.72 for the seven use items and 0.74 for the five efficiency items [29]. Latent class analysis does not require unidimensional scales; it models the joint distribution of the indicators under conditional independence within classes, and model adequacy was judged from the enumeration statistics in Section 3.2 (Table 2). Test–retest reliability was not assessed and is noted as a limitation.
Twelve binary indicators were used to define the latent classes. Seven described reported use: four core technologies (patient-monitoring systems, electronic health records, anaesthesia-planning software and training simulators) and three digital educational resources (e-learning platforms, simulation-based training and webinars). Five described resources were perceived to be used more efficiently after digitalisation (medications, medical staff, sanitary materials, bed occupancy and protective equipment). Because these indicators combine behaviour with perceived operational efficiency, the latent construct is termed a latent digital-use/efficiency class (hereafter, digital-use/efficiency phenotype). The word phenotype is used descriptively for a response profile, not as a biological or stable personal trait. The five efficiency indicators also create conceptual overlap with appraisal and with the Resource-Efficiency Index; excluding the four benefit outcomes prevents direct circularity but does not make the phenotype a pure measure of exposure. To separate use-based from appraisal-based constructs as far as the design allows, a second latent class model restricted to the seven reported-use indicators was fitted as a sensitivity analysis (Section 2.3). Terminology is used consistently hereafter: ‘reported use’ denotes the seven use indicators, ‘perceived efficiency’ denotes the five resource items, ‘benefit appraisal’ denotes the four external outcome items, and the three phenotypes are referred to by class number, with the descriptive labels given in Table 3.
The four trichotomous benefit items assessed whether digital technologies improved patient safety (item Q5 of the original instrument), clinical decision-making (Q9), managerial decision-making (Q10), and continuing education (Q11). These items were deliberately excluded from the class-defining model. This separation is the central design feature of the analysis: if the appraisal items were allowed to inform class membership, any subsequent association between class and appraisal would be circular. Retaining them outside the model leaves them available as external outcomes. From the original item-level responses, we calculated the Digital Benefit Index, which counts affirmative responses across the four domains, and the Uncertainty Index, which counts ‘cannot appraise’ responses across the same four domains; each ranges from 0 to 4. The technology-adoption score (0–4), Barrier Burden score (0–3), and Resource-Efficiency Index (0–5) were also calculated directly from the corresponding questionnaire items. Broad perceived benefit was defined as a Digital Benefit Index of at least 3, and high uncertainty as an Uncertainty Index of at least 2, for the analyses reported here.
2.3. Latent Class Analysis and Class Enumeration
Latent class models with one to five classes were fitted to the 12 binary indicators by maximum likelihood using the expectation-maximisation algorithm with 60 random starts per solution; convergence was declared when the change in log-likelihood fell below 10−9. Enumeration considered AIC, BIC, sample-size-adjusted BIC (aBIC) [30], normalised entropy, smallest-class size and a parametric bootstrap likelihood-ratio test with 150 replicates [31], following published guidance on latent class analysis in critical care research [32]. BIC favoured two classes, whereas aBIC and entropy continued to improve through four classes. The three-class solution was retained as an exploratory, parsimonious compromise because it added a substantively distinct profile while avoiding the 14-person smallest class in the four-class model. This decision does not identify a uniquely true number of classes. Because the enumeration criteria disagreed, the primary role-versus-phenotype models were re-estimated under the two- and four-class solutions as pre-planned sensitivity analyses (Section 2.4), so that the main comparison could be evaluated across the plausible range of class solutions rather than conditioned on a single choice.
Respondents were assigned to their modal class for the descriptive analyses, and mean posterior assignment probabilities are reported by class. Because modal assignment ignores residual classification uncertainty and can attenuate or distort associations with external outcomes [33], the primary outcome models were additionally estimated with the bias-adjusted three-step (BCH) approach, in which respondents enter the outcome model with weights derived from the inverse of the estimated classification-error matrix [34,35], and with posterior-probability weighting, in which each respondent contributes to every class in proportion to their posterior membership probability. Standard errors for the BCH models were obtained from 500 bootstrap resamples of the complete two-stage procedure. In a further sensitivity analysis, the latent class model was re-fitted using only the seven reported-use indicators, so that the class-defining information contained no perceived-efficiency content that could overlap conceptually with benefit appraisal; the three-class use-only solution was carried into the same outcome models. Descriptive class comparisons that use modal assignment remain exploratory. Associations between class and professional role, seniority band and daily tool use were tested with Pearson chi-square tests and quantified with Cramér’s V, a normalised chi-square coefficient of association that does not represent a proportion of explained variance [36]. Adjusted contrasts of classes 2 and 3 against class 1 used Firth-penalised binary logistic regression [37] because sparse or empty cells prevented stable ordinary maximum-likelihood estimation.
2.4. Competing Explanations, Item Response Modelling and Statistical Analysis
Each hypothesis was linked in advance to a specific analysis, decision rule and reporting section, as follows:
H1. Latent class enumeration (Section 2.3; Table 2), the item-response profiles (Table 3, Figure 1) and the cross-classification of modal class with professional role using the Pearson chi-square test, Cramér’s V and Firth-penalised contrasts (Table 4, Figure 2). H1 was considered supported if at least two interpretable classes were retained and every class contained members of more than one profession (Section 3.2, Section 3.3 and Section 3.4). The external associations of the phenotypes with benefit appraisal, barriers and the composite measures (Tables 5 and 6, Section 3.5 and Section 3.6) were descriptive and were not hypothesis tests.
Figure 1.
Item-response probabilities for the selected three digital-use/efficiency phenotypes across the 12 class-defining indicators, with whole-sample prevalence shown for reference.
Figure 2.
Composition of each digital-use/efficiency phenotype by professional role, with respondent counts shown above each bar.
H2. The likelihood-ratio test for adding the two phenotype indicators to the seniority-and-role model (M3 versus M1, defined below) for each primary outcome, with Holm adjustment across the four primary tests; support required p < 0.05 after adjustment (Tables 7 and 8, Section 3.7). The result was re-examined under the sensitivity specifications of Section 2.3 (Table 9, Section 3.8).
H3. The likelihood-ratio test for adding the two role indicators to the seniority-and-phenotype model (M3 versus M2) under the same decision rule (Tables 7 and 9, Section 3.7 and Section 3.8). Shapley partitioning of McFadden’s pseudo-R2 (Section 3.10) was a secondary descriptive comparison of the two constructs, and the exploratory Rasch/DIF analysis of the four benefit items (Table 10, Section 3.9) was not linked to a pre-specified hypothesis.
H4. The exploratory descriptive decomposition of the nurse–physician contrast, with technology-adoption score and class 1 posterior probability as candidate intermediate variables (Table 11, Section 3.10); an indirect component whose bootstrap confidence interval excluded zero would have been taken as exploratory support.
Appraisal outcomes were compared across classes with the Kruskal–Wallis test for ordinal indices, epsilon-squared effect sizes and Bonferroni-corrected Mann–Whitney U tests for pairwise contrasts, and with Pearson chi-square or Fisher exact tests for binary items. The primary explanatory comparison used four nested logistic models for broad perceived benefit and high uncertainty, with seniority band retained in every model so that the two constructs were compared symmetrically: a seniority-only base model (M0), a seniority-and-role model (M1), a seniority-and-phenotype model (M2) and a combined model (M3). The incremental contribution of phenotype was assessed by comparing M2 with M0 and M3 with M1, and that of role by comparing M1 with M0 and M3 with M2; each increment therefore isolates a single construct with 2 degrees of freedom. Item-specific safety and educational-benefit models were secondary. Likelihood-ratio tests were the primary basis for assessing incremental contribution, supplemented by AIC and BIC. Because the DeLong test is invalid for comparing the C-statistics of nested models fitted and evaluated in the same sample [38], DeLong p-values are not reported; differences in the C-statistic are instead accompanied by 95% confidence intervals from 1000 bootstrap resamples in which both models were re-fitted, and each model’s apparent C-statistic is accompanied by an optimism-corrected value obtained with Harrell’s bootstrap procedure using 200 resamples [39]. Adjusted odds ratios with Wald 95% confidence intervals are reported for the seniority-and-role and combined models. Hierarchical partitioning allocated the total McFadden pseudo-R2 among role, phenotype, technology-adoption score and seniority as Shapley values averaged over all entry orders [40]. These values are reported as shares of Shapley-partitioned McFadden pseudo-R2, not as proportions of outcome variance. Because phenotype, adoption score and efficiency indicators overlap conceptually and empirically, the allocations describe correlated predictor blocks rather than independent mechanisms.
An exploratory descriptive decomposition partitioned the model-based nurse–physician contrast, with residents and specialists combined as physicians, into a direct component and an indirect component transmitted through the candidate intermediate variable, on the risk-difference scale. The technology-adoption score and the posterior probability of class 1 (comprehensive-adopter) membership were evaluated separately, adjusting for seniority band, with 800 bootstrap replications and 400 intermediate-variable simulations per replication [41]. The computational algorithm follows the counterfactual mediation literature [41], but the quantities are reported as descriptive components of an observed association rather than as natural direct and indirect effects or proportions mediated, because causal interpretation would require temporal ordering and no unmeasured exposure–intermediate, intermediate–outcome or exposure–outcome confounding, none of which can be established in a cross-sectional survey. The percentage of the total contrast carried by the indirect component is reported only as a descriptive ratio. With 800 bootstrap replications, the smallest attainable two-sided percentile p-value is 0.0025, and smaller values are reported as p < 0.003. The four benefit items were then examined exploratorily with Rasch and two-parameter item-response models [42]. DIF values were obtained from group-centred nurse and physician item difficulties. Because standard errors, confidence intervals, p-values and multiplicity-adjusted tests were not available for the DIF contrasts, they are descriptive signals only. Exact two-sided p-values and 95% confidence intervals are reported where available. Multiplicity was handled at two levels. The four pre-specified primary likelihood-ratio tests (the phenotype and role increments for each of the two primary outcomes) form a single family and are reported with Holm-adjusted p-values [43]. Secondary and exploratory tests (the item-level and barrier comparisons in Table 5, the secondary item-specific model increments and the exploratory decomposition components) are reported with Benjamini–Hochberg false-discovery-rate-adjusted q-values within their family [44], in addition to the Bonferroni-corrected pairwise contrasts; exploratory findings remain hypothesis-generating regardless of adjustment. Analyses were performed in Python 3.11 with NumPy, SciPy, pandas and statsmodels; the BCH, bootstrap and Shapley procedures were implemented in the same environment, and the scripts are available as described in the Data Availability Statement.
3. Results
The results are organised around the four hypotheses. Section 3.1 provides descriptive context from the composite indices and their correlations. Section 3.2, Section 3.3 and Section 3.4 address H1 (class enumeration, description of the phenotypes and their cross-classification with professional role). Section 3.5 and Section 3.6 describe the external associations of the phenotypes and are not hypothesis tests. Section 3.7 addresses H2 and H3 in the primary nested models, and Section 3.8 reports the sensitivity analyses for the same comparison. Section 3.9 reports the exploratory Rasch analysis, and Section 3.10 addresses H4 and the secondary Shapley partitioning.
3.1. Composite Measures and Correlations in the Original Dataset
Composite-index values by professional group and selected associations calculated directly from the original respondent-level records are summarised in Table 1.
Table 1.
Composite-index values and selected correlations calculated from the respondent-level dataset (N = 161).
Mean Digital Benefit Index values were 2.31 for nurses, 3.53 for residents, and 3.36 for specialists. The corresponding technology-adoption means were 2.02, 3.03 and 2.80; Barrier Burden means were 1.87, 1.94 and 1.86; and Resource-Efficiency Index means were 2.60, 3.05 and 2.34. The mean Uncertainty Index was 1.60 among nurses and 0.49 among physicians. In the full sample, the Digital Benefit Index correlated with technology adoption (Spearman rho = 0.25) and seniority (rho = −0.17), while technology adoption correlated with seniority (rho = −0.20). Correlations between clinical and managerial benefit (rho = 0.31) and between safety and educational benefit (rho = 0.29) were modest. Within nurses, seniority correlated with uncertainty (rho = 0.42).
3.2. Class Enumeration: How Many Digital-Use/Efficiency Phenotypes? (H1)
Latent class models with one to five classes were fitted to the 12 digital-use/efficiency indicators, and the enumeration statistics are shown in Table 2.
Table 2.
Latent class enumeration for one- to five-class models fitted to the 12 digital-use/efficiency indicators (N = 161).
The enumeration criteria disagreed. BIC reached its minimum at two classes (2252.3), whereas AIC and aBIC continued to fall through four classes and the bootstrap likelihood-ratio test remained significant for the four- versus three-class comparison (32.2; p = 0.047). Entropy increased from 0.699 for two classes to 0.815 for three and 0.902 for four. The four-class solution divided the largest class into two profiles differing mainly in degree and produced a 14-person smallest class; the five-class solution did not improve aBIC (2127.2 versus 2127.1). The three-class solution was therefore used as an interpretable compromise. It identified a third profile not represented in the two-class solution. Because the choice remains uncertain, the primary outcome models were re-estimated under the two- and four-class solutions (Section 3.8).
3.3. Description of the Digital-Use/Efficiency Phenotypes (H1)
The item-response probabilities describing the selected three-class solution are given in Table 3 and displayed against the sample prevalence of each indicator in Figure 1.
Table 3.
Item-response probabilities for the selected three-class digital-use/efficiency solution, with observed indicator prevalence.
Class 1 included 83 respondents (51.6%) and showed high probabilities for most use indicators, including monitoring systems (1.00), electronic records (0.83), e-learning (0.95) and simulation-based training (0.74), together with comparatively high perceived efficiency gains for medications and bed occupancy. Class 2 included 44 respondents (27.3%) and combined low reported use of training simulators (0.03) and simulation-based training (0.00) with high perceived gains for selected resources, particularly sanitary materials (0.88) and protective equipment (0.61). This pattern is descriptive and does not establish that low simulation use produced those perceived gains. Class 3 included 34 respondents (21.1%) and showed intermediate-to-high tool use but probabilities of 0.00 for perceived efficiency gains in medical staff, sanitary materials, and bed occupancy. Mean posterior assignment probabilities were 0.95, 0.91, and 0.83; the lower value for class 3 and the use of modal assignment warrant caution in downstream comparisons.
Across the seven use indicators, class 1 probabilities were generally above the sample average and class 2 probabilities were generally below it, with the largest separations at the two simulation-related indicators. Class 3 was closer to class 1 on several use indicators. Across the five perceived-efficiency indicators, class 3 had probabilities of 0.00 for medical staff, sanitary materials, and bed occupancy, while classes 1 and 2 had higher probabilities for medical staff and sanitary materials. Thus, the third profile was distinguished mainly by the combination of tool use and low reported operational-efficiency gains.
3.4. Association Between Digital-Use/Efficiency Phenotype and Professional Role (H1)
The distribution of the digital-use/efficiency phenotypes across professional categories, seniority bands and daily tool use is reported in Table 4 and shown in Figure 2.
Table 4.
Distribution of the three digital-use/efficiency phenotypes across professional role, seniority, and daily tool use, with adjusted contrasts.
Phenotype and professional role were strongly associated but far from identical. The chi-square statistic was 62.0 on four degrees of freedom and Cramér’s V was 0.439, a moderate-to-strong association on conventional benchmarks [36]. Because Cramér’s V is a normalised chi-square coefficient rather than a proportion of explained variance, it should not be read as the share of class membership accounted for by role; the cross-classification itself shows why the two are not interchangeable. Nine nurses, 16.4% of the nursing group, fell in class 1 (comprehensive adopters) alongside the physician majority. Thirty-two of the 106 physicians (30.2%) fell outside the class that dominated their profession: ten in class 2 (resource-focused low adopters; seven residents and three specialists) and twenty-two in class 3 (tool users without perceived resource gain; eight residents and fourteen specialists). Class 3 was the most clearly cross-cutting, drawing 12 nurses, 8 residents and 14 specialists, so that it contained members of all three professions in appreciable numbers rather than being dominated by one. In the adjusted contrasts, professional category remained the dominant correlate of membership, with residents and specialists 25- to 33-fold less likely than nurses to occupy class 2, but seniority band was unrelated to phenotype in every contrast (odds ratios 0.85 and 0.92; p = 0.495 and 0.674), as was the unadjusted distribution across the four bands (Cramér’s V = 0.193; p = 0.063). In contrast, seniority correlated with uncertainty within nurses (Spearman rho = 0.42; Table 1) while remaining unrelated to phenotype membership.
The counts in Figure 2 show substantial but incomplete alignment between class and professional role. Class 1 contained 9 nurses, 47 residents and 27 specialists; class 2 contained 34 nurses, 7 residents and 3 specialists; and class 3 contained 12 nurses, 8 residents and 14 specialists. Class 3 therefore included all three professional categories and represented 21.8% of nurses, 12.9% of residents and 31.8% of specialists. These counts support cross-boundary membership while also showing that class composition remained strongly associated with role.
3.5. Benefit Appraisal and Barriers Across Digital-Use/Efficiency Phenotypes (Descriptive External Associations)
Because the four appraisal items were held outside the class-defining model, they can be examined as external outcomes, as reported in Table 5.
Table 5.
Benefit appraisal and reported barriers by digital-use/efficiency phenotype. None of these items entered the class-defining model.
The phenotypes differed far less in what respondents believed than in what they did. The Digital Benefit Index declined across the three classes from 3.29 to 2.91 to 2.74, a gradient that approached conventional significance (H = 6.0; p = 0.051) and corresponded to an epsilon-squared of 0.025. The Uncertainty Index rose from 0.67 to 1.18 without reaching significance (p = 0.108), and no Bonferroni-corrected pairwise contrast was significant for either index. At the item level, perceived educational benefit fell from 90.4% in comprehensive adopters to 70.5% and 67.6% in the other two classes (p = 0.003), and perceived safety benefit fell from 92.8% to 77.3% and 79.4% (p = 0.027). After false-discovery-rate adjustment across the ten comparisons in Table 5, only the educational-benefit difference remained significant (q = 0.030; safety q = 0.135). Clinical and managerial benefit did not differ across phenotypes (p = 0.307 and 0.716). Reported barriers were also similar across phenotypes: p = 0.736 for lack of training, p = 0.444 for technical problems, and p = 0.710 for resistance to change; the Barrier Burden score yielded p = 0.580.
3.6. Correlation Structure of the Composite Measures (Descriptive)
The bivariate relationships among the composite measures, seniority, and class posterior probabilities are given in Table 6.
Table 6.
Spearman rank-correlation matrix of composite indices, seniority and class posterior probabilities (N = 161).
Several features of the matrix require qualification. The correlation of −0.97 between the Digital Benefit Index and the Uncertainty Index is structural: the two are counts of affirmative and non-appraising responses over the same four items, and explicit disagreement was recorded only ten times in 644 responses, so the indices are nearly complementary by construction. The same caution applies to the −0.91 correlation between class 3 membership and the Resource-Efficiency Index, because the resource items help define that class. Setting these aside, the informative correlations were modest. The technology-adoption score correlated 0.25 with perceived benefit and −0.24 with uncertainty, and the Resource-Efficiency Index correlated 0.20 and −0.19 with the same outcomes. Seniority correlated −0.17 with benefit and 0.19 with uncertainty. The posterior probability of class 1 (comprehensive-adopter) membership correlated 0.49 with the adoption score and 0.36 with the Resource-Efficiency Index, but only 0.23 with perceived benefit and −0.20 with uncertainty. Barrier Burden showed no meaningful correlation with the other measures (absolute rho ≤ 0.10).
3.7. Professional Role Versus Digital-Use/Efficiency Phenotype (H2 and H3)
The primary comparison placed professional role and digital-use/efficiency phenotype in symmetric nested logistic models with seniority retained in every model, reported in Table 7; the corresponding adjusted odds ratios are given in Table 8.
Table 7.
Professional role and digital-use/efficiency phenotype as explanations of benefit appraisal: nested logistic models with seniority retained in every model.
For broad perceived benefit, adding phenotype to the seniority-only model yielded a likelihood-ratio statistic of 3.8 (2 df; p = 0.150), and adding it to the seniority-and-role model yielded 2.4 (2 df; p = 0.301; Holm-adjusted p = 0.496), with a ΔAUC of 0.010 whose bootstrap confidence interval (−0.019 to 0.044) included zero. Adding role to the seniority-only model yielded 25.0 (2 df; p < 0.001) and adding it to the seniority-and-phenotype model yielded 23.6 (2 df; p < 0.001), with a ΔAUC of 0.138 (0.052 to 0.229). AIC and BIC were higher for the combined model than for the seniority-and-role model because the likelihood gain was insufficient to offset the penalty for two additional parameters. The same asymmetry was observed for high uncertainty (phenotype increments of 3.6 and 2.8; role increments of 27.0 and 26.2) and for patient-safety benefit (6.8 and 1.2 versus 36.8 and 31.2). For educational benefit, phenotype improved the seniority-only model (11.2; p = 0.004) but not the seniority-and-role model (4.5; p = 0.103; q = 0.206); the ΔAUC of 0.068 for that increment had a bootstrap 95% confidence interval of −0.006 to 0.146 and shrank to 0.055 after optimism correction, so it is not interpreted as evidence of an incremental phenotype contribution. Optimism-corrected C-statistics were 0.02–0.04 lower than apparent values and preserved the ordering of the models. BIC selected the seniority-and-role model over the combined model for all four outcomes.
Table 8.
Adjusted odds ratios (95% CI) for the primary outcomes from the seniority-and-role model (M1) and the combined model (M3).
In the combined models (Table 8), residents and specialists had five-to-seven-fold higher odds of broad perceived benefit than nurses and 81–86% lower odds of high uncertainty, with confidence intervals excluding 1 in every case, whereas the two class coefficients were imprecise and included 1 (odds ratios of 0.48–0.72 for benefit and 1.35–2.02 for uncertainty). Adding phenotype changed the role coefficients by less than 0.15 on the log-odds scale, consistent with the small likelihood-ratio increments.
3.8. Sensitivity of the Role-Versus-Phenotype Comparison to Class Enumeration, Classification Error and Indicator Set (H2 and H3)
Table 9 repeats the two primary increments of Table 7 under alternative class solutions, under classification-error-corrected (BCH) and posterior-probability-weighted estimation, and with a use-only latent class model. The two-class solution contained 101 and 60 respondents; the four-class solution contained 61, 44, 42 and 14 respondents and split class 1 into two profiles differing mainly in the breadth of educational-resource use. The use-only model, fitted to the seven reported-use indicators, retained three classes for comparability (entropy of 0.781; 88, 41 and 32 respondents); its modal classification agreed moderately with the primary classification (Cohen’s kappa = 0.58).
Table 9.
Sensitivity of the primary role-versus-phenotype increments to class enumeration, classification-error correction and indicator set.
Across all nine specifications, the phenotype increment after seniority and role was small and non-significant (likelihood-ratio 1.1–5.2; p ≥ 0.158), whereas the role increment after seniority and phenotype was large and significant throughout (21.3–27.5; all p < 0.001). Classification-error correction slightly increased the phenotype increment, as expected when the attenuation produced by modal assignment is removed, but did not change its inferential status, and the use-only model, which contains no perceived-efficiency content, produced the smallest phenotype increments of all. Shapley shares recomputed under the BCH three-class specification allocated 66.1% and 60.4% of the partitioned pseudo-R2 to role and 13.5% and 12.9% to phenotype for broad benefit and high uncertainty, respectively, close to the primary values in Table 11. The conclusion that role carries more explanatory information than phenotype therefore did not depend on the number of classes, on the treatment of classification uncertainty or on the inclusion of perceived-efficiency indicators.
3.9. The Domain Hierarchy of Perceived Benefit (Exploratory)
The exploratory Rasch item hierarchy and descriptive nurse–physician DIF contrasts are reported in Table 10 and Figure 3.
Table 10.
Exploratory Rasch analysis of the four benefit domains, with descriptive DIF contrasts between nurses and physicians.
Figure 3.
Rasch item characteristic curves for the four benefit domains; markers indicate the difficulty parameter, the point at which endorsement becomes more likely than not; the dashed horizontal line marks the 0.5 probability level.
In the fitted four-item Rasch model, patient safety had the lowest estimated difficulty (−1.59 logits), followed by continuing education (−1.25), clinical decision-making (−0.94), and managerial decision-making (−0.65). The item-level fit statistics did not indicate gross misfit, but the person separation reliability of 0.07 means that the scale cannot distinguish respondents reliably. The centred DIF contrasts were +0.59 logits for patient safety, +0.43 for continuing education, −0.22 for clinical decision-making, and −0.80 for managerial decision-making. Without uncertainty intervals or multiplicity-adjusted tests, these values suggest possible domains for future study but cannot establish differential functioning between nurses and physicians.
Figure 3 displays the fitted item characteristic curves and makes the practical meaning of the difficulty parameters legible. Because the Rasch model constrains all four curves to a common slope, they are parallel and differ only in horizontal position, and the markers at the 0.5 probability level identify the latent propensity at which each domain becomes more likely than not to be endorsed. The span between the easiest and hardest domain is 0.94 logits, which at the estimated discrimination of 1.57 corresponds to a substantial difference in endorsement probability: a respondent sitting at the mean of the latent scale has a fitted probability of 0.92 of endorsing the patient-safety benefit but only 0.74 of endorsing the managerial benefit.
3.10. Exploratory Decomposition of the Nurse–Physician Contrast and Partitioning of Model Information (H4)
The exploratory descriptive decomposition (H4) and the secondary Shapley partitioning are reported in Table 11.
Table 11.
Exploratory descriptive decomposition of the nurse–physician contrast and hierarchical partitioning of McFadden’s pseudo-R2.
For broad perceived benefit, the model-based nurse–physician total contrast was 36.3 percentage points (95% CI 19.1 to 50.9). The indirect component through technology adoption was 1.2 points (95% CI −3.4 to 7.7), and the indirect component through class 1 (comprehensive-adopter) probability was −1.5 points (95% CI −7.6 to 6.4). For high uncertainty, the total contrast was −33.9 points (95% CI −48.1 to −19.4), while the indirect component via adoption was −1.2 points (95% CI −6.5 to 3.1). Thus, the exploratory decompositions provided little evidence that the nurse–physician contrast was carried by adoption breadth or by phenotype probability; they describe an observed association and do not identify a causal direct role effect. In the Shapley partitioning, professional role received 0.121 of the total McFadden pseudo-R2 = 0.178 for perceived benefit (68.3% of the partitioned total), compared with 11.9% for phenotype, 10.2% for adoption and 9.7% for seniority. For high uncertainty, role received 62.3% of the partitioned total.
4. Discussion
4.1. Analysis of Findings
The four hypotheses are considered in turn before the broader interpretation.
H1, that the 12 indicators would yield at least two interpretable phenotypes crossing professional boundaries, was supported. In the selected three-class representation, 16% of nurses fell in class 1 (comprehensive adopters) and 30% of physicians fell outside the class that dominated their profession, and class 3 drew members from all three groups in appreciable numbers; the two- and four-class solutions likewise placed a minority of each profession with the majority of the other. This pattern is what the diffusion-of-innovations account predicts, namely adopter categories defined by behaviour that cut across occupational titles [7], and it agrees with intensive care studies reporting wide variation in usability ratings and reported problems within, not only between, nursing and medical staff [25,26]. The phenotypes are nonetheless an exploratory description: the enumeration criteria disagreed, class 3 had the lowest mean posterior probability (0.83), and the profiles combine reported use with perceived efficiency, so they should be treated as a working typology to be tested in other departments rather than as an established classification.
H2, that phenotype would add information beyond seniority and role, was not supported for the primary outcomes, and the sensitivity analyses in Table 9 show that this was not a consequence of the class-enumeration decision, of classification error in modal assignment, or of the inclusion of perceived-efficiency indicators. Three explanations, each grounded in prior research, appear plausible. First, most of the information carried by phenotype is shared with role: the association between the two was moderate-to-strong (Cramér’s V = 0.439), the seniority-and-phenotype models discriminated above chance (C-statistics 0.63–0.69), and phenotype improved seniority-only models for two of the four outcomes, so phenotype is not uninformative but largely redundant once role is known. This is consistent with implementation reviews that locate the determinants of adoption in role-specific work arrangements [8,45,46,47] and with the FITT framework, in which the fit between task and technology, not the breadth of use, governs perceived benefit [27]. Second, the technology-acceptance literature has repeatedly shown that perceived usefulness depends on whether a system supports the user’s own tasks rather than on how many systems are used [2,3,48,49]; in intensive care specifically, information systems save documentation time for nurses but yield inconsistent gains for physicians [21,22], and usability problems concentrate in medication presentation and documentation steps that fall differently on the two groups [26]. A profile that counts tools and perceived efficiencies across the department therefore need not track the benefit an individual experiences in their own tasks. Third, statistical power was limited: with 161 respondents, the 2-df likelihood-ratio test had roughly 80% power to detect an increment of about 0.05 in McFadden pseudo-R2, whereas the observed phenotype increment was about 0.01, so a small genuine contribution cannot be excluded. What can be said is that any such contribution is much smaller than that of role, and that the direction of the construct overlap between the efficiency indicators and appraisal would, if anything, have inflated rather than masked it.
H3, that role would add information beyond phenotype, was supported: adding role to seniority-and-phenotype models produced large improvements for every outcome (likelihood-ratio of 20.4–31.2), and the ranking of the two constructs was unchanged under every sensitivity specification and in the Shapley partitioning. These comparisons indicate where explanatory information was concentrated in this sample; they do not show that professional role itself caused appraisal differences. A role indicator may proxy task allocation, system access, type of exposure and visibility of digital outputs within the local work system [50]. Reviews of user-group barriers and organisational implementation likewise show that technology is encountered through role-specific work arrangements rather than as a uniform exposure [45,46,47]. Syntheses covering the post-pandemic period reach the same conclusion: the barriers and facilitators that govern professionals’ use of digital tools cluster around workflow fit, training and organisational support, all of which are distributed unevenly across roles [4], and human-factors guidance for clinical AI stresses that a tool’s value is realised only through role-specific work design [51].
H4, that adoption breadth or class 1 probability would show an indirect association linking physician status to appraisal, was not supported: the indirect components were within two percentage points of zero with confidence intervals spanning zero, and the direct component was almost identical to the total contrast. This is the decompositional counterpart of the H2 result. It is consistent with self-efficacy and acceptance research showing that availability and use do not translate directly into perceived usefulness [48,52,53], and with evidence that nurses exposed to the same records as physicians report more stress and less benefit when training and workflow fit are insufficient [12,13]. The decomposition is descriptive, however: with cross-sectional data and self-reported use, it cannot distinguish an absent pathway from one that operates in both directions.
The findings provide little evidence that broader reported digital engagement was sufficient to close appraisal differences, but this should not be read as evidence that exposure is irrelevant. Professional role may capture which system component is used, whether use is discretionary or mandatory, the burden attached to it, and whether downstream benefits are visible. Self-efficacy and technology-acceptance research also suggests that availability and use do not fully determine perceived usefulness [52,53]. The exploratory Rasch pattern raises the possibility that benefit domains differ in visibility across groups, but the four-item scale had very low person reliability, and the DIF contrasts lacked inferential uncertainty. Accordingly, access to interpretation is one plausible explanation among several, not a demonstrated mechanism.
Any implementation implication should be treated as a hypothesis for prospective evaluation. Widening access and training may remain necessary, but role-specific interpretive support, feedback linking digital activity to patient or operational outcomes, and redesign of burdensome workflows could be tested as complementary strategies rather than presented as demonstrated recommendations. Reviews report that electronic records can disrupt nurses’ cognitive work and have mixed effects on nursing time [54,55]; more recent work quantifies this burden, with documentation burden substantial for physicians and nurses alike but measured differently in each group [11], burnout attributed to electronic record use in roughly 40% of health professionals in pooled estimates [56], and record-related stress among nurses linked to insufficient training and workflow disruption [12,57], while acceptance research emphasises perceived usefulness and self-efficacy [48,49]. Nursing informatics scholarship argues for stronger nursing participation in data interpretation and design [58], and critical-care cognitive task analysis supports attention to role-specific information needs [59]. Studies of digital workload and health-IT-related stress further caution that more exposure can also mean more burden [60,61]. In anaesthesia and intensive care specifically, physicians surveyed before and during the introduction of AI-based decision support express cautious optimism that is conditional on transparency, external validation and integration into existing workflows [18,19,20], and implementation reviews of critical-care AI identify clinician acceptance as a prerequisite for any benefit to be realised [15,16]. These observations are consistent with the present finding that role, as a proxy for task context, carried more information about appraisal than reported use did. These sources support the plausibility of the proposed tests, not their effectiveness in this sample; implementation should remain sociotechnical and context-sensitive [62].
4.2. Study Limitations
Several limitations temper interpretation. First, the cross-sectional design cannot establish temporal order or causal effects; the decomposition analysis is an exploratory descriptive partition of an observed association, not a mediation analysis with causal estimands. Second, the data are self-reported, were collected with a locally developed instrument whose test–retest reliability was not assessed, and come from one tertiary emergency hospital, limiting generalisability and correspondence with observed digital behaviour. Third, class enumeration was uncertain: BIC favoured two classes, other criteria extended improvement to four, and the four-class solution contained a 14-person class. The sensitivity analyses in Table 9 show that the primary comparison did not depend on this choice, but the three-class phenotypes themselves remain an exploratory description rather than an established typology. Fourth, modal assignment ignores classification error; the BCH and posterior-probability-weighted re-analyses gave the same conclusions, although the BCH standard errors rely on bootstrap resampling of a two-stage procedure in a modest sample [33,34,35]. Fifth, the class indicators mix reported use with perceived operational efficiency, creating construct overlap with appraisal-related perceptions; the use-only sensitivity analysis showed that this overlap did not drive the comparison, but phenotype, adoption score, and Resource-Efficiency Index are still not conceptually independent. Sixth, role and seniority are related, and sparse cells limit separate interpretation of their adjusted coefficients. Seventh, discrimination was internally validated by bootstrap only; optimism-corrected C-statistics were 0.02–0.04 lower than apparent values, and external validation in another centre has not been performed. Eighth, the study was not powered to detect small increments: with 161 respondents, the 2-df likelihood-ratio tests had roughly 80% power for an increment of about 0.05 in McFadden pseudo-R2 but little power for increments of the size observed for phenotype (about 0.01), so the absence of a phenotype increment should be read as no evidence of a material increment rather than as proof of none. Primary tests were Holm-adjusted and secondary tests false-discovery-rate-adjusted, but the number of exploratory analyses remains large, and those findings are hypothesis-generating. Finally, the four-item Rasch analysis had person separation reliability of 0.07, and DIF contrasts lacked standard errors, confidence intervals, p-values, and multiplicity adjustment. The item ordering is descriptive; person estimates and group-specific DIF claims are not reliable. Larger multicentre longitudinal studies should pre-specify class-solution sensitivity analyses and classification-error correction as done here, add external validation, objective usage measures and adequately powered item-level measurement, and measure reported use and perceived efficiency with separate instruments.
5. Conclusions
Among 161 anaesthesia and intensive care professionals, the exploratory three-class digital-use/efficiency solution crossed professional boundaries, but its associations with perceived benefit were modest. With seniority held in every model, professional role added substantially more explanatory information than phenotype, whereas phenotype added little after seniority and role for the primary outcomes; this ranking was unchanged under two- and four-class solutions, classification-error correction, use-only indicators and internal validation. The phenotype findings themselves remain exploratory, and the exploratory decompositions provided little evidence that the role contrast was carried by adoption breadth or phenotype probability. These cross-sectional findings do not establish that role causes appraisal differences or that broader engagement cannot matter. They instead motivate prospective evaluation of role-specific exposure type, workflow burden, visibility of system outputs, and interpretive support as possible explanations for appraisal gaps.
Author Contributions
Conceptualization, C.V. and O.B.; methodology, C.V. and O.B.; software, C.V. and O.B.; validation, C.V. and O.B.; formal analysis, D.C.S. and C.V.; investigation, D.C.S. and C.V.; resources, D.C.S. and C.V.; data curation, D.C.S. and C.V.; writing—original draft preparation, L.I.M. and S.U.; writing—review and editing, L.I.M. and S.U.; visualisation, L.I.M. and S.U.; project administration, L.I.M. and S.U.; supervision, L.I.M. and S.U. All authors have read and agreed to the published version of the manuscript.
Funding
We would like to acknowledge the “Victor Babeș” University of Medicine and Pharmacy Timișoara for their support in covering the costs of publication for this research paper.
Institutional Review Board Statement
The Local Commission of Ethics from the ‘Pius Brînzeu’ Clinical Emergency Hospital from Timișoara, Romania, operates under article 167 provisions of Law no. 95/2006, art. 28, chapter VIII of order 904/2006; with EU GCP Directives 2005/28/EC, International Conference of Harmonisation of Technical Requirements for Registration of Pharmaceuticals for Human Use (ICH); and with the Declaration of Helsinki. The survey and analysis of its original respondent-level questionnaire data were conducted under this ethical framework. The study was conducted in accordance with the Declaration of Helsinki and approved by the Local Ethics Committee for Scientific Research of the “Pius Brînzeu” Timișoara County Emergency Clinical Hospital (protocol code 291; date of approval: 22 March 2022).
Informed Consent Statement
Informed consent was obtained from all subjects involved in the study.
Data Availability Statement
The anonymized minimal respondent-level dataset and the analysis scripts supporting the findings are available from the corresponding author upon reasonable request. Public deposition of the participant-level dataset is restricted because data sharing remains subject to the ethical and institutional requirements governing the study.
Acknowledgments
The authors used a large language model to assist with language editing and formatting. The authors reviewed and approved all revisions and take full responsibility for the manuscript. No AI tool was used for data collection or statistical analysis.
Conflicts of Interest
The authors declare no conflicts of interest.
Appendix A
Survey instrument. The questionnaire was administered on paper in Romanian in a single wave (4 April to 30 June 2022); the English translation below preserves the item order and response options. Items marked with an asterisk supplied the 12 latent class indicators; Q5, Q9, Q10 and Q11 are the four benefit-appraisal items that were held outside the class-defining model.
Section A. Respondent characteristics. Q1. Your professional role in the department: nurse/resident physician/specialist physician. Q2. Years of professional experience in anaesthesia and intensive care: 0–5/6–10/11–20/more than 20. Q3. Do you use digital tools (patient monitoring, electronic records, planning software or similar) in your daily work? yes/no.
Section B. Technologies used and patient safety. Q4.* Which of the following digital technologies do you use in your work? (tick all that apply): patient-monitoring systems; electronic health records; anaesthesia-planning software; training simulators. Q5. In your opinion, have digital technologies improved patient safety in your department? yes/no/cannot appraise.
Section C. Educational resources and barriers. Q6.* Which of the following digital educational resources have you used in the past 12 months? (tick all that apply): e-learning platforms; simulation-based training; webinars. Q7. Which of the following barriers limit your use of digital technologies? (tick all that apply): lack of training; technical problems; resistance to change.
Section D. Perceived operational efficiency. Q8.* Since the introduction of digital technologies, which of the following resources are used more efficiently in your department? (tick all that apply): medications; medical staff; sanitary materials; bed occupancy; protective equipment.
Section E. Benefit appraisal. Q9. Have digital technologies improved clinical decision-making in your department? yes/no/cannot appraise. Q10. Have digital technologies improved managerial decision-making in your department? yes/no/cannot appraise. Q11. Have digital technologies improved continuing education in your department? yes/no/cannot appraise.
Scoring. Technology-adoption score = number of technologies ticked in Q4 (0–4); Barrier Burden score = number of barriers ticked in Q7 (0–3); Resource-Efficiency Index = number of resources ticked in Q8 (0–5); Digital Benefit Index = number of ‘yes’ responses to Q5, Q9, Q10 and Q11 (0–4); Uncertainty Index = number of ‘cannot appraise’ responses to the same four items (0–4). Broad perceived benefit was defined as a Digital Benefit Index of at least 3 and high uncertainty as an Uncertainty Index of at least 2.
References
- Greenhalgh, T.; Wherton, J.; Papoutsi, C.; Lynch, J.; Hughes, G.; A’Court, C.; Hinder, S.; Fahy, N.; Procter, R.; Shaw, S. Beyond adoption: A new framework for theorizing and evaluating nonadoption, abandonment, and challenges to the scale-up, spread, and sustainability of health and care technologies. J. Med. Internet Res. 2017, 19, e367. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Venkatesh, V.; Morris, M.G.; Davis, G.B.; Davis, F.D. User acceptance of information technology: Toward a unified view. MIS Q. 2003, 27, 425–478. [Google Scholar] [CrossRef] [Scilit]
- Holden, R.J.; Karsh, B.T. The technology acceptance model: Its past and its future in health care. J. Biomed. Inform. 2010, 43, 159–172. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Borges do Nascimento, I.J.; Abdulazeem, H.; Vasanthan, L.T.; Martinez, E.Z.; Zucoloto, M.L.; Østengaard, L.; Azzopardi-Muscat, N.; Zapata, T.; Novillo-Ortiz, D. Barriers and facilitators to utilizing digital health technologies by healthcare professionals. npj Digit. Med. 2023, 6, 161. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- AlQudah, A.A.; Al-Emran, M.; Shaalan, K. Technology acceptance in healthcare: A systematic review. Appl. Sci. 2021, 11, 10537. [Google Scholar] [CrossRef] [Scilit]
- World Health Organization. Global Strategy on Digital Health 2020–2025; World Health Organization: Geneva, Switzerland, 2021. [Google Scholar]
- Rogers, E.M. Diffusion of Innovations, 5th ed.; Free Press: New York, NY, USA, 2003. [Google Scholar]
- Cresswell, K.; Sheikh, A. Organizational issues in the implementation and adoption of health information technology innovations: An interpretative review. Int. J. Med. Inform. 2013, 82, e73–e86. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- De Veer, A.J.E.; Francke, A.L. Attitudes of nursing staff towards electronic patient records: A questionnaire survey. Int. J. Nurs. Stud. 2010, 47, 846–854. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Huryk, L.A. Factors influencing nurses’ attitudes towards healthcare information technology. J. Nurs. Manag. 2010, 18, 606–612. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Moy, A.J.; Schwartz, J.M.; Chen, R.; Sadri, S.; Lucas, E.; Cato, K.D.; Rossetti, S.C. Measurement of clinical documentation burden among physicians and nurses using electronic health records: A scoping review. J. Am. Med. Inform. Assoc. 2021, 28, 998–1008. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Heponiemi, T.; Gluschkoff, K.; Vehko, T.; Kaihlanen, A.-M.; Saranto, K.; Nissinen, S.; Nadav, J.; Kujala, S. Electronic health record implementations and insufficient training endanger nurses’ well-being: Cross-sectional survey study. J. Med. Internet Res. 2021, 23, e27096. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Isidori, V.; Diamanti, F.; Gios, L.; Malfatti, G.; Perini, F.; Nicolini, A.; Longhini, J.; Forti, S.; Fraschini, F.; Bizzarri, G.; et al. Digital technologies and the role of health care professionals: Scoping review exploring nurses’ skills in the digital era and in the light of the COVID-19 pandemic. JMIR Nurs. 2022, 5, e37631. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Carayon, P.; Schoofs Hundt, A.; Karsh, B.T.; Gurses, A.P.; Alvarado, C.J.; Smith, M.; Flatley Brennan, P. Work system design for patient safety: The SEIPS model. Qual. Saf. Health Care 2006, 15, i50–i58. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- van de Sande, D.; van Genderen, M.E.; Huiskens, J.; Gommers, D.; van Bommel, J. Moving from bytes to bedside: A systematic review on the use of artificial intelligence in the intensive care unit. Intensive Care Med. 2021, 47, 750–760. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Yoon, J.H.; Pinsky, M.R.; Clermont, G. Artificial intelligence in critical care medicine. Crit. Care 2022, 26, 75. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Maheshwari, K.; Cywinski, J.B.; Papay, F.; Khanna, A.K.; Mathur, P. Artificial intelligence for perioperative medicine: Perioperative intelligence. Anesth. Analg. 2023, 136, 637–645. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- van der Meijden, S.L.; de Hond, A.A.H.; Thoral, P.J.; Steyerberg, E.W.; Kant, I.M.J.; Cinà, G.; Arbous, M.S. Intensive care unit physicians’ perspectives on artificial intelligence-based clinical decision support tools: Preimplementation survey study. JMIR Hum. Factors 2023, 10, e39114. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Henckert, D.; Malorgio, A.; Schweiger, G.; Raimann, F.J.; Piekarski, F.; Zacharowski, K.; Hottenrott, S.; Meybohm, P.; Tscholl, D.W.; Spahn, D.R.; et al. Attitudes of anesthesiologists toward artificial intelligence in anesthesia: A multicenter, mixed qualitative–quantitative study. J. Clin. Med. 2023, 12, 2096. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Estrada Alamo, C.E.; Diatta, F.; Monsell, S.E.; Lane-Fall, M.B. Artificial intelligence in anesthetic care: A survey of physician anesthesiologists. Anesth. Analg. 2024, 138, 938–950. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Bosman, R.J.; Rood, E.; Oudemans-van Straaten, H.M.; Van der Spoel, J.I.; Wester, J.P.; Zandstra, D.F. Intensive care information system reduces documentation time of the nurses after cardiothoracic surgery. Intensive Care Med. 2003, 29, 83–90. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Mador, R.L.; Shaw, N.T. The impact of a Critical Care Information System (CCIS) on time spent charting and in direct patient care by staff in the ICU: A review of the literature. Int. J. Med. Inform. 2009, 78, 435–445. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Levesque, E.; Hoti, E.; Azoulay, D.; Ichai, P.; Samuel, D.; Saliba, F. The implementation of an Intensive Care Information System allows shortening the ICU length of stay. J. Clin. Monit. Comput. 2015, 29, 263–269. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Thongprayoon, C.; Harrison, A.M.; O’Horo, J.C.; Sevilla Berrios, R.A.; Pickering, B.W.; Herasevich, V. The effect of an electronic checklist on critical care provider workload, errors, and performance. J. Intensive Care Med. 2016, 31, 205–212. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- von Dincklage, F.; Suchodolski, K.; Lichtner, G.; Friesdorf, W.; Podtschaske, B.; Ragaller, M. Investigation of the usability of computerized critical care information systems in Germany. J. Intensive Care Med. 2019, 34, 227–237. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Thissen, A.; Salgado-Baez, E.; Fürstenau, D.; Delucchi Danhier, R.; Meske, C.; Kuss, P.; Angermair, S.; Spies, C.; Balzer, F. Barriers and facilitators of the use of computerized critical care information systems in the intensive care unit: Qualitative interview study. J. Med. Internet Res. 2025, 27, e49254. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Ammenwerth, E.; Iller, C.; Mahler, C. IT-adoption and the interaction of task, technology and individuals: A fit framework and a case study. BMC Med. Inform. Decis. Mak. 2006, 6, 3. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Polit, D.F.; Beck, C.T. The content validity index: Are you sure you know what’s being reported? Critique and recommendations. Res. Nurs. Health 2006, 29, 489–497. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Kuder, G.F.; Richardson, M.W. The theory of the estimation of test reliability. Psychometrika 1937, 2, 151–160. [Google Scholar] [CrossRef] [Scilit]
- Sclove, S.L. Application of model-selection criteria to some problems in multivariate analysis. Psychometrika 1987, 52, 333–343. [Google Scholar] [CrossRef] [Scilit]
- Nylund, K.L.; Asparouhov, T.; Muthén, B.O. Deciding on the number of classes in latent class analysis and growth mixture modeling: A Monte Carlo simulation study. Struct. Equ. Model. 2007, 14, 535–569. [Google Scholar] [CrossRef] [Scilit]
- Sinha, P.; Calfee, C.S.; Delucchi, K.L. Practitioner’s guide to latent class analysis: Methodological considerations and common pitfalls. Crit. Care Med. 2021, 49, e63–e79. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Bakk, Z.; Kuha, J. Relating latent class membership to external variables: An overview. Br. J. Math. Stat. Psychol. 2021, 74, 340–362. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Bolck, A.; Croon, M.; Hagenaars, J. Estimating latent structure models with categorical variables: One-step versus three-step estimators. Polit. Anal. 2004, 12, 3–27. [Google Scholar] [CrossRef] [Scilit]
- Vermunt, J.K. Latent class modeling with covariates: Two improved three-step approaches. Polit. Anal. 2010, 18, 450–469. [Google Scholar] [CrossRef] [Scilit]
- Cohen, J. Statistical Power Analysis for the Behavioral Sciences, 2nd ed.; Lawrence Erlbaum Associates: Hillsdale, NJ, USA, 1988. [Google Scholar]
- Firth, D. Bias reduction of maximum likelihood estimates. Biometrika 1993, 80, 27–38. [Google Scholar] [CrossRef]
- Demler, O.V.; Pencina, M.J.; D’Agostino, R.B., Sr. Misuse of DeLong test to compare AUCs for nested models. Stat. Med. 2012, 31, 2577–2587. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Steyerberg, E.W.; Harrell, F.E., Jr.; Borsboom, G.J.J.M.; Eijkemans, M.J.C.; Vergouwe, Y.; Habbema, J.D.F. Internal validation of predictive models: Efficiency of some procedures for logistic regression analysis. J. Clin. Epidemiol. 2001, 54, 774–781. [Google Scholar] [PubMed]
- Chevan, A.; Sutherland, M. Hierarchical partitioning. Am. Stat. 1991, 45, 90–96. [Google Scholar] [CrossRef] [Scilit]
- VanderWeele, T.J. A unification of mediation and interaction: A 4-way decomposition. Epidemiology 2014, 25, 749–761. [Google Scholar] [PubMed]
- Embretson, S.E.; Reise, S.P. Item Response Theory for Psychologists; Lawrence Erlbaum Associates: Mahwah, NJ, USA, 2000. [Google Scholar]
- Holm, S. A simple sequentially rejective multiple test procedure. Scand. J. Stat. 1979, 6, 65–70. [Google Scholar]
- Benjamini, Y.; Hochberg, Y. Controlling the false discovery rate: A practical and powerful approach to multiple testing. J. R. Stat. Soc. Ser. B 1995, 57, 289–300. [Google Scholar] [CrossRef] [Scilit]
- McGinn, C.A.; Grenier, S.; Duplantie, J.; Shaw, N.; Sicotte, C.; Mathieu, L.; Leduc, Y.; Légaré, F.; Gagnon, M.P. Comparison of user groups’ perspectives of barriers and facilitators to implementing electronic health records: A systematic review. BMC Med. 2011, 9, 46. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Boonstra, A.; Broekhuis, M. Barriers to the acceptance of electronic medical records by physicians: From systematic review to taxonomy and interventions. BMC Health Serv. Res. 2010, 10, 231. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Lluch, M. Healthcare professionals’ organisational barriers to health information technologies: A literature review. Int. J. Med. Inform. 2011, 80, 849–862. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Strudwick, G. Predicting nurses’ use of healthcare technology using the technology acceptance model: An integrative review. Comput. Inform. Nurs. 2015, 33, 189–198. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Gagnon, M.P.; Ghandour, E.K.; Talla, P.K.; Simonyan, D.; Godin, G.; Labrecque, M.; Ouimet, M.; Rousseau, M. Electronic health record acceptance by physicians: Testing an integrated theoretical model. J. Biomed. Inform. 2014, 48, 17–27. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Sittig, D.F.; Singh, H. A new sociotechnical model for studying health information technology in complex adaptive healthcare systems. Qual. Saf. Health Care 2010, 19, i68–i74. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Sujan, M.; Pool, R.; Salmon, P. Eight human factors and ergonomics principles for healthcare artificial intelligence. BMJ Health Care Inform. 2022, 29, e100516. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Bandura, A. Self-efficacy: Toward a unifying theory of behavioral change. Psychol. Rev. 1977, 84, 191–215. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Compeau, D.R.; Higgins, C.A. Computer self-efficacy: Development of a measure and initial test. MIS Q. 1995, 19, 189–211. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Wisner, K.; Lyndon, A.; Chesla, C.A. The electronic health record’s impact on nurses’ cognitive work: An integrative review. Int. J. Nurs. Stud. 2019, 94, 74–84. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Moore, E.C.; Tolley, C.L.; Bates, D.W.; Slight, S.P. A systematic review of the impact of health information technology on nurses’ time. J. Am. Med. Inform. Assoc. 2020, 27, 798–807. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Wu, Y.; Wu, M.; Wang, C.; Lin, J.; Liu, J.; Liu, S. Evaluating the prevalence of burnout among health care professionals related to electronic health record use: Systematic review and meta-analysis. JMIR Med. Inform. 2024, 12, e54811. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Li, C.; Parpia, C.; Sriharan, A.; Keefe, D.T. Electronic medical record-related burnout in healthcare providers: A scoping review of outcomes and interventions. BMJ Open 2022, 12, e060865. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Brennan, P.F.; Bakken, S. Nursing needs big data and big data needs nursing. J. Nurs. Scholarsh. 2015, 47, 477–484. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Fackler, J.C.; Watts, C.; Grome, A.; Miller, T.; Crandall, B.; Pronovost, P. Critical care physician cognitive task analysis: An exploratory study. Crit. Care 2009, 13, R33. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Sinsky, C.; Colligan, L.; Li, L.; Prgomet, M.; Reynolds, S.; Goeders, L.; Westbrook, J.; Tutty, M.; Blike, G. Allocation of physician time in ambulatory practice: A time and motion study in 4 specialties. Ann. Intern. Med. 2016, 165, 753–760. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Gardner, R.L.; Cooper, E.; Haskell, J.; Harris, D.A.; Poplau, S.; Kroth, P.J.; Linzer, M. Physician stress and burnout: The impact of health information technology. J. Am. Med. Inform. Assoc. 2019, 26, 106–114. [Google Scholar] [CrossRef] [Scilit] [PubMed]
- Cresswell, K.M.; Bates, D.W.; Sheikh, A. Ten key considerations for the successful implementation and adoption of large-scale health information technology. J. Am. Med. Inform. Assoc. 2013, 20, e9–e13. [Google Scholar] [CrossRef] [Scilit] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2026 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license.


