Abstract
Digital health innovations (DHIs) have the potential to transform access, continuity, and quality of healthcare in rural, regional, and remote (RRR) settings, yet they often fall short in practice. Barriers extend beyond infrastructure and technology to include workforce challenges and the complex realities of delivering care across diverse geographic, cultural, and social contexts. Effective DHIs must therefore be designed with local needs and systemic constraints in mind. Conventional logic models can align inputs and activities with intended outcomes, but their linear and static assumptions often fail to capture the adaptive, relational, and place-based nature of RRR health systems. This paper presents a logic model scaffold—an iterative, four-step process for planning, implementing, and evaluating DHIs in RRR settings. Informed by program theory and implementation science, the scaffold is illustrated through a case example from the Northern Australian Regional Digital Health Collaborative. The process involves understanding context and needs, aligning interventions with system enablers, translating these into targeted activities and outputs, and embedding reflexivity and iterative adaptation. Applying the scaffold from the earliest stages of planning enhances methodological rigor, transparency, and responsiveness to local priorities, workforce realities, and system-level enablers in RRR healthcare.
1. Introduction
Digital health innovations (DHIs) hold considerable promise to improving access, continuity, and quality of care in rural, regional, and remote (RRR) Australia. In practice, however, these benefits are often difficult to realize. Beyond infrastructure and technology, persistent workforce challenges—including professional isolation, shortages, and limited training opportunities—directly influence the feasibility, adoption, and sustainability of DHIs in these settings [,,,]. Addressing these challenges requires innovation designs that are explicitly aligned with workforce needs, local contexts, and system capabilities, ensuring that DHIs are both usable and impactful.
Rigorous DHIs are typically underpinned by theoretical frameworks, implemented with fidelity, and evaluated using evidence-informed approaches [,]. In RRR contexts, however, conventional notions of rigor—such as reliance on randomized controlled trials—are often impractical or ethically challenging, as service models must remain flexible and context-responsive [,,]. Alternative approaches, including mixed methods, realist evaluation, and participatory designs, better capture contextual complexity, strengthen relevance, and build trust with diverse stakeholders [,,,]. These approaches emphasize not just whether DHIs work, but how, for whom, and under what circumstances [,]. Transparent reporting, attention to scalability and sustainability, and appropriate analytical methods further underpin rigor []. Despite these approaches, fragmented infrastructure, variable digital capability, and enduring inequities continue to constrain the design, implementation, and evaluation of DHIs [,]. Structured, practical tools that provide clarity, coherence, and contextual fit from the outset are therefore essential.
Logic models offer one such tool. By articulating relationships between inputs, activities, outputs, outcomes, and impacts, logic models provide a framework for planning, implementing, and evaluating innovations. They help surface assumptions, identify contextual factors, and clarify causal pathways, serving as a conceptual roadmap through complex systems [,,,]. Widely applied across health systems research, program evaluation, and implementation science [,,,], logic models strengthen intervention coherence, align components with system-level goals, and foster collaboration among diverse stakeholders. Increasingly, they are used as theories of change, informing both process and outcome evaluations, facilitating adaptation, and supporting the identification of enablers and barriers to success [,].
However, conventional logic models often fall short in RRR settings. Their linear assumptions rarely capture the dynamic, relational, and systemic pressures that define these contexts. Workforce shortages, systemic inequalities, and uneven digital maturity further complicate their application, risking oversimplification of complexity and constraining innovation. This gap highlights the need for approaches that retain the strengths of logic models while embedding relational, adaptive, and scalable elements to better support DHI implementation in RRR contexts. This paper responds to this need by presenting a case application of a four-step logic model scaffold, designed to strengthen planning, implementation, and evaluation of DHIs in RRR settings.
2. Materials and Methods
The Northern Australian Regional Digital Health Collaborative (NARDHC) was established in 2022 as a multi-stakeholder initiative supporting DHIs across Northern Australia (www.nardhc.org (accessed on 13 October 2025)). NARDHC brings together research institutions, health services, government agencies, technology developers, and community representatives to collaborate across five priority areas to:
- Establish a dedicated initiative for digital innovation and investment, fostering strong research–industry collaborations.
- Connect stakeholders across Northern Australia (industry partners, researchers, and local communities), through virtual technologies.
- Support collaborative projects via seed funding and strategic guidance to drive digital health solutions.
- Implement, evaluate, and disseminate innovations to promote the broad-scale adoption of effective digital health technologies.
- Deliver skills-based training for students and the health workforce to develop capabilities in using digital health applications.
A case example of using the logic model scaffold described herein focuses on priority area five, illustrating how the scaffold can guide workforce capability development in practice. Rather than replacing the conventional logic model structure (Inputs → Activities → Outputs → Outcomes → Impact), the scaffold wraps around the logic model, strengthening both its construction and application in RRR contexts (Table 1). The scaffold’s novelty lies in its explicit integration of local context, system-level enablers, and relational considerations, ensuring that all elements of the logic model are aligned with the complex realities of RRR health systems. While conventional logic models provide a static roadmap for planning and evaluation, the scaffold embeds iterative refinement, reflexive practice, and stakeholder co-design as core components. This approach adds unique value for DHI design in RRR settings by operationalizing context (mapping inputs, activities, and outcomes to geographic, cultural, and workforce realities), enhancing adaptivity (enabling continuous revision in response to emerging challenges, workforce changes, or policy shifts), and embedding relationality (systematically incorporating power dynamics, stakeholder perspectives, and co-design feedback). By foregrounding these dimensions, the logic model scaffold complements existing models while providing a practical, context-sensitive, and scalable framework for planning, implementing, and evaluating DHIs in complex RRR health systems. Table 1 illustrates these key distinctions and the complementary value added by the scaffold relative to conventional logic models.
Table 1.
Key differences between the logic model scaffold and conventional logic models.
The logic model scaffold was informed by established resources in program theory and evaluation, including the University of Wisconsin Logic Model training [], the W. K. Kellogg Foundation Logic Model Development Guide [], the CDC Evaluation Framework, and guidance from the Australian Institute of Family Studies on planning and evaluation []. These resources provided the theoretical grounding and practical scaffolding needed to design a fit-for-purpose framework. Development followed an iterative and consultative process that combined evidence review with stakeholder engagement. Key digital health capability frameworks, implementation science literature, evaluation reports, and national and regional workforce strategies were reviewed to identify existing principles and gaps [,,]. This was complemented by consultation with NARDHC’s cross-sector network, including researchers, public health and primary care services, government and innovation agencies, and industry technology partners.
A “starting with the end in mind” approach, informed by backward mapping techniques from implementation science [], was applied to anchor the scaffold in long-term outcomes. From these outcomes, the team worked backwards to identify the intermediate conditions, strategies, and resources required to achieve them. This ensured that the scaffold was outcomes-driven, contextually grounded, and aligned to RRR realities from the outset. Each step contributed a distinct layer of insight: Steps 1–2 grounded the process in local context and system enablers, Step 3 translated these insights into concrete activities and outputs, and Step 4 embedded reflexivity and relationality to ensure ongoing adaptation. Together, these steps provided a rigorous yet practical approach that complement a conventional logic model when developing DHIs in RRR settings (Figure 1).
Figure 1.
Steps in the logic model scaffold.
2.1. Step 1: Understand the Setting and Identify Needs
This step focused on grounding understanding of the context in which a DHI will operate. RRR health systems are shaped by distinctive geographic, social, cultural, and structural conditions, including higher rates of hospitalizations, deaths, and injuries, as well as poorer access to and use of primary healthcare services compared with major cities []. Mapping this context involved identifying population distribution, service availability, workforce structures, and infrastructure, while also recognizing how these resources had been accessed and experienced by communities.
Place-based enablers (e.g., trusted relationships, community-led models) and barriers (e.g., digital exclusion, high mobility, infrastructure gaps) were identified early [,]. Diverse stakeholders including community members, service providers, clinicians, and policymakers were engaged to articulate a shared purpose using participatory methods such as co-design workshops, yarning circles, interviews, and collaborative planning sessions []. This step ensured priorities reflected stakeholder views, extending beyond technical outcomes to conditions that support digital health sustainability in RRR settings.
2.2. Step 2: Connect to System-Level Enablers
Sustainability and scalability required alignment with system-level enablers across organizational, policy, and infrastructural levels. This scaffold integrated established theoretical approaches, including implementation science, systems thinking, and behavior change models, to clarify mechanisms of action and enhance its utility for planning, implementation, and evaluation [,]. During this step, assumptions about scalability were assessed, and key dependencies were identified. Behavior change frameworks, including the Capability, Opportunity, Motivation and Behavior (COM-B) model and the Theoretical Domains Framework (TDF), were used to map barriers to targeted intervention components, ensuring that training addresses capability, opportunity, and motivation. Engagement with policymakers, funders, and system leaders ensured alignment with existing health structures, place-sensitive investment, and governance arrangements.
2.3. Step 3: Translate into Activities and Outputs
Service delivery in RRR contexts is dynamic, adaptive, and shaped by workforce, community, and system-level factors. Using insights from Steps 1 and 2, the scaffold guided the translation of context and system enablers into specific activities, inputs, and outputs within a traditional logic model structure. Iterative reflection, stakeholder feedback, and adaptive learning were used to refine these components. The outcome was a logic model that was both practical and responsive, supporting implementation, evaluation, and progressive workforce capability development.
2.4. Step 4: Embed Reflexivity and Dialogue
The success of a DHI in RRR contexts depends not only on technical design and response to need, but also on how well it adapts to the complex human, cultural, and relational dynamics at play. Reflexivity (critical self-reflection) and relationality (attention to relationships and power) were central to this step. Stakeholders, including clinicians, community members, service providers, policymakers, and technology partners engaged in ongoing dialogue to reflect on assumptions, expectations, and experiences. Power imbalances, cultural identities, and institutional structures shaped trust, participation, and decision-making [,]. The scaffold was treated as a living document, revisited and revised regularly to integrate new insights and evolving relationships. This ensured interventions remain relevant, culturally safe, and responsive to local realities, producing a dynamic, evolving set of inputs, activities, outputs, and outcomes.
3. Results
This section presents the application of the logic model scaffold during the design stage of the NARDHC digital health capability initiative.
3.1. Context Profile and Workforce Priorities
Healthcare delivery in northern Australia’s RRR regions is shaped by complex geographic, social, and systemic conditions, including geographic isolation, variable infrastructure, limited workforce capacity, and inequities in access to care []. These challenges contribute to uneven adoption of digital health technologies and variable integration into local systems. Access to training and professional development is often constrained, further limiting workforce readiness.
Grounding the scaffold in local context involved engaging 25 stakeholders, including community members, clinicians, service providers, and policymakers, to understand their experiences, priorities, and challenges. Stakeholders contributed through collaborative planning sessions. Data collected included meeting summaries and reflective logs, which were analyzed thematically to identify patterns, enablers, and barriers relevant to digital health implementation in RRR settings. Workforce-centered priorities extended beyond technical skills to include confidence building, cultural safety, alignment with professional identity, reduction in digital workload, and integration into local workflows. Place-based enablers (e.g., trusted relationships, community-led models) and barriers (e.g., digital exclusion, high mobility, infrastructure gaps) were explicitly mapped.
Step 1 produced a context profile and a set of workforce priorities that informed subsequent design, implementation, and evaluation of the digital health capability program (Box 1). By articulating workforce needs and desired outcomes upfront, this step ensured the initiative was responsive to RRR realities while aligned with broader objectives of equity, workforce retention, and service quality. The iterative analysis and synthesis of stakeholder input also strengthened transparency, reproducibility, and alignment with local and system-level enablers.
Box 1. Context profile for the digital health capability initiative (Step 1).
Place:
Northern Australia’s RRR health workforce faces geographic isolation, workforce shortages, limited digital infrastructure, cultural and linguistic diversity, and constrained access to training. These factors hinder access to care and the effective adoption and integration of digital health tools.
Purpose:
To build a confident and capable RRR health workforce that can sustainably use digital health innovations, thereby strengthening service delivery and access, equity, and system responsiveness.
Needs:
- Tailored, relevant, and context-sensitive digital health training.
- Opportunities for skills development, mentoring, and ongoing support.
- Align with local models of care, policy frameworks, and system priorities.
Goals:
- Equip RRR health workforce with digital capabilities needed to integrate DHIs into routine practice.
- Enhance workforce confidence, engagement, and retention.
- Reduce regional digital inequities and improve service quality and accessibility.
3.2. Mapping Workforce Needs to System-Level Enablers
Sustainability and scalability required linking workforce priorities with broader organizational, policy, and infrastructural enablers. The scaffold integrated established theoretical approaches (e.g., implementation science, systems thinking, or behavior change models) to clarify mechanisms of action and enhance its utility for planning and evaluation [,]. Critical dependencies such as digital system interoperability, availability of training infrastructure, leadership support, and secure funding streams were identified. Potential risks, including digital exclusion (for patients and healthcare providers), staff burnout, and unintended inequities, were explicitly considered to inform mitigation strategies.
A mapping process operationalized the link between workforce capability needs and system-level enablers, involving:
- Mapping workforce barriers and priorities identified in Step 1 against relevant behavioral determinants using the COM-B model and the TDF.
- Aligning each barrier with program responses (e.g., training modules, peer support, credentialing) and corresponding mechanisms of action.
- Validating the map with NARDHC stakeholders, including health services, policymakers, and educators, to ensure coherence with local governance arrangements and system priorities.
The output of this step explicitly linked workforce barriers, behavioral determinants, program responses, and mechanisms of action (Table 2). This table provided a practical planning tool, ensuring that capability-building activities were tailored to RRR workforce needs and positioned for integration, scalability, and sustainability within broader health system structures.
Table 2.
Barriers and targeted responses for building RRR digital health capability (Step 2).
3.3. Designing Activities and Outputs
Workforce needs and system-level enablers were operationalized into targeted, contextually grounded activities, including:
- Skills-based training modules reflecting real-world RRR care scenarios, aligned to national frameworks.
- Self-assessment tools, scenario-based learning, and credentialing mechanisms such as digital badges and CPD recognition.
- Virtual communities of practice, peer mentoring, and interactive learning sessions to support collaboration and continuous learning.
- Learning content tailored to the formal care workforce segments.
- Dashboards, feedback loops, and communication campaigns to monitor uptake, engagement, and learning outcomes.
Together, these activities produced a conventional logic model (Table 3) linking inputs, activities, and outputs to measurable outcomes, supporting adaptive implementation, iterative refinement, and evaluation in RRR settings.
Table 3.
Logic model for the digital health capability initiative (Step 3).
3.4. Reflexivity and Iterative Refinement
The success of DHIs in RRR contexts depends not only on technical design as well as adaption to complex human, cultural, and relational dynamics. Reflexivity (critical self-reflection) and relationality (attention to relationships and power) were central to this process. The scaffold and logic model were treated as living documents, revisited regularly to integrate new insights and evolving relationships. Key outputs of this iterative process included:
- Updated versions of the logic model reflecting new learning and stakeholder feedback.
- Records of stakeholder dialogue (e.g., meeting summaries, reflective notes, or feedback reports) capturing evolving priorities, assumptions, and relational dynamics.
- Actionable refinements to intervention activities, evaluation measures, or governance processes emerging from reflexive reflection.
These outputs ensured interventions remained relevant, culturally safe, and responsive to local realities, producing a dynamic, evolving set of inputs, activities, outputs, and outcomes. By embedding context, system-level enablers, and reflexive processes within a traditional logic model, the scaffold functions as a practical tool for guiding implementation, aligning stakeholders, and supporting ongoing evaluation, addressing feasibility, adoption, and sustainability challenges unique to RRR health systems.
4. Discussion
This paper illustrates the value of a logic model scaffold in enhancing the planning, implementation, and evaluation of DHIs in RRR settings. Using the NARDHC digital health capability initiative as an example, we demonstrate how the logic model scaffold provides a systematic yet flexible structure for supporting DHI development. By explicitly embedding local context, system-level enablers, and reflexive processes, the scaffold moves beyond conventional logic models to support adaptive, context-sensitive, and sustainable interventions in complex RRR health systems.
RRR health systems are shaped by complex and dynamic challenges, including persistent workforce shortages, service fragmentation, and entrenched inequities in access to care []. In these settings, DHIs hold significant potential to improve service access, care coordination, and workforce sustainability. However, realizing these benefits requires a health workforce that is confident, capable, and supported to use digital tools effectively within contextually complex environments.
The logic model scaffold was developed as a living, adaptive tool to guide intervention planning, articulating how targeted, skills-based, contextually relevant training can contribute to workforce development. It provides a structured approach of mapping intervention goals, resources, planned activities, and anticipated outcomes while remaining responsive to local realities. This aligns with prior research highlighting the value of logic models in clarifying causal pathways, surfacing assumptions, and strengthening alignment between intervention design and intended impact []. In workforce development, such tools are particularly useful because they make explicit the mechanisms through which training initiatives are expected to build capability, increase confidence, and improve application of digital health tools in practice. By capturing variability in digital readiness, infrastructure, and workforce conditions, the scaffold helps align diverse stakeholders around shared objectives and identifies key enablers and barriers early in the process [,].
Implementation required significant investment of time and resources, particularly for collaborating with stakeholders to ensure contextual relevance and workforce alignment. Yet this process strengthens credibility, practical utility, and adaptability. In RRR contexts, where governance is fragmented, collaboration is essential, and policy landscapes shift frequently, so co-designed logic models support adaptive delivery by embedding reflexivity and responsiveness. They encourage inclusive dialogue, foster shared ownership, and generate actionable insights that allow DHIs to remain relevant in dynamic conditions, reducing the risk of failure due to rigid design.
Evaluation in real-world RRR healthcare systems is inherently challenging, as traditional methods often overlook socio-cultural, organizational, and contextual influences on how DHIs are implemented and experienced []. Logic models provide a transparent mechanism for mapping assumptions and tracing the pathways through which activities are expected to lead to changes in knowledge, behaviors, and system-level outcomes []. The scaffold strengthens evaluation by embedding place-based challenges, workforce needs, cultural considerations, and system-level enablers from the outset. By visualizing incremental progress alongside broader system-level goals such as retention, equity, and sustainability, the scaffold enables nuanced, ongoing assessment. Its iterative design ensures evolution in response to new learning, emerging challenges, and changes in service or policy contexts, aligning with continuous quality improvement and implementation science principles []. While existing implementation models provide a rigorous framework for mapping determinants, strategies, mechanisms, and outcomes [], the scaffold complements these approaches by foregrounding the realities of RRR health settings. Step 5 emphasizes reflexivity and scalability, bridging practical implementation planning with formal implementation research. In doing so, the scaffold supports adaptive, relational, and outcomes-driven program design while offering a practical framework for evaluating impact across multiple levels of the health system.
Although developed for RRR Australian health systems, the scaffold’s principles may be applicable to other settings, including low- and middle-income countries (LMICs) or urban health systems facing complex service delivery challenges. Features such as iterative adaptation, reflexive engagement, and integration of system-level enablers are broadly relevant where workforce constraints, service fragmentation, or socio-cultural diversity influence implementation. However, applying the scaffold in new settings may require careful tailoring. For example, LMIC contexts may face infrastructure limitations, differing governance structures, or resource constraints, necessitating simplification or prioritization of scaffold elements. Urban systems may require adaptation to larger stakeholder networks and rapidly changing service landscapes. These considerations highlight the importance of context-sensitive adaptation while preserving the scaffold’s core principles.
This manuscript primarily presents a conceptual and methodological framework, contributing a structured, context-sensitive, practical approach for planning, implementing, and evaluating DHIs in RRR settings. The scaffold explicitly integrates local context, system-level enablers, iterative refinement, and stakeholder engagement—dimensions often underrepresented in conventional logic models. Although formal causal testing and generalizability are beyond this paper’s scope, the NARDHC case illustrates the scaffold’s practical application, and future work will empirically assess effectiveness, mechanisms of action, and adaptability across diverse health systems. This approach ensures the scaffold is principled yet adaptable, providing a foundation for evidence-informed DHI implementation while recognizing the importance of context-specific tailoring.
4.1. Limitations and Future Directions
The scaffold provides a structured, evidence-informed framework, but its effectiveness depends on the quality of planning, implementation, and evaluation. Collaboration requires time and resources, which can be challenging in dispersed RRR regions. Future work should explore scalable strategies for engaging diverse stakeholders early, particularly in dispersed regions where participation is logistically challenging. Implementation success depends on partnerships, organizational commitment, and the willingness of individuals to adopt and apply digital health capability frameworks. Research should examine how governance arrangements, funding structures, and cross-sector relationships shape adoption, adaptation, and sustainability of the model in practice. While the scaffold provides a transparency for evaluation, further work is needed to strengthen the evidence base on causal mechanisms and long-term outcomes. Although situating the scaffold alongside international digital health frameworks may offer additional insights, this comparison is beyond the scope of the current study. A review of such frameworks is underway, and findings will inform future research. Future studies should also explore longitudinal impacts of digital health capability-building on workforce behaviors, service delivery models, and health outcomes in RRR settings. Additionally, while the scaffold focuses on healthcare professionals and students, subsequent iterations should incorporate consumers and community perspectives, reflecting the increasing role of digital tools in patient self-management and care navigation.
4.2. Implications for Practice
This study reinforces the importance of grounding DHIs within a clear program theory that articulates the relationships between context, inputs, activities, and intended outcomes. The scaffold’s practical utility and potential benefits are illustrated through the NARDHC case; formal empirical evaluation of outcomes will be addressed in future research. Logic models enhance coherence, rigor, and transparency by clarifying assumptions, identifying enabling conditions, and supporting alignment across stakeholders. In RRR settings where infrastructure and workforce capacity vary, logic models offer practical tools for navigating complexity, aligning resources, and embedding adaptive learning cycles throughout implementation. They ensure capability-building efforts remain responsive to local needs, grounded in evidence, and positioned to deliver tangible benefits for health professionals, services, and communities. For policymakers and system leaders, embedding logic models within commissioning processes, digital health strategies, and program funding decisions supports accountability by ensuring initiatives have clear rationales, realistic pathways to impact, and a commitment to learning and adaptation. In RRR contexts, this approach targets investment towards initiatives that align with workforce realities, address persistent capability gaps, and strengthen equitable, sustainable digital health integration.
5. Conclusions
The logic model scaffold provides a structured yet flexible framework for planning, implementing, and evaluating DHIs in RRR settings. By grounding interventions in local context, engaging stakeholders, and aligning with system enablers, the scaffold supports effective planning of workforce capability initiatives, enables adaptive and reflective implementation, and facilitates robust evaluation of outcomes and impact. Applying a logic model from the earliest stages of DHI planning can strengthen methodological rigor, enhances transparency, and ensures innovations remain responsive to local priorities, workforce realities, and system-level enablers in RRR contexts.
Author Contributions
Conceptualization, M.A.K., N.A. and S.L.L.; methodology, M.A.K.; formal analysis, M.A.K., N.A. and S.L.L.; investigation, M.A.K.; data curation, M.A.K.; writing—original draft preparation, M.A.K.; writing—review and editing, N.A. and S.L.L.; visualization, M.A.K.; project administration, M.A.K.; funding acquisition, S.L.L. All authors have read and agreed to the published version of the manuscript.
Funding
This research was conducted under the Northern Australian Regional Digital Health (NARDHC) program, supported by the Department of Education, Australia. The APC was funded by NARDHC.
Institutional Review Board Statement
As this work involved conceptual development and consultative discussions rather than formal human subjects research, it did not require institutional human research ethics approval.
Informed Consent Statement
Stakeholder participation in the development of the logic model scaffold was conducted with their consent, transparency, and respect for participants’ time and input.
Data Availability Statement
The original contributions presented in this study are included in the article.
Acknowledgments
The authors would like to acknowledge the stakeholders who provided input.
Conflicts of Interest
The authors declare no conflicts of interest. The funders had no role in the design of the study; in the collection, analyses, or interpretation of data; in the writing of the manuscript; or in the decision to publish the results.
Abbreviations
The following abbreviations are used in this manuscript:
| COM-B | Capability, Opportunity, Motivation and Behavior model |
| DHI | Digital Health Innovation |
| NARDHC | Northern Australian Regional Digital Health Collaborative |
| RRR | Rural, Regional, and Remote |
| TDF | Theoretical Domains Framework |
References
- Ramsden, R.; Pappas, S.J.; Rostas, J.; Islam, M.I.; Martiniuk, A.; Guisard, Y. Rural Health Pro-A Digital Platform Connecting Rural People, Organisations, and Communities. Aust. J. Rural Health 2025, 33, e70050. [Google Scholar] [CrossRef]
- Krahe, M.A.; Baker, S.; Woods, L.; Larkins, S.L. Factors That Influence Digital Health Implementation in Rural, Regional, and Remote Australia: An Overview of Reviews and Recommended Strategies. Aust. J. Rural Health 2025, 33, e70045. [Google Scholar] [CrossRef] [PubMed]
- Stewart, R.A. Building a rural and remote health workforce: An overview of effective interventions. Med. J. Aust. 2023, 219, S3–S4. [Google Scholar] [CrossRef] [PubMed]
- eHealth Queensland. Digital Strategy for Rural and Remote Healthcare: 10 Year Plan; Queensland Health: Brisbane, QLD, Australia, 2021.
- Greenhalgh, T.; Wherton, J.; Papoutsi, C.; Lynch, J.; Hughes, G.; A’Court, C.; Hinder, S.; Fahy, N.; Procter, R.; Shaw, S. Beyond Adoption: A New Framework for Theorizing and Evaluating Nonadoption, Abandonment, and Challenges to the Scale-Up, Spread, and Sustainability of Health and Care Technologies. J. Med. Internet Res. 2017, 19, e367. [Google Scholar] [CrossRef]
- Iqbal, F.M.; Aggarwal, R.; Joshi, M.; King, D.; Martin, G.; Khan, S.; Wright, M.; Ashrafian, H.; Darzi, A. Barriers to and Facilitators of Key Stakeholders Influencing Successful Digital Implementation of Remote Monitoring Solutions: Mixed Methods Analysis. JMIR Hum. Factors 2024, 11, e49769. [Google Scholar] [CrossRef]
- Nilsen, P. Making sense of implementation theories, models and frameworks. Implement. Sci. 2015, 10, 53. [Google Scholar] [CrossRef]
- Michie, S.; Atkins, L.; West, R. The Behaviour Change Wheel: A Guide to Designing Interventions; Silverback Publishing: Sutton, UK, 2017. [Google Scholar]
- Skivington, K.; Matthews, L.; Simpson, S.A.; Craig, P.; Baird, J.; Blazeby, J.M.; Boyd, K.A.; Craig, N.; French, D.P.; McIntosh, E.; et al. A new framework for developing and evaluating complex interventions: Update of Medical Research Council guidance. BMJ 2021, 374, n2061. [Google Scholar] [CrossRef] [PubMed]
- Astbury, B. Some reflections on Pawson’s Science of Evaluation: A Realist Manifesto. Evaluation 2013, 19, 383–401. [Google Scholar] [CrossRef]
- Jagosh, J.; Macaulay, A.C.; Pluye, P.; Salsberg, J.; Bush, P.L.; Henderson, J.; Sirett, E.; Wong, G.; Cargo, M.; Herbert, C.P.; et al. Uncovering the benefits of participatory research: Implications of a realist review for health research and practice. Milbank Q. 2012, 90, 311–346. [Google Scholar] [CrossRef]
- Pellegrini, G.; Lovati, C. Stakeholders’ engagement for improved health outcomes: A research brief to design a tool for better communication and participation. Front. Public Health 2025, 13, 1536753. [Google Scholar] [CrossRef]
- Thomas, T.W.; Hooker, S.A.; Schmittdiel, J.A. Principles for Stakeholder Engagement in Observational Health Research. JAMA Health Forum 2024, 5, e240114. [Google Scholar] [CrossRef]
- Hawe, P.; Shiell, A.; Riley, T. Theorising interventions as events in systems. Am. J. Community Psychol. 2009, 43, 267–276. [Google Scholar] [CrossRef] [PubMed]
- Moore, G.F.; Audrey, S.; Barker, M.; Bond, L.; Bonell, C.; Hardeman, W.; Moore, L.; O’Cathain, A.; Tinati, T.; Wight, D.; et al. Process evaluation of complex interventions: Medical Research Council guidance. BMJ 2015, 350, h1258. [Google Scholar] [CrossRef] [PubMed]
- Centre for Epidemiology and Evidence. Increasing the Scale of Population Health Interventions: A Guide; NSW Ministry of Health: Sydney, NSW, Australia, 2023.
- Thomas, J.; Barraket, J.; Parkinson, S.; Wilson, C.; Holcombe-James, I.; Kennedy, J.; Mannell, K.; Brydon, A. Australian Digital Inclusion Index; RMIT, Swinbourne University of Technology, Telstra: Melbourne, VIC, Australia, 2021. [Google Scholar]
- Huxley, C.J.; Atherton, H.; Watkins, J.A.; Griffiths, F. Digital communication between clinician and patient and the impact on marginalised groups: A realist review in general practice. Br. J. Gen. Pract. 2015, 65, e813–e821. [Google Scholar] [CrossRef] [PubMed]
- Kellogg Foundation. Logic Model Development Guide; W.K Kellogg Foundation: Battle Creek, MI, USA, 2004. [Google Scholar]
- Jordan, G.B. Logic modeling: A tool for designing program evaluations. In Handbook on the Theory and Practice of Program Evaluation; Edward Elgar Publishing: Cheltenham, UK, 2013; pp. 143–165. [Google Scholar]
- Carrion, A.J.; Miles, J.D.; Thompson, M.D.; Journee, B.; Nelson, E. Program evaluation through the use of logic models. Curr. Pharm. Teach. Learn. 2021, 13, 789–795. [Google Scholar] [CrossRef]
- Wholey, J. Evalutaion: Promise and Performance; Urban Institute: Washington, DC, USA, 1979. [Google Scholar]
- Voss, S.; Bauer, J.; Coenen, M.; Jung-Sievers, C.; Moore, G.; Rehfuess, E. Logic models for the evaluation of complex interventions in public health: Lessons learnt from a staged development process. BMC Public Health 2025, 25, 1923. [Google Scholar] [CrossRef]
- Hayes, H.; Parchman, M.L.; Howard, R. A logic model framework for evaluation and planning in a primary care practice-based research network (PBRN). J. Am. Board Fam. Med. 2011, 24, 576–582. [Google Scholar] [CrossRef]
- Haynes, A.; Rychetnik, L.; Finegood, D.; Irving, M.; Freebairn, L.; Hawe, P. Applying systems thinking to knowledge mobilisation in public health. Health Res. Policy Syst. 2020, 18, 134. [Google Scholar] [CrossRef] [PubMed]
- Nigatu, D.; Azage, M.; Misgan, E.; Enquobahrie, D.A.; Kebebaw, T.; Abate, E.; Alemneh, E.; Woldie, M.; Girma, T. Implementation research logic model in the design and execution of eHealth innovations for maternal and newborn healthcare in Ethiopia. Health Res. Policy Syst. 2025, 23, 4. [Google Scholar] [CrossRef]
- Smith, J.D.; Li, D.H.; Rafferty, M.R. The Implementation Research Logic Model: A method for planning, executing, reporting, and synthesizing implementation projects. Implement. Sci. 2020, 15, 84. [Google Scholar] [CrossRef]
- Rogers, P.J. Using programme theory to evaluate complicated and complex aspects of interventions. Evaluation 2008, 14, 29–48. [Google Scholar] [CrossRef]
- Taylor-Powell, E.; Henert, E. Developing a Logic Model: Teaching and Training Guide; University of Wisconsin: Madison, WI, USA, 2008. [Google Scholar]
- Smart, J. Planning and Evaluation: Step by Step; Australian Institute of Family Studies: Southbank, VIC, Australia, 2020.
- Australian Digital Health Agency. National Digital Health Workforce and Education Roadmap; Australian Digital Health Agency: Sydney, NSW, Australia, 2020.
- Digital Strategy Branch eHealth Queensland. Digital Health Strategic Vision for Queensland 2026; Queensland Health: Brisbane, QLD, Australia, 2017.
- Woods, L.; Martin, P.; Khor, J.; Guthrie, L.; Sullivan, C. The right care in the right place: A scoping review of digital health education and training for rural healthcare workers. BMC Health Serv. Res. 2024, 24, 1011. [Google Scholar] [CrossRef]
- AIHW. Rural and Remote Health. Available online: https://www.aihw.gov.au/reports/rural-remote-australians/rural-and-remote-health (accessed on 12 October 2025).
- Woolcock, K.; Gregg, J.; Groth, A. Perspectives Brief: Policy Alignment for Place-Based Solutions for Better Health Outcomes in Rural and Remote Communities; Deeble Institute for Health Policy Research: Deakin, ACT, Australia, 2025. [Google Scholar]
- Cornish, F.; Breton, N.; Moreno-Tabarez, U.; Delgado, J.; Rua, M.; de-Graft Aikins, A.; Hodgetts, D. Participatory action research. Nat. Rev. Methods Primer 2023, 3, 34. [Google Scholar] [CrossRef]
- Cane, J.; O’Connor, D.; Michie, S. Validation of the theoretical domains framework for use in behaviour change and implementation research. Implement. Sci. 2012, 7, 37. [Google Scholar] [CrossRef] [PubMed]
- Productivity Commission. Leveraging Digital Technology in Healthcare—Research Paper; Australian Government: Canberra, ACT, Australia, 2024.
- Moffatt, J.J.; Eley, D.S. The reported benefits of telehealth for rural Australians. Aust. Health Rev. 2010, 34, 276–281. [Google Scholar] [CrossRef]
- Armfield, N.R.; Bradford, M.; Bradford, N.K. The clinical use of Skype–For which patients, with which problems and in which settings? A snapshot review of the literature. Int. J. Med. Inform. 2015, 84, 737–742. [Google Scholar] [CrossRef]
- Humphreys, J.S.; Wakerman, J.; Wells, R.; Kuipers, P.; Jones, J.A.; Entwistle, P. Beyond workforce: A systemic solution for health service provision in small rural and remote communities. Med. J. Aust. 2008, 188, S77–S80. [Google Scholar] [CrossRef]
- Bourke, L.; Humphreys, J.S.; Wakerman, J.; Taylor, J. Understanding rural and remote health: A framework for analysis in Australia. Health Place 2012, 18, 496–503. [Google Scholar] [CrossRef] [PubMed]
- Australian Digital Health Agency. Safe, Seamless and Secure: Evolving Health and Care to Meet the Needs of Modern Australia; Australia’s National Digital Health Strategy: Sydney, NSW, Australia, 2023. Available online: https://www.digitalhealth.gov.au/sites/default/files/2020-11/Australia%27s%20National%20Digital%20Health%20Strategy%20-%20Safe%2C%20seamless%20and%20secure.pdf (accessed on 16 November 2025).
- Wakerman, J.; Humphreys, J.; Russell, D.; Guthridge, S.; Bourke, L.; Dunbar, T.; Zhao, Y.; Ramjan, M.; Murakami-Gold, L.; Jones, M.P. Remote health workforce turnover and retention: What are the policy and practice priorities? Hum. Resour. Health 2019, 17, 99. [Google Scholar] [CrossRef]
- Fixsen, D.L.; Blase, K.A.; Naoom, S.F.; Van Dyke, M.; Wallace, F. Implementation: The missing link between research and practice. NIRN Implement. Brief 2009, 1, 218–227. [Google Scholar]
- Greenhalgh, T.; Papoutsi, C. Studying complexity in health services research: Desperately seeking an overdue paradigm shift. BMC Med. 2018, 16, 95. [Google Scholar] [CrossRef] [PubMed]
- Willis, C.D.; Saul, J.; Bevan, H.; Scheirer, M.A.; Best, A.; Greenhalgh, T.; Mannion, R.; Cornelissen, E.; Howland, D.; Jenkins, E.; et al. Sustaining organizational culture change in health systems. J. Health Organ. Manag. 2016, 30, 2–30. [Google Scholar] [CrossRef] [PubMed]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content. |
© 2025 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).