Toward a Standards Framework for Hybrid Intelligence Governance: Integrating Human Judgment and AI Decision Support

Abstract

The rapid integration of artificial intelligence into private and public-sector decision-making has outpaced the development of standards governing the interaction between human judgment and machine intelligence. Existing frameworks—the EU AI Act Regulation, the NIST AI Risk Management Framework, and ISO/IEC 42001—regulate AI systems as discrete technical artifacts but do not standardize the hybrid intelligence configurations in which human cognition and algorithmic outputs jointly produce governance decisions. This paper proposes a three-layer standards framework comprising technical interoperability standards governing how AI outputs are communicated to human decision-makers, procedural standards governing human-AI task allocation and escalation protocols, and accountability standards governing responsibility attribution in distributed decision configurations. The framework is grounded in the Quadruple Bottom Line (QBL), which adds governance as a fourth sustainability dimension. To move beyond a purely conceptual contribution, the paper provides operationalization tools—including a role allocation matrix, confidence calibration thresholds, an accountability mapping template, and a domain classification schema—and proposes a three-tier conformity assessment methodology for evaluating framework implementation. By establishing the hybrid human–AI decision configuration as the unit of standardization, the paper introduces a governance architecture that enables operational, auditable, and comparable hybrid intelligence systems.

1. Introduction

The integration of artificial intelligence into governance and organizational decision-making is no longer prospective; it is operational. Municipal governments deploy AI-assisted systems to allocate budgets and prioritize infrastructure maintenance. Regulatory agencies employ algorithmic tools to scan compliance landscapes and flag enforcement priorities. Emergency management coordinators receive AI-generated threat assessments that shape resource deployment decisions affecting public safety. In the private sector, AI-driven compliance engines, risk-scoring algorithms, and predictive analytics platforms are embedded in workflows ranging from financial auditing to supply chain management. In each of these contexts, the decision is neither purely human nor purely algorithmic—it is hybrid.

Yet the standards that govern these decision-making configurations have not kept pace. The European Union’s Artificial Intelligence Act, knows as Regulation (EU) 2024/1689, the most comprehensive regulatory framework for AI to date, classifies AI systems by risk tier and imposes conformity assessment requirements for high-risk applications. The U.S. National Institute of Standards and Technology’s AI Risk Management Framework (AI RMF 1.0) provides a voluntary, function-based approach organized around four core functions: Govern, Map, Measure, and Manage [1]. The International Organization for Standardization’s AI management system standard, ISO/IEC 42001:2023, establishes organizational process requirements for deploying AI responsibly [2]. Each of these frameworks makes an important contribution. None, however, standardizes the configuration in which human judgment and algorithmic output jointly produce a decision. They regulate the machine. They invoke the human. But they do not govern the interaction between the two.

This paper addresses that gap. It proposes a standards framework for hybrid intelligence governance—defined as the structured integration of human expertise, institutional knowledge, and AI-generated analysis within governance workflows in which neither humans nor machines operate autonomously [3,4]. The framework is grounded in the Quadruple Bottom Line (QBL), which extends the traditional triple bottom line of people, planet, and profit by adding governance as a fourth sustainability dimension [5,6]. The QBL’s governance pillar provides the normative foundation for the argument that hybrid intelligence standards must encode not only technical performance metrics but also institutional accountability structures—mechanisms that determine who decides, who oversees, and who bears responsibility when hybrid systems produce outcomes that affect public welfare.

The paper contributes to the AI governance and standardization literature in three ways. First, it shifts the unit of analysis from the AI system as a discrete artifact to the hybrid intelligence configuration as a governance object—a shift anticipated by the hybrid intelligence literature [3,4] but not yet translated into a standards framework. Second, it applies the QBL framework [5,6] to AI standardization, demonstrating that governance integrity must serve as the binding constraint in standards design. Third, it provides operationalization tools and a conformity assessment framework that move beyond conceptual architecture toward practical implementability, responding to calls for research connecting AI governance principles to operational mechanisms [7,8,9].

The paper proceeds as follows. Section 2 reviews the conceptual foundations of hybrid intelligence and the current AI standards landscape. Section 3 describes the methodology. Section 4 presents the analytical findings on the standardization gap. Section 5 examines three operational domains. Section 6 presents the layered standards architecture, including operationalization protocols and a conformity assessment framework. Section 7 discusses implications. Section 8 concludes.

2. Literature Review and Theoretical Foundations

2.1. Hybrid Intelligence: Conceptual Foundations

The concept of hybrid intelligence emerged from the recognition that neither human intelligence nor artificial intelligence alone can address the full complexity of contemporary decision environments. Dellermann et al. [3] define hybrid intelligence as a configuration that aims at using the complementary strengths of human intelligence and AI, so that they can perform better than each of the two could separately. Akata et al. [4] extended this foundation by articulating a research agenda organized around four challenges: collaborative HI, adaptive HI, responsible HI, and explainable HI. Their framework, recognized as the Best Paper of the year in IEEE Computer in 2020, established hybrid intelligence as a distinct field of inquiry.

The distinction between hybrid intelligence and adjacent concepts is analytically important for standardization. Human-in-the-loop configurations position the human as a reactive overseer. Augmented intelligence frames AI as a tool amplifying human capabilities. Autonomous AI removes the human entirely. Hybrid intelligence, by contrast, entails a structural integration in which the decision configuration itself reflects the joint contributions of human and machine agents [3,10]. Standards designed for human-in-the-loop or autonomous systems do not fit hybrid configurations cleanly, because decision authority is distributed in ways that are often contextually determined, poorly documented, and institutionally unaccounted for.

2.1.1. Typology and Scope

To clarify the framework’s scope, this section proposes an original typology of four configuration types, synthesized from the hybrid intelligence literature [3,4,10], and specifies inclusion/exclusion criteria for the proposed standards framework.

Type 1—Sequential advisory: AI generates an output (recommendation, classification, risk score); a human decision-maker independently evaluates it and makes the final decision. The AI informs but does not co-constitute the decision. Example: an AI system flags a compliance anomaly; a compliance officer investigates independently and determines the response.

Type 2—Parallel assessment with reconciliation: Both human and AI independently produce assessments of the same situation; a reconciliation process integrates or adjudicates between them. Example: an emergency manager and an AI threat model each assess flood risk; a protocol governs how divergent assessments are reconciled.

Type 3—Integrated co-production: Human and AI contribute constitutive elements to a decision that neither could produce alone—the AI provides analytical capacity beyond human cognition, while the human provides contextual judgment, value reasoning, and political accountability. The decision emerges from their interaction. Example: an AI budget optimization model generates resource allocation scenarios incorporating hundreds of variables; a city manager selects, modifies, and authorizes a final allocation integrating equity considerations, constituent priorities, and political feasibility.

Type 4—Fully automated with post hoc human review: The AI system makes and implements the decision; a human reviews the outcome after the fact and may appeal or override. Example: an automated fraud detection system blocks a transaction; the account holder appeals to a human reviewer.

Scope of the proposed framework: The standards framework applies primarily to Types 2 and 3—configurations where human and AI contributions are jointly embedded in the decision process. Type 1 (sequential advisory) falls within scope when the human’s decision is substantively shaped by the AI output rather than merely informed by it—a distinction that depends on the degree of automation bias and the institutional conditions under which the human operates [8]. Type 4 (fully automated with post hoc review) falls outside the framework’s primary scope at the point of initial decision because the configuration is not hybrid when the decision is made. However, the appeal or review process may itself constitute a Type 1 or Type 2 configuration, and the framework’s Layer 3 accountability standards apply to the governance of the appeal stage.

2.1.2. Normative Foundations

The broader AI ethics literature provides the normative foundation for governing hybrid configurations. Floridi et al. [11] proposed a unified framework built on beneficence, non-maleficence, autonomy, justice, and explicability, establishing the principled basis that governance standards must operationalize. The proposed framework translates these principles into institutional mechanisms: Layer 1 operationalizes explicability through structured uncertainty disclosure, Layer 2 operationalizes autonomy through meaningful human override capacity, and Layer 3 operationalizes justice through equitable accountability and remediation. Jarrahi [12] argued that the future of human-AI collaboration depends on understanding AI as a partner whose contributions must be governed through institutional structures. Shneiderman [13] proposed a human-centered AI governance framework emphasizing the need for oversight mechanisms that ensure human control without sacrificing AI capability—a design objective directly reflected in the proposed framework’s procedural layer.

Prior research on hybrid intelligence governance has examined this dynamic across multiple domains. In Alibašić [14], I developed a multi-paradigm ethical framework for hybrid intelligence in blockchain and cryptocurrency systems governance, demonstrating that hybrid configurations in decentralized systems require governance architectures accounting for distributed agency. In Alibašić [15], I demonstrated that even jurisdictions with advanced AI governance frameworks—Singapore and France—fail to standardize the hybrid decision configurations through which AI systems are deployed in administrative contexts. These findings inform the framework proposed here.

2.2. The Current AI Standards Landscape

The EU AI Act (Regulation (EU) 2024/1689) establishes a risk-based classification system with graduated requirements for high-risk AI systems, including human oversight (Article 14) [16]. Article 14 requires that high-risk systems be designed so that natural persons can effectively oversee them during use. However, as Fink [17] has observed, Article 14 prescribes conditions for oversight without specifying the procedural standards through which oversight becomes meaningful. Veale and Zuiderveen Borgesius [18], in a detailed analysis of the EU AI Act’s human oversight provisions, demonstrated that the Act’s requirements remain ambiguous regarding the operational conditions necessary for effective oversight—a finding that directly motivates the procedural layer proposed in this paper. Without procedural specifications, Article 14 risks functioning as a compliance formality rather than substantive governance [19].

The NIST AI RMF 1.0 [1] adopts a voluntary, function-based approach (Govern, Map, Measure, Manage) that is organizationally oriented but does not address hybrid configurations specifically. Wirtz et al. [20] examined AI governance challenges in public administration and identified the absence of operational governance frameworks as a critical gap—the gap that this paper’s framework addresses.

ISO/IEC 42001:2023 [2] establishes AI management system requirements focusing on organizational processes without standardizing hybrid decision configurations. Related standards—ISO/IEC 22989:2022 [21] and ISO/IEC 23894:2023 [22]—provide supporting vocabulary and risk management guidance but do not address hybrid intelligence specifically.

The gap across all three frameworks: each regulates the AI system as a technical artifact and invokes human oversight, but none standardizes the configuration in which human judgment and AI output jointly produce a decision.

Recent work published in this journal reinforces this assessment. Orhan et al. [23] examined AI governance standardization globally, finding deep divisions including unclear responsibilities and regulatory gaps. Metin et al. [24] demonstrated that existing governance frameworks require deliberate integration to address AI-related risks. Alhosban et al. [25] found strong public support for regulatory oversight and developer accountability in algorithmic decision systems—empirical grounding for the accountability standards proposed here.

2.3. The Quadruple Bottom Line as Governance Foundation

The Quadruple Bottom Line (QBL) framework, introduced in Alibašić [5] and further developed in Alibašić [6], extends the TBL by adding governance as a fourth sustainability dimension. The QBL argues that without institutional accountability structures, the other three dimensions lack the enforcement mechanisms necessary for implementation.

The governance dimension of the QBL requires careful conceptual definition, as “governance” carries different meanings across adjacent studies. In corporate governance scholarship, governance refers to structures through which organizational power is exercised and accountability maintained. In IT governance, governance refers to decision rights and accountability frameworks for resource allocation. In AI governance, governance refers to regulatory, institutional, and normative mechanisms through which AI systems are controlled. The QBL’s governance dimension subsumes elements of all three but operates at a higher level of generality: it refers to the institutional infrastructure—formal and informal—through which any organizational commitment (economic, social, or environmental) is rendered enforceable rather than aspirational [5,6].

This institutional grounding connects the QBL to broader institutional theory. North [26] demonstrated that institutions—the formal and informal rules structuring human interaction—determine whether organizational commitments are self-enforcing or require external enforcement mechanisms. Applied to the QBL, governance is the institutional dimension that determines whether economic, social, and environmental commitments are structurally enforceable or merely declarative. Janssen and Kuk [27] extended this institutional perspective to algorithmic governance specifically, arguing that the increasing reliance on algorithms in public decision-making requires new institutional arrangements for transparency and accountability—a requirement that the QBL’s governance pillar operationalizes through the standards framework proposed here.

Applied to hybrid intelligence, the QBL provides four evaluation dimensions: economic viability (cost and scalability of implementation), social equity (distributional effects on affected populations), environmental consideration (ecological footprint of AI-intensive systems), and governance integrity (the degree to which standards embed enforceable accountability mechanisms). Governance integrity is the binding constraint.

3. Methodology

3.1. Research Objectives and Questions

This paper pursues two objectives. The first is analytical: to identify specific standardization gaps in existing AI governance frameworks with respect to hybrid intelligence configurations. The second is constructive: to propose an operationalized standards framework that addresses those gaps and can be applied by organizations and standardization bodies.

These objectives generate three research questions:

• RQ1: What specific dimensions of hybrid intelligence governance are unaddressed by existing AI standards frameworks?
• RQ2: What standards architecture is necessary to govern hybrid intelligence configurations across organizational domains?
• RQ3: How can the proposed framework be operationalized to enable organizational implementation and conformity assessment?

3.2. Methodological Approach and Justification

The paper employs a conceptual framework development methodology—a theory-building approach that synthesizes the existing theoretical and empirical literature to construct a new analytical framework for an undertheorized phenomenon [28]. Jabareen [28] defines a conceptual framework as a network of linked concepts and proposes conceptual framework analysis as a procedure of theorization based on the grounded theory method. This approach is epistemologically appropriate when the research objective is to propose a governance architecture rather than test hypotheses, and when the phenomenon (hybrid intelligence in governance) is sufficiently novel that established measurement instruments do not yet exist.

The methodology has three epistemological strengths. First, it enables cross-disciplinary synthesis, integrating insights from AI governance, public administration, institutional theory, cognitive science, and standardization policy. Second, it supports theory-building at the level of generality appropriate for standards development, where frameworks must be applicable across organizational types and domains. Third, it produces actionable outputs—structured frameworks, classification schemas, assessment protocols, and operationalization templates—that can be directly tested in subsequent empirical research.

The methodology has corresponding limitations. It does not provide empirical validation of the proposed framework’s effectiveness; such validation requires case studies, pilot implementations, and stakeholder testing. The domain cases are illustrative rather than representative, selected to demonstrate applicability across varied contexts. The operationalization tools are proposed as configurable defaults requiring organizational calibration rather than as empirically validated instruments.

3.3. Analytical Protocol

The methodology comprises three structured components, each designed for replicability:

Component 1: Comparative Standards Analysis. The EU AI Act, NIST AI RMF 1.0, and ISO/IEC 42001:2023 were systematically analyzed along four dimensions: (1) whether the framework addresses the human-AI decision interface as a governance object; (2) whether it standardizes role allocation between human and machine agents; (3) whether it specifies procedural conditions for meaningful human oversight; and (4) whether it addresses accountability attribution in distributed decision configurations. For each framework, coverage was assessed as fully addressed, partially addressed, or not addressed. This protocol can be applied to additional frameworks using the same four dimensions.

Component 2: Domain Case Analysis. Three organizational domains—municipal resource allocation, regulatory compliance assessment, and emergency management coordination—were examined using a three-step sequence: (a) identification of the hybrid intelligence configuration in use; (b) identification of standardization gaps; and (c) QBL analysis of governance implications. Domains were selected according to three variation criteria: institutional context (public, cross-sector, crisis), decision stakes (routine, compliance-critical, life-safety), and temporal pressure (deliberative, deadline-driven, urgent).

Component 3: QBL Evaluation Protocol. Each layer of the proposed architecture was evaluated across all four QBL dimensions, identifying for each intersection: the governance question at stake, relevant stakeholder groups, potential for inequitable outcomes, and the standard element addressing the gap.

3.4. Replicability Statement

The analytical protocol is designed for replicability. The four dimensions of the comparative standards analysis, the three-step domain case analysis sequence, and the QBL evaluation matrix provide structured procedures that other researchers can apply to additional frameworks, domains, and organizational contexts. The operationalization tools in Section 6.5 provide templates for organizational adaptation. The conformity assessment framework in Section 6.6 provides metrics for evaluating implementation quality. Application of the protocol requires access to framework documentation, organizational decision process descriptions, and domain-specific case data sufficient to map human–AI interaction structures.

4. The Standardization Gap: Analytical Findings

4.1. The Human Oversight Illusion

The most significant finding is the absence of procedural specifications for meaningful human oversight in hybrid intelligence configurations. Article 14 of the EU AI Act mandates human oversight for high-risk systems [16], but automation bias research demonstrates that the conditions under which oversight is mandated are often those under which it is least effective.

Parasuraman and Riley [29] documented that humans routinely defer to automated recommendations under time pressure, cognitive load, and task complexity. Goddard et al. [30] found that awareness of automation bias is insufficient to counteract it; cognitive debiasing requires structural interventions.

Recent empirical work has reinforced these findings in public administration specifically. Alon-Barkat and Busuioc [8] found that public sector participants exhibited overreliance on algorithmic recommendations even with contradictory information available and exhibited selective adherence—following algorithmic advice when it aligned with pre-existing stereotypes. Ruschemeier [9] demonstrated that automation bias operates in hybrid configurations with comparable intensity to fully automated ones. Papagiannidis et al. [7] found a persistent gap between principled AI commitments and governance implementation.

Without procedural standards specifying how human judgment interacts with AI outputs, human oversight risks becoming a compliance formality—the human overseer is legally present but cognitively absent. Balfour and Adams [31] would recognize this as a structural condition for administrative evil: organizational configurations producing harmful outcomes without individual malicious intent.

The connection to administrative evil requires specification beyond analogy. Balfour and Adams [31] identify three dynamics: (1) moral inversion, where harmful actions are framed as serving legitimate purposes; (2) diffusion of responsibility across institutional roles; and (3) technical rationality displacing ethical reflection. Adams and Balfour [32], in subsequent work examining administrative evil in technological contexts, argued that the increasing mediation of governance decisions through technical systems amplifies conditions for moral inversion.

Hybrid intelligence configurations activate all three dynamics in identifiable ways. First, moral distancing through algorithmic intermediation: when an AI system generates a recommendation producing inequitable outcomes, the human decision-maker who accepts it experiences reduced moral agency because the harmful allocation appears to originate from an objective analytical process. The algorithm functions as a moral buffer. Second, diffusion of awareness through distributed cognition: the AI processes information no individual human fully comprehends, while the human contributes contextual knowledge the AI cannot access. No single agent possesses the complete picture necessary to recognize harm. Third, technical rationality masking as objective analysis: AI outputs carry implicit authority derived from their computational origin, creating what Alon-Barkat and Busuioc [8] identified as selective adherence—humans accept algorithmic recommendations aligning with existing biases because the algorithmic framing lends an appearance of objectivity.

These mechanisms are empirically documented [8,9,29,30]. The accountability standards in Layer 3 counteract them specifically: decision trace requirements make the human’s contribution visible (countering moral distancing); accountability mapping assigns responsibility to identifiable agents (countering diffusion); and confidence calibration exposes value judgments embedded in AI outputs (countering technical rationality masking).

4.2. The Role Allocation Vacuum

Current standards do not prescribe how decision tasks should be distributed between human and machine agents. The EU AI Act requires design for human oversight [16] but not role allocation governance. The NIST AI RMF [1] identifies the context of use but does not map decision architectures. ISO/IEC 42001 [2] addresses organizational management without specifying task allocation procedures.

In practice, role allocation is determined ad hoc. Identical AI systems deployed in different organizations produce different hybrid configurations with different accountability structures—none standardized. A municipal budget tool where analysts review every AI recommendation operates under fundamentally different governance than the same tool where analysts review only outlier recommendations. Both may satisfy Article 14, but they carry different risk profiles.

4.3. The Accountability Attribution Problem

When a hybrid configuration produces an adverse outcome, current frameworks address accountability in fragmented ways. The EU AI Act assigns obligations to the provider (Articles 16–22) and the deployer (Article 26) [16]. ISO/IEC 42001 assigns accountability to organizational leadership [2]. Neither addresses distributed agency.

Busuioc [33] demonstrated that algorithmic opacity disrupts traditional accountability mechanisms. Binns [34] argued that human judgment in algorithmic loops must be substantively meaningful. Bovens [35] established that accountability in networked governance requires identifying the “problem of many hands”—diffusion of responsibility across multiple agents—and designing institutional mechanisms that assign responsibility despite this diffusion. The accountability standards in Layer 3 address precisely this problem.

My prior work on adaptive leadership and disaster resilience [36] examined how ethical decision-making under uncertainty requires institutional structures. The hybrid intelligence context extends this analysis by introducing algorithmic agents whose contributions are often opaque and resistant to ethical scrutiny.

5. Domain Analysis: Hybrid Intelligence in Practice

5.1. Municipal Resource Allocation

Municipal governments deploy AI-assisted systems for budgeting, infrastructure prioritization, and resource allocation—Type 3 (integrated co-production) configurations where elected officials apply political judgment to AI-generated recommendations. No standards govern how recommendations should be presented, what information should accompany them, or how competing priorities should be reconciled.

The QBL analysis reveals: governance (who oversees algorithmic assumptions?), social equity (do AI models reproduce historical funding disparities? [37]), economic (cost-effectiveness of AI-assisted budgeting), and environmental (integration of sustainability metrics into allocation algorithms [5]). Municipal governance already operates within complex accountability structures [5]; hybrid intelligence adds a new agent without adding governance standards.

5.2. Regulatory Compliance Assessment

AI-assisted compliance tools perform regulatory scanning, risk scoring, and gap analysis—Type 1 or Type 2 configurations depending on the degree of human-AI integration. No standards specify how compliance outputs should communicate uncertainty, how override decisions should be documented, or how regulators should evaluate AI-assisted compliance claims [15]. The QBL analysis: governance (legitimacy of determinations), social equity (differential SME access), economic (cost–benefit trade-offs), environmental (energy intensity of continuous monitoring).

5.3. Emergency Management Coordination

Emergency management involves AI-assisted disaster prediction and resource deployment under extreme time pressure—precisely the conditions maximizing automation bias [8,29,30]. This domain represents Type 2 or Type 3 configurations under the most demanding temporal conditions. No standards govern how threat assessments should be communicated under time pressure, how conflicting assessments should be resolved, or how post-incident reviews should evaluate hybrid decision quality [36,38].

Procedural standards for emergency management must be designed for cognitive conditions fundamentally different from routine contexts—requiring pre-established protocols, simplified decision interfaces, and automatic escalation pathways activating when AI and human assessments diverge.

6. The Proposed Standards Framework: Architecture and Operationalization

6.1. Layer 1: Technical Interoperability Standards

This layer governs how AI outputs are formatted, communicated, and rendered interpretable. Required elements: (a) confidence scoring with calibration requirements; (b) uncertainty disclosure requiring explicit model limitations; (c) alternative scenario presentation preventing anchoring effects; (d) explainability thresholds calibrated to decision-maker expertise. These extend the NIST AI RMF’s Map function [1] and operationalize Article 13 transparency requirements [16]. The layer translates Floridi et al.’s [11] principle of explicability into an institutional mechanism.

6.2. Layer 2: Procedural Standards

This layer governs human-AI task allocation, escalation, and override protocols. Required elements: (a) role allocation matrices (see Section 6.5.1); (b) escalation triggers; (c) override documentation requirements; (d) cognitive load management protocols [29,30]. These operationalize Article 14 [16] by specifying conditions under which oversight is meaningful. The layer translates Floridi et al.’s [11] principle of autonomy into a governance mechanism.

The procedural standards interface directly with ISO/IEC 42001’s requirements for AI system impact assessments [2]. ISO/IEC 42001 requires organizations to assess potential impacts and implement proportionate controls. Layer 2 elaborates this by specifying the procedural controls for hybrid configurations: the role allocation matrix translates risk levels into allocation modes; escalation triggers translate severity thresholds into operational protocols; override documentation creates the evidentiary basis for demonstrating that controls function as intended. Layer 2 complements ISO/IEC 42001—it specifies the human-AI interaction controls that the management system standard requires but does not define.

6.3. Layer 3: Accountability Standards

This layer governs responsibility attribution when hybrid configurations produce adverse outcomes. Required elements: (a) accountability mapping with structured decision traces (see Section 6.5.3); (b) liability allocation frameworks; (c) audit trail requirements; (d) remediation mechanisms. These create structural safeguards against the diffusion of moral responsibility [31,33,34,35]. The layer translates Floridi et al.’s [11] principle of justice into an institutional mechanism.

6.4. Cross-Cutting Principle: Governance Integrity as the Binding Constraint

The architecture is an integrated system: each layer is necessary but not individually sufficient. Layer 1 ensures interpretability but not meaningful engagement. Layer 2 ensures protocol compliance but not deviation detection. Layer 3 ensures responsibility assignment but depends on Layers 1 and 2 for documentation. The QBL’s governance pillar [5,6] functions as the integrative mechanism.

Table 1. Layer Specifications Summary: Requirements, Verification Methods, and Implementation Examples.

Layer	Required Element	Specification	Verification Method	Implementation Example
1: Technical Interoperability	Confidence scoring	Calibrated probability reflecting historical accuracy, not model-internal certainty.	Periodic calibration audit comparing stated vs. observed accuracy (calibration error ≤0.10).	AI compliance scanner outputs “Regulatory risk: 0.73 [moderate confidence]; calibration audit: March 2026, error 0.06.”
	Uncertainty disclosure	Explicit statement of data limitations, assumption dependencies, scenario sensitivity.	Review of output templates for completeness of uncertainty fields.	Budget model output includes: “Based on 2019–2025 data; assumes 2.1% inflation; sensitive to population growth above 1.5%.”
	Alternative scenarios	Minimum two alternatives presented alongside primary recommendation.	Template audit confirming the alternatives section is populated.	The resource allocation tool presents recommended allocation plus two alternatives with comparative equity analysis.
	Explainability threshold	Explanation detail calibrated to the decision-maker’s domain expertise.	User testing with representative decision-makers; comprehension assessment.	Emergency manager receives simplified threat tier (Red/Amber/Green) with one-paragraph rationale; policy analyst receives full variable decomposition.
2: Procedural	Role allocation matrix	Documented assignment of decision types to allocation modes.	Organizational audit confirming matrix exists, is current, and is accessible to operators.	The city finance department maintains a matrix classifying 12 decision types by allocation mode, reviewed annually.
	Escalation triggers	Defined conditions activating elevation to senior authority.	Log analysis of escalation events against defined thresholds.	The system automatically flags budget allocations deviating >15% from AI recommendations for director review.
	Override documentation	Structured record of human override decisions with rationale.	Decision trace audit for completeness rate (target ≥ 95%).	Compliance officer overrides AI risk classification from “high” to “moderate,” documents: “Client remediation plan verified independently; regulatory guidance letter of March 2026 supports reclassification.”
	Cognitive load management	Protocols ensuring oversight occurs under conditions permitting meaningful judgment.	Workload analysis: maximum concurrent oversight tasks defined.	Emergency operations center limits each operator to monitoring three AI-assisted decision streams simultaneously.
3: Accountability	Decision trace records	Five-field template completed for each in-scope decision (see Section 6.5.3).	Completeness audit (target ≥ 90%).	Municipal budget allocation: AI output + analyst interpretation + decision taken + deviation rationale + authorization chain.
	Liability allocation	Documented distribution of responsibility across provider, deployer, operator, governance body.	Legal/governance review confirming allocation framework exists.	Procurement contract specifies: provider liable for model accuracy; deployer for configuration; operator for override decisions.
	Audit trail	Retention and accessibility of decision records for review.	Retention period compliance check; accessibility test.	Decision traces are retained for 7 years; accessible to internal audit, regulatory inspectors, and affected parties via formal request.
	Remediation mechanisms	Procedures for affected populations to seek review, explanation and correction.	Accessibility assessment (target ≥ 80% of affected stakeholders can access within the defined timeframe).	Residents affected by AI-assisted zoning decisions can request a review within 30 days; the review panel includes a non-algorithmic assessment.

below summarizes the required elements, specifications, verification methods, and implementation examples for each layer.

6.5. Operationalization Protocol

This section provides the explicit operationalization tools necessary for organizational implementation—transforming the conceptual framework into a practically applicable instrument.

6.5.1. Role Allocation Matrix

Table 2. Model Role Allocation Matrix for Hybrid Intelligence Governance.

Decision Type	Allocation Mode	AI Input Requirements	Human Input Requirements	Output Format	Override Protocol
Routine analytical (data aggregation, pattern detection, compliance scanning).	AI-primary with human audit.	Raw data, model parameters, confidence score.	Periodic audit review; exception-triggered review.	Structured report with confidence intervals.	Humans can flag for escalation; audit findings are documented.
Value-laden (resource allocation affecting equity, policy interpretation).	Human-primary with AI advisory.	Scenario analysis, distributional impact projections, historical comparisons.	Contextual judgment, stakeholder consultation, political accountability assessment.	Decision memorandum citing AI input, human reasoning, stakeholder considerations.	AI recommendation documented whether followed or not; deviation rationale required.
Contested/ambiguous (conflicting data sources, novel regulatory interpretation).	Collaborative with structured deliberation.	Multiple model outputs, sensitivity analyses, uncertainty maps.	Expert judgment, institutional knowledge, cross-functional consultation.	Deliberation record including AI outputs, human assessments, points of disagreement, resolution rationale.	Escalation to senior authority if disagreement persists beyond the defined threshold.
Time-critical emergency (threat response, incident management).	Pre-established protocol with automatic escalation.	Real-time threat assessment, resource optimization recommendation.	Ground-truth validation, contextual override authority.	Action log with timestamped AI recommendation and human decision.	Automatic escalation if divergence exceeds pre-set threshold; post-incident review mandatory.

presents a model role allocation matrix that organizations can adapt to their specific context.

This matrix is a configurable template, not a prescription. Organizations must calibrate thresholds, review frequencies, and escalation criteria to their operational context, regulatory environment, and risk tolerance. The matrix’s governance value is structural: it transforms ad hoc role allocation into a documented, auditable process.

6.5.2. Confidence Calibration Specifications

AI outputs must include calibrated confidence scores—reflecting the historical relationship between stated confidence and observed accuracy, not merely model-internal certainty. Three default threshold tiers are proposed:

High confidence (≥0.85 calibrated probability): Eligible for AI-primary processing under Layer 2. Human audit occurs periodically rather than per-decision.

Moderate confidence (0.60–0.84): Requires collaborative human-AI deliberation. AI output presented with explicit uncertainty disclosure and alternative scenarios. A human decision-maker must document whether the AI recommendation was followed.

Low confidence (<0.60): Requires human-primary processing. AI input is treated as one data source among several. Decision documented independently of AI recommendation.

These are illustrative defaults. Organizations must calibrate based on domain-specific risk tolerance and demonstrated calibration quality. The critical governance requirement is that thresholds exist, are documented, and are subject to periodic review.

6.5.3. Accountability Mapping Template

Layer 3 requires structured decision traces documenting contributions of all agents in a hybrid configuration. Minimum required fields:

• AI System Output: Specific recommendation, classification, or assessment, including confidence score, model version, and data inputs.
• Human Interpretation: Assessment of AI output, contextual factors considered, alternative information sources consulted, interpretive judgments applied.
• Decision Taken: Specific action or determination, with explicit notation of agreement or deviation from AI recommendation.
• Deviation Rationale (if applicable): Grounds for override including contextual factors, value judgments, or contradictory information.
• Authorization Chain: Institutional approval pathway, identity and role of approving authorities.

This template is designed for integration into existing organizational documentation systems. The critical governance requirement is completeness and accessibility—every hybrid intelligence decision within scope must produce a retrievable decision trace.

6.5.4. Domain Classification Parameters

To enable movement from the illustrative domain cases to a general method applicable to any organizational context, the framework provides a domain classification schema:

Table 3. Domain Classification Parameters for Framework Configuration.

Parameter	Low	Medium	High
Temporal pressure	Deliberative (days/weeks)	Deadline-driven (hours/days)	Urgent (minutes/hours)
Human-AI competence asymmetry	Human-dominant (AI supplements established expertise)	Balanced (complementary capabilities)	AI-dominant (AI exceeds human analytical capacity)
Legal consequence severity	Administrative (internal consequences)	Regulatory (external compliance implications)	Existential (criminal liability, public safety, fundamental rights)
Stakeholder impact breadth	Internal only (organizational members)	Bounded external (defined client/customer groups)	Public-wide (general population or vulnerable communities)

describes a domain classification schema enabling organizations to configure the framework for their operational context. Each parameter value influences the stringency of the corresponding GEOR layer. High temporal pressure increases the importance of pre-established protocols and automatic escalation (Layer 2). High competence asymmetry toward AI increases the importance of confidence calibration and uncertainty disclosure (Layer 1). High legal consequence severity increases the stringency of accountability documentation (Layer 3). Broad stakeholder impact increases the importance of remediation mechanisms and equity assessment (Layer 3). Organizations plotting their position on these four parameters can identify which elements require the most stringent implementation.

6.6. Conformity Assessment Framework

Any standards system presupposes conformity assessment, the ability to evaluate whether an organization has implemented the standard, whether the implementation functions as intended, and whether the standard achieves its governance objectives. The framework proposes a three-tier methodology aligned with ISO/IEC 17000 series principles [39,40,41]:

Tier 1—Process Compliance Assessment evaluates whether structural elements of each layer are implemented. Assessment is binary (implemented/not implemented):

• Layer 1: Calibrated confidence scores mandated? Uncertainty disclosures required? Alternative scenarios presented for non-routine decisions?
• Layer 2: Role allocation matrix documented? Escalation triggers defined? Are override documentation requirements in place? Cognitive load protocols established for time-critical contexts?
• Layer 3: Decision trace records maintained? Accountability mapping protocol documented? Are remediation mechanisms accessible to affected stakeholders?

Tier 1 produces a compliance profile enabling gap analysis and implementation planning.

Tier 2—Operational Effectiveness Assessment evaluates whether implemented elements function as intended during operational use. Metrics include:

• Override documentation completeness rate (target: ≥95%)
• Decision trace completeness rate (target: ≥90%)
• Time-to-escalation compliance rate (target: ≥85%)
• Confidence calibration accuracy—calibration error ≤ 0.10
• Stakeholder remediation accessibility rate (target: ≥80%)

These metrics enable quantitative comparison across organizations and longitudinal tracking of governance quality improvement.

Tier 3—Outcome Quality Assessment evaluates whether the governed hybrid intelligence configuration produces governance outcomes satisfying QBL criteria:

• Adverse outcome rate relative to ungoverned baseline or organizational historical rate
• Equity of outcome distribution across stakeholder groups, disaggregated by relevant variables (social dimension)
• Governance audit findings per assessment cycle (governance dimension)
• Cost-effectiveness ratio relative to alternative governance approaches (economic dimension)

This three-tier structure enables organizations to certify compliance (Tier 1), compare alternative governance approaches (Tier 2), and identify cases where the standard fails to achieve its goals (Tier 3).

7. Implications and Critical Assessment

7.1. Implications for Standardization Bodies

Among existing standardization bodies, ISO/IEC JTC 1/SC 42 (Artificial Intelligence) is best positioned to lead hybrid intelligence standards development. SC 42 already maintains the AI management system standard (ISO/IEC 42001), the AI concepts and terminology standard of ISO/IEC 22989, and the AI risk management guidance, SO/IEC 23894—the three standards against which this paper’s gap analysis was conducted [21,22]. A hybrid intelligence working item within SC 42 would build directly on this existing architecture, ensuring interoperability and avoiding fragmentation. CEN-CENELEC should develop harmonized standards for hybrid intelligence under the EU AI Act, translating the proposed framework’s procedural layer into the conformity assessment requirements that Article 14 mandates but does not specify. NIST should develop a Hybrid Intelligence Profile as a voluntary supplement to the AI RMF, extending the Map function to cover decision architecture mapping and the Manage function to cover hybrid-specific governance controls. This prioritization—ISO/IEC JTC 1/SC 42 as lead, with CEN-CENELEC and NIST as regional implementers—reflects the established division of labor in international AI standardization.

The proposed architecture is designed for interoperability with existing frameworks. Layer 1 extends the NIST AI RMF’s Map function [1]. Layer 2 operationalizes Article 14 of the EU AI Act [17]. Layer 3 provides the accountability infrastructure that ISO/IEC 42001’s management system [2] invokes but does not specify.

7.2. Implications for Organizations

Organizations need not wait for formal standards. The operationalization tools in Section 6.5 provide configurable templates for interim governance mechanisms. Implementation challenges differ by organizational size: large enterprises can invest in dedicated governance functions, while SMEs and under-resourced municipalities face different constraints. The QBL’s social equity dimension requires tiered implementation pathways for resource-constrained organizations.

7.3. Implications for Scholarship

This paper shifts the unit of analysis from the AI system to the hybrid intelligence configuration. Methodologically, governance assessments must examine decision architectures, not merely system properties. Theoretically, the paper connects AI governance to hybrid intelligence research [3,4], institutional theory, and administrative evil scholarship [32]. The institutional perspective advanced by Mikalef and Gupta [40]—demonstrating that organizational AI capabilities are shaped by institutional pressures—supports the argument that hybrid intelligence governance requires institutional standards, not merely technical ones. Normatively, the QBL framework [5,6] establishes governance integrity as the binding constraint.

7.4. Limitations

The framework is conceptual and requires empirical validation through case studies, pilot implementations, and stakeholder testing. The three domain cases are illustrative; additional domains (healthcare, judicial, financial) warrant investigation. The framework does not address the political economy of standards adoption. The operationalization tools are configurable defaults requiring calibration. The conformity assessment metrics require empirical baseline establishment. Future research should test the role allocation matrix in organizational settings, validate confidence calibration thresholds against operational data, examine applicability across regulatory jurisdictions, and conduct stakeholder engagement to assess the framework’s practical feasibility.

7.5. Pilot Implementation Design

Empirical validation of the proposed framework requires pilot implementation in an organizational setting. The following sketch outlines a feasible pilot design.

Setting: A mid-sized municipal government (population 100,000–500,000) deploying AI-assisted budget allocation—a Type 3 (integrated co-production) configuration with moderate temporal pressure, human-dominant competence asymmetry, regulatory-level legal consequences, and bounded external stakeholder impact.

Phase 1—Baseline Assessment (Months 1–2): Document the existing hybrid intelligence configuration: what AI outputs are generated, how they are communicated to decision-makers, how role allocation is determined, and what accountability documentation exists. Apply the Tier 1 conformity assessment to establish a pre-implementation compliance profile.

Phase 2—Framework Implementation (Months 3–6): Implement Layer 1 (add confidence scores and uncertainty disclosures to AI budget outputs), Layer 2 (establish a role allocation matrix and override documentation requirements), and Layer 3 (implement the five-field decision trace template). Train relevant staff on the new protocols.

Phase 3—Operational Assessment (Months 7–12): Apply Tier 2 conformity assessment metrics: override documentation completeness rate, decision trace completeness rate, escalation compliance rate. Conduct qualitative interviews with budget analysts and decision-makers to assess usability, cognitive burden, and perceived value.

Phase 4—Outcome Evaluation (Month 12+): Apply Tier 3 conformity assessment: compare budget allocation equity (disaggregated by neighborhood demographics) between pre- and post-implementation periods. Assess the cost-effectiveness of governance overhead. Document governance audit findings.

Success criteria: Tier 1 compliance across all three layers; Tier 2 metrics meeting or exceeding target thresholds; qualitative evidence that decision-makers find the framework usable and governance-enhancing rather than merely burdensome.

This pilot design is illustrative and would require adaptation to the specific organizational context. However, it demonstrates that the framework is testable with existing organizational resources and within a feasible timeframe.

8. Conclusions

The paper has argued that the absence of standards for hybrid intelligence governance creates deficits that neither human-centered nor AI-centered approaches can resolve independently. The proposed three-layer architecture—technical interoperability, procedural, and accountability standards—addresses this gap, grounded in the QBL framework with governance integrity as the binding constraint.

The paper moves beyond pure conceptualization by providing operationalization tools—a role allocation matrix, confidence calibration specifications, an accountability mapping template, and a domain classification schema—and a three-tier conformity assessment methodology enabling organizations to implement the framework, evaluate compliance, and compare governance quality.

Standards that govern only the machine, or only the human, will fail to govern the configuration in which both are embedded. It is the configuration—the structured integration of human expertise, institutional knowledge, and AI-generated analysis within governance workflows—that produces governance outcomes. And it is the configuration that must be the object of standardization.