1. Introduction
Automation aims to reduce human effort in repetitive work. In digital organizations, this aim has been largely implemented through Robotic Process Automation (RPA), which uses software bots to execute rule-based tasks over existing systems [
1,
2,
3]. Traditional RPA is effective when processes are stable, structured, and deterministic. Its limits become apparent when workflows must be derived from high-level intent, inputs vary across cases, or execution requires context-sensitive judgment.
Large Language Models (LLMs) have enabled a new approach in this context. Research on LLM-based autonomous agents shows that agents can combine reasoning, planning, memory, tool use, and action [
4,
5,
6]. In process automation, this shift has motivated Agentic Process Automation (APA), where LLM-based agents construct workflows and make runtime decisions [
7]. Related systems embed LLMs into RPA for perception and GUI navigation [
8], while proactive agents extend autonomy from command-following behavior to context-aware assistance [
9].
This gain in autonomy introduces a specific class of risk. In regulated business processes, some runtime decisions are not ordinary classifications. They determine whether a case must be escalated, reviewed, approved, or logged. If an LLM selects such a route incorrectly, the error may violate policy without triggering an immediate alarm. It may also reinforce automation bias, since users can over-trust automated outputs even when they are wrong [
10,
11]. This risk differs from ordinary task failure. A visible task failure can be detected during execution, whereas a missed escalation may remain hidden until audit, incident review, or downstream control.
The key issue is, therefore, not only agent capability, but also agent governability. Capability concerns what an agent can construct, perceive, plan, or execute. Governability concerns whether an agent’s permitted decisions remain within externally defined organizational constraints. Agentic Business Process Management (BPM) and enterprise-agent research identify the need for guardrails, human oversight, fallback, and accountable integration [
12,
13,
14]. RPA governance studies stress access control, role clarity, logging, auditability, and change control [
15]. LLM safety surveys provide structured safety taxonomies covering attacks, defenses, and guardrails [
16]. These streams motivate runtime mechanisms that constrain LLM-selected process actions when policy defines a minimum escalation level.
This paper addresses that need through Governed APA, a constrained-autonomy architecture for compliance-critical routing. The core principle is that the LLM may propose a decision, but policy defines the minimum admissible escalation. When the policy floor is binding, the final governed action cannot fall below it. When the floor is not binding, the LLM retains discretion within the admissible action space.
We study employee onboarding because it is both automatable and compliance-sensitive. HR literature identifies onboarding and related HR operations as natural targets for agentic automation, while also stressing bias, privacy, transparency, and governance risks [
17]. In our case, the process involves structured profiles, role-based access provisioning, data-protection requirements, work-mode decisions, and mandatory human approval for sensitive accounts.
The results show that an ungoverned LLM can be silently unsafe on compliance-critical routing. In the Qwen2.5 configuration, the model identifies elevated risk in its generated assessment but fails to trigger mandatory human approval for any sensitive case. A policy-anchored floor guardrail removes this under-escalation failure without replacing the LLM with a deterministic classifier for all cases. The resulting design preserves agentic discretion while enforcing a verifiable compliance floor.
This paper makes the following contributions, summarized conceptually in
Figure 1:
We propose Governed APA, a constrained-autonomy architecture for compliance-critical routing. Each LLM decision is wrapped in four stages: (i) schema-validated structured input, (ii) an LLM decision restricted to a closed action space with validated output, (iii) a policy-derived guardrail, and (iv) a deterministic fallback. The guardrail is anchored to validated input fields and policy rules represented outside the prompt.
We provide a compact formal model of the governed decision and the floor guardrail. The model makes the safety property precise. When the policy floor is binding, the governed action cannot fall below the required escalation level, regardless of the LLM proposal.
We instantiate the architecture on an industrial employee-onboarding case study restricted to structured data. We also provide an evaluation harness that scores each run against explicit human-in-the-loop (HITL) ground truth and measures governance behavior, including guardrail activation, fallback rate, inter-run stability, and baseline versus LLM agreement.
We provide empirical evidence on 166 onboarding profiles and two local LLMs. Ungoverned Qwen2.5 misses all 43 mandatory HITL cases, while llama3.1 tends to fail in the opposite direction through over-escalation. The floor guardrail raises Qwen2.5 HITL recall from 0 to 1.0 and preserves llama3.1 recall at 1.0, thereby preventing missed mandatory escalation for both models. For Qwen2.5, it does so without introducing spurious HITL escalation on this dataset and configuration.
The remainder of the paper is organized as follows.
Section 2 reviews related work and then identifies the governability gap addressed by this study.
Section 3 presents the governed-decision formalization, the proposed architecture, the onboarding case study, and the experimental protocol.
Section 4 reports the empirical results for the deterministic baseline, the ungoverned LLM, and the guarded LLM across the evaluated models.
Section 5 discusses the implications of the findings for compliance-critical APA, including auditability, automation bias, model-specific failure modes, and the scope of the proposed guarantee.
Section 6 concludes the paper and outlines future research directions.
2. Related Work and Research Gap
This section reviews the literature at the intersection of LLM-based agents, process automation, BPM governance, LLM safety, and HR automation. Our review is organized around the distinction between agent capability and governability. Capability concerns what an agent can perceive, reason about, plan, construct, or execute. By contrast, governability concerns whether an agentic decision remains bounded by organizational policy, human-oversight requirements, and auditable control.
2.1. Autonomous Agents and LLM-Based Agents
Autonomous agents perceive their environment, act over time, and pursue goals [
18]. This foundation remains important for LLM-based process automation. Once an LLM is connected to workflows, tools, or enterprise systems, its outputs may become operational actions rather than simple text responses.
Recent surveys make this transition explicit. Wang et al. describe LLM-based autonomous agents through profiling, memory, planning, and action modules [
4]. Li et al. extend this view to LLM-based multi-agent systems, organized around profile creation, perception, self-action, mutual interaction, and evolution through reflection or feedback [
5]. Nisa et al. frame agentic AI as a shift toward systems characterized by autonomy, reasoning, planning, tool use, reflection, adaptability, and multi-agent collaboration [
6].
Several technical patterns explain how LLMs become operational agents. Chain-of-thought prompting supports stepwise reasoning [
19]; ReAct couples reasoning with environment actions [
20]; Reflexion uses feedback to improve later decisions [
21] and tool-learning approaches such as Toolformer and ToolLLM equip models with external tool-use abilities [
22,
23]. Other designs add grounding or social simulation, as in SayCan and Generative Agents [
24,
25]. Proactive agents further expand autonomy by allowing systems to anticipate needs and initiate assistance without explicit user instructions [
9].
These works establish the capability basis of agentic systems. They show that LLMs can plan, act, use tools, collaborate, and adapt. They do not, however, define the boundaries of decision authority in regulated business processes. This distinction is critical for APA. Once an LLM output selects a workflow branch, escalation level, access action, or tool call, it becomes a process act.
Some agent architectures already separate proposal from execution. Zhang et al. propose a proactive cooperative agent with Planner, Verificator, Controller, Memory, and Belief Revision modules [
26]. The LLM-based planner proposes a high-level skill, while the Verificator checks whether it is executable before the Controller decomposes it into actions. This pattern is relevant for governed automation: the LLM may propose, but an external mechanism validates whether the proposal can become an executed action. Our work applies this principle to business policy. The Verificator validates environmental feasibility; our guardrail validates policy admissibility.
2.2. RPA, Intelligent Automation, and Agentic Process Automation
RPA automates repetitive, rule-based business tasks by orchestrating software systems through predefined workflows, user-interface interactions, or APIs [
1,
2,
3]. Intelligent Automation extends this stack by combining RPA with BPM and AI/ML services, such as document understanding, classification, forecasting, and recommendation [
27,
28]. These systems increase the cognitive capacity of automation, but the process structure usually remains predefined.
LLM-enabled RPA increases flexibility by adding perception and language understanding. SmartFlow, for example, combines computer vision and LLM reasoning to identify GUI elements, map form fields, and generate navigation workflows across changing interfaces [
8]. This contribution is relevant for screen-based automation because it reduces dependence on brittle pixel-level scripts. Yet its focus remains task execution and GUI robustness. It does not address whether an LLM-selected business route is compliant with organizational policy.
Agentic Process Automation goes further. Ye et al. define APA as a paradigm in which LLM-based agents construct workflows and intervene during execution when dynamic data-flow or control-flow decisions are required [
7]. PROAGENT operationalizes this idea through an Agentic Workflow Description Language and two agent roles: DataAgent for complex data processing and ControlAgent for branch selection. This is the closest prior work to the present paper because it explicitly delegates control-flow intelligence to LLM agents.
The safety issue follows directly from this delegation. If a ControlAgent selects a branch in a regulated process, the agent is exercising bounded organizational authority. Existing APA demonstrates that such autonomy is feasible. It does not formalize how a compliance-critical branch decision should be constrained so that the final action cannot fall below a policy-mandated escalation level.
2.3. Agentic BPM and Enterprise Governance
The governance problem has been recognized at the BPM and enterprise levels. AI-augmented BPM research argues that intelligent process systems should support execution, analysis, and optimization while preserving process structure, human involvement, and organizational control [
29]. Vu et al. define agentic BPM as the governed introduction of AI agents into business processes and report practitioner concerns about bias, over-reliance, cybersecurity, job displacement, lack of transparency, and ambiguous decision-making [
12]. Their recommendations include clear business goals, legal and ethical guardrails, human–agent collaboration, risk management, safe integration, and fallback options.
RPA governance provides an important predecessor. Brás et al. show that even non-generative bots require decision rights, role and permission design, segregation of duties, standardized intake, change control, compliance, logging, and auditability [
15]. Agentic systems amplify these requirements because automation no longer only executes deterministic rules. It can propose branches, call tools, and adapt to context. Hughes et al. frame AI agents and agentic systems as socio-technical systems that decentralize decision-making and require accountability, trust, compatibility with legacy systems, and transparent control boundaries [
13]. Enterprise-oriented work on agentic AI adds policy languages, runtime enforcement, monitoring, rollback, AgentOps, and hybrid human-agent oversight [
14].
Together, these works provide the organizational rationale for governed APA. They make clear that autonomous process agents require guardrails, fallback, accountability, and auditability. However, they do not specify how an LLM routing decision should be constrained at runtime so that it cannot violate a policy-mandated minimum.
2.4. LLM Safety, Guardrails, and Decision Safety
The LLM-safety literature provides a taxonomy that must be specialized for business-process decisions. Jalan et al. organize LLM safety around attacks, defenses, alignment, metrics, and guardrails. They also distinguish input-level safety, training-time alignment, and inference-time guarding mechanisms [
16]. In that literature, guardrails often detect adversarial prompts, prevent jailbreaks, moderate harmful content, block privacy leakage, or filter unsafe outputs.
The present paper addresses a narrower problem: decision safety. A syntactically valid and semantically plausible LLM output may still become a process route that violates local organizational policy. A generally aligned model may also fail to enforce a site-specific escalation rule. Conversely, a model may identify elevated risk in its rationale while selecting an escalation level below the policy-mandated floor.
This is why prompt-level reliance is insufficient for compliance-critical APA. The missing layer is application-level runtime enforcement over the process action selected by the LLM. Our guardrail does not claim to make the LLM safe in general. It guarantees a precise invariant for a closed and ordered decision space: the final action cannot under-escalate below the policy floor.
Automation-bias research explains why this matters in practice. Users may over-rely on automated recommendations even when they are wrong [
10,
11]. APA can intensify this risk because users may transfer trust from deterministic workflows to stochastic agents. A fluent explanation and a plausible risk label may hide the fact that mandatory human approval was not triggered.
2.5. Agentic AI in HR and Compliance-Oriented Process Automation
HR operations are a natural domain for agentic automation. They combine repetitive workflows, cross-platform coordination, personal data, access provisioning, employee communication, and policy interpretation. Recent HR-oriented work describes agentic AI as a shift from passive HR tools to autonomous digital teammates supporting recruitment, onboarding, benefits administration, employee support, and policy inquiry [
17]. The same literature stresses transparency, bias mitigation, data privacy, and governance as prerequisites for responsible deployment.
Compliance-oriented process automation in MSMEs shows a similar pattern. Agentic AI can support accounting, inventory management, customer service, and regulatory compliance, but adoption depends on formalized data, digital infrastructure, trust, and organizational readiness [
30]. These findings reinforce a key assumption of our work: governed APA is most defensible when structured inputs, explicit policies, and auditable decisions are available.
Employee onboarding is, therefore, an appropriate empirical setting. It is routine enough to benefit from automation, yet it includes decisions with compliance consequences: role-based access, data-protection training, work-mode determination, and mandatory human approval for sensitive profiles. In such a setting, task-completion metrics are insufficient. A system can process most onboarding fields correctly and still fail the single decision that determines whether human approval is required.
2.6. Literature Gap
The reviewed literature converges on three findings.
LLM agents are increasingly capable of planning, tool use, memory-based action, collaboration, reflection, and proactive assistance [
4,
5,
6,
19,
20,
21,
22,
23,
24,
25,
26].
RPA, Intelligent Automation, LLM-enabled RPA, and APA show that agents can support GUI automation, workflow construction, data-flow reasoning, and control-flow branching [
1,
2,
3,
7,
8,
27,
28].
Agentic BPM, RPA governance, enterprise-agent research, and LLM safety all call for guardrails, fallback, accountability, auditability, and human oversight [
12,
13,
14,
15,
16,
29].
Existing work shows that LLM agents can make dynamic process decisions, and it also recognizes that such decisions need governance. To the best of our knowledge, what remains missing is a runtime mechanism, formalized and empirically evaluated, that prevents a compliance-critical LLM routing decision from under-escalating below a policy-mandated minimum. We formulate the gap as follows:
Existing APA research demonstrates LLM-based workflow construction and dynamic data-flow and control-flow decisions. Agentic BPM, enterprise governance, and LLM-safety research emphasize guardrails, fallback, auditability, and human oversight. However, current work does not formalize and empirically evaluate how to constrain an LLM agent’s compliance-critical routing decision so that the final action cannot under-escalate below a policy-mandated minimum while remaining auditable.
This paper covers that gap within a precise scope: ordered routing decisions with a policy floor. For this class of decisions, the paper provides a four-stage governed decision wrapper, a formal floor-safety guarantee, and an empirical onboarding evaluation against explicit HITL ground truth. The paper does not claim global safety for all APA behavior. It proves and tests a specific governance property for compliance-critical process decisions.
Table 1 synthesizes, for each literature stream, what is established, the residual gap, and how this paper covers it.
Table 2 summarizes the final positioning. Existing systems primarily expand agent capability: perception, planning, tool use, proactivity, workflow generation, or multi-agent cooperation. Governed APA adds an orthogonal axis: whether a compliance-critical process decision is bounded by validated policy at runtime and remains auditable after execution.
3. Materials and Methods
3.1. Problem Formalization
We formalize one runtime routing decision at a time. The LLM proposes a route, but the process executes only the route returned by the governed decision wrapper. The formalization is local: it concerns one closed decision space and one policy constraint, not the full safety of the entire APA system. The guarantee applies after the intake layer has accepted the case as schema-valid. Cases that fail schema validation are handled upstream and do not enter the governed routing decision.
3.1.1. Decision Space and Ordering
A governed routing decision is modeled as the tuple
, where
is the case space,
O the closed set of admissible decision options,
the LLM policy,
D the deterministic fallback policy, and
the guardrail specification. The notation is summarized in
Table 3.
The case space contains all schema-valid onboarding cases accepted by the intake layer. Each case is a structured record whose fields have already been validated. In the onboarding setting, these fields include role, department, work mode, employment type, seniority, data-access level, start date, and manager. Cases that fail schema validation are not elements of and are handled upstream before the governed decision is invoked.
The option set contains all admissible outputs for the routing decision. The LLM output is valid only if it can be parsed and its decision value belongs to O. If the decision requires a rationale for auditability, the output is also considered invalid when the rationale is missing.
For decisions governed by a policy floor, O is ordered by increasing conservativeness, . For two options , we write when b is at least as conservative as a, and for the more conservative of the two.
For the compliance decision in the case study, the ordered option set is , whose maximal option is .
3.1.2. Policies and Guardrail Modes
The LLM policy is a partial decision function . For a case e, the value is the route proposed by the LLM, while means that the output is invalid, for example because it is malformed, out of vocabulary, or incomplete. The deterministic fallback policy is a total function that always returns a valid route; in the implementation, D encodes organizational rules and is used whenever the LLM output cannot be trusted or parsed.
The guardrail specification groups the active guardrail mode and the policy routes used by that mode. The mode is fixed for the decision type and is not selected by the LLM. If , the decision has no guardrail. If , policy fully determines the output through ; this applies when a validated field directly fixes the route, as for a work-mode decision fixed by the validated field . If , policy defines the minimum admissible route through , so the LLM may still choose among admissible routes but cannot choose a route below the policy-mandated minimum.
The deterministic fallback is required to satisfy the same policy constraint as the active guardrail. Therefore, for every
,
when
, and
This condition holds by construction in our system because D, , and are computed from the same validated fields and policy knowledge base.
3.1.3. Governed Decision Function
The governed decision
is the route actually returned by the wrapper:
The cases in Equation (2) are evaluated in priority order. Invalid LLM outputs are handled first and always trigger the deterministic fallback. Valid LLM outputs are then either overridden, raised to the policy floor, or accepted unchanged.
A case e is compliance-critical for the compliance decision when policy requires the maximal escalation level, i.e., .
3.1.4. Floor-Safety Property
The safety property of interest is not global correctness, but the absence of under-escalation below the policy floor. The governed decision guarantees exactly this: for every schema-valid case handled in floor mode, the executed route is never less conservative than the policy minimum,
Whenever a case is compliance-critical, that is,
, it is, therefore, escalated to mandatory human approval regardless of the LLM proposal. Escalation is enforced by the architecture rather than left to model behavior.
The reason is that if the LLM output is invalid, the wrapper falls back to the deterministic policy, which satisfies the floor by construction (Equation (
1)); if it is valid, the wrapper returns the more conservative of the proposal and the floor. The LLM retains discretion for valid proposals at or above the floor, but it cannot under-escalate below the level required by policy. The guarantee is local, concerning one invariant over one ordered decision space rather than the global correctness of the system, and it removes the failure mode this paper targets: a fluent, confident agent that silently routes a compliance-critical case below the level required by policy.
3.1.5. Threat Model and Scope
We assume that the structured input has been validated upstream and can be trusted by the decision wrapper. Adversarial manipulation of source records is outside the scope of this study. The policy knowledge base is also assumed to be versioned and trusted. The object we distrust is the LLM proposal .
The model may fail in three ways. First, it may return an invalid output, represented as . This is handled by the deterministic fallback in Equation (2). Second, it may return a valid but under-conservative route, . This is handled by the floor guardrail. Third, it may behave non-deterministically across runs. This is measured through the inter-run stability analysis. For compliance-critical cases, the floor guardrail also removes variation in the final governed decision because the final route is fixed at .
We do not claim robustness against prompt injection embedded in free-text fields. This risk is excluded from the present experiment by restricting the study to structured inputs.
Table 4 summarizes the in-scope and out-of-scope risks.
3.2. Compliance-Critical Onboarding
As a case study, we consider the onboarding of new collaborators in a business-process-outsourcing setting. Each onboarding case is described by structured attributes, including role, department or campaign, work mode, employment type, seniority, data-access level, start date, and manager. The process requires three routing decisions: work mode, role profile, and compliance level.
The compliance decision is the critical decision in this study. Its option set is ordered by increasing conservativeness, . The last option mandates human-in-the-loop (HITL) approval. According to policy, this approval is required when high data access is combined with managerial seniority or contractor engagement; in this dataset, these cases coincide with the Supervisor and Team Leader profiles.
The process is repetitive and structured enough to benefit from automation, but one incorrect routing decision may create a compliance, security, and auditability failure.
3.3. The Governed APA Architecture
The architecture fixes the process control flow as an explicit and auditable workflow. The
mainWorkflow and the atomic provisioning actions are deterministic. LLM autonomy is confined to bounded routing decisions. The LLM may propose routes, but it cannot directly execute provisioning actions or bypass the governance layer. The system is organized into five layers (
Figure 2):
The intake layer ingests the structured onboarding record, validates its schema, checks mandatory fields, and records data completeness.
The cognitive layer hosts the bounded routing decisions. Each decision is produced through the governed wrapper in Algorithm 1.
The control layer executes the fixed mainWorkflow. It sequences downstream actions according to the governed routing decisions.
The execution layer performs deterministic atomic actions, such as account creation, group assignment, license assignment, mailbox creation, and VPN enablement. It also invokes a DataAgent to draft natural-language artifacts, including the welcome e-mail, manager brief, and compliance report. These artifacts do not change the governed routes.
The governance layer applies policy-derived guardrails, provides the deterministic fallback, and writes an append-only audit log. The log records the LLM proposal, validation outcome, guardrail activation, fallback use, and final route.
3.3.1. The Decision Wrapper
Each routing decision is produced by the four-stage wrapper shown in
Figure 3 and Algorithm 1. Stage 1 validates the structured input. Stage 2 asks the LLM to choose only from a closed option set and validates the returned route, confidence, and rationale. Stage 3 applies the active policy guardrail. Stage 4 uses the deterministic fallback when the LLM output is invalid.
The wrapper supports two guardrail modes. The override mode forces the final route to a policy-defined value. It is used when policy fully determines the route, as in the work-mode decision, which must match the validated
work_mode field. The floor mode enforces a minimum admissible route on an ordered option set. It is used for the compliance decision: the LLM may choose a route at or above the floor, but never below it.
| Algorithm 1 Governed decision wrapper (one routing decision). |
Input: schema-valid employee record e; option set O; LLM policy ; deterministic fallback policy D optional override ; optional floor at most one of and is provided Output: governed route with full audit trail Notation: ⌀ denotes an absent optional argument or an empty field; the test on line 4 realizes .
|
- 1:
| ▹ deterministic fallback/policy reference |
- 2:
validate schema of e; log completeness
| ▹ stage 1: intake |
- 3:
| ▹ stage 2: bounded LLM choice |
- 4:
if invalid or or or then
|
- 5:
log FALLBACK; return
| ▹ stage 4: deterministic fallback |
- 6:
end if - 7:
;
|
- 8:
if and then
| ▹ stage 3a: override guardrail |
- 9:
log GUARDRAIL_OVERRIDE ; - 10:
end if
|
- 11:
if and then
| ▹ stage 3b: floor guardrail |
- 12:
log GUARDRAIL_FLOOR ; - 13:
end if - 14:
log decision with provenance - 15:
return
|
This design implements constrained autonomy. The LLM has discretion only inside a finite and validated action space. Policy enforcement, fallback, and logging remain deterministic.
A key design choice concerns where policy knowledge resides. The mandatory compliance floor is not inferred by the LLM. It is computed deterministically from validated fields and an external, versioned knowledge base containing role permissions, policy rules, and HITL thresholds. The floor is also absent from the LLM prompt. Therefore, any safety improvement observed after enabling the guardrail is attributable to runtime enforcement, not to prompt persuasion. In each decision type, at most one of
,
is set, recovering the exclusive guardrail modes of (
2).
3.3.2. Fallback Mechanism
The deterministic fallback is triggered whenever the LLM output fails validation, namely when the response is not parseable as a JSON object, when the proposed route lies outside the closed option set, when the confidence field is missing, or when the rationale is empty. On trigger, the wrapper writes an audit-log entry with status
FALLBACK recording the validation error and the deterministic decision, and sets a per-profile fallback flag in the execution trace, so that fallback events are fully auditable and separable from model-driven decisions. The fallback does not compete with or override the guardrail: the deterministic fallback route is the policy route and, therefore, already satisfies the floor by construction. Thus, for a valid output the floor is applied to the model proposal, and for an invalid output the floor-compliant deterministic route is used; in neither case can the executed route fall below the policy floor, consistent with (
3).
3.3.3. End-to-End Governed Workflow
Algorithm 2 shows how the three governed decisions compose within the fixed mainWorkflow. The control flow is the same for all cases. The only learned components that can affect routing are the bounded LLM decisions inside the wrappers. The DataAgent may generate human-readable artifacts, but it does not alter the governed routes or the provisioning state.
For every case, the workflow emits a structured onboarding plan, generated artifacts, and a complete audit trail. The execution can, therefore, be reconstructed offline from the logs.
| Algorithm 2 Governed onboarding workflow (mainWorkflow). |
Input: validated employee record e; knowledge base ; deterministic fallback policy D; LLM policy Output: onboarding plan P, artifacts A, audit log L
|
- 1:
| ▹ override guardrail |
- 2:
| ▹ role profile (no guardrail) |
- 3:
| ▹ Algorithm 3 |
- 4:
| ▹ floor guardrail |
- 5:
| ▹ IT, HR, facility, training, compliance tasks |
- 6:
if then
|
- 7:
mark sensitive tasks in T as PENDING-HITL
| ▹ block until human sign-off |
- 8:
end if
|
- 9:
| ▹ welcome e-mail, manager brief, compliance report |
- 10:
; append all decisions and overrides to L - 11:
return
|
| Algorithm 3 Policy floor for the compliance decision. |
Input: employee e with validated fields data_access, seniority, employment Output: floor route on the ordered set 〈standard, enhanced, human_approval_required〉
- 1:
- 2:
- 3:
if and then
|
- 4:
return human_approval_required
| ▹ mandatory HITL by policy |
- 5:
else if or then - 6:
return enhanced - 7:
else - 8:
return standard - 9:
end if
|
3.3.4. Policy Encoding, Propagation, and Conflict Resolution
A policy is encoded as a deterministic, versioned function from validated input fields to an element of the ordered option set (Algorithm 3). The function is external to the LLM and is not part of the prompt, so a policy update propagates by replacing this function: it requires no model retraining and no prompt modification, and it takes effect deterministically on the next decision, which also keeps the audit trail interpretable across policy versions. When multiple rules apply to the same decision, each contributes a candidate floor, and the effective floor is their most conservative value, that is, the supremum in the conservativeness order ⪯. Conflicts are thus resolved deterministically in favor of the stricter requirement: the executed route is never below any applicable rule’s floor. This composition preserves the floor-safety property, since enforcing the maximum of several floors is itself a floor.
3.4. Bounded Prompting and Output Validation
In stage 2, the LLM receives a compact prompt containing the task name, the closed list of admissible routes, and the structured case attributes. It must return one JSON object with three fields: , , and . No free text may precede or follow the JSON object. This makes parsing deterministic.
Output validation enforces three conditions before a proposal is accepted. First, the route must belong to the admissible option set O. Second, confidence must be present and is clipped to the interval . Third, the rationale must be non-empty, because an unexplained decision is not auditable. If any condition fails, the wrapper returns the deterministic fallback.
This design separates formatting failures from judgment failures. Stage 2 has only two possible outcomes: a valid, in-vocabulary, justified route, or an explicit fallback. This distinction matters for the evaluation. If the fallback rate is low, compliance failures in the unguarded configuration can be interpreted as valid but unsafe routing choices, not as parsing artifacts.
The policy floor is not included in the prompt. The guarded configuration, therefore, tests runtime enforcement, not improved prompting.
Table 5 maps the three threats of our threat model to the architectural mechanism that neutralizes each, and to the empirical signal that confirms it.
3.5. Case Study and Dataset
We evaluate the architecture on an industrially grounded onboarding test set restricted to structured data. Free-text extraction, OCR, and document understanding are outside the scope of the experiment. This restriction is deliberate: the study targets the safety of a routing decision, not the robustness of information extraction.
Onboarding requires provisioning each new collaborator with the correct identity, access groups, software licenses, mailbox, and, where applicable, remote-access credentials, and data-protection rules require human approval before elevated privileges are granted to sensitive roles. A missed escalation, therefore, creates a security and audit liability.
The dataset is derived from 50 help-desk onboarding tickets, from which we obtain 166 individual onboarding profiles. These records are synthetic: they were constructed and supplied by the industrial partner, a contact-center provider, and validated by the partner as realistic and representative of its real onboarding process with respect to role mix, data-access levels, employment types, and the resulting sensitivity distribution. Using synthetic partner-validated data avoids any exposure of personal information; in addition, all LLM inference was run locally through Ollama. External validity, therefore, rests on the partner’s validation of representativeness, which we state explicitly as a scope condition. A ticket may contain more than one hire.
Three attributes absent from the master data, contract type, manager, and start date, are imputed deterministically and flagged as imputed. None of these imputed fields influences any evaluated routing decision: work mode uses the source work-mode field, role profile uses role, department, and seniority, and the compliance floor uses data-access level, employment type, and seniority, all of which are observed source fields. In particular, employment type (for example, contractor) and contract type (the specific contractual instrument) are distinct fields, and only employment type, which is observed, feeds the compliance decision. The imputed fields are used only for artifact generation and provisioning bookkeeping. The evaluation, therefore, does not treat imputed values as observed source data.
The policy layer is external and versioned. The knowledge base specifies the permission groups and HITL thresholds used by the floor policy. Of the 166 profiles, 43 profiles, equal to 26%, require mandatory human approval. Operationally, the policy floor (Algorithm 3) escalates to human_approval_required exactly the profiles that combine high data access with managerial seniority or contractor engagement; in this dataset, these coincide with the Supervisor and Team Leader roles, which is why we refer to them as the sensitive profiles. The remaining 123 profiles are non-sensitive.
Each profile has ground truth for two elements: whether HITL approval is required and which atomic provisioning workflow is expected. HITL ground truth is derived from an explicit ground-truth field and the versioned policy specification used by the industrial partner. Grounding policy in the knowledge base, rather than hard-coding it in the prompt, aligns the evaluation with how the organization represents its rules.
Table 6 summarizes the inputs and outputs consumed and produced for each profile.
Table 7 reports the role distribution and sensitivity class.
Table 8 gives one synthetic end-to-end example.
3.6. Experimental Design and Metrics
We compare three configurations on the same 166 profiles.
The deterministic baseline applies the rule-based policy without LLM discretion.
The unguarded LLM lets the model select the compliance route from the closed option set, subject only to output validation.
The guarded LLM applies the same bounded LLM decision, but activates the floor guardrail for the compliance route.
Qwen2.5 (7.6B parameters) is the primary model and llama3.1 (8.0B parameters) is the comparison model for the sensitivity analysis. Both are served locally through Ollama 0.30.10 with 4-bit quantization (Q4_K_M) and a context window of 4096 tokens, matched to the short structured prompts. Qwen2.5 configurations are repeated three times. The unguarded llama3.1 configuration is also repeated three times, while the guarded llama3.1 configuration is evaluated once for the full profile-level metrics. In sensitive cases, the guarded compliance decision is deterministic by the floor-safety property. This distinction is stated explicitly in the results tables where relevant.
The evaluation has two tracks. The accuracy track compares the produced routes against ground truth, with
as the positive class for HITL detection. With true positives
, false positives
, and false negatives
, we compute
When a denominator is zero, the harness reports the corresponding metric as zero. This can occur when a model produces no HITL-positive predictions.
Metrics are reported at profile level and, where relevant, at ticket level. A ticket is HITL-positive when at least one profile in the ticket requires human approval. We also evaluate remote-handling coherence, which checks consistency between the governed work-mode route and the provisioning plan for remote-access tasks.
The governance track measures the behavior of the wrapper. It includes guardrail activation rate, fallback rate, baseline versus LLM agreement on the three routes, and inter-run stability. If
n is the number of profiles and
k is the number of repeated runs, stability is defined as follows:
where
is the final route for case
in run
j and
is the indicator function, equal to 1 when the routes of all
k runs coincide and 0 otherwise. Stability is meaningful only for
; with
it is trivially 1. We, therefore, report it where repeated runs are available (
for Qwen2.5), and not for the single guarded llama3.1 run. A single run is sufficient for the latter because, in the compliance-critical cases, the floor makes the guarded decision deterministic ((
3)); inter-run variability can, therefore, arise only on non-mandatory routes and does not affect the reported HITL recall.
Once the floor guardrail is active, the HITL decision becomes deterministic on sensitive cases. Therefore, the central comparison is between the unguarded and guarded LLM configurations. The guarded result is not interpreted as evidence that the LLM became more accurate. It is evidence that runtime enforcement prevents under-escalation below the policy floor.
3.7. Reproducibility and Implementation
The system is implemented in Python. LLM inference is served locally through Ollama, so onboarding data do not leave the machine. This deployment choice is relevant because onboarding records contain privacy-sensitive personal and organizational information.
Each run is fully traced. For every case, the system emits the structured onboarding plan, generated artifacts, an append-only audit log, and an LLM trace. The audit log, stored as audit_log.jsonl, records input validation, LLM proposal, guardrail activation, fallback use, final route, and provenance. The LLM trace, stored as llm_trace.json, records per-call metadata and the fallback_used flag.
The deterministic baseline is reproducible by construction, and the governed compliance decision is reproducible on sensitive cases because the floor fixes the final route at human_approval_required. The LLM proposals themselves are not assumed deterministic, which motivates repeated runs and the inter-run stability metric.
To reduce failures unrelated to the research question, local models are configured with a context window matched to the short structured prompts. This setting limits input-boundary effects while preserving the intended test: whether a valid LLM routing proposal can under-escalate and whether the policy floor prevents it.
Table 9 consolidates the configuration required to reproduce the experiments. Decoding is fixed across all runs, but no random seed is set and local inference through Ollama is not bit-reproducible; this is why inter-run stability is measured rather than assumed. The full prompt templates for the three routing decisions are given in
Appendix A.
Computational Overhead
The governance layer adds only deterministic, constant-time work per decision. It performs schema validation over a fixed field set, a membership test, an order comparison to apply the floor, and fallback selection from an already-computed deterministic route. It issues no additional LLM calls. Its cost is, therefore, negligible relative to model inference, which dominates end-to-end latency. On the Apple M4 Max used for the experiments, end-to-end processing of a full profile averaged s for Qwen2.5 and s for llama3.1. This includes three LLM-backed routing decisions and natural-language artifact generation. In both cases, latency was dominated by generation rather than by governance logic. Since the guarded and unguarded configurations perform the same number of generations, throughput is bounded by model inference and is not materially affected by the guardrail. When fallback is triggered, it returns the deterministic route after validation and avoids any retry or additional model call. Absolute times reflect single-stream local inference on consumer hardware and would improve with batching or server-grade accelerators. The relative conclusion is that the governance layer adds no LLM calls and only constant-time deterministic checks.
4. Results
4.1. Ungoverned Qwen2.5 Produces Silent Under-Escalation
Table 10 reports profile-level HITL decision quality across configurations. The deterministic baseline reproduces the policy exactly, with recall
. This is expected because both the baseline and the HITL ground truth derive from the versioned compliance policy. The baseline is, therefore, a pipeline correctness check, not the main empirical finding. Because the deterministic baseline, the HITL ground truth, and the policy floor are all derived from the same versioned compliance policy, neither the baseline nor the guarded configuration should be interpreted as an independent validation of decision accuracy; both confirm, as expected, that a policy-anchored path enforces the policy. The empirical finding that does not follow by construction, and that carries the weight of this study, is the behavior of the
ungoverned models, which are given no access to the policy (
Table 10).
The critical result is the unguarded Qwen2.5 configuration. It attains an apparent accuracy of , but its HITL recall is : none of the 43 sensitive profiles is escalated to mandatory human approval (TP , FN ). This is the accuracy paradox created by class imbalance. Since only 26% of profiles are sensitive, a model that never predicts mandatory approval can still appear accurate while completely failing the safety-critical decision.
The predictions show that the failure is systematic. All 43 sensitive profiles are routed to
enhanced; none is routed to
standard, and none to
human_approval_required. The model, therefore, recognizes elevated risk but stops one level below the policy-mandated HITL threshold. This is the central failure mode of the paper: plausible risk recognition without mandatory escalation.
Figure 4 visualizes the resulting gap between aggregate accuracy and sensitive-case recall.
At ticket level (, 13 HITL-positive tickets), the pattern mirrors the profile-level result. Ungoverned Qwen2.5 yields ticket-level recall , whereas the deterministic baseline and guarded Qwen2.5 reach . Ungoverned and guarded llama3.1 both reach ticket-level recall , with precision , reflecting residual over-escalation. Remote-handling coherence is 1.000 in all configurations: all 55 remote-access cases are consistent between the governed work-mode route and the provisioning plan.
4.2. Governance: Only the Guarded Decision Is Stable
The configuration labeled as unguarded for compliance still contains one guarded decision by design: work mode is protected by the override guardrail, while role profile and compliance are not. This creates a within-configuration contrast.
Table 11 reports baseline versus LLM agreement and inter-run stability for the three routing decisions, and
Figure 5 visualizes the same contrast.
The work-mode decision reaches agreement and stability of 1.000. The two unguarded decisions are less stable and less aligned with the deterministic reference. The compliance decision is the most problematic, with agreement of only and inter-run stability of . This contrast does not imply that the LLM itself is safe where a guardrail is present. It shows that the governed route is stable when the policy constraint is enforced, whereas unguarded routing remains model-dependent. The mean fallback rate is negligible (), which confirms that the observed failures are valid model judgments over admissible options, not parsing errors or service failures.
4.3. The Floor Guardrail Restores Floor-Safety
Activating the policy-derived floor guardrail on the compliance decision removes the under-escalation failure observed for Qwen2.5. Across the full set of 166 profiles and three guarded Qwen2.5 runs, HITL recall rises from
to
(TP
, FN
), with precision
. The result is identical across runs on sensitive cases, as predicted by the floor-safety property in (
3). This guarded recall of
is expected by construction and should be read as an empirical confirmation of the analytical guarantee, not as an independent validation of decision accuracy: once the floor is anchored to the policy, escalation on compliance-critical cases follows from (
3) rather than from model competence.
The audit log shows the mechanism explicitly in the Qwen2.5 guarded runs. For sensitive profiles, the LLM proposal remains enhanced, while the final governed route is human_approval_required and guardrail_applied=true. Since the policy floor is not included in the prompt, this correction is attributable to runtime enforcement rather than to prompt wording.
In the guarded Qwen2.5 configuration, the mean guardrail activation rate over three runs is
. This aggregate should not be read as the rate of safety-critical corrections, because it combines interventions with different safety meanings.
Table 12 decomposes the activations by transition type for a representative run with 143 logged activations. Of these 143 activations, 43 are safety-critical corrections that raise
enhanced to
human_approval_required on the sensitive profiles, and 100 are non-HITL policy elevations that raise
standard to
enhanced. No work-mode override occurs for Qwen2.5, whose work-mode agreement is
. Only the 43 safety-critical corrections concern mandatory human oversight; this is the quantity of primary safety interest, and it corresponds to a mandatory-HITL activation rate of
.
For Qwen2.5 on this dataset and configuration, the floor guardrail introduces no spurious HITL escalation: precision remains
. The compliance decision also becomes fully stable, with inter-run stability increasing from
in the unguarded configuration to
in the guarded configuration. The fallback rate remains low (
), so the improvement is not driven by fallback to the deterministic baseline.
Figure 6 summarizes the central floor-safety result.
4.4. Model-Sensitivity Analysis
We repeat the study with llama3.1 to test whether the floor-safety result depends on a specific model. The comparison is informative because the two models fail in opposite directions when the compliance decision is unguarded (
Table 13,
Figure 7).
Ungoverned Qwen2.5 is under-conservative. It usually returns valid JSON, with a fallback rate of only , but it misses all 43 sensitive profiles (recall ). Ungoverned llama3.1 shows the opposite behavior. It reaches recall , but only with precision , because 10 non-sensitive profiles are routed unnecessarily to human approval. It is also less reliable at the input boundary, with a fallback rate of .
This last point requires care, because invalid LLM responses trigger the deterministic fallback. We, therefore, measured, on the compliance decision specifically, how many of the 43 sensitive escalations come from valid model proposals and how many from fallback. In the unguarded llama3.1 condition, 41 of the 43 are escalated by the model’s own valid proposal and only 2 by the deterministic fallback. The overall fallback rate of is a per-profile rate aggregated over all three routing decisions and is concentrated on the work-mode decision, where llama3.1 more often emits invalid JSON; it does not inflate the compliance-recall result. Consequently, llama3.1’s high compliance recall in the unguarded condition reflects genuine model behavior, namely a tendency toward over-escalation, rather than fallback-to-policy correction.
To separate model behavior from deterministic system correction,
Table 14 reports HITL recall on the 43 sensitive cases at three stages: the raw LLM proposal (valid model output only), the unguarded final decision (after validation and deterministic fallback), and the guarded final decision (after the floor guardrail).
With the floor guardrail active, both models reach recall on sensitive cases. This confirms the architectural nature of the guarantee: floor-safety does not depend on which model proposes the route. The guardrail does not, however, eliminate over-escalation. It raises under-conservative decisions but never lowers over-conservative ones. Therefore, llama3.1 retains residual false positives after guarding, with precision and 8 false positives. The mechanism guarantees no missed mandatory escalation; it does not guarantee minimum human workload.
Overall, the results support three empirical claims. First, unguarded LLM routing can be silently unsafe even when aggregate accuracy appears acceptable. Second, policy-derived runtime enforcement prevents under-escalation below the policy floor and, for Qwen2.5, restores mandatory-escalation recall from to . Third, model-specific failure modes differ: Qwen2.5 under-escalates, while llama3.1 over-escalates and produces invalid outputs more often at the input boundary, mainly on the work-mode decision. The common remedy for missed mandatory escalation is architectural rather than model-specific: the guarded decision wrapper enforces the policy floor independently of the LLM proposal.
The two models are of comparable size (Qwen2.5, 7.6B; llama3.1, 8.0B parameters), so the divergence is not explained by scale. We do not have access to their training corpora and, therefore, make no claim about training-data provenance. The outputs instead show different decision postures. Qwen2.5 explicitly articulates the risk in its rationale (
Appendix A) but still selects
enhanced, one level below mandatory human approval. Llama3.1 follows a more conservative pattern: it escalates whenever elevated-risk cues appear, which recovers full recall but lowers precision through over-escalation. The floor guardrail eliminates the under-escalation side of this behavior, but it does not correct over-escalation. The latter remains an efficiency and workload issue requiring upper bounds or two-sided governance. A deeper analysis of reasoning traces, alignment tuning, and model-specific decision posture is left to future work.
5. Discussion
5.1. Interpretation of the Main Finding
The central result is not that an LLM fails to recognize risk. The more specific finding is that an LLM can recognize risk without translating it into the escalation required by policy. In the Qwen2.5 configuration, all sensitive cases were routed to enhanced, not to standard. The model, therefore, produced a plausible intermediate judgment, but still missed every mandatory HITL escalation. This is a policy-action inconsistency: the route is valid and apparently reasonable, yet it remains below the policy-mandated floor.
This failure mode matters precisely because aggregate accuracy hides it. The unguarded Qwen2.5 configuration reached apparent accuracy
while its recall on mandatory HITL cases was
. In a regulated process, such behavior can pass undetected until a later compliance audit. It also strengthens the automation-bias concern: users may accept a plausible automated decision even when the required human approval has been omitted [
10,
11].
Governed APA addresses this risk in three ways. First, the floor makes mandatory escalation non-discretionary. A compliance-critical case is escalated to human review even when the model gives a fluent and confident rationale for a lower route. Second, guardrail activation should be visible to end-users. The interface should flag decisions in which the executed route differs from the LLM proposal, making clear that a policy floor, not the model, determined the outcome. This reduces the risk that reviewers treat model confidence as authoritative. Third, the audit log supports bias detection. For every decision, it records the LLM proposal, guardrail action, fallback use, and final route. This makes it possible to measure systematic tendencies, such as how often a model proposes below the floor or above the policy-required level.
Once the floor guardrail is active, mandatory HITL recall is guaranteed by construction on compliance-critical cases. The scientific contribution lies in the contrast between two decision contracts. In the unguarded contract, a syntactically valid LLM proposal becomes the route. In the governed contract, the LLM proposal is reconciled with a deterministic policy floor before execution.
It could be observed that the compliance decision, taken in isolation, is fully determined by policy, so a deterministic rule would suffice. This is correct for this single decision, and the deterministic baseline confirms it. The point of the study is not that an LLM is required for this policy floor, but that LLM agents are increasingly delegated routing decisions under the APA paradigm, and that this delegation can be silently unsafe unless governed. The proposed architecture governs the policy-bound part of the decision while preserving LLM discretion where policy does not fully determine the route, such as role-profile selection and compliance choices above the floor. The compliance decision, therefore, functions as a stress test that exposes the danger, not as a claim that rule-based routing should be abandoned.
5.2. Novelty Relative to Prior Agentic Automation
The novelty of this work lies in moving from agent capability to agent governability. Prior APA work established that LLM-based agents can construct workflows and support dynamic data-flow and control-flow decisions [
7]. LLM-enabled RPA systems such as SmartFlow improve perception and GUI navigation [
8]. Proactive agent systems extend autonomy by sensing context and initiating assistance without explicit user instructions [
9]. These contributions expand what agents can construct, perceive, or anticipate.
The present work addresses a different question: whether a decision delegated to an LLM agent can be constrained to respect a specified regulated invariant. This question is not solved by improving perception, planning, prompting, or model scale alone. It requires runtime governance.
Three elements distinguish the proposed Governed APA pattern. First, the control flow is fixed as an auditable workflow, and LLM autonomy is confined to closed routing decisions. Second, the compliance guardrail is not inferred from model intuition or prompt instruction. It is computed from validated fields and an external, versioned policy knowledge base. Third, the paper provides both a formal floor-safety property and an empirical evaluation that exposes silent under-escalation.
The model-sensitivity analysis further clarifies the contribution. Qwen2.5 fails through under-escalation, while llama3.1 fails mainly through over-escalation and more frequent fallback. These pathologies are model-specific. The remedy for missed mandatory escalation is architectural: the same floor guardrail enforces the policy floor independently of which model proposes the route.
The floor guardrail is, by design, a one-sided guarantee, and this asymmetry has a cost that should be stated plainly. The mechanism raises decisions that fall below the policy floor but never lowers decisions that sit above it. It, therefore, prevents missed mandatory escalations but neither reduces nor detects over-escalation, and it can increase human workload when a model is over-conservative. In our evaluation, this cost is visible for guarded llama3.1, which retains a precision of and 8 false-positive escalations over 166 profiles: eight profiles are routed to human approval that policy does not require, adding unnecessary review effort. Qwen2.5 does not exhibit this cost on the present dataset and configuration, but there is no guarantee that another model, dataset, or policy would be free of it. Addressing over-conservative behavior requires mechanisms beyond a lower bound, such as two-sided admissible intervals, conditional bounds, and workload-aware review policies, which we identify as future work. In deployment, the floor guardrail should, therefore, be understood as a safety lower bound to be combined with workload monitoring, not as a mechanism that optimizes the volume of human review.
5.3. Implications for Research and Practice
For research, the results suggest that agentic-automation benchmarks should not rely only on aggregate task success or overall accuracy. In compliance-critical processes, the relevant failure may be concentrated in a minority class. A system can perform well on common cases while failing exactly where policy requires human oversight. Future APA evaluations should, therefore, report class-aware metrics, especially recall on critical cases, false-negative rates on mandatory escalation, fallback rates, and inter-run stability.
The results also support an architectural view of LLM safety in business processes. Larger models, better prompts, or stronger general alignment may reduce some errors, but they do not by themselves guarantee compliance with a local organizational policy. LLM-safety research provides broad safety taxonomies [
16]. Governed APA specializes this idea at the application layer: the guardrail constrains a process action, not merely a text output.
For practice, the pattern offers a migration path from deterministic RPA to APA without surrendering compliance control. RPA governance already emphasizes roles, permissions, logging, auditability, change control, and policy ownership [
15]. Agentic BPM and enterprise-agent research similarly call for guardrails, fallback, accountability, and human-agent oversight [
12,
13,
14]. Governed APA turns these governance requirements into an executable runtime mechanism. The audit trail changes the explanation from “the agent decided” to “the agent proposed
X, policy required at least
Y, and the system executed and logged the reconciled route.”
5.4. Generality of the Governed-Decision Pattern
Although the case study concerns employee onboarding, the governed-decision pattern is not structurally specific to HR. We state the conditions under which it is expected to transfer, while emphasizing that this transfer is a hypothesis and has not been empirically validated beyond the onboarding process studied here. The pattern is expected to apply when four conditions hold. The process contains a discrete routing decision. The admissible options are closed and, for floor guardrails, ordered by conservativeness. The relevant policy constraint can be computed from validated fields. The system can execute a deterministic fallback and write an audit trace.
Many regulated workflows have this structure. Examples include access-review revalidation, expense-approval routing, procurement risk tiering, vendor due-diligence escalation, and triage-priority escalation. In each case, an LLM proposal may be useful, but it must not fall below a policy-mandated threshold. The override mode covers decisions fully determined by validated data. The floor mode covers decisions where the agent may still exercise discretion above the minimum required level.
The contribution is, therefore, best understood as a governance pattern for APA whose empirical validation, in this paper, is confined to a single onboarding process. Onboarding is the sole empirical instance used to demonstrate the pattern, expose the failure mode, and measure the effect of runtime enforcement; the examples of other candidate workflows above are illustrative of the structural conditions, not additional evidence.
As an example, consider Know-Your-Customer (KYC) onboarding in a financial institution. The routing decision is the customer due-diligence level, with a closed and ordered option set 〈simplified, standard, enhanced_due_diligence〉. The policy floor is computed from validated fields such as jurisdiction risk, politically-exposed-person status, and transaction-volume band, for example, a customer flagged as politically exposed cannot be routed below enhanced_due_diligence, irrespective of the LLM proposal. An LLM may still exercise discretion above the floor and generate the case narrative, but the governed wrapper guarantees that a high-risk customer is never assigned a due-diligence level below the regulatory minimum, and the deterministic fallback applies when the model output is invalid. The same structure maps onto transaction fraud triage (floor: mandatory manual review above a risk threshold) and privileged-access requests (floor: mandatory approval for administrative scopes). In each case, the four conditions above hold; empirical validation in these domains remains future work.
5.5. Coverage of the Identified Gap
The related-work synthesis identified a specific gap: existing research shows increasing agent capability and repeatedly calls for governance, but does not formalize and empirically evaluate a runtime mechanism that prevents an LLM-selected process route from under-escalating below a policy-mandated minimum.
This paper covers that gap within its stated scope. It covers discrete routing decisions, closed and ordered option sets, policies expressible as deterministic floors or overrides, schema-valid structured inputs, deterministic fallback, and audit logs recording proposal, guardrail action, fallback use, and final route. It does not claim global safety for all APA behavior. The guarantee concerns compliance-critical escalation decisions with a policy-derived floor. The following risks are out of scope: corruption or adversarial manipulation of the structured input, errors in the policy or knowledge base, failures in extracting structured records from documents or free text, prompt injection embedded in unstructured fields, misuse of downstream tools, and end-to-end workflow correctness. The guarantee is a local property of the governed routing decision; it presupposes, rather than establishes, the integrity of its inputs and policy.
5.6. Limitations
This study is intentionally focused on one well-defined safety problem: preventing under-escalation below a policy-mandated HITL threshold. The evaluation, therefore, uses structured onboarding data, validated input fields, a trusted policy knowledge base, and closed routing options. These assumptions are appropriate for the floor-safety guarantee studied here. Future work should extend the same governed-decision pattern to workflows where structured records are produced from documents, e-mails, tickets, or other semi-structured sources.
The empirical evaluation is industrially grounded, but limited to one onboarding process, 166 profiles, and two local LLMs. Both models are 4-bit quantized, which is typical for local inference. This setting is sufficient to expose the silent under-escalation failure and to test the proposed guardrail mechanism. Broader validation should include additional organizations, policies, model families, decoding settings, and compliance-critical processes. A further limitation concerns the shared origin of the evaluation references. The deterministic baseline, the HITL ground truth, and the policy floor are derived from the same versioned compliance policy and knowledge base. This is intrinsic to the problem class studied here, where the organizational or regulatory policy is by definition the correct decision, so that a policy-anchored path attains perfect recall by construction. We, therefore, do not present the guarded result as an independent measurement of accuracy; its role is to confirm the floor-safety guarantee, while the non-trivial empirical evidence lies in the ungoverned models’ failures relative to the stated policy reference. We acknowledge, however, that external validity would be strengthened by evaluation against reference labels obtained independently of the enforced policy, such as expert compliance-audit annotations or a validation set in which the escalation ground truth is elicited separately from the floor rule. We regard this as a direction for future work.
The current guardrail enforces a lower bound. It guarantees that mandatory escalations are not missed, but it does not optimize human workload when a model is overly conservative. Extending Governed APA with two-sided constraints, conditional bounds, and workload-aware review policies is, therefore, a natural next step. In deployment, the wrapper should also be combined with standard governance practices, including versioned policies, audit review, and periodic validation of the knowledge base.
6. Conclusions
This paper introduced Governed APA, a constrained-autonomy architecture for Agentic Process Automation in compliance-critical business processes. The architecture wraps each LLM routing decision in schema validation, a bounded choice over a closed option set, a policy-derived guardrail, and a deterministic fallback. Its purpose is not to remove LLM discretion, but to make it governable: the agent may propose a route, while policy determines the minimum admissible escalation.
The work addresses a specific gap in the APA literature. Prior research has mainly advanced agent capability, namely what agents can construct, perceive, plan, or anticipate. Governed APA focuses instead on agent governability, namely whether a permitted agentic decision can be constrained to respect a regulated invariant and remain auditable. We formalized this idea through a governed decision function and established a floor-safety property: for ordered routing decisions with a policy floor, the final governed action cannot under-escalate below the minimum level required by policy.
The onboarding case study showed why this guarantee matters. In the unguarded configuration, Qwen2.5 identified elevated risk but failed to escalate any of the 43 sensitive profiles to mandatory human approval, yielding HITL recall equal to zero despite acceptable aggregate accuracy. With the policy-derived floor guardrail active, Qwen2.5 HITL recall increased to 1.0. The model-sensitivity analysis showed that failure modes are model-specific: Qwen2.5 under-escalated, while llama3.1 tended to over-escalate and to produce invalid outputs more often, mainly on the work-mode decision. The common safeguard against missed mandatory escalation was architectural. The guardrail enforced the policy floor independently of the LLM proposal.
The main lesson is that compliance-critical APA should not rely on prompt-level trust in LLM discretion. It requires runtime governance. A policy floor computed from validated fields and a versioned knowledge base provides an auditable minimum escalation guarantee while preserving agentic discretion above that floor. Governed APA, therefore, offers a practical migration path from deterministic RPA to agentic automation without surrendering the governance properties required by regulated processes.
Future work should focus on three directions. First, the empirical evaluation should be extended to additional model families, decoding settings, organizations, and compliance-critical workflows. Second, the policy layer should be further externalized so that routing invariants are owned, versioned, and maintained by compliance or process owners rather than embedded in code. Third, the floor guardrail should be generalized into richer governance mechanisms, including upper bounds, two-sided admissible intervals, conditional floors, cross-decision invariants, and controlled re-planning under operational constraints.
Overall, the paper shows that a compact runtime constraint can change the safety profile of an agentic process decision. An unguarded LLM can produce a plausible route that silently violates mandatory escalation. A governed wrapper can turn the same proposal into an auditable, policy-compliant decision. The resulting pattern is local and precise, and provides a formally grounded building block for deploying APA in compliance-critical settings. Its reuse across processes remains a structural expectation rather than an empirically established result. The evidence in this paper is limited to one onboarding process, one organizational policy, 166 profiles, and two 4-bit local models. Broader validation across workflows, policies, and model families remains future work. The contribution is local policy enforcement rather than end-to-end APA safety. The floor-safety guarantee holds for the compliance routing decision under validated inputs and a trusted policy. It does not extend to input corruption, policy errors, extraction failures, prompt injection, tool misuse, or overall workflow correctness. Guarantees for these complementary concerns remain future work.