Skip to Content
SystemsSystems
  • Article
  • Open Access

14 September 2026

28 Pages

Style2Risk: A Closed-Loop Testing System for Safety Evaluation of Automated Vehicles Under Style-Conditioned Adversarial Interactions

,
,
,
,
,
,
and
1
Department of Control Science and Engineering, Tongji University, Shanghai 201804, China
2
Shanghai Research Institute for Intelligent Autonomous Systems, Tongji University, Shanghai 201804, China
3
Beijing Zhongguancun Academy, Beijing 100094, China
4
Key Laboratory of Road and Traffic Engineering of the Ministry of Education, Tongji University, Shanghai 201804, China

Highlights

Please indicate how your work links to systems science via your contributions to systems practice, theory, and/or methodology.
  • Style2Risk makes interaction style a controllable interface for closed-loop automated-vehicle testing by combining a style-conditioned behavior prior with bounded planner-directed residual actions.
  • Its style–interaction–event archive distinguishes newly covered safety-critical regions from repeated discoveries under a common screening protocol.
What are the main findings and/or the implications of the main findings?
  • In the 31,500-rollout mechanism-comparison campaign, Style2Risk raises protocol-valid safety-critical events from 110.0 to 258.0 per planner chunk and occupied archive cells from 28 to 33 relative to strict no-style.
  • A common trajectory evaluator reports lower joint displacement error and collision rate for Style2Risk, supporting targeted testing without sacrificing motion quality in the evaluated setting.

Abstract

Closed-loop safety evaluation requires traffic agents that expose planner weaknesses without producing arbitrary behavior. Existing adversarial tests often couple behavior generation, risk search, and failure counting, limiting control over how interactions are created and whether repeated events constitute new evidence. Style2Risk uses interaction style as an explicit control interface. Assertiveness and courtesy condition a Gaussian behavior prior, while a bounded residual directs the controlled participant toward the tested planner. Protocol screens retain interactions that satisfy declared action and trajectory constraints, and a style–interaction–event archive separates discovery breadth from repeated observations. We evaluate seven configurations and three planners in 31,500 WOMD–Waymax rollouts. Relative to strict no-style, Style2Risk increases protocol-valid safety-critical events from 110.0 to 258.0 per 500-scenario planner chunk and expands occupied archive cells from 28 to 33. A common trajectory evaluator that does not call the generating prior reports a 1.343 m reduction in joint displacement error, a 0.163 increase in interaction consistency, and a 0.037 reduction in collision rate. A separate 26-scenario experiment assigns style from pre-rollout information and evaluates online archive guidance. The results support style-conditioned control as a practical mechanism for targeted closed-loop testing and explicit evidence accounting.

1. Introduction

Closed-loop safety evaluation tests an automated-vehicle (AV) planner through the feedback created by its own decisions. A traffic participant changes the planner’s next observation, the planner responds, and that response shapes the interaction that follows. This feedback is central to planner safety, yet safety-critical encounters are sparse in passive driving data [1]. Fleet-scale validation is therefore not only a data problem but also a systems problem: the simulator, controlled traffic behavior, AV planner, safety criteria, and failure analysis must operate as one testing loop [2].
The central challenge is to make this loop adversarial without losing control over the behavior being tested. Offline perturbation methods such as AdvSim [3], STRIVE [4], and KING [5] create difficult trajectories before execution, but the perturbed participant cannot adjust its behavior as the planner responds. Risk-seeking traffic policies such as NADE [6], D2RL [7], and CAT [8] introduce closed-loop reactivity, although the resulting interaction is controlled mainly through risk objectives and feasibility constraints. Imitation-based agents [9,10] provide a learned source of traffic motion, but they do not by themselves give the evaluator a direct handle for testing different negotiation styles. What is missing is an interpretable interface that changes how a participant negotiates with the AV while retaining a bounded mechanism for targeted planner probing.
Interaction style provides such an interface. In a merge, lane change, or gap-acceptance encounter, the same geometric conflict can unfold differently when the other participant maintains speed, accepts a smaller gap, yields earlier, or induces less braking from the AV. Style2Risk represents these tendencies through continuous assertiveness and courtesy indicators. The indicators describe an interaction rather than assigning a permanent identity to a driver, which makes them suitable as controllable test conditions.
Style2Risk turns this idea into a closed-loop adversarial interaction mechanism. A style-conditioned Gaussian behavior prior produces the controlled participant’s base delta-pose action. A bounded residual then adds a limited correction directed toward the tested planner. This decomposition gives each component a clear role: the prior controls the behavioral regime, while the residual supplies the planner-facing challenge. The composed action is returned through Waymax, so both agents continue to react throughout the rollout.
Targeted interaction generation also requires evidence that distinguishes breadth from repetition. Style2Risk applies declared action and trajectory screens before recording a safety-critical event. The resulting style–interaction–event archive reports which formal testing regions have been reached and how often later rollouts revisit them. A large event count can therefore be interpreted alongside occupied cells and duplicate concentration rather than being treated automatically as broad discovery.
The evaluation contains a 31,500-rollout WOMD–Waymax mechanism-comparison campaign across seven configurations and three planners. Relative to strict no-style, Style2Risk increases protocol-valid safety-critical events from 110.0 to 258.0 per 500-scenario planner chunk and expands the archive from 28 to 33 occupied cells. A common trajectory evaluator, applied independently of the generating behavior prior, reports lower joint displacement error, higher interaction consistency, and a lower collision rate for Style2Risk. Additional style-sensitivity and pre-rollout experiments test whether the control variables influence the executed policy and whether they can be prescribed without using future trajectory information.
The study makes three contributions:
  • An interaction-style control interface for closed-loop AV testing. Assertiveness and courtesy condition the controlled participant before adversarial probing, and the style-sensitivity analysis verifies that both inputs affect the executed policy.
  • A style-conditioned adversarial interaction mechanism that combines a learned behavior prior with a bounded planner-directed residual. This separation produces more protocol-valid safety-critical evidence than strict no-style while retaining explicit action constraints.
  • A style–interaction–event archive that measures discovery breadth and repeated observations separately. The archive exposes a five-cell expansion in the main campaign and connects categorical coverage to realized trajectory characteristics.
Section 2 positions the work against closed-loop testing, behavior modeling, and coverage-based evaluation. Section 3 and Section 4 define the testing problem and Style2Risk mechanism. Section 5 and Section 6 describe the evaluation and results, followed by the discussion, limitations, and conclusions.

3. Closed-Loop Testing System Formulation

3.1. Closed-Loop Test and Event Record

The testing system contains the tested planner, the controlled traffic agent, surrounding replay agents, scenario context, protocol screens, and the event archive:
T = { P AV , A ctrl , A replay , M , V , C } ,
where P AV is the tested AV planner and A ctrl is the controlled traffic agent. The terms A replay , M , V , and C denote the replay agents, map and scenario context, protocol screens, and style–interaction–event archive, respectively. A rollout first produces an interactive trajectory. Safety-critical triggers are then screened and assigned to the archive:
scenario context → controlled interaction → planner response → raw safety-critical trigger → protocol screen → valid event → archive assignment → { novel , duplicate } → top - K storage .
The chain separates raw triggers, protocol-valid safety-critical events, distinct archive cells, and stored exemplars. Non-duplication and storage capacity are applied after event validity. We use safety-critical event because TTC-based near misses are surrogate outcomes rather than confirmed AV failures.
A test begins from a WOMD traffic segment. The initial state s 0 contains the tested AV, one controlled traffic agent, surrounding replay agents, and vectorized map context M . The map context includes lane centerlines, boundaries, traffic lights, and road topology. Each rollout uses T = 20 steps with Δ t = 0.1 s, giving a 2.0 s closed-loop horizon after initialization. The controlled-agent action is a delta-pose vector
a t = [ Δ x t , Δ y t , Δ ψ t ] ⊤ ∈ R 3 ,
where Δ x t and Δ y t are global-plane position increments in meters and Δ ψ t is a yaw increment in radians for one integration step. At timestep t:
  • The AV planner observes s t and produces action a t AV ;
  • The controlled traffic agent produces the delta-pose action a t ;
  • Replay agents follow pre-recorded trajectories;
  • Waymax applies the planner and traffic-agent actions to produce s t + 1 .
The resulting trajectory is τ = ( s 0 , a 0 AV , a 0 , s 1 , … , s T ) . Because the controlled action changes the next scene state observed by P AV , the planner and testing agent remain coupled throughout the rollout. The replay agents provide the surrounding logged context; the controlled participant and tested AV form the actively updated interaction pair.

3.2. Evaluation Outputs and Objective

A raw safety-critical candidate is produced from the saved closed-loop trajectory. The main detector first assigns collision when the minimum centre distance falls below the geometry-dependent overlap threshold. Otherwise, it assigns severe near miss when the minimum Time-to-Collision (TTC) is below 1.5 s. For each AV–agent pair, TTC is Euclidean separation divided by relative-speed magnitude at states with positive closing motion; the minimum over valid pairs and timesteps is used. The common evaluator and pre-rollout validation retain six multi-label triggers: collision; TTC < 1.5 s; nonnegative PET < 1.0 s; DRAC > 3.35 m/s2; either agent’s longitudinal acceleration ≤ −4.0 m/s2; and deadlock. Deadlock requires at least five terminal states, mean pair speed below 0.2 m/s over those states, and initial mean pair speed above 1.0 m/s. The prioritized primary class is collision, severe near miss, trajectory conflict (PET or DRAC), hard braking, then deadlock. Jerk and the saved Waymax off-road diagnostic enter the motion screen and are also reported separately.
The evaluation uses two complementary validity functions. The main campaign applies
I valid main ( τ ) = I trig ( τ ) I support ( τ ) I geo ( τ ) .
Here, I support contains the behavior prior’s self-NLL together with action, acceleration, jerk, clipping, and the saved Waymax off-road diagnostic. The geometric screen passes when the saved trajectory has no collision and its minimum pair distance is either unavailable or greater than 2.0 m. Because the self-NLL is relative to the behavior prior used by each configuration, this protocol measures internal support rather than providing a common motion-quality comparison. We therefore apply a second trajectory evaluator to all configurations:
I valid common ( τ ) = I trig ( τ ) I motion ( τ ) ,
where I motion applies the same trajectory, interaction, and action-constraint criteria to every configuration without calling either generating prior. The first protocol measures compliance with the implemented testing constraints, while the second compares trajectory quality on a common scale.
Each valid safety-critical event is assigned to one archive cell:
c ( τ ) = b ( z assert arc ) , b ( z courtesy arc ) , c interaction , f event ,
where b ( · ) maps an archive style measurement to low, mid, or high. The main archive uses the prescribed interaction-style proxies, and its active event dimension contains collision and severe near miss. The common-evaluator archive additionally assigns cells from post-rollout realized style. The pre-rollout validation records intended and realized assignments separately; only intended style and pre-rollout context can affect online guidance. The interaction category covers unprotected intersection, merge, lane-change competition, following pressure, yield/gap acceptance, and other.
For either declared protocol, let N valid = ∑ n = 1 N I valid ( τ n ) and let C valid = { c ( τ n ) : I valid ( τ n ) = 1 } be the set of occupied cells. For a stated rollout order, the first valid event assigned to a cell is a novel insertion and every later valid event in that cell is a duplicate. Thus, N valid = N novel + N dup , with N novel = | C valid | . The duplicate rate is
r dup = 1 − | C valid | N valid , N valid > 0 , 0 , N valid = 0 .
This definition keeps valid-event yield and archive breadth separate. A duplicate remains valid but does not increase the occupied-cell count. After all rollouts are generated, the implementation ranks events within each cell and stores at most K = 3 exemplars. This post hoc capacity changes only the number of stored rows; it does not reject valid events or alter cell occupancy.
Effective Normalized Failure Discovery Rate (ENFDR) expresses occupied cells per evaluated scenario:
ENFDR = | C valid | N ,
where N is the number of unique scenarios in the stated evaluation unit. Campaign results also report the raw occupied-cell count, active-grid coverage | C valid | / | G | , and occupied cells per rollout. The main archive has | G | = 108 active cells. The online-guidance validation uses a 135-cell archive indexed by intended assertiveness, intended courtesy, pre-rollout context, and five primary event classes. Supporting outputs include N valid , N dup , N stored , capacity rejections, collision and trajectory diagnostics, and discovery-versus-budget curves.

4. The Style2Risk Closed-Loop Testing System

Style2Risk instantiates the controlled traffic agent in the evaluation loop. Its central design choice is to separate behavior generation from planner-directed probing. The style-conditioned prior supplies a base action supported by the learned model, and the bounded residual modifies that action under explicit trust-region constraints.

4.1. Overview: Controlled Agent in Closed-Loop Evaluation

Given a WOMD scenario, the selected traffic participant receives the map context, surrounding-agent state, and current AV planner state. It then produces one delta-pose action for the next simulation step. Figure 1 shows the complete data flow. Scenario and map inputs initialize the planner, replay agents, and controlled participant. The intended style vector conditions the behavior prior, and the residual modifies the proposed base action. Waymax executes the composed action and returns the next state to both interacting agents.
Figure 1. Style2Risk system overview. The main campaign prescribes a proxy from the logged two-agent segment once and holds it fixed during rollout; the separate validation assigns style from pre-rollout information. Style conditions both the Gaussian prior and the residual factor chain. Waymax returns the next scene state, and post-rollout internal screens and a common evaluator that does not call the generating prior produce event, motion, and archive evidence. Dashed feedback is used only in the online-guidance validation. Solid arrows denote the forward state/action flow, the dashed arrow denotes optional online-guidance feedback, and the panel colors distinguish scenario context, style indicators, behavior prior, residual control, and evidence evaluation.
The evaluation path begins after execution. Safety-surrogate triggers pass through the internal-support and geometric screens before the archive records valid events, occupied cells, and duplicate observations. In the main campaign, the coverage factor uses target metadata fixed before rollout and the archive summarizes the completed trajectories. The separate online-guidance experiment updates archive occupancy after each evaluated rollout and uses that state when constructing the next residual action.

4.2. Continuous Interaction-Style Indicators

The interaction-style vector provides the control interface for the testing agent:
z = [ z assert , z courtesy ] ∈ [ 0 , 1 ] 2 .
For each two-agent WOMD segment, the proxy labels are deterministic functions of trajectory measurements. Let Δ p be the second agent’s progress minus the first agent’s progress, and let Δ v be their mean-speed difference. We denote minimum separation by g and minimum positive TTC by T c , setting T c = 3 s when unavailable. The remaining terms are induced deceleration d ind , maximum DRAC D, and nonnegative PET P. With [ x ] + = max ( 0 , x ) and logistic function σ ( · ) , the implemented labels are
z assert = σ 0.7 Δ p 20 + 0.5 Δ v 8 + 0.6 [ 20 − g ] + 20 + 0.3 [ 3 − T c ] + 3 ,
z courtesy = σ 0.8 [ g − 5 ] + 30 − 0.7 d ind 5 − 0.4 D 10 + 0.2 P 5 .
The denominators place the measurements on comparable numerical ranges, and the weights encode the intended signs and relative emphasis of the trajectory terms. They were set heuristically and fixed before the main campaign rather than optimized on its results. The resulting values describe local negotiation within an encounter and do not assign a persistent identity to either driver.
These indicators summarize local interaction tendencies in a specific encounter rather than human-labeled driving-style annotations. The style encoder E θ maps the two normalized agent-trajectory sequences to a bounded two-dimensional estimate:
z ^ = E θ ( τ i , τ j ) = z ^ assert , z ^ courtesy ∈ [ 0 , 1 ] 2 .
Here, τ i and τ j are the two interacting-agent trajectories used to construct the training segment. Two sigmoid heads produce the assertiveness and courtesy proxy estimates.
The encoder receives two normalized trajectory sequences. Each timestep contains relative position, sine and cosine of heading, planar velocity, vehicle length, and width. A two-layer relational sequence encoder with attention enabled produces the two proxy estimates. Training minimizes the implemented proxy-prediction loss with Adam; rank correlation, monotonicity across binned labels, and early/late-window consistency are reported as evaluation diagnostics rather than separate training objectives. On the scenario-level validation partition, the predictions achieve Pearson correlations of 0.962 for assertiveness and 0.743 for courtesy against their deterministic trajectory-derived targets. These values measure internal label consistency, not independent validation of human driving style.
The trajectory-derived proxy, intended test style, encoder prediction, and realized rollout behavior serve different roles. Proxy construction and encoder training use the complete 91-state logged two-agent segment because the target describes the interaction as a whole. In the main campaign, the stored proxy is prescribed once at initialization and held fixed for all 20 steps; the encoder is not called during rollout. This experiment therefore tests how the controller responds to an offline interaction-style condition. The separate pre-rollout validation assigns style without using the logged future. In both protocols, realized speed, gap, and deceleration descriptors are computed only after execution.

4.3. Style-Conditioned Behavior Prior

The behavior prior supplies the controlled agent’s base delta-pose action. It models π base ( a t ∣ x t , z ) from an 18-dimensional pair-state feature x t and the intended interaction-style vector. The feature contains relative position, both headings, both planar velocities and speeds, relative velocity, pair distance, and vehicle dimensions. A multilayer perceptron encodes x t , and Feature-wise Linear Modulation (FiLM) injects z through the hidden layers. Map data remain part of the Waymax scene and the saved Waymax off-road diagnostic but are not inputs to this action prior.
The output head is a diagonal Gaussian:
π base ( a t | x t , z ) = N a t ; μ θ ( x t , z ) , diag σ θ 2 ( x t , z ) ,
where separate heads predict the three-dimensional mean and log standard deviation. Rollouts execute the deterministic mean a t base = μ θ ( x t , z ) ; the predicted variance supplies the internal base-policy NLL statistic used by the protocol screen.
The prior is trained via behavior cloning on WOMD segments:
L base = − E ( x t , a t * , z ) ∼ D log π base ( a t * | x t , z ) ,
where a t * is the recorded next-step delta pose. The no-style branch removes the style input while retaining the same state features, hidden width, action head, and Gaussian NLL objective. A style-grid check evaluates the action mean at the nine configurations in { 0.2 , 0.5 , 0.8 } 2 . The resulting base-action sensitivity of 0.26–0.30 shows that the intended indicator vector changes the prior output before residual probing.

4.4. Bounded Residual Action for Adversarial Interaction

The bounded residual converts the prior action into a planner-directed test action without replacing the behavior prior. Its coefficients were selected during method development and fixed before the 500-scenario campaign. The sensitivity analysis evaluates this design under alternative residual bounds.
The controlled-agent action is
a t adv = clip a t base + Δ a t res , B ,
where a t base = μ θ ( x t , z ) and B denotes the component and norm bounds applied by the rollout implementation. Both terms use the delta-pose action coordinates defined in Section 3, so the base action and correction remain identifiable at every step.
The residual magnitude is computed through a factor chain:
ρ t = clip δ base α style ( z ) α attrib α cover α isolated α transfer , 0 , δ x y .
Let d ˜ t be the weighted planar direction produced from the current pair geometry and d t = d ˜ t / ∥ d ˜ t ∥ 2 when its norm is nonzero. Let ψ t be the controlled participant’s yaw. The residual is
Δ a t res = ρ t d t , x ρ t d t , y clip wrap atan 2 ( d t , y , d t , x ) − ψ t , − δ yaw , δ yaw .
The scalar δ base = 0.62 δ x y preserves modulation headroom. The style factor changes residual magnitude with assertiveness and courtesy. The attribution and coverage factors use target metadata fixed before the campaign, rather than the current occupancy of an online archive. The direction d t combines an AV-facing unit vector with a tangential component. The transfer factor is used only in the additional-signal variant.
The default implementation uses the following:
  • α style ( z ) = max ( 0.45 , min ( 1.05 , 0.60 + 0.32 z assert − 0.16 z courtesy ) ) modulates the residual magnitude by style.
  • α attrib = 1.20 when targeting underexplored event categories, 0.38 otherwise.
  • α cover = 1.25 for empty formal cells, 1.02 for empty pair cells, 0.58 for occupied cells.
  • α isolated = 1.08 when the frozen target metadata marks an isolated trigger, 1.00 otherwise.
  • α transfer = 1.10 when the pair-to-formal signal is present and 0.90 otherwise in Style2Risk. The Style2Risk+ extension uses 1.12 and 0.92 together with the isolated-trigger signal.
  • d ˜ = 0.70 u + 0.30 t when a severe-gap target is new in either the formal- or pair-level frozen metadata, and 0.18 u + 0.82 t otherwise, where u is the unit vector toward the AV’s predicted position and t is the oriented perpendicular tangent. The implementation normalizes d ˜ before applying ρ t .
The rollout implementation constrains both the residual and the composed action:
∥ Δ a x y ∥ 2 ≤ δ x y = 0.15 m ,
| Δ yaw | ≤ δ yaw = 0.04 rad ,
∥ a x y base ∥ 2 ≤ 2.5 m ,
∥ a x y adv ∥ 2 ≤ 2.8 m , | a yaw adv | ≤ 0.40 rad .
Here, Δ a x y contains the two planar residual components. The base and composed actions are clipped to their stated step bounds during rollout, and every activation is counted. In the main protocol, I support = 1 when five conditions hold: mean base-policy self-NLL is at most 20; controlled-agent acceleration and jerk are at most 12 m/s2 and 150 m/s3; the saved Waymax off-road diagnostic does not activate; the residual bound holds; and no feasibility clip is activated. The self-NLL is − log π base ( μ θ ( x t , z ) ∣ x t , z ) averaged over steps. The common trajectory evaluator removes this prior-relative term and applies the same motion and constraint screen to every method. Section 6.6 evaluates alternative residual bounds.

4.5. Style–Interaction–Event Archive

The style–interaction–event archive exposes the structure hidden by an aggregate event count. For the two event classes in the main campaign, the active archive C is a 3 × 3 × 6 × 2 = 108 -cell grid indexed by prescribed assertiveness, prescribed courtesy, interaction type, and event type. Every event that passes the trigger, internal-support, and geometric screens contributes to valid-event yield. Its cell assignment either occupies a new region or increments the duplicate count for a represented region.
The main runner generates all rollouts before constructing the archive. It ranks valid events within each cell and retains at most three exemplars, while the complete rollout rows remain available for event counting. Storage capacity therefore changes the retained examples but not event validity or occupied cells. The online-guidance experiment uses a distinct 135-cell archive, resets it for each planner, and updates it after each rollout so that occupancy can influence the next test action.

5. Experimental Design

5.1. Data and Platform

All configurations use WOMD v1.2.0 validation records and the same Waymax interface, rollout horizon, planners, and trajectory recorder. Dataset construction extracts 30,000 SDC–participant segments from 685 unique WOMD scenarios and assigns complete scenario IDs to 480 training, 99 validation, and 106 test scenarios. These partitions contain 20,785, 4690, and 4525 interaction segments, respectively. All pairs from a scenario remain in one partition. The style encoder and behavior prior use the training partition, and validation loss selects their checkpoints.
The main campaign selects one eligible SDC–participant pair from each of 500 scenarios in this pool. Here, 685 denotes unique scenario records, while 500 is the fixed evaluation subset. Both selected tracks remain valid from initialization through the 20-step rollout. The subset contains 349 training, 71 validation, and 80 test scenario IDs; its stratified selection also uses coverage statistics from an earlier baseline run. This common interaction-rich pool supports the mechanism comparison. Section 5.3 introduces a separate validation set with no model-development or prior-experiment overlap. The interaction-type distribution is given in Table 2.
Table 2. Interaction-type distribution of the main 500-scenario subset. Exactly one controlled SDC–participant pair is selected in each scenario.
Waymax executes 20 closed-loop steps at 0.1 s per step. Three fixed planners control the tested AV. Logged-trajectory reference follows the next recorded WOMD state. Reactive log-braking follows the log and reduces the next-step displacement when the controlled participant is ahead and within 12 m. Cautious gap-braking applies a stronger reduction when the participant is ahead and within 18 m. These planners are deterministic under the recorded scene state; the three seeds affect only stochastic residual variants.

5.2. Main Evaluation Campaign

The main campaign comprises 31,500 closed-loop rollouts: 500 selected scenarios, seven configurations, three planners, and stored seed labels 42, 43, and 44. Each configuration contributes 4500 rollout records. The deterministic configurations produce identical trajectories across the three seed labels. We therefore report planner-level results from the distinct executions and use scenarios, rather than repeated seed files, as the unit of uncertainty. All trajectory metrics are computed from the saved closed-loop trajectories using the definitions in Section 3.

5.3. Pre-Rollout Style and Online-Guidance Validation

The second experiment evaluates style prescription and archive guidance without using future trajectory information. It uses the 26 test scenarios that are absent from the encoder/prior training and validation partitions and from all earlier campaigns. Scenario order is fixed before execution. The controlled participant is selected from its object type and states available through initialization step 10; logged future states, failure outcomes, archive gaps, and earlier method results are not used.
Each scenario receives a prescribed style from a balanced 3 × 3 grid with assertiveness and courtesy levels { 0.2 , 0.5 , 0.8 } . The intended style is fixed before rollout, while realized speed, gap, and deceleration descriptors are measured after execution. Four coefficient-matched configurations pair a no-style or style-conditioned prior with a uniform residual, then add style-modulated residual control without and with online archive guidance. This design isolates the effects of style conditioning, style-modulated probing, and occupancy-aware guidance in 312 rollouts.
For this validation, B = δ x y = 0.15 m is the planar residual budget. The uniform residual has magnitude 0.25 B and normalized direction N ( 0.35 u + 0.65 t ) , where N ( v ) = v / ∥ v ∥ 2 for nonzero v . The style residual has pre-clip magnitude
m z = 0.55 B ( 0.25 + 0.75 A ) ( 1 − 0.35 C )
and normalized direction N ( ( 0.45 + 0.25 A ) u + ( 0.55 − 0.25 A ) t ) , where A and C are prescribed assertiveness and courtesy. The online-guidance configuration multiplies m z by 1.18 when its intended-style/pre-context target has not appeared among earlier protocol-valid events for that planner, and by 0.85 otherwise. The archive starts empty and is reset for each planner; it is updated only after the current rollout is evaluated. Its 135 cells are the product of three intended-assertiveness bins, three intended-courtesy bins, three pre-rollout context bins, and five prioritized primary-event classes. All four configurations use the same fixed evaluator, which does not call either behavior prior. It reports kinematic, collision, saved Waymax off-road, interaction-consistency, conflict-geometry, deceleration, and constraint-activation metrics.

5.4. Method Configurations

Seven mechanism variants compare how the implemented policy branches change the main campaign. Their residual modules use branch-specific coefficients and direction weights, so the sequence shows where performance changes occur but is not a coefficient-matched ablation. The four-configuration pre-rollout validation provides the factor-isolated comparison.
  • Strict no-style: no style conditioning in the behavior prior or residual action; all residual factors are neutral.
  • Style base + uniform reactive residual: a style-conditioned prior with a reactive residual that is not modulated by style.
  • Style residual: the style-only magnitude and direction rule.
  • Style + attribution: the style–attribution rule for severe-gap versus other targets.
  • Style + coverage: the style–coverage rule using static formal/pair-gap metadata.
  • Style2Risk: the proposed style–attribution–coverage configuration with pair-to-formal scaling.
  • Style2Risk+: an extended configuration that adds isolated-trigger and strengthened pair-to-formal factors.
The strict no-style configuration uses a separately trained state-only Gaussian prior and a fixed low-strength residual. Configuration (2) restores the style-conditioned prior while retaining that residual. The remaining rows progressively add style modulation, attribution, coverage, and the optional additional signals. The residual factors and branch definitions are specified in Section 4.4 and Appendix A.
The development-stage matched comparison adds three same-interface controls on a 50-scenario subset for each planner. Let B = 0.15 m, let N normalize a nonzero planar vector, and let d be pair distance. Their implemented residuals are
ρ uniform = 0.25 B , d uniform = N ( 0.35 u + 0.65 t ) ,
θ ∼ U [ − π , π ] , r ∼ U [ 0.25 , 1 ] , ρ random = r B , d random = [ cos θ , sin θ ] ⊤ ,
q = clip ( ( 12 − d ) / 12 , 0 , 1 ) , ρ risk = 0.78 B ( 0.70 + 0.30 q ) , d risk = u ,
ρ post = B , d post = N ( 0.88 u + 0.12 t ) .
All controls use the common yaw bound. The post hoc control applies full-strength pressure before the after-rollout screen. This 50-scenario development subset is used to compare residual behavior under a matched interface; the 500-scenario campaign and the separate 26-scenario validation provide the main evidence.

5.5. Metrics

The evaluation reports raw triggers, protocol-valid events, novel and duplicate events, stored exemplars, occupied cells, collision outcomes, action and dynamics diagnostics, and style sensitivity. The internal-support pass rate contains the generating prior’s self-NLL and measures compliance with the main testing protocol. Motion quality is evaluated separately with the common trajectory evaluator. We retain the internal composite ENFDR × r support × r geo only as a compact summary of that protocol’s operating point.
ENFDR divides the number of distinct formal cells by the unique-scenario budget of the stated unit. In the main campaign, 33 cells give 33 / 500 = 0.066 . The same result is reported as 33 raw cells, 33 / 108 = 0.306 active-grid coverage, and 33 / 4500 = 0.0073 cells per stored method rollout. Campaign-level ENFDR and the 50-scenario development value are reported separately because they use different scenario budgets.

5.6. Statistical Analysis

The design is paired by scenario: every configuration is evaluated on the same selected scenes under each planner. We report planner-specific point estimates and treat the three planners as fixed tested systems rather than exchangeable replicates. Deterministic seed copies are collapsed before uncertainty analysis. For the headline contrasts, we average planner-specific method differences within each scenario and apply a scenario-level paired bootstrap and sign-permutation test. Archive unions are recomputed within 10,000 scenario-bootstrap samples. The Style2Risk-minus-strict archive gain is five cells with a 95% percentile interval of [ 2 , 7 ] . For online guidance, the one-cell point difference has an interval of [ 0 , 1 ] . Five hundred shuffled scenario orders quantify partial-budget discovery; the complete 500-scenario union is order-invariant.

5.7. Computational Scope

The campaign contains 63,000 s of simulated interaction (31,500 rollouts × 2.0 s). The experiments ran on NVIDIA Corporation (Santa Clara, CA, USA) A100-SXM4-80GB GPUs, with one JAX CUDA device assigned to each experiment chunk. Recorded chunk times total 88,318 s, or 24.53 A100 GPU-hours, corresponding to a coarse campaign average of 2.80 s per rollout. The common trajectory evaluator required 595.7 s and 1880.5 MiB (1.84 GiB) maximum resident CPU memory. At each step, the fixed-width behavior prior and constant-size residual factor chain have O ( 1 ) cost with respect to campaign size. Archive assignment is O ( 1 ) per event, followed by linear aggregation over rollout rows.

6. Results

The results test three questions. First, does style-conditioned interaction control produce more protocol-valid safety-critical evidence than no-style control? Second, does the additional yield extend archive coverage rather than only repeat represented events? Third, does the motion remain competitive under a trajectory evaluator shared by all configurations? Mechanism comparisons and the pre-rollout validation then examine where these effects arise.

6.1. Style2Risk Increases Valid-Event Yield and Archive Breadth

Style2Risk produces substantially more safety-critical events that satisfy the main testing protocol. Relative to strict no-style, the mean valid-event count rises from 110.0 to 258.0 per 500-scenario planner chunk. The internal-support pass rate rises from 0.386 to 0.901, and the geometric-screen pass rate rises from 0.951 to 0.987. The support rate measures compliance with the implemented behavior-prior and motion constraints; Section 6.2 evaluates motion quality with a common prior-independent protocol. Figure 2 and Table 3 summarize these campaign-level results.
Figure 2. Main comparison across strict no-style (NS), style base with a uniform residual (SB), Style2Risk (S2R), and Style2Risk+ (S2R+). The panels show complementary views of testing performance: archive breadth, protocol-valid event yield, and internal-support compliance.
Table 3. Main WOMD–Waymax campaign (31,500 stored rollouts). ENFDR and cells are campaign-union quantities normalized by 500 unique scenarios; Valid, Support, Geo., Duplicate, and Composite are means over the three distinct planners after deterministic seed copies are collapsed.
The additional yield is accompanied by a measurable expansion of formal discovery breadth. ENFDR increases from 0.056 to 0.066, and the campaign union grows from 28 to 33 occupied cells. These values correspond to 25.9% and 30.6% of the 108-cell active grid, or 0.0062 and 0.0073 occupied cells per 4500 rollout evaluations. The duplicate rate also rises from 0.745 to 0.872. Style2Risk therefore reaches new archive regions while continuing to revisit several exposed regions, which is precisely the distinction that aggregate event counts cannot show.
The style-conditioned prior already increases the mean valid-event count from 110.0 to 173.3 when paired with a uniform residual. Adding style-modulated probing, attribution, and coverage produces the 258.0-event result and the five-cell expansion. Style2Risk+ reaches the same 33-cell union with 256.7 valid events and a 0.898 internal-support pass rate. These results place the main transition in the style-conditioned and style-modulated branches rather than in the optional additional signals.
Table 4 summarizes the same result by event yield, protocol compliance, discovery breadth, and search concentration.
Table 4. Complementary testing outcomes for strict no-style and Style2Risk in the 500-scenario campaign. Planner-level quantities collapse identical deterministic executions.

6.2. Motion Quality Under a Common Trajectory Evaluator

Style2Risk retains stronger motion quality than strict no-style when both are assessed by the same trajectory evaluator. Across the 500 paired scenarios, joint ADE decreases by 1.343 m (95% paired-bootstrap CI [ 1.199 , 1.488 ] ), joint speed MAE decreases by 1.464 m/s [ 1.285 , 1.646 ] , interaction consistency increases by 0.163 [ 0.143 , 0.182 ] , collision rate decreases by 0.037 [ 0.021 , 0.055 ] , and the common-evaluator pass rate increases by 0.587 [ 0.537 , 0.637 ] . Scenario-level sign-permutation tests give p < 0.0001 for the headline contrasts. Table 5 reports the corresponding values for each tested planner.
Table 5. Motion quality under a common trajectory evaluator in the 500-scenario campaign. Panel (a) reports trajectory and interaction outcomes; Panel (b) reports motion extrema and a saved Waymax off-road diagnostic. All rows use the same frozen common trajectory evaluator.
The evaluator also reports displacement, final displacement, speed, acceleration, jerk, minimum distance, relative speed, conflict geometry, deceleration, and action-constraint activations. The saved Waymax off-road flag activates in 3/500 rollouts for both methods under every planner. We report it as a diagnostic, not as an independently reconstructed roadgraph metric or an official WOSAC off-road score; map-compliance scope is discussed in Section 8.
Table 6 uses realized post-rollout style for archive assignment. For every planner–method pair, protocol-valid events equal novel plus duplicate events, and they also equal stored plus capacity-rejected events. These counts complement the main 110/258 comparison because they use realized style and the common trajectory screen.
Table 6. Event accounting under the common trajectory screen and realized-style archive. Archive capacity controls exemplar storage while protocol-valid yield counts all events that pass the screen.
The order-dependent discovery curves are shown in Figure 3.
Figure 3. Realized-style archive discovery versus rollout budget. Lines are means over 500 shuffled scenario orders; bands are 95% empirical intervals. The final union is order-invariant, whereas partial-budget discovery depends on order.
Style2Risk discovers archive regions faster than strict no-style in the early rollout budget. At 100 rollouts, it reaches 25.8 cells [ 20.0 , 31.0 ] for the logged reference, 27.9 [ 22.0 , 33.0 ] for the reactive planner, and 28.9 [ 23.5 , 35.0 ] for the cautious planner. Strict no-style reaches 10.2 [ 6.0 , 14.0 ] , 10.8 [ 6.0 , 16.0 ] , and 11.1 [ 6.0 , 17.0 ] , respectively. At the full budget, the order-invariant unions are 58, 63, and 65 cells for Style2Risk, compared with 30, 31, and 33 for strict no-style.

6.3. Style-Interaction Archive Coverage and Concentration

Style2Risk reaches five formal cells that are absent under strict no-style. This increases active-grid coverage from 28 cells (25.9%) to 33 cells (30.6%). A 10,000-replicate scenario bootstrap gives a five-cell difference with a 95% percentile interval of [ 2 , 7 ] . Figure 4 locates the additional cells in the 3 × 3 × 6 × 2 = 108 -cell archive, and Table 7 connects each cell to its source scenario and realized conflict geometry.
Figure 4. Projection of the five archive cells reached by Style2Risk but not by strict no-style in the 500-scenario campaign. Each entry reports the number of additional cells in an assertiveness–courtesy bin and the corresponding interaction type. All five carry the original severe-near-miss label; three remain valid under the common trajectory protocol.
Table 7. Realized trajectory characteristics of the five formal cells reached by Style2Risk but not by strict no-style. Each row corresponds to one unique source scenario. The final column reports the result under the common trajectory protocol.
The five cells span all three assertiveness levels, two courtesy levels, and five interaction types. All five carry the severe-near-miss label assigned by the original archive, and each comes from a different source scenario. Under the common trajectory protocol, three source scenarios remain valid severe near misses and two fail the screen. The distance, relative-speed, and angle columns summarize the nominated controlled-participant–AV pair; they do not re-establish the original archive label by themselves. The five-cell result therefore represents broader formal style–interaction coverage, complemented by the independently screened outcomes and the realized-space analysis below.
Realized trajectory features provide a second view of diversity. Across the seven configurations at canonical seed 42, 4275 planner-level valid events arise from 332 unique scenarios. The physical representation combines minimum distance, relative speed and angle at conflict, both agents’ maximum deceleration, interaction-distance error, and relative-speed error. Style2Risk contributes 757 events from 255 scenarios and covers 25 physical clusters and 258 spatiotemporal clusters; strict no-style contributes 201 events from 67 scenarios, 22 physical clusters, and 70 spatiotemporal clusters. These summaries complement the categorical archive by describing realized motion and event location.

6.4. Contribution of Style-Conditioned Interaction Control

Style conditioning and style-modulated probing account for most of the observed transition. Replacing the state-only prior with the style-conditioned prior while retaining the uniform residual raises the mean valid-event count from 110.0 to 173.3 and the internal-support pass rate from 0.386 to 0.567, while the union remains at 28 cells. Adding the style residual produces the largest adjacent archive step: ENFDR rises by 0.008 and the union expands by four cells. Attribution and coverage then reach the 33-cell result used by Style2Risk. Because these mechanism variants retain their implemented branch coefficients, the sequence localizes the transition; the coefficient-matched validation in Section 6.5 isolates the contribution of online guidance. The mechanism sequence is shown in Figure 5 and summarized in Table 8.
Figure 5. Mechanism comparison across seven configurations: NS (no style), SB (style base), SR (style residual), SA (style with attribution), SC (style with coverage), Style2Risk (S2R), and Style2Risk+ (S2R+). The sequence shows how each design stage changes archive breadth and protocol compliance.
Table 8. Mechanism-variant comparison in the main campaign. Rows use their implemented branch coefficients; the separate pre-rollout experiment provides the coefficient-matched factor comparison.
The same-interface controls support the role of style-conditioned probing. Figure 6 places the style-aware configurations at higher internal-support pass rates without reducing scenario-normalized occupancy, while Figure 7 shows nonzero sensitivity in both base and final action means. On the matched development subset, Style2Risk records ENFDR 0.527, 26.3 occupied cells, 33.3 valid events, and an internal composite of 0.499; the risk-only residual records 0.473, 23.7, 30.7, and 0.389. Figure 8 and Table 9 provide the full comparison.
Figure 6. Internal operating plane and attribution summary for the 500-scenario campaign. Configuration abbreviations follow Figure 5. The left panel relates archive discovery to internal-support compliance; the right panel separates events involving the controlled agent from other or joint events.
Figure 7. Style-input sensitivity and duplicate-rate analysis in the 500-scenario campaign. Sensitivity measures how strongly the controller responds to the supplied style input, while duplicate rate quantifies repeated valid events within already represented archive regions.
Figure 8. Internal operating points on the matched WOMD–Waymax development subset. The vertical coordinate is scenario-normalized archive occupancy, and the horizontal coordinate is the internal-support pass rate.
Table 9. Development-stage same-platform controls on the matched WOMD–Waymax subset. Values are means over three planners on the same 50 scenarios; deterministic seed copies are collapsed. Support and Composite are internal protocol quantities.
All controls use the same scenarios, planner interface, rollout horizon, protocol screen, and aggregation code. The alternatives apply generic bounded residuals, distance-directed residuals without style conditioning, or full-strength risk pressure followed by post-rollout screening.

6.5. Pre-Rollout Style and Online Archive Guidance

The 26-scenario validation shows that the Style2Risk control variables can be assigned before rollout and that archive occupancy can be used online. All 312 rollouts completed without scenario replacement. The balanced design has mean intended assertiveness and courtesy of 0.488. Across the four configurations, realized assertiveness/courtesy changes from 0.557/0.435 for the no-style prior with uniform residual to 0.596/0.409 for the complete guidance configuration, showing that the prescribed input produces a measurable change in executed interaction behavior.
The point estimate is one additional occupied cell without an increase in event yield. Guidance-off and guidance-on each produce 14 protocol-valid events per planner, while occupancy changes from 12/135 (8.89%) to 13/135 (9.63%). The scenario-bootstrap interval for this point difference is [ 0 , 1 ] . Raw triggers, common-evaluator pass counts, valid-event counts, and collision counts remain unchanged. Table 10 reports the complete four-configuration comparison.
Table 10. Pre-rollout style and online-guidance validation on 26 held-out test scenarios. Each planner uses one deterministic execution and the same common trajectory evaluator.
The coefficient-matched transitions clarify the role of each component. Adding the style residual increases valid-event yield by 0.077 per scenario [ 0.000 , 0.192 ] and expands the planner archive to 12 cells. The subsequent online-guidance step changes the discovery breadth rather than the event count, reaching 13 cells with the same 14-event yield. Its joint ADE changes by 0.040 m [ 0.016 , 0.064 ] , while interaction consistency changes by − 0.003   [ − 0.007 , 0.002 ] . Table 10 reports the complete trajectory and collision measurements under the common evaluator.
The 312 rollouts require 919.0 s of sequential-equivalent planner time, corresponding to a coarse 2.95 s per rollout. This targeted validation supports pre-rollout style control and online archive use; the larger campaign remains the primary evaluation of event yield and archive breadth.

6.6. Sensitivity and Indicator Consistency

The method ordering is stable within the evaluated local sensitivity slice. Table 11 and Figure 9 compare conservative, default, and relaxed bounds on the reactive-planner seed-42 subset. A separate weighting sweep recomputes ENFDR from the archived cells without changing the rollout outcomes.
Table 11. Residual-bound sensitivity for the risk-only residual and Style2Risk configurations. Support and Composite are internal protocol quantities.
Figure 9. Residual-bound sensitivity for Style2Risk and the risk-only residual across conservative, default, and relaxed trust-region settings. The horizontal coordinate is the internal-support pass rate.
Across all three bound profiles, Style2Risk keeps ENFDR at 0.520 and occupies 26 cells; its internal-support pass rate ranges from 0.940 to 0.960. The risk-only residual reaches ENFDR values of 0.500, 0.480, and 0.480, while its support-screen pass rate decreases from 0.900 to 0.840 as the bound is relaxed. The weighting sweep gives the same ordering within this subset. For w occupied = 0.1 , 0.3 , 0.5 , 1.0 , Style2Risk obtains weighted ENFDR values of 0.026, 0.034, 0.041, and 0.060. The corresponding risk-only values are 0.021, 0.028, 0.036, and 0.053.
The indicator bins follow the ordering built into their trajectory-derived definitions. Table 12 and Table 13 compare speed maintenance, accepted gap, yielded gap, deceleration onset, and smoothness across the low, mid, and high bins.
Table 12. Assertiveness indicator behavior statistics.
Table 13. Courtesy indicator behavior statistics.
Higher assertiveness increases speed maintenance from 0.529 to 0.909 and 1.222, while accepted gap decreases from 30.5 m to 27.5 m and 27.3 m. The mean controlled-agent Δ x proxy becomes more negative across the three bins ( − 0.107 , − 0.149 , and − 0.470 m/step). Higher courtesy increases yielded gap from 16.9 m to 31.4 m and 51.6 m. Deceleration smoothness rises from 0.127 to 0.194 and 0.244, while the SDC Δ x response decreases from 0.607 to 0.286 and 0.218 m/step. These displacement-action proxies are not acceleration measurements. The trends are an internal consistency check because several reported quantities also contribute to the proxy construction.

7. Discussion

7.1. How Style Conditioning Increases Event Yield

Style2Risk gains most of its testing capacity before the optional guidance signals are added. The style-conditioned prior raises valid-event yield from 110.0 to 173.3 while using the same uniform residual, which shows that the behavioral starting point matters. Style-modulated probing then produces the largest adjacent archive change, reaching 251.0 valid events and 32 cells. Attribution and coverage complete the proposed configuration at 258.0 events and 33 cells. The sequence supports the central design: style controls the interaction regime, and the bounded residual turns that regime into targeted pressure on the planner.
The common trajectory evaluator strengthens this interpretation. Style2Risk lowers joint ADE by 1.343 m, increases interaction consistency by 0.163, and lowers collision rate by 0.037 relative to strict no-style. These comparisons use the same evaluator for both methods and do not depend on the behavior prior’s likelihood. Together with the nonzero base- and final-action sensitivity, they show that style conditioning changes the controller in a predictable way while retaining stronger motion quality under the common protocol.

7.2. The Archive Reveals Discovery Breadth and Repetition

Event yield and archive occupancy describe different properties of a testing campaign. Style2Risk more than doubles the mean protocol-valid event count, but the occupied-cell union grows by five cells. The accompanying increase in duplicate rate shows why both quantities are needed: the method reaches additional style–interaction regions and also returns frequently to already exposed regions. A raw event count would combine these two effects.
The added cells cover three assertiveness levels, two courtesy levels, and five interaction types. All five contain severe near misses, so their contribution is broader conditional coverage rather than additional event classes. Realized-space clustering provides a complementary view: Style2Risk covers more physical and spatiotemporal clusters than strict no-style, although those totals also grow with the number of events. Scenario lineage, formal cells, and realized trajectory features together give a more informative account of discovery than any one diversity measure alone.

7.3. Implications for Closed-Loop AV Testing

Style2Risk makes interaction style a test input rather than a label applied only after simulation. The pre-rollout validation shows that assertiveness and courtesy can be prescribed without future trajectory access and remain reflected in realized behavior. Online archive guidance then changes the occupied-cell point estimate from 12 to 13 per planner while leaving event yield fixed. This targeted experiment demonstrates how the same interface can support sequential coverage-aware testing, while the larger campaign provides the primary evidence on event yield and archive coverage.
The system also improves traceability. Each rollout preserves the style input, base action, residual action, screen decisions, event class, and archive address. Direct controlled-pair events can be separated from effects propagated through surrounding traffic. The controller requires fixed-width policy inference and a constant-size residual chain, and the 31,500-rollout campaign uses 24.53 A100 GPU-hours. These properties make Style2Risk suitable for controlled simulation campaigns in which the behavior being tested, the planner-facing intervention, and the resulting safety-critical evidence must remain distinguishable.

8. Limitations

The present evaluation uses WOMD records in Waymax and three fixed rule-based or trajectory-guided planners. The 500-scenario campaign is designed for controlled mechanism comparison on an interaction-rich pool. The separate 26-scenario validation evaluates the same design on previously unused scenarios and one rollout stream fixed before execution; its one-cell point difference is not a test of cross-order stability. Future work should test learned planning stacks, other simulators, and additional traffic domains.
The main campaign treats assertiveness and courtesy as prescribed conditions derived from complete logged interactions. The 26-scenario experiment complements this design by prescribing style entirely from pre-rollout information. Both studies use trajectory-derived interaction proxies rather than human driving-style annotations. Learning style from online observations and validating it against human judgments remain open directions.
The internal-support and common trajectory protocols answer different questions. The first evaluates the declared behavior-prior, action, and motion constraints. The second removes prior likelihood and compares trajectories under one shared evaluator. Adding an independently reconstructed roadgraph metric or official WOSAC off-road score, together with a counterfactual avoidability search, would broaden the physical validity assessment.
The experiments compare same-interface controls so that behavior-prior and residual mechanisms remain identifiable. Broader comparisons with external testing systems require a shared planner and simulator interface. The current sensitivity study covers residual and yaw bounds; a larger coefficient study could further characterize the style, attribution, coverage, and direction factors. The protocol and configuration choices used for the reported comparisons are specified in the main text and Appendix A.

9. Conclusions

Style2Risk introduces an interpretable style-conditioned adversarial interaction mechanism for closed-loop AV testing. Assertiveness and courtesy control a learned behavior prior, and a bounded residual converts that behavior into targeted pressure on the tested planner. A style–interaction–event archive then records where protocol-valid safety-critical events occur and whether later rollouts expand or repeat the represented regions.
In the 31,500-rollout WOMD–Waymax mechanism comparison, Style2Risk increases protocol-valid events from 110.0 to 258.0 per planner chunk and expands the formal archive from 28 to 33 occupied cells relative to strict no-style. Under a common trajectory evaluator, Style2Risk reduces joint displacement error by 1.343 m, improves interaction consistency by 0.163, and reduces collision rate by 0.037. The separate pre-rollout experiment further shows that style can be assigned without future trajectory access. In its fixed stream, online guidance produces a one-cell occupancy point difference without changing event yield.
These results support interaction style as a practical control variable for closed-loop safety testing in the evaluated setting. By separating behavior generation, bounded planner probing, and archive-based discovery analysis, Style2Risk produces targeted testing evidence whose behavioral condition, physical execution, and discovery structure remain visible. Extending this interface to learned planners and broader traffic domains offers a direct path toward more comprehensive interactive AV evaluation.

Author Contributions

Conceptualization, J.L., S.L., M.W., and C.M.; methodology, J.L., S.L., M.W., and S.H.; validation, J.L., S.L., M.W., Z.Z., Y.G., S.H., and C.M.; formal analysis, J.L., S.L., M.W., Z.Z., Y.G., S.H., and C.M.; investigation, J.L., S.L., M.W., Z.Z., and Y.G.; data curation, J.L., S.L., Z.Z., and Y.G.; writing—original draft preparation, J.L. and S.L.; writing—review and editing, J.L., S.L., M.W., Z.Z., Y.G., S.H., C.M., and S.G.; visualization, J.L., S.L., S.H., and S.G. All authors have read and agreed to the published version of the manuscript.

Funding

This paper is partially supported by the National Natural Science Foundation of China (No. 52502406). This work is supported by the Zhongguancun Academy (Grant No. JC2605003). This paper is also partially supported by the Shanghai Science and Technology Plan Project (No. 25ZR1402500), Shanghai Automotive Industry Science and Technology Development Foundation (No. 2617), and the Postdoctoral Fellowship Program of CPSF (No. GZB20240541).

Institutional Review Board Statement

Not applicable.

Data Availability Statement

This study uses the publicly available Waymo Open Motion Dataset (WOMD), available at https://waymo.com/open/ (accessed on 24 August 2026), and the Waymax simulator, whose source code is available at https://github.com/waymo-research/waymax (accessed on 24 August 2026). WOMD records and map assets are not redistributed and must be obtained under the dataset’s terms.

Acknowledgments

The authors thank all collaborators and institutions that supported this research.

Conflicts of Interest

The authors declare no conflicts of interest.

Abbreviations

AVAutomated Vehicle
DRACDeceleration Rate to Avoid Collision
ENFDREffective Normalized Failure Discovery Rate
FiLMFeature-wise Linear Modulation
PETPost-Encroachment Time
TTCTime-to-Collision
WOMDWaymo Open Motion Dataset
WOSACWaymo Open Sim Agents Challenge

Appendix A. Supplementary Paired Comparison and Mechanism Pilot

Table A1 compares Style2Risk+ with the primary configurations under the same aggregation used in the main text. Figure A1 reports the development-stage mechanism pilot.
Table A1. Supplementary comparison for Style2Risk+. ENFDR is a campaign-level difference; the remaining values are differences between distinct-planner means after deterministic seed copies are collapsed.
Figure A1. A 100-scenario mechanism study using the configuration abbreviations in Figure 5. The results show how style conditioning, residual modulation, attribution, and coverage affect event attribution and archive discovery.

Appendix B. Model Architecture Details

Table A2 lists the architectural hyperparameters of the style encoder and behavior prior.
Table A2. Model architecture summary.

Appendix C. Coverage Archive Cell Definitions

The main archive uses three assertiveness bins: low [ 0 , 0.33 ) , mid [ 0.33 , 0.67 ) , and high [ 0.67 , 1.0 ] . Courtesy uses the same boundaries. Its six interaction types are unprotected intersection, merge, lane-change competition, following pressure, yield/gap acceptance, and other. Its two active event classes are collision and severe near miss, giving 3 × 3 × 6 × 2 = 108 cells. The online-guidance archive uses three intended-assertiveness bins, three intended-courtesy bins, three pre-rollout context bins, and five prioritized event classes: collision, severe near miss, trajectory conflict, hard braking, and deadlock. Its active grid is 3 × 3 × 3 × 5 = 135 cells.

Appendix D. Reproducibility Checklist

Table A3 and Table A4 record the data, execution, screening, accounting, and reporting settings used in the analyses.
Table A3. Reproducibility checklist: data and execution settings.
Table A4. Reproducibility checklist: protocol and reporting settings.

References

  1. Kalra, N.; Paddock, S.M. Driving to Safety: How Many Miles of Driving Would It Take to Demonstrate Autonomous Vehicle Reliability? Transp. Res. Part A Policy Pract. 2016, 94, 182–193. [Google Scholar] [CrossRef] [Scilit]
  2. Koopman, P.; Wagner, M. Autonomous Vehicle Safety: An Interdisciplinary Challenge. IEEE Intell. Transp. Syst. Mag. 2017, 9, 90–96. [Google Scholar] [CrossRef] [Scilit]
  3. Wang, J.; Pun, A.; Tu, J.; Manivasagam, S.; Sadat, A.; Casas, S.; Ren, M.; Urtasun, R. AdvSim: Generating Safety-Critical Scenarios for Self-Driving Vehicles. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, 20–25 June 2021; pp. 9909–9918. [Google Scholar] [CrossRef] [Scilit]
  4. Rempe, D.; Philion, J.; Guibas, L.J.; Fidler, S.; Litany, O. Generating Useful Accident-Prone Driving Scenarios via a Learned Traffic Prior. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), New Orleans, LA, USA, 18–24 June 2022; pp. 17305–17315. [Google Scholar] [CrossRef] [Scilit]
  5. Hanselmann, N.; Renz, K.; Chitta, K.; Bhattacharyya, A.; Geiger, A. KING: Generating Safety-Critical Driving Scenarios for Robust Imitation via Kinematics Gradients. In Proceedings of the Computer Vision–ECCV 2022; Lecture Notes in Computer Science; Springer: Cham, Switzerland, 2022; Volume 13698, pp. 335–352. [Google Scholar] [CrossRef] [Scilit]
  6. Feng, S.; Yan, X.; Sun, H.; Feng, Y.; Liu, H.X. Intelligent Driving Intelligence Test for Autonomous Vehicles with Naturalistic and Adversarial Environment. Nat. Commun. 2021, 12, 748. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  7. Feng, S.; Sun, H.; Yan, X.; Zhu, H.; Zou, Z.; Shen, S.; Liu, H.X. Dense Reinforcement Learning for Safety Validation of Autonomous Vehicles. Nature 2023, 615, 620–627. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  8. Zhang, L.; Peng, Z.; Li, Q.; Zhou, B. CAT: Closed-Loop Adversarial Training for Safe End-to-End Driving. In Proceedings of the 7th Conference on Robot Learning; PMLR (Proceedings of Machine Learning Research): Cambridge, MA, USA, 2023; Volume 229, pp. 2357–2372. [Google Scholar]
  9. Suo, S.; Regalado, S.; Casas, S.; Urtasun, R. TrafficSim: Learning to Simulate Realistic Multi-Agent Behaviors. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Nashville, TN, USA, 20–25 June 2021; pp. 10400–10409. [Google Scholar] [CrossRef] [Scilit]
  10. Zhang, Z.; Liniger, A.; Dai, D.; Yu, F.; Van Gool, L. TrafficBots: Towards World Models for Autonomous Driving Simulation and Motion Prediction. In Proceedings of the IEEE International Conference on Robotics and Automation (ICRA), London, UK, 29 May–2 June 2023; pp. 1522–1529. [Google Scholar] [CrossRef] [Scilit]
  11. Gulino, C.; Fu, J.; Luo, W.; Tucker, G.; Bronstein, E.; Lu, Y.; Harb, J.; Pan, X.; Wang, Y.; Chen, X.; et al. Waymax: An Accelerated, Data-Driven Simulator for Large-Scale Autonomous Driving Research. In Proceedings of the Advances in Neural Information Processing Systems 36, New Orleans, LA, USA, 10–16 December 2023. [Google Scholar] [CrossRef] [Scilit]
  12. Montali, N.; Lambert, J.; Mougin, P.; Kuefler, A.; Rhinehart, N.; Li, M.; Gulino, C.; Emrich, T.; Yang, Z.; Whiteson, S.; et al. The Waymo Open Sim Agents Challenge. In Proceedings of the Advances in Neural Information Processing Systems 36, New Orleans, LA, USA, 10–16 December 2023; pp. 59151–59171. [Google Scholar] [CrossRef] [Scilit]
  13. Ettinger, S.; Cheng, S.; Caine, B.; Liu, C.; Zhao, H.; Pradhan, S.; Chai, Y.; Sapp, B.; Qi, C.R.; Zhou, Y.; et al. Large Scale Interactive Motion Forecasting for Autonomous Driving: The Waymo Open Motion Dataset. In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Montreal, QC, Canada, 10–17 October 2021; pp. 9710–9719. [Google Scholar] [CrossRef] [Scilit]
  14. Caesar, H.; Bankiti, V.; Lang, A.H.; Vora, S.; Liong, V.E.; Xu, Q.; Krishnan, A.; Pan, Y.; Baldan, G.; Beijbom, O. nuScenes: A Multimodal Dataset for Autonomous Driving. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Seattle, WA, USA, 13–19 June 2020; pp. 11621–11631. [Google Scholar] [CrossRef] [Scilit]
  15. Krajewski, R.; Bock, J.; Kloeker, L.; Eckstein, L. The highD Dataset: A Drone Dataset of Naturalistic Vehicle Trajectories on German Highways for Validation of Highly Automated Driving Systems. In Proceedings of the 21st IEEE International Conference on Intelligent Transportation Systems (ITSC), Maui, HI, USA, 4–7 November 2018; pp. 2118–2125. [Google Scholar] [CrossRef] [Scilit]
  16. Ding, W.; Xu, C.; Arief, M.; Lin, H.; Li, B.; Zhao, D. A Survey on Safety-Critical Driving Scenario Generation—A Methodological Perspective. IEEE Trans. Intell. Transp. Syst. 2023, 24, 6971–6988. [Google Scholar] [CrossRef] [Scilit]
  17. Zhong, Z.; Tang, Y.; Zhou, Y.; de Oliveira Neves, V.; Liu, Y.; Ray, B. A Survey on Scenario-Based Testing for Automated Driving Systems in High-Fidelity Simulation. arXiv 2021, arXiv:2112.00964. [Google Scholar] [CrossRef] [Scilit]
  18. Wang, C.; Kong, L.; Tamborski, M.; Albrecht, S.V. HAD-Gen: Human-Like and Diverse Driving Behavior Modeling for Controllable Scenario Generation. Accid. Anal. Prev. 2025, 223, 108270. [Google Scholar] [CrossRef] [Scilit] [PubMed]
  19. Zhan, W.; Sun, L.; Wang, D.; Shi, H.; Clausse, A.; Naumann, M.; Kummerle, J.; Konigshof, H.; Stiller, C.; de La Fortelle, A.; et al. INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Maps. arXiv 2019, arXiv:1910.03088. [Google Scholar] [CrossRef] [Scilit]
  20. Cui, J.; Liang, F.; Yang, G.; Tang, C.; Cui, J. SaFeR: Safety-Critical Scenario Generation for Autonomous Driving Test via Feasibility-Constrained Token Resampling. arXiv 2026, arXiv:2603.04071. [Google Scholar] [CrossRef] [Scilit]
  21. Ruan, Q.; Wang, Y.; Li, H.; Li, Z.; Xu, C.Z. ScenePilot: Controllable Boundary-Driven Critical Scenario Generation for Autonomous Driving. In Proceedings of the 43rd International Conference on Machine Learning; PMLR (Proceedings of Machine Learning Research): Cambridge, MA, USA, 2026; Volume 306. [Google Scholar]
  22. Feng, S.; Feng, Y.; Yu, C.; Zhang, Y.; Liu, H.X. Testing Scenario Library Generation for Connected and Automated Vehicles, Part I: Methodology. IEEE Trans. Intell. Transp. Syst. 2021, 22, 1573–1582. [Google Scholar] [CrossRef] [Scilit]
  23. Laurent, T.; Klikovits, S.; Arcaini, P.; Ishikawa, F.; Ventresque, A. Parameter Coverage for Testing of Autonomous Driving Systems under Uncertainty. ACM Trans. Softw. Eng. Methodol. 2023, 32, 58:1–58:31. [Google Scholar] [CrossRef] [Scilit]
  24. Mouret, J.B.; Clune, J. Illuminating Search Spaces by Mapping Elites. arXiv 2015, arXiv:1504.04909. [Google Scholar] [CrossRef] [Scilit]
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.