1. Introduction
Event cameras have demonstrated strong potential in robotic navigation and SLAM [
1,
2,
3], autonomous driving [
4,
5,
6], and high-speed tracking [
7,
8,
9]. Unlike frame-based cameras, event sensors asynchronously report per-pixel brightness changes as a stream of events, enabling microsecond-level temporal resolution, low latency, and high dynamic range. These properties make event cameras particularly attractive for fast motion and challenging lighting conditions, where conventional cameras often suffer from motion blur and under-/over-exposure. Event-based vision has rapidly evolved from early sensor prototypes to a mature research field with a broad algorithmic ecosystem; comprehensive overviews can be found in the surveys by Gallego et al. and Liu et al. [
10,
11].
Despite these advantages, the differential sensing mechanism of event cameras [
12] makes event streams inherently susceptible to noise, including background activity, thermal noise, and hot pixels. This noise is not simply additive, it is sparse, temporally irregular, and can be spatially concentrated, which severely degrades downstream tasks such as motion estimation and reconstruction. As a result, reliably separating real events caused by scene dynamics from sensor noise has become a fundamental problem in event-based vision [
13].
Existing denoising methods can be broadly divided into rule-based filtering and learning-based approaches. Rule-based filters typically rely on handcrafted priors, such as spatiotemporal density or clustering cues [
14,
15,
16]. While efficient, they can be brittle in complex scenes where event rates and motion patterns change rapidly. Another line of work formulates denoising as iterative optimization by exploiting global spatiotemporal correlations, often guided by a single dominant cue, e.g., motion consistency [
17,
18] or contrast maximization (CM) [
19]. However, relying on a single cue can lead to failure modes. CM-based models may be distracted by spurious high responses after warping, while pure motion-consistency models may discard weak yet valid boundary events in low-texture or low-contrast regions. Deep learning methods [
20,
21,
22,
23] can achieve strong performance on specific benchmarks, but they often require large labeled datasets, introduce substantial model complexity, and may generalize poorly across sensors and operating conditions.
To address these limitations, we propose a multi-level spatiotemporal noise filtering framework, termed MSF, that integrates motion-compensated aggregation with neighborhood-level statistical verification. MSF first estimates a constant 2D optical flow within a window by robust contrast maximization on the image of warped events. The objective combines (i) density-normalized robust contrast to reduce sensitivity to varying event rates, (ii) a polarity-based regularization term to suppress mixed-polarity noise patterns, and (iii) a peak-suppression term to mitigate hot-pixel-induced degeneracy. We optimize the motion parameters using a practical two-stage strategy: coarse grid initialization followed by gradient-ascent refinement. Based on the estimated motion, MSF then performs hierarchical event selection. It extracts highly reliable central events from high-confidence aggregated regions on the warped plane, expands them to local events through joint spatial–temporal–directional–polarity consistency, and finally recovers weak border events using a density-normalized probabilistic support model. This progressive selection preserves coherent motion-induced structures while effectively rejecting background-activity noise.
Experimental results on public datasets show that MSF consistently outperforms representative filtering baselines and improves the reliability of downstream event processing in complex real-world scenarios.
Contributions
The main contributions of this paper are summarized as follows:
We propose MSF, a multi-level joint spatiotemporal denoising framework that progressively separates motion-induced real events from noisy event streams. The method remains robust under diverse motion patterns and illumination conditions.
We introduce a robust CM-based motion estimation objective for event streams. It combines density-normalized robust contrast, polarity regularization, and peak suppression, and it is optimized efficiently via grid initialization followed by gradient ascent.
We design a hierarchical event selection strategy (central–local–border) that integrates motion-compensated aggregation with neighborhood-based spatiotemporal probabilistic support. This enables the effective removal of sparse background noise while preserving weak but valid boundary events.
2. Related Work
From a sensing perspective, event cameras are a representative instance of event-driven sensing, where measurements are reported asynchronously upon sufficiently large signal changes. This paradigm is closely related to the send-on-delta (SoD) strategy, which formalizes threshold-triggered reporting and has been widely discussed beyond vision [
24]. Broader perspectives on event-driven sensing and its perception algorithms in both vision and audition are summarized in [
11], while ref. [
10] provides an extensive survey focused on event-based vision.
Recent studies commonly categorize event camera denoising methods according to their algorithmic principles and the event characteristics they exploit. First, spatiotemporal correlation filtering leverages the continuity and local clustering of genuine events in space and time to suppress random and isolated noise events; representative strategies include local density thresholding and neighborhood-consistency tests, often achieving a favorable balance between detail preservation and real-time efficiency [
25,
26]. Second, graph spectral and graph-learning approaches model events as nodes in a graph with edges encoding spatial/temporal proximity, and then use spectral properties (e.g., the Fiedler vector) to separate sparsely connected noise from structured signal events; this line also includes models that combine graph encoding with temporal convolution and attention, as well as graph convolutional networks that learn event representations for denoising and classification [
27]. Third, deep learning—especially transformer-based architectures—has been adapted to learn complex spatiotemporal dependencies from data, achieving state-of-the-art performance on real-world benchmarks; convolutional and recurrent networks have also been explored to process event streams (or their representations) in an end-to-end manner [
28,
29]. Fourth, cascaded noise-processing pipelines typically apply multi-stage spatial/temporal filtering together with adaptive thresholding to improve signal-to-noise ratio with reduced computational cost, making them attractive for real-time deployment [
30]. Finally, hybrid and bio-inspired frameworks either integrate graph-based features with neural networks to improve robustness and feature fusion, or draw inspiration from biological neural systems (e.g., LIF neurons and their enhanced variants) to achieve energy-efficient, low-latency denoising suitable for neuromorphic hardware [
31,
32,
33,
34]. Overall, this diversity reflects the multifaceted noise characteristics of event data and application-driven trade-offs, with hybrid and bio-inspired directions increasingly viewed as promising [
28].
Regarding methodology and data transparency, representative algorithms span from classical filters to learning-based models. Spatiotemporal filters remove noise by analyzing local density and neighborhood continuity and have been applied effectively in task-specific settings such as space target detection while maintaining efficiency [
25]. Graph-based denoising performs structured separation through graph construction and spectral analysis, and can be strengthened by deep modules for temporal modeling and discrimination [
35]. Transformer-based methods rely on large and diverse data to learn cross-scene spatiotemporal correlations and have demonstrated strong performance on real-world datasets [
25]. Cascaded and adaptive-threshold approaches improve the trade-off between denoising and detail retention with computationally efficient multi-stage processing [
30], whereas bio-inspired methods emphasize deployability and energy efficiency for edge devices and neuromorphic platforms [
31,
32,
33,
34]. In parallel, because dense ground truth is often unavailable for real event data, the community has introduced label-free evaluation metrics to quantify structural preservation after denoising, and has released large-scale real-world datasets. Visualization techniques—such as converting event streams into intensity-like images or contrast curves—further support both quantitative and qualitative assessment [
36,
37].
A critical synthesis of existing findings indicates clear strengths and limitations across categories. Spatiotemporal filtering is effective for preserving fine event details and enabling real-time operation, yet it can be sensitive to parameter choices and may struggle with complex or structured noise [
38]. Graph spectral methods are robust to sparse noise and can be scaled using efficient eigenvector estimation algorithms, but they may incur significant cost for large event graphs and remain sensitive to graph construction and hyperparameters [
35]. Deep models provide high accuracy and strong representational capacity, but their performance is highly dependent on data diversity and may generalize poorly under low-light or high-noise conditions not well covered during training [
28,
39,
40]. Cascaded pipelines are computationally efficient and often suitable for real-time use, but can lead to over-smoothing or under-filtering and may be less adaptive to rapidly changing scenes [
38]. Hybrid and bio-inspired approaches show potential in energy efficiency and robustness, yet they face integration complexity and are still limited by the lack of standardized benchmarks and comprehensive comparisons [
31,
32,
33,
34]. More broadly, event denoising inherently involves a trade-off between noise suppression and detail preservation; adaptive thresholding and multi-scale decomposition can improve this balance, but require systematic optimization under different application constraints [
41,
42,
43,
44]. Consequently, emerging research trends emphasize stronger adaptability and real-world generalization, including integrating physical noise modeling with data-driven learning, and employing domain adaptation, cross-sensor transfer, and temporal fusion to enhance robustness in complex environments [
45,
46].
3. Method
Prior work [
47] modeled the measured characteristic of background activity (BA) noise and drew conclusions that BA noise behaves very differently under bright and dark conditions. Although the mechanisms underlying noise formation vary across different illumination conditions, the distribution characteristics of noise in event streams consistently exhibit separation from the motion trajectory of moving objects [
48]. Consequently, the critical challenge in noise elimination resides in discriminating between events triggered by moving objects and inherent sensor noise. To address this fundamental distinction, we introduce a novel denoising framework as shown in
Figure 1. This framework is anchored in the spatiotemporal mo tion trajectory of objects within the observed scene.
3.1. The Theory of Event Denoising
Event cameras work asynchronously by responding to logarithmic intensity changes [
12,
24], triggering timestamped events when the logarithmic-scale intensity variation surpasses the threshold parameter
c > 0:
where
indicates the logarithmic brightness at time
t and
and at pixel position
, and the polarity
. Thus, the event is a 4-dimensional tuple
, where
is the pixel position,
is is the triggering time and
is the polarity of
k-th events.
Moving objects generate a large number of real events, which dynamically outline their instantaneous contours. These real events exhibit strong spatiotemporal consistency, which can be quantified by the proximity of their positional coordinates and timestamps. The temporal information of the events corresponds to the motion trends of the objects, while the spatial information relates to their geometric shapes [
49]. The distinction between events and noise based on spatiotemporal correlation relies on the following two rules:
(a) Real events and their adjacent events exhibit high spatial compactness and continuity, and these adjacent events are likely to represent the geometric contours of moving objects. In other words, real events can be fitted on the same temporal plane with adjacent events through consistent motion patterns, whereas noise lacks such motion coherence.
(b) An event is considered real if it exhibits a strong spatio-temporal correlation with its neighbors. This principle is rooted in the continuity of object motion, which, when captured by the high temporal resolution of event-based sensors, manifests as a sequence of causally related events forming a coherent motion trajectory. In contrast, noise events are temporally isolated, with random timestamps lacking correlation with neighboring events.
3.2. Problem Formulation
Let an event stream within a time window be
where
is the pixel location,
is the timestamp, and
denotes the polarity. We estimate the motion parameters in each window and simultaneously remove noise events, producing a denoised event stream.
3.3. Constant-Flow Warping Model
We adopt a constant 2D optical flow model within each window:
Given a reference time
(set to the window midpoint in our implementation), each event is temporally warped onto the reference plane by
yielding the warped event
. When
matches the true motion, events triggered by the same moving edge become maximally aligned on the reference plane.
3.4. Robust Contrast Maximization with Polarity Regularization
3.4.1. Image of Warped Events (IWEs)
Instead of the Dirac delta, we construct the image of warped events (IWEs) using Gaussian splatting to reduce discretization artifacts and improve robustness to isolated hot pixels:
where
is the pixel grid and
is an isotropic Gaussian kernel with standard deviation
. To exploit polarity information, we accumulate two polarity-separated IWEs:
3.4.2. Density-Normalized Robust Contrast
A key difficulty in contrast maximization is that the absolute scale of depends on the event rate, which can vary significantly across windows. Moreover, a few hot pixels can create spurious high peaks after warping. To stabilize the objective, we define a robust, density-normalized contrast based on a robust center and scale.
We first define a robust center (median) on the pixel plane:
and a robust scale using the median absolute deviation (MAD):
where
is a small constant for numerical stability. We then define the normalized residual
The robust contrast term is obtained through a Huber M-estimator:
with
where
c is a constant (e.g.,
). Compared to applying Huberization on raw deviations around the mean, the MAD-normalized formulation provides (i) insensitivity to outliers and (ii) comparable objective scales across windows with different event densities.
3.4.3. Polarity Regularization via Gradient Decorrelation
Event polarities encode the sign of brightness changes. Random sensor noise and hot pixels often yield mixed-polarity activations that are not spatially coherent, while true motion-induced events form consistent edge structures. We therefore regularize motion estimation using a polarity term defined on the spatial gradients of and .
Let
where
∇ denotes the spatial gradient operator on the IWE plane. We define a normalized gradient correlation and minimize it (equivalently, maximize its negative):
This term is scale-invariant with respect to event counts, which reduces sensitivity to window selection and makes the regularization weight more stable across sequences.
3.4.4. Peak-Suppression Regularizer (Anti-Hot-Pixel)
Even under robust contrast, degenerate solutions may occur when a small number of pixels absorb a disproportionate amount of warped mass (typical of hot-pixel noise). To explicitly suppress such a collapse, we introduce a peak-occupancy penalty. Define the normalized IWE as
and the peak regularizer as
This regularizer is small for properly sharpened edge structures but becomes large if the warped mass collapses onto a single pixel.
3.4.5. Final Objective and Motion Estimation
Combining the above components, we estimate the motion parameters in each window by
where
and
balance polarity regularization and peak suppression.
Grid Initialization + Gradient Ascent
We optimize
using a two-stage strategy. First, we evaluate
on a coarse grid of flow vectors
and select the best candidate as initialization:
where
denotes the grid. Second, starting from
, we refine the solution by gradient ascent:
where
is the step size at iteration
m. In practice,
is computed via the chain rule through the warping function and the IWE construction, and
is chosen using a simple backtracking line search to ensure monotonic increase of
. The derivation process can be found in
Appendix A.
3.5. Central Event Selection and Back-Projection
After obtaining
, we construct the final IWE
. Since event density varies across windows, we retain a fixed proportion of highly aggregated pixels using an adaptive quantile threshold:
where
denotes the sample quantile at level
.
Pure quantile masking may still include isolated hot-pixel peaks. We therefore require that high-valued pixels also have local neighborhood support. Let
denote a small neighborhood (e.g.,
). Define
and form the central pixel mask
3.5.1. Back-Projection to the Event Domain
Given the binary central mask on the reference plane, we compute a soft membership for each event by bilinear sampling at its warped sub-pixel coordinate .
Let
and define the 4-neighborhood pixels
The bilinear weights are
We then compute
If any neighbor lies outside the image bounds, its mask value is treated as zero (zero padding). The final hard decision is
where
controls strictness. In all experiments we use
, which corresponds to requiring that at least half of the bilinear support lies inside the central mask.
3.5.2. Directional Consistency
We further enforce consistency with the estimated motion direction. The predicted direction for
is
We also compute the observed direction between warped locations of
and
:
The direction gate is
where
is an angular threshold.
3.5.3. Polarity Consistency and Joint Gating
We require polarity consistency:
The joint gating function is then
Finally, we define the set of local events as those satisfying the joint gate with at least one central event:
This selection suppresses random noise events that accidentally align after warping but are inconsistent in temporal support or motion direction, while retaining events that extend the central structure into locally continuous contours.
3.6. Border Event Identification via Density-Normalized Probabilistic Support
After extracting
and
, the remaining candidates are
These events often include weak responses near the boundary of true structures and isolated noise. We identify border events by measuring their spatiotemporal support from
and
while penalizing self-clustered candidates.
3.6.1. Local Neighborhood and Three Support Counts
For any candidate event
, define a local spatiotemporal neighborhood
where
and
are the spatial and temporal radii.
We compute three support features:
Here,
measures direct support from reliable central structures,
measures continuity support from local contours, and
captures clustering behavior within candidates themselves.
3.6.2. Density Normalization and Probabilistic Decision
Because
scale with event density, we normalize them to obtain density-invariant ratios:
We then define the probability of being a real (non-noise) event by a logistic model:
where
are weights and
b is a bias term. The weights
control the relative importance of the three density-normalized supports: direct support from central events (
), continuity support from local events (
), and self-clustering among remaining candidates (
). We enforce the intuitive ordering
and
, reflecting that support from
is the most reliable,
provides secondary evidence, and excessive clustering in
should be penalized.
In practice, we determine
using a lightweight validation procedure on DVSNOISE20 windows (
Section 4.1): we perform a small grid search under the above constraints to maximize validation ESR, and then fix the selected weights for all datasets. This protocol avoids per-dataset tuning while providing a principled way to set the decision boundary of
.
Finally, the border event set is obtained by thresholding:
3.7. Denoised Event Stream
The final denoised event stream is the union of central, local, and border events:
This hard-selection output preserves (i) strongly motion-compensated core structures, (ii) spatiotemporally and directionally consistent supporting events, and (iii) boundary events that are weak individually but supported by nearby real structures, thereby improving robustness to hot pixels, random background activations, and window-dependent event density variations.
3.8. Algorithm Overview
Algorithm 1 summarizes the proposed denoising pipeline within a single time window.
| Algorithm 1 Denoising with Robust CM and Hierarchical Event Selection |
- Require:
Event window , reference time , grid , parameters , quantiles , thresholds , neighborhood radii , local gates - Ensure:
Denoised events - 1:
Construct for each and evaluate - 2:
{Grid initialization} - 3:
gradient ascent initialized at maximizing - 4:
Construct and compute central mask via quantiles on H and neighborhood support S - 5:
Back-project to events to obtain using - 6:
Compute adaptive from and select by joint gating - 7:
; for each compute in and - 8:
- 9:
- 10:
return
|
4. Experimental Evaluation
4.1. Experimental Setup
4.1.1. Datasets
We evaluate the proposed MSF on four public benchmarks: DVSNOISE20 [
23], DVSMOTION20 [
50], DVSCLEAN [
20], and E-MLB [
36]. These datasets jointly cover (i) different background activity and hot-pixel characteristics (DVSNOISE20), (ii) a wide range of motion magnitudes including slow-motion sequences with large inter-event intervals (DVSMOTION20), (iii) controlled synthetic noise injection (DVSCLEAN), and (iv) progressively degraded illumination where noise becomes dominant (E-MLB). This combination enables an informative assessment of robustness and generalization.
4.1.2. Windowing Protocol
Following common practice in event denoising, all methods process the stream in fixed-length temporal windows of
. For each window, we set the reference time
to the midpoint of the window, consistent with
Section 3.3. All reported quantitative results are obtained by averaging per-window scores over all sequences in each dataset.
4.1.3. Implementation Details and Hyperparameters
MSF contains three stages: (1) motion estimation via robust contrast maximization, (2) central and local event selection, and (3) border event identification by density-normalized probabilistic support.
Motion estimation. We construct the IWE using Gaussian splatting (
Section 3.4.1) with kernel standard deviation
. The robust contrast term uses the Huber constant
c (
Section 3.4.2). The final objective is
(
Section 3.4.5), where
and
weight polarity regularization and peak suppression, respectively. Optimization follows the two-stage strategy in
Section 3.4.5: a coarse grid search over
to obtain
, followed by gradient ascent with backtracking line search to yield
.
Central event extraction. Given
, we form the central mask
by quantile thresholding on
and on the neighborhood-supported accumulation
(
Section 3.5). The quantile levels are
q and
, respectively. Central events are obtained by back-projecting
to the event domain using bilinear weights and thresholding the soft membership
with
(
Section 3.5.1).
Local event selection. Local events
are selected by joint gating (
Section 3.5.3), enforcing spatial proximity (
), temporal proximity (
), directional consistency (
), and polarity consistency. Importantly,
and
are
adaptive and computed from the robust speed scale
derived from
:
This design prevents over-expansion in low-speed segments and preserves sufficient support in high-speed segments.
Border event identification. For the remaining candidates
, we compute neighborhood support counts
in the spatiotemporal neighborhood
with radii
(
Section 3.6.1). We then form density-normalized ratios
and apply the logistic model
with threshold
(
Section 3.6.2), yielding border events
.
4.1.4. Baselines
We compare MSF against density-based filters DWF [
47], Knoise [
51], and Ynoise [
52]; a motion-based method EvFlow [
17]; surface/smoothness methods TS [
53] and RED [
54]; and the learning-based EDnCNN [
23]. All methods are evaluated under the same windowing protocol.
4.1.5. Metric
The mainstream evaluation metrics for event denoising include relative plausibility measure of denoising (RPMD) [
23], plots receiver operating characteristic (ROC) [
47], and Event Structural Ratio (ESR) [
36]. RPMD evaluates the event denoising performance by measuring the APS intensity and based on IMU motion prediction, and requires high-quality and correctly aligned APS and IMU data, which is suitable for the DVSNOISE20 dataset; ROC assesses the denoising accuracy by using noise annotation data to calculate the false positive rate (FPR) and true positive rate (TPR), and is suitable for synthetic datasets such as DVSCLEAN. ESR assesses the denoising performance by projecting the events onto a distorted event image and calculating the image contrast metric, and can be tested directly on the event sequence. ESR neither relies on synthetic data nor requires access to additional information sources to obtain true value data, and can represent the noise level in all cases. ESR is computed from the image of warped events (IWE), obtained by accumulating the denoised events onto a 2D pixel grid after warping (e.g., using the estimated motion/flow). Let
K denote the number of pixels in the IWE,
N the total number of events, and
the number (or accumulated count) of events falling on pixel
i (
), such that
. A basic contrast measure for the IWE is the normalized total sum of squares (NTSS), defined as
NTSS reflects the tendency of events to concentrate on a subset of pixels (high contrast) and is normalized by
N, making it largely comparable across different event counts. However, NTSS alone can be biased toward over-denoising: if too many events are removed, the remaining events may become artificially concentrated, and in the extreme case
NTSS reaches its upper bound, failing to faithfully represent the noise level.
To mitigate this issue, ESR incorporates a penalty term that accounts for the spatial support (i.e., the effective area occupied by events) in the IWE:
where
M is a fixed reference number of events used for interpolation (kept constant throughout evaluation). Intuitively,
down-weights pixels with larger
, so
increases when events are spread over more pixels and decreases when events collapse to a small spatial region. This term, therefore, discourages degenerate solutions that remove most events and yield spuriously high contrast.
Finally, ESR is defined as the geometric combination of the normalized contrast and the support penalty:
A higher ESR indicates that the denoised events form sharp, spatially coherent structures (high
) while still maintaining a reasonable spatial support (appropriate
), i.e., preserving meaningful event geometry rather than achieving high contrast by excessive event removal.
4.1.6. Hyper-Parameter Tuning and Protocol
MSF involves several hyper-parameters. To avoid per-dataset overfitting and to ensure fair cross-benchmark evaluation, we adopt a two-stage tuning protocol and then keep a single configuration fixed for all reported results. We also tune the logistic weights
of the border-event model (
Section 3.6.2) using the same DVSNOISE20 validation protocol, and keep them fixed for all benchmarks.
Stage 1 (coarse search on a validation split). We tune the core hyper-parameters on
DVSNOISE20 only. Following a sampling-based split, we randomly sample
20% of non-overlapping temporal windows from each sequence as a validation set, and use the remaining windows for evaluation, ensuring that windows are not shared across splits. We run a coarse grid/random search over a limited set of sensitive parameters and select the configuration that maximizes the average validation ESR (
Section 4.1.5), with ties broken by runtime stability.
Stage 2 (fixed-parameter evaluation on all benchmarks). After selecting a single configuration on DVSNOISE20 validation windows, we fix the same hyper-parameters and evaluate on all four datasets (DVSMOTION20, DVSNOISE20, DVSCLEAN, and E-MLB) without any dataset-specific re-tuning.
Core parameters disclosed. In the interest of reproducibility, we disclose the main tuned parameters as follows (fixed across all datasets): Gaussian splatting standard deviation pixel; Huber constant ; regularization weights and ; central-mask quantiles and ; back-projection threshold . border-event probability threshold ; logistic weights . Other parameters (e.g., window length , neighborhood size, and flow-grid bounds) follow common practice and are kept constant across all experiments.
4.2. Qualitative Evaluation
Figure 2 shows representative results in scenes with different motion magnitudes. The raw streams exhibit severe background activity, including isolated events and small spurious clusters that do not correspond to physical edges. Density-based methods (DWF, Knoise, and Ynoise) rely primarily on local event-count statistics and therefore face an intrinsic ambiguity in complex scenes: when genuine edges are temporally sparse (e.g., slow motion or low texture), density can be insufficient to distinguish weak-but-real events from noise, leading to either residual noise or over-suppression of valid structures. TS, which enforces local spatiotemporal surface regularity, often suppresses noise aggressively but may also remove thin structures and attenuate texture-like details, reducing the perceptual completeness of object contours.
EvFlow and RED, which impose temporal continuity constraints, can fail in slow-motion regimes where the temporal spacing of true events becomes large. In such cases, real events on edges are more easily rejected as temporally inconsistent, resulting in fragmented contours. EDnCNN generally produces visually clean outputs, but its behavior depends on the training distribution; in particular, under distribution shifts (e.g., extreme low-light noise patterns), it may either leave structured residual artifacts or oversmooth informative event patterns.
MSF yields visually sharper and more coherent structures across motion conditions. The improvement stems from two coupled mechanisms. First, the robust CM objective (
Section 3.4.5) aligns motion-induced events while being less sensitive to event-rate variations and hot-pixel peaks, due to MAD normalization, polarity–gradient decorrelation, and explicit peak suppression. Second, the hierarchical selection strategy preserves structure progressively: central events provide a high-precision core; local events restore spatial continuity under adaptive spatiotemporal thresholds and directional agreement; and border events recover weak responses only when supported by nearby reliable events, while penalizing candidate self-clustering.
Figure 3 further highlights robustness under decreasing illumination. As illumination diminishes, background activity increases and the event manifolds become less regular, which degrades surface-fitting and temporal continuity baselines. MSF remains stable because motion-compensated aggregation strengthens true structures, and the density-normalized probabilistic support (
Section 3.6.2) reduces sensitivity to the increased overall event rate, enabling the retention of meaningful contours even in the most challenging setting.
4.3. Quantitative Evaluation
Table 1 reports average ESR over four benchmarks. All methods improve ESR relative to the raw streams to varying degrees, confirming that suppressing background activity generally increases structural consistency. EDnCNN achieves the highest ESR on DVSNOISE20, which is expected because the dataset provides noise probability labels and is commonly used to train or calibrate learning-based denoisers [
23]. On DVSCLEAN, Ynoise attains the best ESR, likely because synthetic high-density noise amplifies the effectiveness of density-driven rules.
MSF achieves the best ESR on DVSMOTION20 and E-MLB, and remains highly competitive on DVSNOISE20 and DVSCLEAN. Notably, the gains on DVSMOTION20 indicate robustness to slow motion, where temporal continuity cues are weak and density statistics are ambiguous. The top performance on E-MLB validates MSF under low-light noise, where event-rate changes and hot-pixel activations are more pronounced. These results support the central claim of MSF: combining robust motion-compensated alignment with hierarchical, density-invariant spatiotemporal support yields stable denoising across heterogeneous conditions.
4.4. Ablation Study
To quantify the individual contribution of each proposed component, we conduct an ablation study on DVSNOISE20 under the same windowing protocol (
ms) and the fixed hyper-parameter setting reported in
Section 4.1. We report the average ESR over all windows. Each ablation variant removes one component from MSF while keeping all other steps unchanged.
4.4.1. Ablated Components
We evaluate the following: (i) removing the polarity–gradient decorrelation term by setting (“w/o Pol”); (ii) removing peak suppression by setting (“w/o Peak”); and (iii) removing each level of hierarchical selection by using only a subset of event sets: central-only (“C only”), central+local (“C+L”), and central+local+border (full MSF).
4.4.2. Results and Discussion
Table 2 shows that each proposed component consistently improves ESR. In particular, the polarity regularization and peak suppression stabilize motion estimation under mixed-polarity noise and hot-pixel-induced degeneracy, respectively, which translates to improved event alignment and higher ESR. Moreover, progressively adding local and border events improves structural completeness: central events provide high precision, local expansion restores contour continuity, and the border stage recovers weak boundary events that are otherwise missed, leading to the best overall ESR.
4.5. Scalability with Respect to the Number of Events
We analyze how MSF scales with the number of events in a temporal window. Let the sensor resolution be pixels (e.g., ), the flow grid size be , the number of gradient-ascent iterations be I, the Gaussian splatting support size be S pixels per event (a small constant determined by and truncation), and the average number of central events be .
4.5.1. Motion Estimation (Grid + Refinement)
For each candidate flow
, constructing the IWE by Gaussian splatting costs
. Computing robust statistics (median and MAD) over the pixel plane costs
(or
if implemented via sorting; in practice
K is fixed by the sensor resolution). The polarity–gradient correlation and peak penalty are also
after the IWEs are built. Therefore, evaluating the objective once is
The coarse grid search is
, and the refinement stage is
, yielding total motion-estimation complexity
For a fixed sensor resolution and fixed splatting kernel,
S and
K are constants; hence. motion estimation scales linearly with
.
4.5.2. Central Event Extraction
Given , building the final IWE is and computing quantiles/neighborhood sums on the pixel plane is . Back-projecting the central mask to the event domain via bilinear sampling is . Thus, this stage is , i.e., linear in .
4.5.3. Local Event Selection (Central-to-Local Expansion)
A naive implementation that checks each non-central event against all central events would be
. To keep the method scalable, we use local spatiotemporal neighbor queries: events are indexed in a spatial grid (or voxel hash) and processed in timestamp order so that candidate neighbors of an event can be retrieved in expected constant time with a bounded neighborhood. With such indexing, each event only compares against a bounded number of nearby events within
, and the expected cost becomes
where
is the average number of retrieved neighbors inside the query window (typically small and bounded by the chosen radii). Hence local selection is near-linear in
.
4.5.4. Border Event Identification
Border identification computes by counting neighbors in . With the same grid/voxel indexing, each candidate event queries a bounded neighborhood; thus, the expected complexity is also .
4.5.5. Overall Scaling
Combining all components, for fixed resolution
K and fixed hyperparameters
, MSF scales approximately linearly with the number of events per window:
where
and
depend on the chosen accuracy–speed setting rather than on
itself. In the worst case, if the neighborhood query window becomes so large that
grows with
, the counting stages may degrade toward quadratic behavior; however, MSF uses fixed spatiotemporal radii and a constant window length, which keeps the neighborhood size bounded and avoids such degeneration in typical operating conditions.
4.6. Computational Efficiency
4.6.1. Protocol
We measure average wall-clock runtime per ms window on a desktop CPU (Intel i5-13600KF) using Python 3.8 implementations for all methods. This setting reflects a practical non-optimized deployment and enables a fair comparison under the same windowing protocol used throughout the paper.
4.6.2. Runtime Comparison and Real-Time Requirement
With
ms, real-time processing requires the average per-window latency to be below 20 ms.
Table 3 reports the measured runtimes. MSF achieves 11.64 ms per window on average, satisfying the real-time constraint on CPU in Python. Among the compared methods, density-based filters (Knoise/DWF/Ynoise) are faster due to their simpler local counting rules, while TS/RED and MSF remain within the 20 ms budget. In contrast, EvFlow (256 ms) and EDnCNN (313 ms) are not real-time under our CPU Python setup.
4.6.3. Discussion
MSF’s runtime is dominated by motion estimation (coarse grid evaluation and refinement) and the hierarchical neighborhood verification. In practice, the speed can be further improved by reducing the flow-grid resolution, decreasing the number of refinement iterations. These knobs provide an explicit accuracy–speed trade-off for embedded or low-power deployment.
5. Conclusions
We proposed MSF, a motion-guided multi-level filtering framework for event-stream denoising. Within each temporal window, MSF estimates a constant optical flow by maximizing a robust, density-normalized contrast objective on the image of warped events. We further incorporate a polarity–gradient decorrelation term to suppress mixed-polarity noise and a peak-suppression regularizer to avoid degeneracy caused by hot pixels. Based on the estimated motion, MSF performs hierarchical event selection: central events are extracted via quantile-based masking with neighborhood support and back-projection; local events are recovered using adaptive spatiotemporal proximity and directional consistency; and border events are identified by a density-normalized probabilistic support model that rewards support from reliable structures while penalizing self-clustering among remaining candidates. Experiments on four public datasets demonstrate that MSF consistently improves ESR and generalizes well across diverse motion and illumination conditions.
Future work will extend MSF beyond the single-motion assumption by integrating motion segmentation and multi-model flow estimation, enabling principled denoising in scenes containing multiple independently moving objects and complex motion boundaries.