Next Article in Journal
Robot-Assisted Gait Training Combined with Conventional Physiotherapy in Postoperative Patients with Diplegic Cerebral Palsy: A Pilot Single Cohort Observational Study
Next Article in Special Issue
From Light Pulses to Selective Enhancement: Performance Analysis of Event-Based Object Detection Under Pulsed Automotive Headlight Illumination
Previous Article in Journal
AWG-Based Spectral Multiplexing for Unambiguous Range-Extended FMCW LiDAR
Previous Article in Special Issue
Event-Based Camera Modeling for Atmospheric Turbulence Prediction
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

MSF: Multi-Level Spatiotemporal Filtering for Event Denoising via Motion Estimation

by
Jiuhe Wang
1,2,
Kun Yu
1,2,*,
Xinghua Xu
1,2 and
Nanliang Shan
1,2
1
The National Key Laboratory of Electromagnetic Energy, Naval University of Engineering, Wuhan 430033, China
2
East Lake Laboratory, Wuhan 430202, China
*
Author to whom correspondence should be addressed.
Sensors 2026, 26(5), 1437; https://doi.org/10.3390/s26051437
Submission received: 19 January 2026 / Revised: 15 February 2026 / Accepted: 22 February 2026 / Published: 25 February 2026
(This article belongs to the Special Issue Event-Driven Vision Sensor Architectures and Application Scenarios)

Abstract

Event cameras provide microsecond-level temporal resolution, low latency, and high dynamic range, enabling robust perception under fast motion and challenging lighting conditions. Nevertheless, event streams are susceptible to background activity, thermal noise, and hot pixels. Their sparse and irregular patterns can corrupt event structures and degrade downstream tasks. We propose MSF, a multi-level spatiotemporal filtering framework that couples motion-compensated aggregation with neighborhood-level verification. In each temporal window, MSF estimates a constant 2D optical flow by maximizing a robust, density-normalized contrast objective on the image of warped events (IWE). We further incorporate polarity–gradient decorrelation to suppress mixed-polarity noise and an explicit peak-suppression regularizer to avoid hot-pixel-induced degeneracy. The motion parameters are optimized via coarse grid initialization followed by gradient-ascent refinement. Based on the estimated motion, MSF performs hierarchical event selection: central events are extracted from high-confidence aggregated regions, local events are recovered through joint spatial–temporal–directional–polarity consistency, and weak border events are identified using a density-normalized probabilistic support model that rewards support from reliable structures while penalizing self-clustering. Experiments on four public benchmarks (DVSNOISE20, DVSMOTION20, DVSCLEAN, and E-MLB) show that MSF consistently improves the Event Structural Ratio (ESR) and outperforms representative baselines across diverse motion regimes and severe low-light noise.

1. Introduction

Event cameras have demonstrated strong potential in robotic navigation and SLAM [1,2,3], autonomous driving [4,5,6], and high-speed tracking [7,8,9]. Unlike frame-based cameras, event sensors asynchronously report per-pixel brightness changes as a stream of events, enabling microsecond-level temporal resolution, low latency, and high dynamic range. These properties make event cameras particularly attractive for fast motion and challenging lighting conditions, where conventional cameras often suffer from motion blur and under-/over-exposure. Event-based vision has rapidly evolved from early sensor prototypes to a mature research field with a broad algorithmic ecosystem; comprehensive overviews can be found in the surveys by Gallego et al. and Liu et al. [10,11].
Despite these advantages, the differential sensing mechanism of event cameras [12] makes event streams inherently susceptible to noise, including background activity, thermal noise, and hot pixels. This noise is not simply additive, it is sparse, temporally irregular, and can be spatially concentrated, which severely degrades downstream tasks such as motion estimation and reconstruction. As a result, reliably separating real events caused by scene dynamics from sensor noise has become a fundamental problem in event-based vision [13].
Existing denoising methods can be broadly divided into rule-based filtering and learning-based approaches. Rule-based filters typically rely on handcrafted priors, such as spatiotemporal density or clustering cues [14,15,16]. While efficient, they can be brittle in complex scenes where event rates and motion patterns change rapidly. Another line of work formulates denoising as iterative optimization by exploiting global spatiotemporal correlations, often guided by a single dominant cue, e.g., motion consistency [17,18] or contrast maximization (CM) [19]. However, relying on a single cue can lead to failure modes. CM-based models may be distracted by spurious high responses after warping, while pure motion-consistency models may discard weak yet valid boundary events in low-texture or low-contrast regions. Deep learning methods [20,21,22,23] can achieve strong performance on specific benchmarks, but they often require large labeled datasets, introduce substantial model complexity, and may generalize poorly across sensors and operating conditions.
To address these limitations, we propose a multi-level spatiotemporal noise filtering framework, termed MSF, that integrates motion-compensated aggregation with neighborhood-level statistical verification. MSF first estimates a constant 2D optical flow within a window by robust contrast maximization on the image of warped events. The objective combines (i) density-normalized robust contrast to reduce sensitivity to varying event rates, (ii) a polarity-based regularization term to suppress mixed-polarity noise patterns, and (iii) a peak-suppression term to mitigate hot-pixel-induced degeneracy. We optimize the motion parameters using a practical two-stage strategy: coarse grid initialization followed by gradient-ascent refinement. Based on the estimated motion, MSF then performs hierarchical event selection. It extracts highly reliable central events from high-confidence aggregated regions on the warped plane, expands them to local events through joint spatial–temporal–directional–polarity consistency, and finally recovers weak border events using a density-normalized probabilistic support model. This progressive selection preserves coherent motion-induced structures while effectively rejecting background-activity noise.
Experimental results on public datasets show that MSF consistently outperforms representative filtering baselines and improves the reliability of downstream event processing in complex real-world scenarios.

Contributions

The main contributions of this paper are summarized as follows:
  • We propose MSF, a multi-level joint spatiotemporal denoising framework that progressively separates motion-induced real events from noisy event streams. The method remains robust under diverse motion patterns and illumination conditions.
  • We introduce a robust CM-based motion estimation objective for event streams. It combines density-normalized robust contrast, polarity regularization, and peak suppression, and it is optimized efficiently via grid initialization followed by gradient ascent.
  • We design a hierarchical event selection strategy (central–local–border) that integrates motion-compensated aggregation with neighborhood-based spatiotemporal probabilistic support. This enables the effective removal of sparse background noise while preserving weak but valid boundary events.

2. Related Work

From a sensing perspective, event cameras are a representative instance of event-driven sensing, where measurements are reported asynchronously upon sufficiently large signal changes. This paradigm is closely related to the send-on-delta (SoD) strategy, which formalizes threshold-triggered reporting and has been widely discussed beyond vision [24]. Broader perspectives on event-driven sensing and its perception algorithms in both vision and audition are summarized in [11], while ref. [10] provides an extensive survey focused on event-based vision.
Recent studies commonly categorize event camera denoising methods according to their algorithmic principles and the event characteristics they exploit. First, spatiotemporal correlation filtering leverages the continuity and local clustering of genuine events in space and time to suppress random and isolated noise events; representative strategies include local density thresholding and neighborhood-consistency tests, often achieving a favorable balance between detail preservation and real-time efficiency [25,26]. Second, graph spectral and graph-learning approaches model events as nodes in a graph with edges encoding spatial/temporal proximity, and then use spectral properties (e.g., the Fiedler vector) to separate sparsely connected noise from structured signal events; this line also includes models that combine graph encoding with temporal convolution and attention, as well as graph convolutional networks that learn event representations for denoising and classification [27]. Third, deep learning—especially transformer-based architectures—has been adapted to learn complex spatiotemporal dependencies from data, achieving state-of-the-art performance on real-world benchmarks; convolutional and recurrent networks have also been explored to process event streams (or their representations) in an end-to-end manner [28,29]. Fourth, cascaded noise-processing pipelines typically apply multi-stage spatial/temporal filtering together with adaptive thresholding to improve signal-to-noise ratio with reduced computational cost, making them attractive for real-time deployment [30]. Finally, hybrid and bio-inspired frameworks either integrate graph-based features with neural networks to improve robustness and feature fusion, or draw inspiration from biological neural systems (e.g., LIF neurons and their enhanced variants) to achieve energy-efficient, low-latency denoising suitable for neuromorphic hardware [31,32,33,34]. Overall, this diversity reflects the multifaceted noise characteristics of event data and application-driven trade-offs, with hybrid and bio-inspired directions increasingly viewed as promising [28].
Regarding methodology and data transparency, representative algorithms span from classical filters to learning-based models. Spatiotemporal filters remove noise by analyzing local density and neighborhood continuity and have been applied effectively in task-specific settings such as space target detection while maintaining efficiency [25]. Graph-based denoising performs structured separation through graph construction and spectral analysis, and can be strengthened by deep modules for temporal modeling and discrimination [35]. Transformer-based methods rely on large and diverse data to learn cross-scene spatiotemporal correlations and have demonstrated strong performance on real-world datasets [25]. Cascaded and adaptive-threshold approaches improve the trade-off between denoising and detail retention with computationally efficient multi-stage processing [30], whereas bio-inspired methods emphasize deployability and energy efficiency for edge devices and neuromorphic platforms [31,32,33,34]. In parallel, because dense ground truth is often unavailable for real event data, the community has introduced label-free evaluation metrics to quantify structural preservation after denoising, and has released large-scale real-world datasets. Visualization techniques—such as converting event streams into intensity-like images or contrast curves—further support both quantitative and qualitative assessment [36,37].
A critical synthesis of existing findings indicates clear strengths and limitations across categories. Spatiotemporal filtering is effective for preserving fine event details and enabling real-time operation, yet it can be sensitive to parameter choices and may struggle with complex or structured noise [38]. Graph spectral methods are robust to sparse noise and can be scaled using efficient eigenvector estimation algorithms, but they may incur significant cost for large event graphs and remain sensitive to graph construction and hyperparameters [35]. Deep models provide high accuracy and strong representational capacity, but their performance is highly dependent on data diversity and may generalize poorly under low-light or high-noise conditions not well covered during training [28,39,40]. Cascaded pipelines are computationally efficient and often suitable for real-time use, but can lead to over-smoothing or under-filtering and may be less adaptive to rapidly changing scenes [38]. Hybrid and bio-inspired approaches show potential in energy efficiency and robustness, yet they face integration complexity and are still limited by the lack of standardized benchmarks and comprehensive comparisons [31,32,33,34]. More broadly, event denoising inherently involves a trade-off between noise suppression and detail preservation; adaptive thresholding and multi-scale decomposition can improve this balance, but require systematic optimization under different application constraints [41,42,43,44]. Consequently, emerging research trends emphasize stronger adaptability and real-world generalization, including integrating physical noise modeling with data-driven learning, and employing domain adaptation, cross-sensor transfer, and temporal fusion to enhance robustness in complex environments [45,46].

3. Method

Prior work [47] modeled the measured characteristic of background activity (BA) noise and drew conclusions that BA noise behaves very differently under bright and dark conditions. Although the mechanisms underlying noise formation vary across different illumination conditions, the distribution characteristics of noise in event streams consistently exhibit separation from the motion trajectory of moving objects [48]. Consequently, the critical challenge in noise elimination resides in discriminating between events triggered by moving objects and inherent sensor noise. To address this fundamental distinction, we introduce a novel denoising framework as shown in Figure 1. This framework is anchored in the spatiotemporal mo tion trajectory of objects within the observed scene.

3.1. The Theory of Event Denoising

Event cameras work asynchronously by responding to logarithmic intensity changes [12,24], triggering timestamped events when the logarithmic-scale intensity variation surpasses the threshold parameter c > 0:
log L x , t log L x , τ = p · c ,
where L x , t indicates the logarithmic brightness at time t and τ and at pixel position x , and the polarity p = + 1 , 1 . Thus, the event is a 4-dimensional tuple e k x k , t k , p k , where x k = x k , y k T is the pixel position, t k is is the triggering time and p k is the polarity of k-th events.
Moving objects generate a large number of real events, which dynamically outline their instantaneous contours. These real events exhibit strong spatiotemporal consistency, which can be quantified by the proximity of their positional coordinates and timestamps. The temporal information of the events corresponds to the motion trends of the objects, while the spatial information relates to their geometric shapes [49]. The distinction between events and noise based on spatiotemporal correlation relies on the following two rules:
(a) Real events and their adjacent events exhibit high spatial compactness and continuity, and these adjacent events are likely to represent the geometric contours of moving objects. In other words, real events can be fitted on the same temporal plane with adjacent events through consistent motion patterns, whereas noise lacks such motion coherence.
(b) An event is considered real if it exhibits a strong spatio-temporal correlation with its neighbors. This principle is rooted in the continuity of object motion, which, when captured by the high temporal resolution of event-based sensors, manifests as a sequence of causally related events forming a coherent motion trajectory. In contrast, noise events are temporally isolated, with random timestamps lacking correlation with neighboring events.

3.2. Problem Formulation

Let an event stream within a time window be
Ω = { e k } k = 1 N e , e k ( x k , t k , p k ) ,
where x k = ( x k , y k ) R 2 is the pixel location, t k R is the timestamp, and p k { 1 , + 1 } denotes the polarity. We estimate the motion parameters in each window and simultaneously remove noise events, producing a denoised event stream.

3.3. Constant-Flow Warping Model

We adopt a constant 2D optical flow model within each window:
θ v = ( v x , v y ) .
Given a reference time t ref (set to the window midpoint in our implementation), each event is temporally warped onto the reference plane by
x k = W ( x k , t k ; θ ) x k + v ( t ref t k ) ,
yielding the warped event e k ( x k , t ref , p k ) . When θ matches the true motion, events triggered by the same moving edge become maximally aligned on the reference plane.

3.4. Robust Contrast Maximization with Polarity Regularization

3.4.1. Image of Warped Events (IWEs)

Instead of the Dirac delta, we construct the image of warped events (IWEs) using Gaussian splatting to reduce discretization artifacts and improve robustness to isolated hot pixels:
H ( x ; θ ) = k = 1 N e κ g ( x x k ) , x X ,
where X is the pixel grid and κ g ( · ) is an isotropic Gaussian kernel with standard deviation σ g . To exploit polarity information, we accumulate two polarity-separated IWEs:
H ± ( x ; θ ) = k : p k = ± 1 κ g ( x x k ) .

3.4.2. Density-Normalized Robust Contrast

A key difficulty in contrast maximization is that the absolute scale of H ( x ; θ ) depends on the event rate, which can vary significantly across windows. Moreover, a few hot pixels can create spurious high peaks after warping. To stabilize the objective, we define a robust, density-normalized contrast based on a robust center and scale.
We first define a robust center (median) on the pixel plane:
m H ( θ ) = median x X H ( x ; θ ) ,
and a robust scale using the median absolute deviation (MAD):
s H ( θ ) = 1.4826 · median x X H ( x ; θ ) m H ( θ ) + ϵ ,
where ϵ > 0 is a small constant for numerical stability. We then define the normalized residual
r ( x ; θ ) = H ( x ; θ ) m H ( θ ) s H ( θ ) .
The robust contrast term is obtained through a Huber M-estimator:
f rc ( θ ) = 1 | X | x X ρ r ( x ; θ ) ,
with
ρ ( u ) = 1 2 u 2 , | u | c , c | u | 1 2 c 2 , | u | > c ,
where c is a constant (e.g.,  c [ 1.5 , 2.5 ] ). Compared to applying Huberization on raw deviations around the mean, the MAD-normalized formulation provides (i) insensitivity to outliers and (ii) comparable objective scales across windows with different event densities.

3.4.3. Polarity Regularization via Gradient Decorrelation

Event polarities encode the sign of brightness changes. Random sensor noise and hot pixels often yield mixed-polarity activations that are not spatially coherent, while true motion-induced events form consistent edge structures. We therefore regularize motion estimation using a polarity term defined on the spatial gradients of H + and H .
Let
g ± ( x ; θ ) H ± ( x ; θ ) ,
where denotes the spatial gradient operator on the IWE plane. We define a normalized gradient correlation and minimize it (equivalently, maximize its negative):
f pol ( θ ) = x X g + ( x ; θ ) g ( x ; θ ) x X g + ( x ; θ ) 2 x X g ( x ; θ ) 2 + ϵ .
This term is scale-invariant with respect to event counts, which reduces sensitivity to window selection and makes the regularization weight more stable across sequences.

3.4.4. Peak-Suppression Regularizer (Anti-Hot-Pixel)

Even under robust contrast, degenerate solutions may occur when a small number of pixels absorb a disproportionate amount of warped mass (typical of hot-pixel noise). To explicitly suppress such a collapse, we introduce a peak-occupancy penalty. Define the normalized IWE as
H ˜ ( x ; θ ) = H ( x ; θ ) y X H ( y ; θ ) + ϵ ,
and the peak regularizer as
R peak ( θ ) = H ˜ ( · ; θ ) = max x X H ˜ ( x ; θ ) .
This regularizer is small for properly sharpened edge structures but becomes large if the warped mass collapses onto a single pixel.

3.4.5. Final Objective and Motion Estimation

Combining the above components, we estimate the motion parameters in each window by
θ * = arg max θ f ( θ ) , f ( θ ) = f rc ( θ ) + λ pol f pol ( θ ) λ peak R peak ( θ ) ,
where λ pol 0 and λ peak 0 balance polarity regularization and peak suppression.
Grid Initialization + Gradient Ascent
We optimize f ( θ ) using a two-stage strategy. First, we evaluate f ( θ ) on a coarse grid of flow vectors θ [ v x min , v x max ] × [ v y min , v y max ] and select the best candidate as initialization:
θ 0 = arg max θ G f ( θ ) ,
where G denotes the grid. Second, starting from θ 0 , we refine the solution by gradient ascent:
θ ( m + 1 ) = θ ( m ) + η m θ f ( θ ( m ) ) ,
where η m is the step size at iteration m. In practice, θ f ( θ ) is computed via the chain rule through the warping function and the IWE construction, and η m is chosen using a simple backtracking line search to ensure monotonic increase of f ( θ ) . The derivation process can be found in Appendix A.

3.5. Central Event Selection and Back-Projection

After obtaining θ * , we construct the final IWE H ( x ) H ( x ; θ * ) . Since event density varies across windows, we retain a fixed proportion of highly aggregated pixels using an adaptive quantile threshold:
τ = Q q { H ( x ) } x X ,
where Q q ( · ) denotes the sample quantile at level q ( 0 , 1 ) .
Pure quantile masking may still include isolated hot-pixel peaks. We therefore require that high-valued pixels also have local neighborhood support. Let N ( x ) denote a small neighborhood (e.g.,  3 × 3 ). Define
S ( x ) = y N ( x ) H ( y ) , τ s = Q q s { S ( x ) } x X ,
and form the central pixel mask
M c ( x ) = 1 H ( x ) τ · 1 S ( x ) τ s .

3.5.1. Back-Projection to the Event Domain

Given the binary central mask M c ( x ) { 0 , 1 } on the reference plane, we compute a soft membership for each event by bilinear sampling at its warped sub-pixel coordinate x k = ( x k , y k ) .
Let
x 0 = x k , y 0 = y k , δ x = x k x 0 , δ y = y k y 0 ,
and define the 4-neighborhood pixels
( x 0 , y 0 ) , ( x 0 + 1 , y 0 ) , ( x 0 , y 0 + 1 ) , ( x 0 + 1 , y 0 + 1 ) .
The bilinear weights are
w 00 = ( 1 δ x ) ( 1 δ y ) , w 10 = δ x ( 1 δ y ) ,
w 01 = ( 1 δ x ) δ y , w 11 = δ x δ y .
We then compute
g k c ( θ * ) = w 00 M c ( x 0 , y 0 ) + w 10 M c ( x 0 + 1 , y 0 ) + w 01 M c ( x 0 , y 0 + 1 ) + w 11 M c ( x 0 + 1 , y 0 + 1 ) .
If any neighbor lies outside the image bounds, its mask value is treated as zero (zero padding). The final hard decision is
χ k c ( θ * ) = 1 g k c ( θ * ) η c ,
where η c ( 0 , 1 ] controls strictness. In all experiments we use η c = 0.5 , which corresponds to requiring that at least half of the bilinear support lies inside the central mask.

3.5.2. Directional Consistency

We further enforce consistency with the estimated motion direction. The predicted direction for e j is
d ^ j pred Δ x j pred Δ x j pred + ϵ .
We also compute the observed direction between warped locations of e i and e j :
d ^ i j obs x j x i x j x i + ϵ .
The direction gate is
g θ ( i , j ) = 1 ( d ^ i j obs , d ^ j pred ) τ θ ,
where τ θ is an angular threshold.

3.5.3. Polarity Consistency and Joint Gating

We require polarity consistency:
g p ( i , j ) = 1 [ p i = p j ] .
The joint gating function is then
g ( i , j ) = g d ( i , j ) g t ( i , j ) g θ ( i , j ) g p ( i , j ) .
Finally, we define the set of local events as those satisfying the joint gate with at least one central event:
Ω l = e j Ω Ω c | e i Ω c : g ( i , j ) = 1 .
This selection suppresses random noise events that accidentally align after warping but are inconsistent in temporal support or motion direction, while retaining events that extend the central structure into locally continuous contours.

3.6. Border Event Identification via Density-Normalized Probabilistic Support

After extracting Ω c and Ω l , the remaining candidates are
Ω = Ω ( Ω c Ω l ) .
These events often include weak responses near the boundary of true structures and isolated noise. We identify border events by measuring their spatiotemporal support from Ω c and Ω l while penalizing self-clustered candidates.

3.6.1. Local Neighborhood and Three Support Counts

For any candidate event e = ( x , t , p ) Ω , define a local spatiotemporal neighborhood
U ( e ) = e = ( x , t , p ) Ω | x x r s , | t t | r t ,
where r s and r t are the spatial and temporal radii.
We compute three support features:
n A ( e ) = e i Ω c 1 e i U ( e ) ,
n B ( e ) = e j Ω l 1 e j U ( e ) ,
n C ( e ) = e k Ω e k e 1 e k U ( e ) .
Here, n A measures direct support from reliable central structures, n B measures continuity support from local contours, and n C captures clustering behavior within candidates themselves.

3.6.2. Density Normalization and Probabilistic Decision

Because n A , n B , n C scale with event density, we normalize them to obtain density-invariant ratios:
u A ( e ) = n A ( e ) n A ( e ) + n B ( e ) + n C ( e ) + ϵ ,
u B ( e ) = n B ( e ) n A ( e ) + n B ( e ) + n C ( e ) + ϵ ,
u C ( e ) = n C ( e ) n A ( e ) + n B ( e ) + n C ( e ) + ϵ .
We then define the probability of being a real (non-noise) event by a logistic model:
P ( real e ) = σ α u A ( e ) + β u B ( e ) γ u C ( e ) b , σ ( z ) = 1 1 + e z ,
where α , β , γ 0 are weights and b is a bias term. The weights ( α , β , γ , b ) control the relative importance of the three density-normalized supports: direct support from central events ( u A ), continuity support from local events ( u B ), and self-clustering among remaining candidates ( u C ). We enforce the intuitive ordering α > β 0 and γ > 0 , reflecting that support from Ω c is the most reliable, Ω l provides secondary evidence, and excessive clustering in Ω should be penalized.
In practice, we determine ( α , β , γ , b ) using a lightweight validation procedure on DVSNOISE20 windows (Section 4.1): we perform a small grid search under the above constraints to maximize validation ESR, and then fix the selected weights for all datasets. This protocol avoids per-dataset tuning while providing a principled way to set the decision boundary of P ( real e ) .
Finally, the border event set is obtained by thresholding:
Ω b = e Ω | P ( real e ) π .

3.7. Denoised Event Stream

The final denoised event stream is the union of central, local, and border events:
Ω real = Ω c Ω l Ω b .
This hard-selection output preserves (i) strongly motion-compensated core structures, (ii) spatiotemporally and directionally consistent supporting events, and (iii) boundary events that are weak individually but supported by nearby real structures, thereby improving robustness to hot pixels, random background activations, and window-dependent event density variations.

3.8. Algorithm Overview

Algorithm 1 summarizes the proposed denoising pipeline within a single time window.
Algorithm 1 Denoising with Robust CM and Hierarchical Event Selection
 Require: 
Event window Ω = { ( x k , t k , p k ) } k = 1 N e , reference time t ref , grid G , parameters σ g , c , λ pol , λ peak , quantiles q , q s , thresholds η c , π , neighborhood radii r s , r t , local gates ( a d , b d , a t , b t , τ θ )
 Ensure: 
Denoised events Ω real
1:
Construct H ( · ; θ ) , H ± ( · ; θ ) for each θ G and evaluate f ( θ )
2:
θ 0 arg max θ G f ( θ ) {Grid initialization}
3:
θ * gradient ascent initialized at θ 0 maximizing f ( θ )
4:
Construct H ( · ) H ( · ; θ * ) and compute central mask M c via quantiles on H and neighborhood support S
5:
Back-project M c to events to obtain Ω c using g k c η c
6:
Compute adaptive τ d , τ t from θ * and select Ω l by joint gating g d g t g θ g p
7:
Ω Ω ( Ω c Ω l ) ; for each e Ω compute n A , n B , n C in U ( e ) and P ( real e )
8:
Ω b { e Ω P ( real e ) π }
9:
Ω real Ω c Ω l Ω b
10:
return  Ω real

4. Experimental Evaluation

4.1. Experimental Setup

4.1.1. Datasets

We evaluate the proposed MSF on four public benchmarks: DVSNOISE20 [23], DVSMOTION20 [50], DVSCLEAN [20], and E-MLB [36]. These datasets jointly cover (i) different background activity and hot-pixel characteristics (DVSNOISE20), (ii) a wide range of motion magnitudes including slow-motion sequences with large inter-event intervals (DVSMOTION20), (iii) controlled synthetic noise injection (DVSCLEAN), and (iv) progressively degraded illumination where noise becomes dominant (E-MLB). This combination enables an informative assessment of robustness and generalization.

4.1.2. Windowing Protocol

Following common practice in event denoising, all methods process the stream in fixed-length temporal windows of Δ t = 20 ms . For each window, we set the reference time t ref to the midpoint of the window, consistent with Section 3.3. All reported quantitative results are obtained by averaging per-window scores over all sequences in each dataset.

4.1.3. Implementation Details and Hyperparameters

MSF contains three stages: (1) motion estimation via robust contrast maximization, (2) central and local event selection, and (3) border event identification by density-normalized probabilistic support.
Motion estimation. We construct the IWE using Gaussian splatting (Section 3.4.1) with kernel standard deviation σ g . The robust contrast term uses the Huber constant c (Section 3.4.2). The final objective is f ( θ ) = f rc ( θ ) + λ pol f pol ( θ ) λ peak R peak ( θ ) (Section 3.4.5), where λ pol and λ peak weight polarity regularization and peak suppression, respectively. Optimization follows the two-stage strategy in Section 3.4.5: a coarse grid search over G to obtain θ 0 , followed by gradient ascent with backtracking line search to yield θ * .
Central event extraction. Given θ * , we form the central mask M c by quantile thresholding on H ( x ) and on the neighborhood-supported accumulation S ( x ) = y N ( x ) H ( y ) (Section 3.5). The quantile levels are q and q s , respectively. Central events are obtained by back-projecting M c to the event domain using bilinear weights and thresholding the soft membership g k c with η c (Section 3.5.1).
Local event selection. Local events Ω l are selected by joint gating (Section 3.5.3), enforcing spatial proximity ( τ d ), temporal proximity ( τ t ), directional consistency ( τ θ ), and polarity consistency. Importantly, τ d and τ t are adaptive and computed from the robust speed scale v ¯ derived from θ * :
τ d = a d + b d v ¯ , τ t = a t + b t v ¯ + ϵ .
This design prevents over-expansion in low-speed segments and preserves sufficient support in high-speed segments.
Border event identification. For the remaining candidates Ω , we compute neighborhood support counts n A , n B , n C in the spatiotemporal neighborhood U ( e ) with radii ( r s , r t ) (Section 3.6.1). We then form density-normalized ratios ( u A , u B , u C ) and apply the logistic model P ( real e ) = σ ( α u A + β u B γ u C b ) with threshold π (Section 3.6.2), yielding border events Ω b .

4.1.4. Baselines

We compare MSF against density-based filters DWF [47], Knoise [51], and Ynoise [52]; a motion-based method EvFlow [17]; surface/smoothness methods TS [53] and RED [54]; and the learning-based EDnCNN [23]. All methods are evaluated under the same windowing protocol.

4.1.5. Metric

The mainstream evaluation metrics for event denoising include relative plausibility measure of denoising (RPMD) [23], plots receiver operating characteristic (ROC) [47], and Event Structural Ratio (ESR) [36]. RPMD evaluates the event denoising performance by measuring the APS intensity and based on IMU motion prediction, and requires high-quality and correctly aligned APS and IMU data, which is suitable for the DVSNOISE20 dataset; ROC assesses the denoising accuracy by using noise annotation data to calculate the false positive rate (FPR) and true positive rate (TPR), and is suitable for synthetic datasets such as DVSCLEAN. ESR assesses the denoising performance by projecting the events onto a distorted event image and calculating the image contrast metric, and can be tested directly on the event sequence. ESR neither relies on synthetic data nor requires access to additional information sources to obtain true value data, and can represent the noise level in all cases. ESR is computed from the image of warped events (IWE), obtained by accumulating the denoised events onto a 2D pixel grid after warping (e.g., using the estimated motion/flow). Let K denote the number of pixels in the IWE, N the total number of events, and n i the number (or accumulated count) of events falling on pixel i ( i = 1 , , K ), such that i = 1 K n i = N . A basic contrast measure for the IWE is the normalized total sum of squares (NTSS), defined as
NTSS = i = 1 K n i ( n i 1 ) N ( N 1 ) .
NTSS reflects the tendency of events to concentrate on a subset of pixels (high contrast) and is normalized by N, making it largely comparable across different event counts. However, NTSS alone can be biased toward over-denoising: if too many events are removed, the remaining events may become artificially concentrated, and in the extreme case N = 1 NTSS reaches its upper bound, failing to faithfully represent the noise level.
To mitigate this issue, ESR incorporates a penalty term that accounts for the spatial support (i.e., the effective area occupied by events) in the IWE:
L N : = K i = 1 K 1 M N n i ,
where M is a fixed reference number of events used for interpolation (kept constant throughout evaluation). Intuitively, 1 M N n i down-weights pixels with larger n i , so L N increases when events are spread over more pixels and decreases when events collapse to a small spatial region. This term, therefore, discourages degenerate solutions that remove most events and yield spuriously high contrast.
Finally, ESR is defined as the geometric combination of the normalized contrast and the support penalty:
ESR : = NTSS · L N .
A higher ESR indicates that the denoised events form sharp, spatially coherent structures (high NTSS ) while still maintaining a reasonable spatial support (appropriate L N ), i.e., preserving meaningful event geometry rather than achieving high contrast by excessive event removal.

4.1.6. Hyper-Parameter Tuning and Protocol

MSF involves several hyper-parameters. To avoid per-dataset overfitting and to ensure fair cross-benchmark evaluation, we adopt a two-stage tuning protocol and then keep a single configuration fixed for all reported results. We also tune the logistic weights ( α , β , γ , b ) of the border-event model (Section 3.6.2) using the same DVSNOISE20 validation protocol, and keep them fixed for all benchmarks.
Stage 1 (coarse search on a validation split). We tune the core hyper-parameters on DVSNOISE20 only. Following a sampling-based split, we randomly sample 20% of non-overlapping temporal windows from each sequence as a validation set, and use the remaining windows for evaluation, ensuring that windows are not shared across splits. We run a coarse grid/random search over a limited set of sensitive parameters and select the configuration that maximizes the average validation ESR (Section 4.1.5), with ties broken by runtime stability.
Stage 2 (fixed-parameter evaluation on all benchmarks). After selecting a single configuration on DVSNOISE20 validation windows, we fix the same hyper-parameters and evaluate on all four datasets (DVSMOTION20, DVSNOISE20, DVSCLEAN, and E-MLB) without any dataset-specific re-tuning.
Core parameters disclosed. In the interest of reproducibility, we disclose the main tuned parameters as follows (fixed across all datasets): Gaussian splatting standard deviation σ g = 1.0 pixel; Huber constant c = 2.0 ; regularization weights λ pol = 0.2 and λ peak = 0.1 ; central-mask quantiles q = 0.95 and q s = 0.90 ; back-projection threshold η c = 0.5 . border-event probability threshold π = 0.5 ; logistic weights ( α , β , γ , b ) = ( 4 , 2 , 3 , 0 ) . Other parameters (e.g., window length Δ t , neighborhood size, and flow-grid bounds) follow common practice and are kept constant across all experiments.

4.2. Qualitative Evaluation

Figure 2 shows representative results in scenes with different motion magnitudes. The raw streams exhibit severe background activity, including isolated events and small spurious clusters that do not correspond to physical edges. Density-based methods (DWF, Knoise, and Ynoise) rely primarily on local event-count statistics and therefore face an intrinsic ambiguity in complex scenes: when genuine edges are temporally sparse (e.g., slow motion or low texture), density can be insufficient to distinguish weak-but-real events from noise, leading to either residual noise or over-suppression of valid structures. TS, which enforces local spatiotemporal surface regularity, often suppresses noise aggressively but may also remove thin structures and attenuate texture-like details, reducing the perceptual completeness of object contours.
EvFlow and RED, which impose temporal continuity constraints, can fail in slow-motion regimes where the temporal spacing of true events becomes large. In such cases, real events on edges are more easily rejected as temporally inconsistent, resulting in fragmented contours. EDnCNN generally produces visually clean outputs, but its behavior depends on the training distribution; in particular, under distribution shifts (e.g., extreme low-light noise patterns), it may either leave structured residual artifacts or oversmooth informative event patterns.
MSF yields visually sharper and more coherent structures across motion conditions. The improvement stems from two coupled mechanisms. First, the robust CM objective (Section 3.4.5) aligns motion-induced events while being less sensitive to event-rate variations and hot-pixel peaks, due to MAD normalization, polarity–gradient decorrelation, and explicit peak suppression. Second, the hierarchical selection strategy preserves structure progressively: central events provide a high-precision core; local events restore spatial continuity under adaptive spatiotemporal thresholds and directional agreement; and border events recover weak responses only when supported by nearby reliable events, while penalizing candidate self-clustering.
Figure 3 further highlights robustness under decreasing illumination. As illumination diminishes, background activity increases and the event manifolds become less regular, which degrades surface-fitting and temporal continuity baselines. MSF remains stable because motion-compensated aggregation strengthens true structures, and the density-normalized probabilistic support (Section 3.6.2) reduces sensitivity to the increased overall event rate, enabling the retention of meaningful contours even in the most challenging setting.

4.3. Quantitative Evaluation

Table 1 reports average ESR over four benchmarks. All methods improve ESR relative to the raw streams to varying degrees, confirming that suppressing background activity generally increases structural consistency. EDnCNN achieves the highest ESR on DVSNOISE20, which is expected because the dataset provides noise probability labels and is commonly used to train or calibrate learning-based denoisers [23]. On DVSCLEAN, Ynoise attains the best ESR, likely because synthetic high-density noise amplifies the effectiveness of density-driven rules.
MSF achieves the best ESR on DVSMOTION20 and E-MLB, and remains highly competitive on DVSNOISE20 and DVSCLEAN. Notably, the gains on DVSMOTION20 indicate robustness to slow motion, where temporal continuity cues are weak and density statistics are ambiguous. The top performance on E-MLB validates MSF under low-light noise, where event-rate changes and hot-pixel activations are more pronounced. These results support the central claim of MSF: combining robust motion-compensated alignment with hierarchical, density-invariant spatiotemporal support yields stable denoising across heterogeneous conditions.

4.4. Ablation Study

To quantify the individual contribution of each proposed component, we conduct an ablation study on DVSNOISE20 under the same windowing protocol ( Δ t = 20 ms) and the fixed hyper-parameter setting reported in Section 4.1. We report the average ESR over all windows. Each ablation variant removes one component from MSF while keeping all other steps unchanged.

4.4.1. Ablated Components

We evaluate the following: (i) removing the polarity–gradient decorrelation term by setting λ pol = 0 (“w/o Pol”); (ii) removing peak suppression by setting λ peak = 0 (“w/o Peak”); and (iii) removing each level of hierarchical selection by using only a subset of event sets: central-only (“C only”), central+local (“C+L”), and central+local+border (full MSF).

4.4.2. Results and Discussion

Table 2 shows that each proposed component consistently improves ESR. In particular, the polarity regularization and peak suppression stabilize motion estimation under mixed-polarity noise and hot-pixel-induced degeneracy, respectively, which translates to improved event alignment and higher ESR. Moreover, progressively adding local and border events improves structural completeness: central events provide high precision, local expansion restores contour continuity, and the border stage recovers weak boundary events that are otherwise missed, leading to the best overall ESR.

4.5. Scalability with Respect to the Number of Events

We analyze how MSF scales with the number of events N e in a temporal window. Let the sensor resolution be K = | X | pixels (e.g., K = W H ), the flow grid size be | G | = G , the number of gradient-ascent iterations be I, the Gaussian splatting support size be S pixels per event (a small constant determined by σ g and truncation), and the average number of central events be N c .

4.5.1. Motion Estimation (Grid + Refinement)

For each candidate flow θ , constructing the IWE by Gaussian splatting costs O ( N e S ) . Computing robust statistics (median and MAD) over the pixel plane costs O ( K ) (or O ( K log K ) if implemented via sorting; in practice K is fixed by the sensor resolution). The polarity–gradient correlation and peak penalty are also O ( K ) after the IWEs are built. Therefore, evaluating the objective once is
O ( N e S + K ) .
The coarse grid search is O G ( N e S + K ) , and the refinement stage is O I ( N e S + K ) , yielding total motion-estimation complexity
O ( G + I ) ( N e S + K ) .
For a fixed sensor resolution and fixed splatting kernel, S and K are constants; hence. motion estimation scales linearly with N e .

4.5.2. Central Event Extraction

Given θ * , building the final IWE is O ( N e S ) and computing quantiles/neighborhood sums on the pixel plane is O ( K ) . Back-projecting the central mask to the event domain via bilinear sampling is O ( N e ) . Thus, this stage is O ( N e S + K ) , i.e., linear in N e .

4.5.3. Local Event Selection (Central-to-Local Expansion)

A naive implementation that checks each non-central event against all central events would be O ( N c ( N e N c ) ) . To keep the method scalable, we use local spatiotemporal neighbor queries: events are indexed in a spatial grid (or voxel hash) and processed in timestamp order so that candidate neighbors of an event can be retrieved in expected constant time with a bounded neighborhood. With such indexing, each event only compares against a bounded number of nearby events within ( τ d , τ t ) , and the expected cost becomes
O ( N e m ¯ ) ,
where m ¯ is the average number of retrieved neighbors inside the query window (typically small and bounded by the chosen radii). Hence local selection is near-linear in N e .

4.5.4. Border Event Identification

Border identification computes ( n A , n B , n C ) by counting neighbors in U ( e ) . With the same grid/voxel indexing, each candidate event queries a bounded neighborhood; thus, the expected complexity is also O ( N e m ¯ ) .

4.5.5. Overall Scaling

Combining all components, for fixed resolution K and fixed hyperparameters ( G , I , S , τ d , τ t , r s , r t ) , MSF scales approximately linearly with the number of events per window:
T ( N e ) = O ( G + I ) N e + N e m ¯ ,
where ( G + I ) and m ¯ depend on the chosen accuracy–speed setting rather than on N e itself. In the worst case, if the neighborhood query window becomes so large that m ¯ grows with N e , the counting stages may degrade toward quadratic behavior; however, MSF uses fixed spatiotemporal radii and a constant window length, which keeps the neighborhood size bounded and avoids such degeneration in typical operating conditions.

4.6. Computational Efficiency

4.6.1. Protocol

We measure average wall-clock runtime per Δ t = 20 ms window on a desktop CPU (Intel i5-13600KF) using Python 3.8 implementations for all methods. This setting reflects a practical non-optimized deployment and enables a fair comparison under the same windowing protocol used throughout the paper.

4.6.2. Runtime Comparison and Real-Time Requirement

With Δ t = 20 ms, real-time processing requires the average per-window latency to be below 20 ms. Table 3 reports the measured runtimes. MSF achieves 11.64 ms per window on average, satisfying the real-time constraint on CPU in Python. Among the compared methods, density-based filters (Knoise/DWF/Ynoise) are faster due to their simpler local counting rules, while TS/RED and MSF remain within the 20 ms budget. In contrast, EvFlow (256 ms) and EDnCNN (313 ms) are not real-time under our CPU Python setup.

4.6.3. Discussion

MSF’s runtime is dominated by motion estimation (coarse grid evaluation and refinement) and the hierarchical neighborhood verification. In practice, the speed can be further improved by reducing the flow-grid resolution, decreasing the number of refinement iterations. These knobs provide an explicit accuracy–speed trade-off for embedded or low-power deployment.

5. Conclusions

We proposed MSF, a motion-guided multi-level filtering framework for event-stream denoising. Within each temporal window, MSF estimates a constant optical flow by maximizing a robust, density-normalized contrast objective on the image of warped events. We further incorporate a polarity–gradient decorrelation term to suppress mixed-polarity noise and a peak-suppression regularizer to avoid degeneracy caused by hot pixels. Based on the estimated motion, MSF performs hierarchical event selection: central events are extracted via quantile-based masking with neighborhood support and back-projection; local events are recovered using adaptive spatiotemporal proximity and directional consistency; and border events are identified by a density-normalized probabilistic support model that rewards support from reliable structures while penalizing self-clustering among remaining candidates. Experiments on four public datasets demonstrate that MSF consistently improves ESR and generalizes well across diverse motion and illumination conditions.
Future work will extend MSF beyond the single-motion assumption by integrating motion segmentation and multi-model flow estimation, enabling principled denoising in scenes containing multiple independently moving objects and complex motion boundaries.

Author Contributions

Conceptualization, J.W.; methodology, J.W.; software, J.W. and N.S.; validation, J.W.; formal analysis, J.W.; investigation, J.W.; resources, X.X.; data curation, N.S.; writing—original draft preparation, J.W.; writing—review and editing, K.Y.; visualization, J.W.; supervision, K.Y. and X.X.; project administration, K.Y. and X.X.; funding acquisition, K.Y. All authors have read and agreed to the published version of the manuscript.

Funding

This research was funded by the Foundation for the National Key Laboratory of Electromagnetic Energy under Grant No. 6142217242040101.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

The raw data supporting the conclusions of this article will be made available by the authors on request.

Acknowledgments

The authors extend their gratitude to the reviewers and editors for their help.

Conflicts of Interest

The authors declare no conflicts of interest.

Appendix A

Appendix A.1. Gradient Computation for Motion Parameters

To facilitate replication, we provide the explicit gradient of the objective w.r.t. the constant-flow parameters θ = v = ( v x , v y ) . Denote Δ t k ( t ref t k ) and the warped location
x k = x k + v Δ t k .
Our IWE is
H ( x ; v ) = k = 1 N e κ g ( x x k ) , κ g ( u ) = exp u 2 2 σ g 2 ,
(and similarly H ± by restricting to events with p k = ± 1 ). For any pixel x , the derivative of H w.r.t. v follows by the chain rule through x k :
H ( x ; v ) v = k = 1 N e κ g ( x x k ) x k x k v ,
x k v = Δ t k I 2 ,
κ g ( x x k ) x k = κ g ( x x k ) ( x x k ) σ g 2 .
Therefore,
H ( x ; v ) v = k = 1 N e κ g ( x x k ) ( x x k ) σ g 2 Δ t k ,
which is a 2D vector (for v x and v y ). The gradients for H + and H are obtained by summing only over events of the corresponding polarity.

Appendix A.2. Gradient of the Robust Contrast Term

Let r ( x ; v ) = H ( x ; v ) m H ( v ) s H ( v ) and f rc ( v ) = 1 | X | x ρ ( r ( x ; v ) ) . We compute v f rc by
v f rc ( v ) = 1 | X | x X ρ r ( x ; v ) v r ( x ; v ) ,
where ρ ( u ) = u if | u | c and ρ ( u ) = c sign ( u ) otherwise. In implementation, for numerical stability and efficiency, we treat m H ( v ) and s H ( v ) as constants within each gradient-ascent iteration (i.e., we do not back-propagate through the median/MAD operators), and update them after each motion update. (This is a standard practice in robust optimization with non-smooth robust statistics; we found it stable and it matches the objective improvement in practice.) Thus,
v r ( x ; v ) 1 s H ( v ) v H ( x ; v ) ,
and v H ( x ; v ) is given in Equation (A6).

Appendix A.3. Gradient of Polarity Regularization

Recall f pol ( v ) = g + , g g + g + ϵ where g ± ( x ; v ) = H ± ( x ; v ) . We compute v f pol by differentiating the normalized correlation. Concretely, since the spatial gradient operator is linear, we have
g ± ( x ; v ) v = H ± ( x ; v ) v ,
where H ± v is computed with Equation (A6) using polarity-restricted sums. The remaining derivative follows from standard quotient-rule differentiation of cosine similarity.

Appendix A.4. Gradient of the Peak-Suppression Regularizer

For H ˜ ( x ; v ) = H ( x ; v ) / ( y H ( y ; v ) + ϵ ) and R peak ( v ) = max x H ˜ ( x ; v ) , we use a smooth approximation to the max to enable stable gradients:
R peak ( v ) 1 β log x X exp β H ˜ ( x ; v ) ,
with a large β (e.g., β = 50 ). This yields a softmax-weighted gradient of H ˜ w.r.t. v , again using Equation (A6) and the quotient rule.
Finally, the overall gradient is
v f ( v ) = v f rc ( v ) + λ pol v f pol ( v ) λ peak v R peak ( v ) ,
which is used in Equation (18) with backtracking line search to guarantee monotonic ascent.

References

  1. Zhang, Z.; Liu, Q. Spike-Event-Driven Deep Spiking Neural Network With Temporal Encoding. IEEE Signal Process. Lett. 2021, 28, 484–488. [Google Scholar] [CrossRef]
  2. Rebecq, H.; Horstschaefer, T.; Gallego, G.; Scaramuzza, D. EVO: A Geometric Approach to Event-Based 6-DOF Parallel Tracking and Mapping in Real Time. IEEE Robot. Autom. Lett. 2017, 2, 593–600. [Google Scholar] [CrossRef]
  3. Guo, S.; Gallego, G. CMax-SLAM: Event-based Rotational-Motion Bundle Adjustment and SLAM System using Contrast Maximization. IEEE Trans. Robot. 2024, 40, 2442–2461. [Google Scholar] [CrossRef]
  4. Chen, W.; Zhang, Y.; Sun, X.; Wu, F. Event-Based Stereo Depth Estimation by Temporal-Spatial Context Learning. IEEE Signal Process. Lett. 2024, 31, 1429–1433. [Google Scholar] [CrossRef]
  5. Chen, G.; Cao, H.; Conradt, J.; Tang, H.; Rohrbein, F.; Knoll, A. Event-based neuromorphic vision for autonomous driving: A paradigm shift for bio-inspired visual sensing and perception. IEEE Signal Process. Mag. 2020, 37, 34–49. [Google Scholar] [CrossRef]
  6. Maqueda, A.I.; Loquercio, A.; Gallego, G.; García, N.; Scaramuzza, D. Event-based vision meets deep learning on steering prediction for self-driving cars. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2018; pp. 5419–5427. [Google Scholar]
  7. Wang, Y.; Jiang, C.; Jia, X.; Guo, Y.; Yu, L. Event-Based Shutter Unrolling and Motion Deblurring in Dynamic Scenes. IEEE Signal Process. Lett. 2024, 31, 1069–1073. [Google Scholar] [CrossRef]
  8. Gehrig, D.; Rebecq, H.; Gallego, G.; Scaramuzza, D. Asynchronous, photometric feature tracking using events and frames. In Proceedings of the European Conference on Computer Vision (ECCV); IEEE: Piscataway, NJ, USA, 2018; pp. 750–765. [Google Scholar]
  9. Vasco, V.; Glover, A.; Bartolozzi, C. Fast event-based Harris corner detection exploiting the advantages of event-driven cameras. In Proceedings of the 2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS); IEEE: Piscataway, NJ, USA, 2016; pp. 4144–4149. [Google Scholar]
  10. Gallego, G.; Delbrück, T.; Orchard, G.; Bartolozzi, C.; Taba, B.; Censi, A.; Leutenegger, S.; Davison, A.J.; Conradt, J.; Daniilidis, K.; et al. Event-based Vision: A Survey. IEEE Trans. Pattern Anal. Mach. Intell. 2022, 44, 154–180. [Google Scholar] [CrossRef]
  11. Liu, S.C.; Rueckauer, B.; Ceolini, E.; Huber, A.; Delbrück, T. Event-Driven Sensing for Efficient Perception: Vision and Audition Algorithms. IEEE Signal Process. Mag. 2019, 36, 29–37. [Google Scholar] [CrossRef]
  12. Lichtsteiner, P.; Posch, C.; Delbruck, T. A 128×128 120 dB 15 μs latency asynchronous temporal contrast vision sensor. IEEE J. Solid-State Circuits 2008, 43, 566–576. [Google Scholar] [CrossRef]
  13. Czech, D.; Orchard, G. Evaluating noise filtering for event-based asynchronous change detection image sensors. In Proceedings of the 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob); IEEE: Piscataway, NJ, USA, 2016; pp. 19–24. [Google Scholar]
  14. Zhang, P.; Ge, Z.; Song, L.; Lam, E.Y. Neuromorphic imaging with density-based spatiotemporal denoising. IEEE Trans. Comput. Imaging 2023, 9, 530–541. [Google Scholar] [CrossRef]
  15. Duan, P.; Wang, Z.W.; Shi, B.; Cossairt, O.; Huang, T.; Katsaggelos, A.K. Guided event filtering: Synergy between intensity images and neuromorphic events for high performance imaging. IEEE Trans. Pattern Anal. Mach. Intell. 2021, 44, 8261–8275. [Google Scholar] [CrossRef] [PubMed]
  16. Liu, H.; Brandli, C.; Li, C.; Liu, S.C.; Delbruck, T. Design of a spatiotemporal correlation filter for event-based sensors. In Proceedings of the 2015 IEEE International Symposium on Circuits and Systems (ISCAS); IEEE: Piscataway, NJ, USA, 2015; pp. 722–725. [Google Scholar]
  17. Wang, Y.; Du, B.; Shen, Y.; Wu, K.; Zhao, G.; Sun, J.; Wen, H. EV-gait: Event-based robust gait recognition using dynamic vision sensors. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2019; pp. 6358–6367. [Google Scholar]
  18. Wu, J.; Ma, C.; Li, L.; Dong, W.; Shi, G. Probabilistic undirected graph based denoising method for dynamic vision sensor. IEEE Trans. Multimed. 2020, 23, 1148–1159. [Google Scholar] [CrossRef]
  19. Gallego, G.; Rebecq, H.; Scaramuzza, D. A unifying contrast maximization framework for event cameras, with applications to motion, depth, and optical flow estimation. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2018; pp. 3867–3876. [Google Scholar]
  20. Fang, H.; Wu, J.; Li, L.; Hou, J.; Dong, W.; Shi, G. AEDNet: Asynchronous event denoising with Spatial-Temporal correlation among irregular data. In Proceedings of the 30th ACM International Conference on Multimedia; ACM: New York, NY, USA, 2022; pp. 1427–1435. [Google Scholar]
  21. Alkendi, Y.; Azzam, R.; Ayyad, A.; Javed, S.; Seneviratne, L.; Zweiri, Y. Neuromorphic camera denoising using graph neural network-driven transformers. IEEE Trans. Neural Netw. Learn. Syst. 2022, 35, 4110–4124. [Google Scholar] [CrossRef] [PubMed]
  22. Duan, P.; Wang, Z.W.; Zhou, X.; Ma, Y.; Shi, B. EventZoom: Learning to denoise and super resolve neuromorphic events. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2021; pp. 12824–12833. [Google Scholar]
  23. Baldwin, R.; Almatrafi, M.; Asari, V.; Hirakawa, K. Event probability mask (epm) and event denoising convolutional neural network (edncnn) for neuromorphic cameras. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2020; pp. 1701–1710. [Google Scholar]
  24. Miskowicz, M. Send-on-Delta Concept: An Event-Based Data Reporting Strategy. Sensors 2006, 6, 49–63. [Google Scholar] [CrossRef]
  25. Jiang, H.; Wang, X.; Tang, W.; Song, Q.; Song, Q.; Hao, W. Event Stream Denoising Method Based on Spatio-Temporal Density and Time Sequence Analysis. Sensors 2024, 24, 6527. [Google Scholar] [CrossRef]
  26. Lin, W.; Li, Y.; Xu, C.; Liu, L. A motion denoising algorithm with Gaussian self-adjusting threshold for event camera. Vis. Comput. 2024, 40, 6567–6580. [Google Scholar] [CrossRef]
  27. Jeziorek, K.; Pinna, A.; Kryjak, T. Memory-efficient graph convolutional networks for object classification and detection with event cameras. In Proceedings of the 2023 Signal Processing: Algorithms, Architectures, Arrangements, and Applications (SPA); IEEE: Piscataway, NJ, USA, 2023; pp. 160–165. [Google Scholar]
  28. Jiang, B.; Xiong, B.; Qu, B.; Salman Asif, M.; Zhou, Y.; Ma, Z. Edformer: Transformer-based event denoising across varied noise levels. In Proceedings of the European Conference on Computer Vision; Springer: Berlin/Heidelberg, Germany, 2024; pp. 200–216. [Google Scholar]
  29. Zhang, Z.; Suo, J.; Dai, Q. Denoising of event-based sensors with deep neural networks. In Proceedings of the Optoelectronic Imaging and Multimedia Technology VIII; SPIE: Bellingham, WA, USA, 2021; Volume 11897, pp. 203–209. [Google Scholar]
  30. Boudiaf, M.A.; Benkherrat, M.; Djelel, S.; Messadeg, D.; Absi, R. Efficient Adaptive Learning via Partial-Update Variable Step-Size LMS for Real-Time ERP Denoising. Appl. Sci. 2025, 15, 12702. [Google Scholar] [CrossRef]
  31. Yuan, C.; Jin, Y.; Wu, Z.; Wei, F.; Wang, Y.; Chen, L.; Wang, X. Learning bottleneck transformer for event image-voxel feature fusion based classification. In Proceedings of the Chinese Conference on Pattern Recognition and Computer Vision (PRCV); Springer: Berlin/Heidelberg, Germany, 2023; pp. 3–15. [Google Scholar]
  32. Duan, Y. Led: A large-scale real-world paired dataset for event camera denoising. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2024; pp. 25637–25647. [Google Scholar]
  33. Wu, Z.; Zhang, Z.; Gao, H.; Qin, J.; Zhao, R.; Zhao, G.; Li, G. Modeling learnable electrical synapse for high precision spatio-temporal recognition. Neural Netw. 2022, 149, 184–194. [Google Scholar] [CrossRef]
  34. Wu, Z.; Zhang, H.; Lin, Y.; Li, G.; Wang, M.; Tang, Y. Liaf-net: Leaky integrate and analog fire network for lightweight and efficient spatiotemporal information processing. IEEE Trans. Neural Netw. Learn. Syst. 2021, 33, 6249–6262. [Google Scholar] [CrossRef]
  35. Harada, S.; Hara, J.; Higashi, H.; Tanaka, Y. Denoising for Neuromorphic Cameras Based on Graph Spectral Features. In Proceedings of the 2024 IEEE 26th International Workshop on Multimedia Signal Processing (MMSP); IEEE: Piscataway, NJ, USA, 2024; pp. 1–6. [Google Scholar]
  36. Ding, S.; Chen, J.; Wang, Y.; Kang, Y.; Song, W.; Cheng, J.; Cao, Y. E-MLB: Multilevel benchmark for event-based camera denoising. IEEE Trans. Multimed. 2023, 26, 65–76. [Google Scholar] [CrossRef]
  37. Shao, B.; Wang, Y.; Cai, Z.; Zhao, J. Event Camera Visualization. In Proceedings of the International Conference on Guidance, Navigation and Control; Springer: Berlin/Heidelberg, Germany, 2022; pp. 6023–6032. [Google Scholar]
  38. Lv, Y.; Liu, Z.; Zhou, L.; Qiao, W.; Zhang, H. Denoising algorithm based on event camera. In Proceedings of the Sixth Conference on Frontiers in Optical Imaging and Technology: Novel Detector Technologies; SPIE: Bellingham, WA, USA, 2024; Volume 13154, pp. 59–65. [Google Scholar]
  39. Kim, T.; Jeong, J.; Cho, H.; Jeong, Y.; Yoon, K.J. Towards real-world event-guided low-light video enhancement and deblurring. In Proceedings of the European Conference on Computer Vision; Springer: Berlin/Heidelberg, Germany, 2024; pp. 433–451. [Google Scholar]
  40. Pallavi, K.; Deepa, M. Adaptive thresholding method for speckle reduction of echocardiographic images. IETE J. Res. 2022, 68, 1034–1042. [Google Scholar]
  41. Bhandari, A.K.; Kumar, D.; Kumar, A.; Singh, G.K. Optimal sub-band adaptive thresholding based edge preserved satellite image denoising using adaptive differential evolution algorithm. Neurocomputing 2016, 174, 698–721. [Google Scholar] [CrossRef]
  42. Bhutada, G.; Anand, R.S.; Saxena, S. PSO-based learning of sub-band adaptive thresholding function for image denoising. Signal Image Video Process. 2012, 6, 1–7. [Google Scholar] [CrossRef]
  43. WangNo, N.; Chiewchanwattana, S.; Sunat, K. An efficient adaptive thresholding function optimized by a cuckoo search algorithm for a despeckling filter of medical ultrasound images. J. Ambient. Intell. Humaniz. Comput. 2023, 14, 15429–15454. [Google Scholar] [CrossRef]
  44. Birdawod, H.Q.; Khudhur, A.M.; Kadir, D.H.; Saleh, D.M. A wavelet shrinkage mixed with a single-level 2D discrete wavelet transform for image denoising. Kurd. J. Appl. Res. 2024, 9, 1–12. [Google Scholar] [CrossRef]
  45. Kong, L.; Lu, D.; Xu, X.; Ng, L.X.; Ooi, W.T.; Cottereau, B.R. EventFly: Event Camera Perception from Ground to the Sky. In Proceedings of the Computer Vision and Pattern Recognition Conference; IEEE: Piscataway, NJ, USA, 2025; pp. 1472–1484. [Google Scholar]
  46. Cho, H.; Kim, T.; Jeong, Y.; Yoon, K.J. TTA-EVF: Test-time adaptation for event-based video frame interpolation via reliable pixel and sample estimation. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; IEEE: Piscataway, NJ, USA, 2024; pp. 25701–25711. [Google Scholar]
  47. Guo, S.; Delbruck, T. Low cost and latency event camera background activity denoising. IEEE Trans. Pattern Anal. Mach. Intell. 2022, 45, 785–795. [Google Scholar] [CrossRef]
  48. Ester, M.; Kriegel, H.P.; Sander, J.; Xu, X. A density-based algorithm for discovering clusters in large spatial databases with noise. In Proceedings of the KDD’96: Second International Conference on Knowledge Discovery and Data Mining; AAAI: Menlo Park, CA, USA, 1996; Volume 96, pp. 226–231. [Google Scholar]
  49. Fang, H.; Wu, J.; Hou, Q.; Dong, W.; Shi, G. Fast window-based event denoising with spatiotemporal correlation enhancement. IEEE Trans. Pattern Anal. Mach. Intell. 2024, 47, 1381–1394. [Google Scholar] [CrossRef]
  50. Almatrafi, M.; Baldwin, R.; Aizawa, K.; Hirakawa, K. Distance surface for event-based optical flow. IEEE Trans. Pattern Anal. Mach. Intell. 2020, 42, 1547–1556. [Google Scholar] [CrossRef]
  51. Khodamoradi, A.; Kastner, R. O(N)-space spatiotemporal filter for reducing noise in neuromorphic vision sensors. IEEE Trans. Emerg. Top. Comput. 2018, 9, 15–23. [Google Scholar] [CrossRef]
  52. Feng, Y.; Lv, H.; Liu, H.; Zhang, Y.; Xiao, Y.; Han, C. Event density based denoising method for dynamic vision sensor. Appl. Sci. 2020, 10, 2024. [Google Scholar] [CrossRef]
  53. Lagorce, X.; Orchard, G.; Galluppi, F.; Shi, B.E.; Benosman, R.B. Hots: A hierarchy of event-based time-surfaces for pattern recognition. IEEE Trans. Pattern Anal. Mach. Intell. 2016, 39, 1346–1359. [Google Scholar] [CrossRef]
  54. Ding, S.; Zhang, H.; Zhang, Y.; Huang, X.; Song, W. Hyper real-time flame detection: Dynamic insights from event cameras and FlaDE dataset. Expert Syst. Appl. 2025, 263, 125746. [Google Scholar] [CrossRef]
Figure 1. Framework of multi-level joint spatiotemporal noise filtering. This framework extracts center events from the raw events based on motion parameters, subsequently derives local events and border events according to the spatiotemporal relationships among events, and identifies the remaining events as noise.
Figure 1. Framework of multi-level joint spatiotemporal noise filtering. This framework extracts center events from the raw events based on motion parameters, subsequently derives local events and border events according to the spatiotemporal relationships among events, and identifies the remaining events as noise.
Sensors 26 01437 g001
Figure 2. The denoising performance of different algorithms under different motion speed scenes, including (a) slow motion scene and (b) intense motion scene. The relative movement speed between the event camera and the scene is less than 10 pixels per second in (a) scene and greater than 100 pixels per second in (b) scene.
Figure 2. The denoising performance of different algorithms under different motion speed scenes, including (a) slow motion scene and (b) intense motion scene. The relative movement speed between the event camera and the scene is less than 10 pixels per second in (a) scene and greater than 100 pixels per second in (b) scene.
Sensors 26 01437 g002
Figure 3. The denoising performance of different algorithms under varying noise scale scenes, including (a) poor illumination scene and (b) sufficient illumination scene. The E-MLB dataset simulates different light intensities by placing neutral density(ND) filters with different light transmittance (1/4, 1/16, and 1/64) in front of the event camera, represented as ND04, ND16, and ND64. Red boxes denote regions of desired signal to be retained, while blue boxes indicate noise regions to be removed.
Figure 3. The denoising performance of different algorithms under varying noise scale scenes, including (a) poor illumination scene and (b) sufficient illumination scene. The E-MLB dataset simulates different light intensities by placing neutral density(ND) filters with different light transmittance (1/4, 1/16, and 1/64) in front of the event camera, represented as ND04, ND16, and ND64. Red boxes denote regions of desired signal to be retained, while blue boxes indicate noise regions to be removed.
Sensors 26 01437 g003aSensors 26 01437 g003b
Table 1. Average ESR on public datasets. The best and second-best results are highlighted.
Table 1. Average ESR on public datasets. The best and second-best results are highlighted.
DVSMOTION20DVSNOISE20DVSCLEANE-MLB
Raw0.6840.5240.7320.814
Knoise0.6950.5500.7650.865
DWF0.7510.4580.7520.911
EvFlow0.6900.6670.7830.878
Ynoise0.7820.6540.8230.878
TS0.7320.7450.8150.891
RED0.7460.7240.8050.906
EDnCNN0.7620.7620.8160.913
Ours0.7950.7470.8180.920
Table 2. Ablation study on DVSNOISE20. We report average ESR under the same protocol as Section 4.1. Higher is better.
Table 2. Ablation study on DVSNOISE20. We report average ESR under the same protocol as Section 4.1. Higher is better.
VariantESR ↑
Full MSF (C+L+B, w/ Pol, w/ Peak)0.795
w/o Polarity term ( λ pol = 0 )
w/o Peak suppression ( λ peak = 0 )
0.732
0.748
C only (central events only)
C+L (central + local, no border)
0.697
0.752
Table 3. Average runtime per 20 ms window on Intel i5-13600KF (Python). Real-time requires <20 ms/window.
Table 3. Average runtime per 20 ms window on Intel i5-13600KF (Python). Real-time requires <20 ms/window.
MethodAvg. Runtime (ms/window)
Knoise3.18
DWF7.25
Ynoise6.07
TS17.46
RED12.05
MSF (ours)11.64
EvFlow256
EDnCNN313
Disclaimer/Publisher’s Note: The statements, opinions and data contained in all publications are solely those of the individual author(s) and contributor(s) and not of MDPI and/or the editor(s). MDPI and/or the editor(s) disclaim responsibility for any injury to people or property resulting from any ideas, methods, instructions or products referred to in the content.

Share and Cite

MDPI and ACS Style

Wang, J.; Yu, K.; Xu, X.; Shan, N. MSF: Multi-Level Spatiotemporal Filtering for Event Denoising via Motion Estimation. Sensors 2026, 26, 1437. https://doi.org/10.3390/s26051437

AMA Style

Wang J, Yu K, Xu X, Shan N. MSF: Multi-Level Spatiotemporal Filtering for Event Denoising via Motion Estimation. Sensors. 2026; 26(5):1437. https://doi.org/10.3390/s26051437

Chicago/Turabian Style

Wang, Jiuhe, Kun Yu, Xinghua Xu, and Nanliang Shan. 2026. "MSF: Multi-Level Spatiotemporal Filtering for Event Denoising via Motion Estimation" Sensors 26, no. 5: 1437. https://doi.org/10.3390/s26051437

APA Style

Wang, J., Yu, K., Xu, X., & Shan, N. (2026). MSF: Multi-Level Spatiotemporal Filtering for Event Denoising via Motion Estimation. Sensors, 26(5), 1437. https://doi.org/10.3390/s26051437

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop