This is an early access version, the complete PDF, HTML, and XML versions will be available soon.
Open AccessArticle
A Systematic Parametric Campaign to Benchmark Event Cameras in Computer Vision Tasks
by
Dario Cazzato
Dario Cazzato
Dr. Dario Cazzato received his PhD in
Innovation Engineering from the University of Salento in of [...]
Dr. Dario Cazzato received his PhD in
Innovation Engineering from the University of Salento in 2016, investigating
the topics of human–machine interaction, gaze estimation, social robotics
(robotic vision), and biometrics. After post-doctoral experiences at the
IMIBIC, Instituto Maimónides de Investigación Biomédica de Córdoba, Spain, and
the Interdisciplinary Centre for Security, Reliability and Trust (SnT) at the
University of Luxembourg, as well as experiences in the R&D departments of
private companies, he moved to the Joint Research Centre of the European
Commission in 2024. His research topics mainly include computer vision,
artificial intelligence, pattern recognition, and robotics.
*
,
Graziano Renaldi
Graziano Renaldi
Graziano
Renaldi holds an MSc degree in Engineering from Politecnico di Milano,
Italy. He conducts a [...]
Graziano
Renaldi holds an MSc degree in Engineering from Politecnico di Milano,
Italy. He conducts his research and development activities at the
European Commission
Joint Research Centre. His works cover a diverse range of fields,
including robotics, complex network analysis, protocols for radio
communications, Internet of Things devices, edge computing, smart city
platforms, and computer vision. His research focuses
on cutting-edge technologies, with an analytic approach supported by
mathematical analyses and laboratory tests, with an interdisciplinary
vision to combine their benefits.
and
Flavio Bono
Flavio Bono
Flavio Bono holds an MSc degree in Engineering from the Polytechnic of Milan, Italy. He is leading a [...]
Flavio Bono holds an MSc degree in Engineering from the Polytechnic of Milan, Italy. He is leading research activities at the European Commission Joint Research Centre, with a focus on innovative technologies and digital solutions for Smart Cities and Infrastructures. He has performed research activities on structural monitoring techniques and technologies, along with laboratory testing of large-scale structures, for the seismic protection of buildings. His research has also focused on network analysis of critical infrastructures, urban environments, and complex systems, with the integration of data mining techniques with spatial and mathematical analyses. He has extensive experience in IT and industrial automation for the development and implementation of industrial integration and control systems.
Joint Research Centre (JRC), European Commission, 21027 Ispra, Italy
*
Author to whom correspondence should be addressed.
Electronics 2025, 14(13), 2603; https://doi.org/10.3390/electronics14132603 (registering DOI)
Submission received: 26 May 2025
/
Revised: 19 June 2025
/
Accepted: 23 June 2025
/
Published: 27 June 2025
Abstract
The dynamic vision sensor (DVS), or event camera, is emerging as a successful sensing solution for many application fields. While state-of-the-art datasets for event-based vision are well-structured and suitable for the designed goals, they often rely on simulated data or are recorded in loosely controlled conditions, thereby making it challenging to understand the sensor response to varying camera parameters and illumination conditions. To address this knowledge gap, this work introduces the JRC INVISIONS Neuromorphic Sensors Parametric Tests dataset, an extensive collection of event-based data specifically acquired in controlled scenarios that systematically vary bias settings and environmental factors, enabling rigorous evaluation of sensor performance, robustness, and artifacts under realistic conditions that existing datasets lack. The dataset is composed of 2156 scenes recorded with two different off-the-shelf event cameras, eventually paired with a frame camera across three different controlled scenarios: moving targets, mechanical vibrations, and rotation speed estimation; the inclusion of ground truth enables the evaluation of standard computer vision tasks. The proposed manuscript is complemented by an experimental analysis of sensor performance under varying speeds and illumination, event statistics, and acquisition artifacts such as event loss and motion-induced distortions due to line-based readout. The dataset is publicly available and, to the best of our knowledge, represents the first dataset of its kind in the literature, providing a valuable resource for the research community to advance the development of event-based vision systems and applications.
Share and Cite
MDPI and ACS Style
Cazzato, D.; Renaldi, G.; Bono, F.
A Systematic Parametric Campaign to Benchmark Event Cameras in Computer Vision Tasks. Electronics 2025, 14, 2603.
https://doi.org/10.3390/electronics14132603
AMA Style
Cazzato D, Renaldi G, Bono F.
A Systematic Parametric Campaign to Benchmark Event Cameras in Computer Vision Tasks. Electronics. 2025; 14(13):2603.
https://doi.org/10.3390/electronics14132603
Chicago/Turabian Style
Cazzato, Dario, Graziano Renaldi, and Flavio Bono.
2025. "A Systematic Parametric Campaign to Benchmark Event Cameras in Computer Vision Tasks" Electronics 14, no. 13: 2603.
https://doi.org/10.3390/electronics14132603
APA Style
Cazzato, D., Renaldi, G., & Bono, F.
(2025). A Systematic Parametric Campaign to Benchmark Event Cameras in Computer Vision Tasks. Electronics, 14(13), 2603.
https://doi.org/10.3390/electronics14132603
Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details
here.
Article Metrics
Article Access Statistics
For more information on the journal statistics, click
here.
Multiple requests from the same IP address are counted as one view.