Skip to Content
SensorsSensors
  • Article
  • Open Access

6 February 2021

14 Pages

Optical Flow Estimation by Matching Time Surface with Event-Based Cameras

,
and
1
Department of Electronics and Electrical Engineering, Faculty of Science and Technology, Keio University, 3-14-1, Hiyoshi, Kohoku-ku, Yokohama, Kanagawa 223-8522, Japan
2
Denso IT Laboratory, 2-15-1, Shibuya, Shibuya-ku, Tokyo 150-0002, Japan
*
Author to whom correspondence should be addressed.
This article belongs to the Section Sensing and Imaging

Abstract

In this work, we propose a novel method of estimating optical flow from event-based cameras by matching the time surface of events. The proposed loss function measures the timestamp consistency between the time surface formed by the latest timestamp of each pixel and the one that is slightly shifted in time. This makes it possible to estimate dense optical flows with high accuracy without restoring luminance or additional sensor information. In the experiment, we show that the gradient was more correct and the loss landscape was more stable than the variance loss in the motion compensation approach. In addition, we show that the optical flow can be estimated with high accuracy by optimization with L1 smoothness regularization using publicly available datasets.

Article Metrics

Citations

Article Access Statistics

Multiple requests from the same IP address are counted as one view.