Vision without the Image
AbstractNovel image sensors transduce the stream of photons directly into asynchronous electrical pulses, rather than forming an image. Classical approaches to vision start from a good quality image and therefore it is tempting to consider image reconstruction as a first step to image analysis. We propose that, instead, one should focus on the task at hand (e.g., detection, tracking or control) and design algorithms that compute the relevant variables (class, position, velocity) directly from the stream of photons. We discuss three examples of such computer vision algorithms and test them on simulated data from photon-counting sensors. Such algorithms work just-in-time, i.e., they complete classification, search and tracking with high accuracy as soon as the information is sufficient, which is typically before there are enough photons to form a high-quality image. We argue that this is particularly useful when the photons are few or expensive, e.g., in astronomy, biological imaging, surveillance and night vision. View Full-Text
Share & Cite This Article
Chen, B.; Perona, P. Vision without the Image. Sensors 2016, 16, 484.
Chen B, Perona P. Vision without the Image. Sensors. 2016; 16(4):484.Chicago/Turabian Style
Chen, Bo; Perona, Pietro. 2016. "Vision without the Image." Sensors 16, no. 4: 484.
Note that from the first issue of 2016, MDPI journals use article numbers instead of page numbers. See further details here.