Microsaccades for Neuromorphic Stereo Vision

Publikationstyp
Konferenz
Autor(en)
Kaiser, Jacques and Weinland, Jakob and Keller, Philip and Steffen, Lea and Tieck, J Camilo Vasquez and Reichard, Daniel and Roennau, Arne and Conradt, Jörg and Dillmann, Rüdiger
Jahr
2018
Seiten
244--252
Buchtitel
International Conference on Artificial Neural Networks
Bearbeiter
Springer
Abstract
Depth perception through stereo vision is an important feature of biological and artificial vision systems. While biological systems can compute disparities effortlessly, it requires intensive processing for artificial vision systems. The computing complexity resides in solving the correspondence problem -- finding matching pairs of points in the two eyes. Inspired by the retina, event-based vision sensors allow a new constraint to solve the correspondence problem: time. Relying on precise spike-time, spiking neural networks can take advantage of this constraint. However, disparities can only be computed from dynamic environments since event-based vision sensors only report local changes in light intensity. In this paper, we show how microsaccadic eye movements can be used to compute disparities from static environments. To this end, we built a robotic head supporting two Dynamic Vision Sensors (DVS) capable of independent panning and simultaneous tilting. We evaluate the method on both static and dynamic scenes perceived through microsaccades. This paper demonstrates the complementarity of event-based vision sensors and active perception leading to more biologically inspired robots.
Link
https://link.springer.com/chapter/10.1007/978-3-030-01418-6_24
DOI
https://doi.org/10.1007/978-3-030-01418-6_24
Forschungsfelder
Service-Robotik und mobile Manipulation
Projekt
Human Brain Project
Download .bib
Download .bib
Eingetragen von
Jacques Kaiser