Title :
A Bio-Inspired AER Temporal Tri-Color Differentiator Pixel Array
Author :
Farian, Lukasz ; Lenero-Bardallo, Juan Antonio ; Hafliger, Philipp
Author_Institution :
Dept. of Inf., Univ. of Oslo, Blindern, Norway
Abstract :
This article investigates the potential of a bio-inspired vision sensor with pixels that detect transients between three primary colors. The in-pixel color processing is inspired by the retinal color opponency that are found in mammalian retinas. Color transitions in a pixel are represented by voltage spikes, which are akin to a neuron´s action potential. These spikes are conveyed off-chip by the Address Event Representation (AER) protocol. To achieve sensitivity to three different color spectra within the visual spectrum, each pixel has three stacked photodiodes at different depths in the silicon substrate. The sensor has been fabricated in the standard TSMC 90 nm CMOS technology. A post-processing method to decode events into color transitions has been proposed and implemented as a custom interface to display real-time color changes in the visual scene. Experimental results are provided. Color transitions can be detected at high speed (up to 2.7 kHz). The sensor has a dynamic range of 58 dB and a power consumption of 22.5 mW. This type of sensor can be of use in industrial, robotics, automotive and other applications where essential information is contained in transient emissions shifts within the visual spectrum.
Keywords :
CMOS image sensors; photodiodes; TSMC CMOS technology; address event representation protocol; automotive applications; bioinspired AER temporal tricolor differentiator pixel array; color transitions; in-pixel color processing; industrial applications; mammalian retinas; neuron action potential; noise figure 58 dB; photodiodes; postprocessing method; power 22.5 mW; power consumption; retinal color opponency; robotics; silicon substrate; transient emissions; visual scene; visual spectrum; voltage spikes; Arrays; Color; Image color analysis; Photodiodes; Retina; Robot sensing systems; Sensitivity; Address Event Representation (AER); CMOS pixel; asynchronous vision sensor; color processing; dynamic vision sensor; high-speed vision sensor; image sensors; temporal contrast;
Journal_Title :
Biomedical Circuits and Systems, IEEE Transactions on
DOI :
10.1109/TBCAS.2015.2492460