Title :
A neuromorphic depth-from-motion vision model with STDP adaptation
Author :
Yang, Zhijun ; Murray, Alan ; Wörgötter, Florentin ; Cameron, Katherine ; Boonsobhak, Vasin
Author_Institution :
Dept. of Comput. Sci., Nanjing Normal Univ., China
fDate :
3/1/2006 12:00:00 AM
Abstract :
We propose a simplified depth-from-motion vision model based on leaky integrate-and-fire (LIF) neurons for edge detection and two-dimensional depth recovery. In the model, every LIF neuron is able to detect the irradiance edges passing through its receptive field in an optical flow field, and respond to the detection by firing a spike when the neuron´s firing criterion is satisfied. If a neuron fires a spike, the time-of-travel of the spike-associated edge is transferred as the prediction information to the next synapse-linked neuron to determine its state. Correlations between input spikes and their timing thus encode depth in the visual field. The adaptation of synapses mediated by spike-timing-dependent plasticity is used to improve the algorithm´s robustness against inaccuracy caused by spurious edge propagation. The algorithm is characterized on both artificial and real image sequences. The implementation of the algorithm in analog very large scale integrated (aVLSI) circuitry is also discussed.
Keywords :
edge detection; image motion analysis; image sequences; neural nets; STDP adaptation; analog very large scale integrated circuitry; edge detection; image sequences; leaky integrate-and-fire neurons; neuromorphic depth-from-motion vision model; neuron firing criterion; optical flow field; spike-associated edge; spike-timing-dependent plasticity; spurious edge propagation; synapse-linked neuron; two-dimensional depth recovery; Adaptation model; Fires; Image edge detection; Image motion analysis; Image sequences; Neuromorphics; Neurons; Robustness; Timing; Very large scale integration; Integrate-and-fire neurons; monocular depth recovery; neuromorphic vision model; synaptic plasticity; Animals; Biomimetics; Computer Simulation; Depth Perception; Humans; Models, Neurological; Motion Perception; Nerve Net; Neural Networks (Computer); Pattern Recognition, Automated; Visual Pathways;
Journal_Title :
Neural Networks, IEEE Transactions on
DOI :
10.1109/TNN.2006.871711