• DocumentCode
    857434
  • Title

    A neuromorphic depth-from-motion vision model with STDP adaptation

  • Author

    Yang, Zhijun ; Murray, Alan ; Wörgötter, Florentin ; Cameron, Katherine ; Boonsobhak, Vasin

  • Author_Institution
    Dept. of Comput. Sci., Nanjing Normal Univ., China
  • Volume
    17
  • Issue
    2
  • fYear
    2006
  • fDate
    3/1/2006 12:00:00 AM
  • Firstpage
    482
  • Lastpage
    495
  • Abstract
    We propose a simplified depth-from-motion vision model based on leaky integrate-and-fire (LIF) neurons for edge detection and two-dimensional depth recovery. In the model, every LIF neuron is able to detect the irradiance edges passing through its receptive field in an optical flow field, and respond to the detection by firing a spike when the neuron´s firing criterion is satisfied. If a neuron fires a spike, the time-of-travel of the spike-associated edge is transferred as the prediction information to the next synapse-linked neuron to determine its state. Correlations between input spikes and their timing thus encode depth in the visual field. The adaptation of synapses mediated by spike-timing-dependent plasticity is used to improve the algorithm´s robustness against inaccuracy caused by spurious edge propagation. The algorithm is characterized on both artificial and real image sequences. The implementation of the algorithm in analog very large scale integrated (aVLSI) circuitry is also discussed.
  • Keywords
    edge detection; image motion analysis; image sequences; neural nets; STDP adaptation; analog very large scale integrated circuitry; edge detection; image sequences; leaky integrate-and-fire neurons; neuromorphic depth-from-motion vision model; neuron firing criterion; optical flow field; spike-associated edge; spike-timing-dependent plasticity; spurious edge propagation; synapse-linked neuron; two-dimensional depth recovery; Adaptation model; Fires; Image edge detection; Image motion analysis; Image sequences; Neuromorphics; Neurons; Robustness; Timing; Very large scale integration; Integrate-and-fire neurons; monocular depth recovery; neuromorphic vision model; synaptic plasticity; Animals; Biomimetics; Computer Simulation; Depth Perception; Humans; Models, Neurological; Motion Perception; Nerve Net; Neural Networks (Computer); Pattern Recognition, Automated; Visual Pathways;
  • fLanguage
    English
  • Journal_Title
    Neural Networks, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    1045-9227
  • Type

    jour

  • DOI
    10.1109/TNN.2006.871711
  • Filename
    1603632