Title :
Hyperbolic Hopfield Neural Networks
Author :
Kobayashi, Masato
Author_Institution :
Interdiscipl. Grad. Sch. of Med. & Eng., Univ. of Yamanashi, Kofu, Japan
Abstract :
In recent years, several neural networks using Clifford algebra have been studied. Clifford algebra is also called geometric algebra. Complex-valued Hopfield neural networks (CHNNs) are the most popular neural networks using Clifford algebra. The aim of this brief is to construct hyperbolic HNNs (HHNNs) as an analog of CHNNs. Hyperbolic algebra is a Clifford algebra based on Lorentzian geometry. In this brief, a hyperbolic neuron is defined in a manner analogous to a phasor neuron, which is a typical complex-valued neuron model. HHNNs share common concepts with CHNNs, such as the angle and energy. However, HHNNs and CHNNs are different in several aspects. The states of hyperbolic neurons do not form a circle, and, therefore, the start and end states are not identical. In the quantized version, unlike complex-valued neurons, hyperbolic neurons have an infinite number of states.
Keywords :
Hopfield neural nets; algebra; CHNN; Clifford algebra; HHNN; Lorentzian geometry; complex-valued Hopfield neural network; geometric algebra; hyperbolic HNN; hyperbolic Hopfield neural network; hyperbolic algebra; hyperbolic neuron; phasor neuron; Algebra; Biological neural networks; Hebbian theory; Learning systems; Neurons; Quaternions; Training; Clifford algebra; Hopfield neural networks (HNNs); complex-valued neural networks; hyperbolic algebra;
Journal_Title :
Neural Networks and Learning Systems, IEEE Transactions on
DOI :
10.1109/TNNLS.2012.2230450