Title :
Parallel Reservoir Computing Using Optical Amplifiers
Author :
Vandoorne, Kristof ; Dambre, Joni ; Verstraeten, David ; Schrauwen, Benjamin ; Bienstman, Peter
Author_Institution :
Dept. of Inf. Technol., Ghent Univ., Ghent, Belgium
Abstract :
Reservoir computing (RC), a computational paradigm inspired on neural systems, has become increasingly popular in recent years for solving a variety of complex recognition and classification problems. Thus far, most implementations have been software-based, limiting their speed and power efficiency. Integrated photonics offers the potential for a fast, power efficient and massively parallel hardware implementation. We have previously proposed a network of coupled semiconductor optical amplifiers as an interesting test case for such a hardware implementation. In this paper, we investigate the important design parameters and the consequences of process variations through simulations. We use an isolated word recognition task with babble noise to evaluate the performance of the photonic reservoirs with respect to traditional software reservoir implementations, which are based on leaky hyperbolic tangent functions. Our results show that the use of coherent light in a well-tuned reservoir architecture offers significant performance benefits. The most important design parameters are the delay and the phase shift in the system´s physical connections. With optimized values for these parameters, coherent semiconductor optical amplifier (SOA) reservoirs can achieve better results than traditional simulated reservoirs. We also show that process variations hardly degrade the performance, but amplifier noise can be detrimental. This effect must therefore be taken into account when designing SOA-based RC implementations.
Keywords :
learning (artificial intelligence); optical neural nets; parallel processing; pattern classification; recurrent neural nets; semiconductor optical amplifiers; amplifier noise; babble noise; complex classification problems; complex recognition problems; coupled semiconductor optical amplifiers; isolated word recognition task; leaky hyperbolic tangent functions; neural systems; optical neural networks; parallel reservoir computing; performance evaluation; photonic reservoirs; recurrent neural networks; simulated reservoirs; software reservoir; Network topology; Neurons; Photonics; Reservoirs; Semiconductor optical amplifiers; Speech recognition; Topology; Integrated optics; optical neural networks; photonic reservoir computing; semiconductor optical amplifiers; speech recognition; Amplifiers, Electronic; Computer Simulation; Humans; Neural Networks (Computer); Noise; Optical Devices; Pattern Recognition, Physiological; Semiconductors; Spectrum Analysis; Speech Recognition Software;
Journal_Title :
Neural Networks, IEEE Transactions on
DOI :
10.1109/TNN.2011.2161771