Title :
On the use of a pruning prior for neural networks
Author_Institution :
Dept. of Math. Modeling, Tech. Univ., Lyngby, Denmark
Abstract :
We address the problem of using a regularization prior that prunes unnecessary weights in a neural network architecture. This prior provides a convenient alternative to traditional weight-decay. Two examples are studied to support this method and illustrate its use. First we use the sunspots benchmark problem as an example of time series processing. Then we address the problem of system identification on a small artificial system
Keywords :
identification; neural nets; time series; neural network architecture; neural networks; pruning prior; regularization prior; sunspots benchmark problem; system identification; time series processing; Arthritis; Artificial neural networks; Cost function; Electronic mail; Mathematical model; Multi-layer neural network; Multilayer perceptrons; Neural networks; Signal processing; System identification;
Conference_Titel :
Neural Networks for Signal Processing [1996] VI. Proceedings of the 1996 IEEE Signal Processing Society Workshop
Conference_Location :
Kyoto
Print_ISBN :
0-7803-3550-3
DOI :
10.1109/NNSP.1996.548335
