Title :
A-Optimality Orthogonal Forward Regression Algorithm Using Branch and Bound
Author :
Hong, Xia ; Chen, Sheng ; Harris, Chris J.
Author_Institution :
Sch. of Syst. Eng., Univ. of Reading, Reading
Abstract :
In this brief, we propose an orthogonal forward regression (OFR) algorithm based on the principles of the branch and bound (BB) and A-optimality experimental design. At each forward regression step, each candidate from a pool of candidate regressors, referred to as S, is evaluated in turn with three possible decisions: 1) one of these is selected and included into the model; 2) some of these remain in S for evaluation in the next forward regression step; and 3) the rest are permanently eliminated from S . Based on the BB principle in combination with an A-optimality composite cost function for model structure determination, a simple adaptive diagnostics test is proposed to determine the decision boundary between 2) and 3). As such the proposed algorithm can significantly reduce the computational cost in the A-optimality OFR algorithm. Numerical examples are used to demonstrate the effectiveness of the proposed algorithm.
Keywords :
design of experiments; neural nets; regression analysis; statistical testing; tree searching; A-optimality experimental design; adaptive diagnostics test; branch-and-bound principle; composite cost function; decision boundary; model structure determination; neural network; orthogonal forward regression algorithm; Branch and bound (BB); experimental design; forward regression; structure identification; Algorithms; Computer Simulation; Models, Statistical; Neural Networks (Computer); Regression Analysis;
Journal_Title :
Neural Networks, IEEE Transactions on
DOI :
10.1109/TNN.2008.2003251