Title :
Stein´s paradox and improved quadratic discrimination of real and simulated data by covariance weighting
Author :
Piper, Jim ; Poole, Ian ; Carothers, Andrew
Author_Institution :
Human Genetics Unit, MRC, Edinburgh, UK
Abstract :
The cross-validation error rates of quadratic discriminant classifiers were substantially reduced by weighting the off-diagonal elements of the covariance matrices by a constant less than one. The improvement was found both when real chromosome data was classified, and also when simulated multivariate normal random vectors were classified. It is shown empirically that the optimum value of the weighting constant depended on the size of the training set, and that its relative benefit was greatest when the training set was small. The optimum weight appeared to be largely independent of the number of features. The relationship of this heuristic to Stein´s paradox (1956) was explored, and it is shown that near-optimal values of weight could be predicted directly, thereby avoiding the need for an expensive empirical search
Keywords :
pattern classification; Stein´s paradox; chromosome data; covariance matrices; covariance weighting; cross-validation error rates; improved quadratic discrimination; multivariate normal random vectors; near-optimal values; off-diagonal elements; weighting constant optimal value; Biological cells; Cells (biology); Covariance matrix; Error analysis; Gaussian distribution; Genetics; Humans; Maximum likelihood estimation; Parameter estimation; Testing;
Conference_Titel :
Pattern Recognition, 1994. Vol. 2 - Conference B: Computer Vision & Image Processing., Proceedings of the 12th IAPR International. Conference on
Conference_Location :
Jerusalem
Print_ISBN :
0-8186-6270-0
DOI :
10.1109/ICPR.1994.577004