Title :
A criterion for model selection using minimum description length
Author :
Najmi, Amir ; Olshen, Richard A. ; Gray, Robert M.
Author_Institution :
Dept. of Electr. Eng., Stanford Univ., CA, USA
Abstract :
Rissanen (1978) proposed the idea that the goodness of fit of a parametric model of the probability density of a random variable could be thought of as an information coding problem. He argued that the best model was that which was able to describe the training data together with the model parameters using the fewest number of bits of information (Occam´s razor). This paper builds upon that basic insight and derives a more general result than did Rissanen, dealing as he was, with time series analysis. To arrive at a model selection criterion with wider applicability, the present derivation relies upon results from information theory and the theory of rate-distortion
Keywords :
Gaussian distribution; data compression; encoding; random processes; rate distortion theory; Occam´s razor; goodness of fit; information coding problem; information theory; minimum description length; model selection; parametric model; probability density; random variable; rate-distortion; selection criterion; training data; Information theory; Parametric statistics; Predictive models; Probability; Random variables; Stochastic processes; Time series analysis; Training data; Zinc;
Conference_Titel :
Compression and Complexity of Sequences 1997. Proceedings
Conference_Location :
Salerno
Print_ISBN :
0-8186-8132-2
DOI :
10.1109/SEQUEN.1997.666916
