Title :
Stochastic Complexity for tree models
Author :
Takeuchi, Jun ; Barron, Andrew R.
Author_Institution :
Dept. of Inf., Kyushu Univ., Fukuoka, Japan
Abstract :
We study the problem of data compression, gambling and prediction of strings xn = x1x2...xn in terms of coding regret, where the tree model is assumed as a target class. We apply the minimax Bayes strategy for curved exponential families to this problem and show that it achieves the minimax regret without restriction on the data strings. This is an extension of the minimax result by (Takeuchi et al. 2013) for models of kth order Markov chains and determines the constant term of the Stochastic Complexity for the tree model.
Keywords :
Bayes methods; Markov processes; computational complexity; data compression; formal languages; minimax techniques; trees (mathematics); curved exponential families; data compression problem; kth order Markov chains; minimax Bayes strategy; minimax regret; stochastic complexity; string gambling; string prediction; tree models; Complexity theory; Context; Data models; Encoding; Markov processes; Maximum likelihood estimation;
Conference_Titel :
Information Theory Workshop (ITW), 2014 IEEE
Conference_Location :
Hobart, TAS
DOI :
10.1109/ITW.2014.6970825