Tree-based unit selection for English speech synthesis

In concatenative synthesis for English, scarcity of speech data for many contexts is a serious problem. The authors propose a novel unit selection scheme using a decision-tree-based clustering method that combines acoustic and linguistic knowledge with statistical modeling. This approach makes it possible not only to find a trainable and consistent set of generalized allophonic models but also to achieve some local optimality with respect to the limited training data. To evaluate the validity of this algorithm, regression tree generation has been carried out for both vowels and consonants from 200 phonetically balanced sentences read by a female speaker. Experimental results show that regression trees offer a promising solution for the data scarcity problem.<>