Penalized maximum-likelihood estimation, the Baum–Welch algorithm, diagonal balancing of symmetric matrices and applications to training acoustic data

We study penalized maximum-likelihood estimation methods for nonparametric density estimation and propose their use in training acoustic models for speech recognition. Several algorithms for the numerical solution of the optimization problems that we encounter are proposed and analyzed.