Title :
Minimum Chernoff entropy and exponential bounds for locating changes
Author :
Lake, Douglas E.
Author_Institution :
Dept. of Stat., Virginia Univ., Charlottesville, VA, USA
fDate :
5/1/2000 12:00:00 AM
Abstract :
Large deviation theory makes extensive use of Chernoff exponential bounds to establish exert rates of convergence for certain probabilities. In this article, stronger exponential bounds from martingale theory are utilized to give results on the errors of the maximum-likelihood estimate of the location of a change between two probability measures in terms of the minimum Chernoff entropy (MCE). For example, the probability of estimating the change point exactly is bigger than one minus twice the MCE. These results support the use of the MCE as an appropriate distance measure between probability measures for applications such as the automatic classification of digital modulation signal constellations
Keywords :
convergence of numerical methods; maximum likelihood estimation; minimum entropy methods; modulation; probability; signal classification; MLE errors; automatic classification; change point estimation; convergence rates; digital modulation signal constellations; distance measure; martingale theory; maximum-likelihood estimate; minimum Chernoff entropy bounds; minimum exponential bounds; probability measures; Constellation diagram; Convergence; Digital modulation; Entropy; Error analysis; Lakes; Maximum likelihood estimation; Random variables; Statistics; Testing;
Journal_Title :
Information Theory, IEEE Transactions on