Title :
A competitive Neyman-Pearson approach to universal hypothesis testing with applications
Author :
Levitan, Evgeny ; Merhav, Neri
Author_Institution :
Dept. of Electr. Eng., Technion-Israel Inst. of Technol., Haifa, Israel
fDate :
8/1/2002 12:00:00 AM
Abstract :
The problem of hypothesis testing for parametric information sources whose parameters are not explicitly known is considered. A new, modified version of the Neyman-Pearson criterion of optimality, where the uniform constraint on exponential rate of the false-alarm probability is replaced by one that depends on unknown values of the parameters, is proposed. An optimal universal decision rule, based on Kullback-Leibler divergence, is developed and shown to be efficient in the sense of achieving exponential decay of both misdetection and false-alarm probabilities for all values of unknown parameters, whenever such an efficient decision rule exists at all. Furthermore, necessary and sufficient conditions for the existence of such efficient universal tests are established and the best universally achievable error exponents are presented. Finally, the proposed approach is applied to several important problems in signal processing and communications and compared to the generalized likelihood ratio test (LRT).
Keywords :
error statistics; information theory; signal processing; Kullback-Leibler divergence; competitive Neyman-Pearson approach; efficient decision rule; error exponents; exponential decay; exponential rate; false-alarm probability; generalized Neyman-Pearson approach; generalized likelihood ratio test; i.i.d. sources; misdetection probability; necessary conditions; optimal universal decision rule; parametric information sources; signal processing; sufficient conditions; training sequences classification; uniform constraint; universal hypothesis testing; Decoding; Error probability; Information theory; Light rail systems; Neural networks; Probability distribution; Random variables; Signal processing; Sufficient conditions; Testing;
Journal_Title :
Information Theory, IEEE Transactions on
DOI :
10.1109/TIT.2002.800478