DocumentCode
907428
Title
Canonically optimum threshold detection
Author
Middleton, David
Volume
12
Issue
2
fYear
1966
fDate
4/1/1966 12:00:00 AM
Firstpage
230
Lastpage
243
Abstract
A general canonical theory is developed for the systematic approximation of optimum, or Bayes, detection procedures in the critical limiting threshold mode of operation. The approximations to Bayes detectors introduced here are called locally optimum Bayes detectors (LOBD\´s) and are defined by the condition that they produce the same value of average risk and its derivative for vanishingly small input signals
as do the corresponding Bayes systems. The LOBD,
, in the binary (i.e., two-alternative cases:
, signal and noise, vs.
, noise alone) is found to be the expansion of the logarithm of the optimum or likelihood ratio (functional) form
, including a suitable bias term, e.g.,
Suitable choices of bias
can frequently be made so that
is asymptotically as efficient as
, the corresponding Bayes detector. The principal advantages of the LOBD are that 1) its comparative simplicity vis-à-vis the Bayes system,
) its structure can always be found, even when the structure of the Bayes system cannot be obtained explicitly; and 3) expected performance (average risk and error probabilities) can often be determined for the LOBD when such is not possible for the Bayes system. In addition, the LOBD is canonically derived, i.e., the form of
, (1), is independent of the particular noise statistics and signal, structure. New results include 1) the fact that the logarithm of the likelihood ratio is the function of the received data to be approximated, 2) correlated samples (including continuous sampling on an interval), 3) structures analogous to (1) which hold for the LOBD in binary sequential detection, and 4) similar expansions of the logarithm of the likelihood ratios, etc., which are required for the LOBD in multiple alternative cases. Moreover, in the binary situation of testing for signals
of one class against signals
of another in noise, the LOBD - is seen to be a linearly weighted sum of characteristics like (1). To account for the effects of correlated samples and limiting distributions that do not obey the Central Limit Theorem, i.e., are not asymptotically normal (as illustrated in several of the examples), a criterion of asymptotic relative efficiency (ARE)
is developed. Sufficient, and necessary and sufficient conditions on the bias and on
itself are established, which when satisfied insure that the LOBD is at least asymptotically as efficient, or equivalent to, the corresponding Bayes detector in the limit.
as do the corresponding Bayes systems. The LOBD,
, in the binary (i.e., two-alternative cases:
, signal and noise, vs.
, noise alone) is found to be the expansion of the logarithm of the optimum or likelihood ratio (functional) form
, including a suitable bias term, e.g.,
Suitable choices of bias
can frequently be made so that
is asymptotically as efficient as
, the corresponding Bayes detector. The principal advantages of the LOBD are that 1) its comparative simplicity vis-à-vis the Bayes system,
) its structure can always be found, even when the structure of the Bayes system cannot be obtained explicitly; and 3) expected performance (average risk and error probabilities) can often be determined for the LOBD when such is not possible for the Bayes system. In addition, the LOBD is canonically derived, i.e., the form of
, (1), is independent of the particular noise statistics and signal, structure. New results include 1) the fact that the logarithm of the likelihood ratio is the function of the received data to be approximated, 2) correlated samples (including continuous sampling on an interval), 3) structures analogous to (1) which hold for the LOBD in binary sequential detection, and 4) similar expansions of the logarithm of the likelihood ratios, etc., which are required for the LOBD in multiple alternative cases. Moreover, in the binary situation of testing for signals
of one class against signals
of another in noise, the LOBD - is seen to be a linearly weighted sum of characteristics like (1). To account for the effects of correlated samples and limiting distributions that do not obey the Central Limit Theorem, i.e., are not asymptotically normal (as illustrated in several of the examples), a criterion of asymptotic relative efficiency (ARE)
is developed. Sufficient, and necessary and sufficient conditions on the bias and on
itself are established, which when satisfied insure that the LOBD is at least asymptotically as efficient, or equivalent to, the corresponding Bayes detector in the limit.Keywords
Bayes procedures; Signal detection; Contracts; Detectors; Entropy; Error probability; Information theory; Pattern recognition; Signal detection; Signal synthesis; Signal to noise ratio; Statistics;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.1966.1053866
Filename
1053866
Link To Document