DocumentCode
913345
Title
Some convergence properties of a nearest neighbor decision rule
Author
Peterson, David W.
Volume
16
Issue
1
fYear
1970
fDate
1/1/1970 12:00:00 AM
Firstpage
26
Lastpage
31
Abstract
This paper focuses on the problem of the relationship between the risk incurred using a nearest neighbor rule and the size of the data base. Theoretical results include demonstrations of the facts that the proximity of the nearest neighbor to a new sample in a collection of
samples becomes (in probability) arbitrarily small as
is increased; that the convergence is often (but not always) with probability 1; that as a result of these convergences, the risk associated with a decision may be closely controlled; and that these facts and their demonstrations aid one in determining the size of a sample of data to be used as a nearest neighbor decision-making base. An example serves to demonstrate that the size of the data base required to meet performance criteria other than the relatively lax expected risk criterion can be unreasonably large.
samples becomes (in probability) arbitrarily small as
is increased; that the convergence is often (but not always) with probability 1; that as a result of these convergences, the risk associated with a decision may be closely controlled; and that these facts and their demonstrations aid one in determining the size of a sample of data to be used as a nearest neighbor decision-making base. An example serves to demonstrate that the size of the data base required to meet performance criteria other than the relatively lax expected risk criterion can be unreasonably large.Keywords
Decision procedures; Pattern classification; Convergence; Electronic switching systems; Gaussian processes; Information theory; Integral equations; Kernel; Nearest neighbor searches; Power engineering and energy; Probability density function; Spectral analysis;
fLanguage
English
Journal_Title
Information Theory, IEEE Transactions on
Publisher
ieee
ISSN
0018-9448
Type
jour
DOI
10.1109/TIT.1970.1054408
Filename
1054408
Link To Document