• DocumentCode
    913345
  • Title

    Some convergence properties of a nearest neighbor decision rule

  • Author

    Peterson, David W.

  • Volume
    16
  • Issue
    1
  • fYear
    1970
  • fDate
    1/1/1970 12:00:00 AM
  • Firstpage
    26
  • Lastpage
    31
  • Abstract
    This paper focuses on the problem of the relationship between the risk incurred using a nearest neighbor rule and the size of the data base. Theoretical results include demonstrations of the facts that the proximity of the nearest neighbor to a new sample in a collection of n samples becomes (in probability) arbitrarily small as n is increased; that the convergence is often (but not always) with probability 1; that as a result of these convergences, the risk associated with a decision may be closely controlled; and that these facts and their demonstrations aid one in determining the size of a sample of data to be used as a nearest neighbor decision-making base. An example serves to demonstrate that the size of the data base required to meet performance criteria other than the relatively lax expected risk criterion can be unreasonably large.
  • Keywords
    Decision procedures; Pattern classification; Convergence; Electronic switching systems; Gaussian processes; Information theory; Integral equations; Kernel; Nearest neighbor searches; Power engineering and energy; Probability density function; Spectral analysis;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.1970.1054408
  • Filename
    1054408