• DocumentCode
    1254215
  • Title

    Capacity of multilevel threshold devices

  • Author

    Diep, Thanh A.

  • Author_Institution
    Dept. of Risk Anal. & Decision Syst., Visa Internat., San Francisco, CA, USA
  • Volume
    44
  • Issue
    1
  • fYear
    1998
  • fDate
    1/1/1998 12:00:00 AM
  • Firstpage
    241
  • Lastpage
    255
  • Abstract
    The principal purpose of this research is to discover the underlying properties of linear multilevel threshold devices and networks of linear multilevel threshold devices. The main theoretical developments of this investigation entail generalizing the function-counting theorem associated with linear bi-level threshold devices to that of linear multilevel threshold devices. The investigation reveals surprising connections that underlie linear inequalities, linear separability, linear ordering, and region counting. The results have implications in the field of geometric probability. Computations based on theoretical analysis support Brown´s (1964) conjecture and suggest that k/(k-1) is a natural definition for the information-storage capacity of a k-level threshold device. A lower bound on the number of weights required to implement a universal network of k-level threshold devices is derived. Finally, it is shown that the Vapnik-Chervonenki (1971)s dimension (VC-dimension) for the class of multilevel threshold function is d+1 for pattern vectors in ℛd . This VC-dimension is also linked to an error-rate bound for multilevel threshold functions within the framework of uniform learnability
  • Keywords
    channel capacity; learning systems; linear network analysis; linear systems; probability; Brown´s conjecture; Vapnik-Chervonenkis dimension; computational learning theory; error-rate bound; function-counting theorem; geometric probability; information-storage capacity; linear bi-level threshold devices; linear inequalities; linear multilevel threshold device; linear multilevel threshold networks; linear ordering; linear separability; lower bound; multilevel threshold devices capacity; multilevel threshold function; pattern vectors; region counting; uniform learnability; universal network; weights; Information analysis; Postal services; Risk analysis; Vectors; Virtual colonoscopy;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/18.651031
  • Filename
    651031