• DocumentCode
    934955
  • Title

    Application of information theory to the construction of efficient decision trees

  • Author

    Hartmann, Carlos R P ; Varshney, Pramod K. ; Mehrotra, Kishan G. ; Gerberich, Carl L.

  • Volume
    28
  • Issue
    4
  • fYear
    1982
  • fDate
    7/1/1982 12:00:00 AM
  • Firstpage
    565
  • Lastpage
    577
  • Abstract
    The problem of conversion of decision tables to decision trees is treated. In most cases, the construction of optimal decision trees is an NP-complete problem and, therefore, a heuristic approach to this problem is necessary. In this heuristic approach, an application of information theoretic concepts to construct efficient decision trees for decision tables which may include "don\´t care" entries is made. In contrast to most of the existing heuristic algorithms, this algorithm is systematic and is intuitively appealing from an information theoretic standpoint. The algorithm has low design complexity and yet provides near-optimal decision trees.
  • Keywords
    Information theory; Trees; Algorithm design and analysis; Application software; Data processing; Decision trees; Dynamic programming; Heuristic algorithms; Information theory; NP-complete problem; Statistics; Testing;
  • fLanguage
    English
  • Journal_Title
    Information Theory, IEEE Transactions on
  • Publisher
    ieee
  • ISSN
    0018-9448
  • Type

    jour

  • DOI
    10.1109/TIT.1982.1056522
  • Filename
    1056522