• DocumentCode
    2865217
  • Title

    On reducing classifier granularity in mining concept-drifting data streams

  • Author

    Wang, Peng ; Wang, Haixun ; Wu, Xiaochen ; Wang, Wei ; Shi, Baile

  • Author_Institution
    Fudan Univ., Shanghai, China
  • fYear
    2005
  • fDate
    27-30 Nov. 2005
  • Abstract
    Many applications use classification models on streaming data to detect actionable alerts. Due to concept drifts in the underlying data, how to maintain a model´s up-to-dateness has become one of the most challenging tasks in mining data streams. State of the art approaches, including both the incrementally updated classifiers and the ensemble classifiers, have proved that model update is a very costly process. In this paper, we introduce the concept of model granularity. We show that reducing model granularity will reduce model update cost. Indeed, models of fine granularity enable us to efficiently pinpoint local components in the model that are affected by the concept drift. It also enables us to derive new components that can easily integrate with the model to reflect the current data distribution, thus avoiding expensive updates on a global scale. Experiments on real and synthetic data show that our approach is able to maintain good prediction accuracy at a fraction of model updating cost of state of the art approaches.
  • Keywords
    data mining; pattern classification; classifier granularity; concept-drifting data stream mining; ensemble classifiers; incrementally updated classifier; model granularity reduction; model update cost reduction; Accuracy; Costs; Data mining; Decision trees; Predictive models; Training data; Ubiquitous computing;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Data Mining, Fifth IEEE International Conference on
  • ISSN
    1550-4786
  • Print_ISBN
    0-7695-2278-5
  • Type

    conf

  • DOI
    10.1109/ICDM.2005.108
  • Filename
    1565714