• DocumentCode
    2913856
  • Title

    Novel resampling method for the classification of imbalanced datasets for industrial and other real-world problems

  • Author

    Cateni, Silvia ; Colla, Valentina ; Vannucci, Marco

  • Author_Institution
    TeCIP Inst., Scuola Superiore Sant´´Anna, Pisa, Italy
  • fYear
    2011
  • fDate
    22-24 Nov. 2011
  • Firstpage
    402
  • Lastpage
    407
  • Abstract
    The paper deals a novel resampling method in order to cope with imbalanced dataset in binary classification problems. Imbalanced datasets are frequently found in many industrial applications: for instance, the occurrence of particular product defects or machine faults are rare events whose detection is of utmost importance. In this paper a new resampling method combining an oversampling and an undersampling techniques is treated. In order to prove the effectiveness of the proposed approach, several tests have been developed. Two classifiers based on Support Vector Machine and Decision Tree have been designed, which are applied for binary classification on four datasets: a synthetic dataset, a widely used public dataset and two industrial datasets. The obtained results are presented and discussed in the paper; in particular, the performance that is achieved by the two classifiers through our resampling approach is compared to the ones that are obtained without any resampling and through the classical SMOTE approach, respectively.
  • Keywords
    decision trees; pattern classification; sampling methods; support vector machines; binary classification; decision tree; imbalanced dataset classification; industrial dataset; industrial problem; oversampling technique; public dataset; real world problem; resampling method; support vector machine; synthetic dataset; undersampling technique; Accuracy; Breast cancer; Databases; Decision trees; Intelligent systems; Support vector machines; Training; imbalanced dataset; oversampling; undersampling;
  • fLanguage
    English
  • Publisher
    ieee
  • Conference_Titel
    Intelligent Systems Design and Applications (ISDA), 2011 11th International Conference on
  • Conference_Location
    Cordoba
  • ISSN
    2164-7143
  • Print_ISBN
    978-1-4577-1676-8
  • Type

    conf

  • DOI
    10.1109/ISDA.2011.6121689
  • Filename
    6121689