DocumentCode :
2913856
Title :
Novel resampling method for the classification of imbalanced datasets for industrial and other real-world problems
Author :
Cateni, Silvia ; Colla, Valentina ; Vannucci, Marco
Author_Institution :
TeCIP Inst., Scuola Superiore Sant´´Anna, Pisa, Italy
fYear :
2011
fDate :
22-24 Nov. 2011
Firstpage :
402
Lastpage :
407
Abstract :
The paper deals a novel resampling method in order to cope with imbalanced dataset in binary classification problems. Imbalanced datasets are frequently found in many industrial applications: for instance, the occurrence of particular product defects or machine faults are rare events whose detection is of utmost importance. In this paper a new resampling method combining an oversampling and an undersampling techniques is treated. In order to prove the effectiveness of the proposed approach, several tests have been developed. Two classifiers based on Support Vector Machine and Decision Tree have been designed, which are applied for binary classification on four datasets: a synthetic dataset, a widely used public dataset and two industrial datasets. The obtained results are presented and discussed in the paper; in particular, the performance that is achieved by the two classifiers through our resampling approach is compared to the ones that are obtained without any resampling and through the classical SMOTE approach, respectively.
Keywords :
decision trees; pattern classification; sampling methods; support vector machines; binary classification; decision tree; imbalanced dataset classification; industrial dataset; industrial problem; oversampling technique; public dataset; real world problem; resampling method; support vector machine; synthetic dataset; undersampling technique; Accuracy; Breast cancer; Databases; Decision trees; Intelligent systems; Support vector machines; Training; imbalanced dataset; oversampling; undersampling;
fLanguage :
English
Publisher :
ieee
Conference_Titel :
Intelligent Systems Design and Applications (ISDA), 2011 11th International Conference on
Conference_Location :
Cordoba
ISSN :
2164-7143
Print_ISBN :
978-1-4577-1676-8
Type :
conf
DOI :
10.1109/ISDA.2011.6121689
Filename :
6121689
Link To Document :
بازگشت