Title :
Reviewing RELIEF and its extensions: a new approach for estimating attributes considering high-correlated features
Author :
Flórez-López, Raqukel
Author_Institution :
Dept. of Econ. & Bus. Adm., Univ. of Leon, Spain
Abstract :
RELIEF algorithm and its extensions are some of the most known filter methods for estimating the quality of attributes in classification problems dealing with both dependent and independent features. These methods attend to find all meaningful features for each problem (both weakly and strongly ones) so they are usually employed like a first stage for detecting irrelevant attributes. Nevertheless, in this paper we checked that RELIEF-family algorithms present some important limitations that could distort the selection of the final features´ subset, specially in the presence of high-correlated attributes. To overcome these difficulties, a new approach has been developed (WACSA algorithm), which performance and validity are verified on wellknown data sets.
Keywords :
data mining; learning (artificial intelligence); RELIEF algorithm; attributes; classification problems; knowledge discovery; learning; pattern recognition; Algorithm design and analysis; Filters; Linear regression; Machine learning; Optimization methods; Pattern analysis; Pattern recognition; Probability distribution; Problem-solving; Statistical analysis;
Conference_Titel :
Data Mining, 2002. ICDM 2003. Proceedings. 2002 IEEE International Conference on
Print_ISBN :
0-7695-1754-4
DOI :
10.1109/ICDM.2002.1184009