Title :
A game theoretic framework for feature selection
Author :
Fard, Seyed Mehdi Hazrati ; Hamzeh, Ali ; Hashemi, Sattar
Author_Institution :
Dept. of Electr. & Comput. Eng., Shiraz Univ., Shiraz, Iran
Abstract :
Feature subset selection plays a key role in both dimensionality and noise reduction. Moreover, it is often used to enhance accuracy in classification and clustering problems while decreasing their complexity. Inspired by Markov Decision Process, the presented paper considers feature subset selection as a one player game and uses Reinforcement Learning paradigm to select best features. In order to have an optimal traverse in the search space, we introduce a Monte Carlo graph search to overcome the complexity of the problem of concern. Finally, a low cost evaluation function is used to evaluate each state. The evaluation function leads search process into the most promising regions by rewarding each state. The results on the benchmarks prove superiority of our method over other well known methods in the literatures.
Keywords :
Markov processes; Monte Carlo methods; decision theory; game theory; learning (artificial intelligence); pattern classification; pattern clustering; search problems; Markov decision process; Monte Carlo graph search; classification problem; clustering problem; feature subset selection; game theoretic framework; low cost evaluation function; noise reduction; one player game; reinforcement learning paradigm; search space; Accuracy; Benchmark testing; Complexity theory; Frequency selective surfaces; Fuses; Games; Monte Carlo methods; Feature Subset Selection; Markov Decision Process; One-player game; Reinforcement Learning;
Conference_Titel :
Fuzzy Systems and Knowledge Discovery (FSKD), 2012 9th International Conference on
Conference_Location :
Sichuan
Print_ISBN :
978-1-4673-0025-4
DOI :
10.1109/FSKD.2012.6234170