PSA: A Hybrid Feature Selection Approach for Persian Text Classification

In recent decades, as enormous amount of data being accumulated, the number of text documents is increasing vastly. E-mails, web pages, texts, news and articles are only part of this grow. Thus the need for text mining techniques, including automatic text classi?cation, is rising. In automatic text classi?cation, feature selection from within any text appears to be the most important step. Since the feature space in textual data includes tens of thousands of words, feature selection is used for dimension reduction. Di?erent techniques, from statistical to machine learning approaches for feature selection in text have been reported in literature, each with advantages and disadvantages. However up to now there have been very rare researches on utilizing advantages of both learning and statistical approaches. In this paper a new algorithm for feature selection in text is presented to improve the classi?cation performance substantially. The proposed approach - PSA - is based on simulated annealing algorithm and document frequency method. So it can bene?t from advantages of both statistical and learning techniques. The simulated annealing algorithm requires an appropriate function for ?tness evaluation, where document frequency method as an evaluation function has low computational cost. In addition, a new Persian text dataset, i.e. Persian 7-NewsGroups Dataset, is introduced for evaluating the proposed approach. Therefore, to justify and evaluate our approach, the performance of the PSA is compared to famous methods such as chi-square and correlation coe?cient on Persian 7-NewsGroups dataset. The results show that the PSA has overall better performance in comparison to the other methods.