点击次数：

论文类型：期刊论文

发表时间：2008-04-01

发表刊物：Journal of Computational Information Systems.

收录刊物：EI

卷号：4

期号：2

页面范围：495-501

摘要：The high-dimension and sparseness of text data declines the performance of text classifiers. Consequently, it is vital for text classification to reduce the dimensionality of feature space effectively. In this paper, we propose an effective feature reduction method to address the problem. Firstly, we get rid of insignificant features using filtering method based on categorical document frequency distribution difference (CDFDD), and then conduct feature selection method based on variable precision rough set (VPRS) to obtain features significant to document category. To verify the effectiveness of our proposal, we adopt radial basis function (RBF) neural network classifier in experiment and test the classification performance by holding different number of features. Experimental results show that the proposed method outperforms Information Gain and X2 Statistic methods. What's more, it can achieve high precision and recall in condition of removing as much as 98% features.