International Journal of Scientific and Research Publications

IJSRP, Volume 2, Issue 9, September 2012 Edition [ISSN 2250-3153]


English & Persian Document Categorization based on a Novel Hybrid Algorithm
      Vahid Behravesh, S.M.R. Farshchi
Abstract: This paper describes automatic document categorization based on large text hierarchy. We handle the large number of features and training examples by taking into account hierarchical structure of examples and using feature selection for large text data. We experimentally evaluate feature subset selection on real-world text data collected from the existing Web hierarchy named Yahoo. In our learning experiments naive Bayesian classifier was used on text data using feature vector document representation that includes word sequences (n-grams) instead of just single words (unigrams). Experimental evaluation on real-world data collected form the Web shows that our approach gives promising results and can potentially be used for document categorization on the Web. Additionally the best result on our data is achieved for relatively small feature subset, while for larger subset the performance substantially drops. The best performance among six tested feature scoring measure was achieved by the feature scoring measure called Odds ratio that is known from information retrieval.

Reference this Research Paper (copy & paste below code):

Vahid Behravesh, S.M.R. Farshchi (2018); English & Persian Document Categorization based on a Novel Hybrid Algorithm; Int J Sci Res Publ 2(9) (ISSN: 2250-3153). http://www.ijsrp.org/research-paper-0912.php?rp=P09227
©️ Copyright 2011-2022 IJSRP - All rights reserved. Use of this web site signifies your agreement to the terms and conditions.