Persian text classification using naive bayes algorithms and support vector machine algorithm

One of the several benefits of text classification is to automatically assign document in predefined category is one of the primary steps toward knowledge extraction from the raw textual data. In such tasks, words are dealt with as a set of features. Due to high dimensionality and sparseness of feature vector results from traditional feature selection methods, most of the proposed text classification methods for this purpose lack performance and accuracy. Many algorithms have been implemented to the problem of Automatic Text Categorization that’s why, we tried to use new methods like Information Extraction, Natural Language Processing, and Machine Learning. This paper proposes an innovative approach to improve the classification performance of the Persian text. Naive Bayes classifiers which are widely used for text classification in machine learning are based on the conditional probability. we have compared the Gaussian, Multinomial and Bernoulli methods of naive Bayes algorithms with SVM algorithm. for statistical text representation, TF and TF-IDF and character-level 3 (3-Gram) [1,2] were used. Finally, experimental results on 10 newsgroups. © 2018 Institute of Advanced Engineering and Science.

Authors
Publisher
Institute of Advanced Engineering and Science
Number of issue
1
Language
English
Pages
178-188
Status
Published
Volume
8
Year
2020
Organizations
  • 1 Information Technologies Department, Peoples' Friendship University of Russia (RUDN University), Moscow, Russian Federation
Keywords
Bernoulli Naive Bayes; Gaussian Naive Bayes; Multinomial Naive Bayes; SVM; Text classifications; TF-IDF
Date of creation
02.11.2020
Date of change
02.11.2020
Short link
https://repository.rudn.ru/en/records/article/record/64917/
Share

Other records