Comparison of Naive Bayes Algorithm and Support Vector Machine using PSO Feature Selection for Sentiment Analysis on E-Wallet Review

Comparison of Naive Bayes Algorithm and Support Vector Machine using PSO Feature Selection for Sentiment Analysis on E-Wallet Review

• By Putri, Dwi Andini; Kristiyanti, Dinar Ajeng; Indrayuni, Elly; Nurhadi, Acmad; Hadinata, Denda Rinaldi;
• Seminar Internasional Bereputasi
• 323

Cashless payment habits have been widely applied to the transportation system, restaurants and shops in the mall area. So, it is normal if the growth of mobile payment services is currently very rapid. The ease of doing transactions and promotional offers in the form of points and cashback in digital wallet applications (e-wallets) is very beneficial for its users. One of the most popular e-wallets is OVO. With so many reviews about OVO customer opinions on social media, there has also been a lot of public opinion. These opinions can produce negative or positive statements. Sentiment analysis is the mining of opinions or text to classify opinions or user reviews, of a brand reviews, product reviews, or service reviews into the category of positive or negative opinion. The methods used in this research are Naive Bayes and SVM. Both of these algorithms are the best algorithms widely used in text classification research. However, both of these algorithms have weaknesses in several parameters. So, in this study Feature Selection is used to improve its performance. The evaluation was carried out using 10-fold cross validation. Measurement accuracy is measured by confusion matrix and ROC curves. This study uses 500 positive reviews and 500 negative reviews as data training. The results of this study indicate that the use of PSO-based Naive Bayes algorithm produces an accuracy value of 93.10 percent with an AUC value of 0.750. While the results of research from the PSO-based SVM algorithm are 91.30 percent with an AUC value of 0.970. Based on these results the accuracy value generated by the Naive Bayes algorithm is classified as Fair Classification and SVM is classified as Excellent Classification. The AUC value generated by the Naive Bayes algorithm is also smaller than SVM. Therefore, in this study found that SVM is the best algorithm in classifying text. 

• Katakunci
• URL https://iopscience.iop.org/article/10.1088/1742-6596/1641/1/012085
• Penerbit ,

REFERENSI

[1] Aaputra S A Didi Rosiyadi Windu Gata and Syepry Maulana Husain, 2019 Sentiment Analysis Analisis Sentimen E-Wallet Pada Google Play Menggunakan Algoritma Naive Bayes

[2] Putri D A, 2015 Penerapan Algoritma Support Vector Machine Berbasis Algoritma Genetika Untuk Analisis Sentimen I, 01 P. 1–7.

[3] Mahendrajaya R Buntoro G A and Setyawan M B, 2019 Analisis Sentimen Pengguna Gopay Menggunakan Metode Lexicon Based Dan Support Vector Machine Komputek 3, 2 p. 52.

[4] Kristiyanti D A Umam A H Wahyudi M Amin R and Marlinda L, 2019 Comparison of SVM Na¨ıve Bayes Algorithm for Sentiment Analysis Toward West Java Governor Candidate Period 2018-2023 Based on Public Opinion on Twitter in 2018 6th International Conference on Cyber and IT Service Management, CITSM 2018.

[5] Kristiyanti D A and Wahyudi M, 2017 Feature selection based on Genetic algorithm, particle swarm optimization and principal component analysis for opinion mining cosmetic product review in 2017 5th International Conference on Cyber and IT Service Management, CITSM 2017.

[6] Wisnu H Afif M and Ruldevyani Y, 2020 Sentiment analysis on customer satisfaction of digital payment in Indonesia: A comparative study using KNN and Na¨ıve Bayes J. Phys. Conf. Ser. 1444, 1.

[7] Dhande L L and Patnaik P G K, 2014 Analyzing Sentiment of Movie Review Data using Naive Bayes Neural Classifier 3, 4 p. 313–320.

[8] Wibowo W S Az-zahra H M and Bachtiar F A, 2018 Evaluasi dan Rekomendasi Tampilan Website E-Complaint Universitas Brawijaya Pada Perangkat Bergerak Menggunakan Metode Heuristic Evaluation J. Pengemb. Teknol. Inf. dan Ilmu Komput. Univ. Brawijaya 2, 12 p. 7192–7201.

[9] Chou J Cheng M Wu Y and Pham A, 2014 Expert Systems with Applications Optimizing parameters of support vector machine using fast messy genetic algorithm for dispute classification Expert Syst. Appl. 41, 8 p. 3955–3964

[10] K. Schoefegger, T. Tammet and M G, 2013 A survey on socio-semantic information retrieval Comput. Sci. 8 p. 25–46.

[11] Kristiyanti D A Normah and Umam A H, 2019 Prediction of Indonesia presidential election results for the 2019-2024 period using twitter sentiment analysis Proc. 2019 5th Int. Conf. New Media Stud. CONMEDIA 2019 p. 36–42.

[12] Moraes R Valiati J F and Neto W P G, 2013 Expert Systems with Applications Document-level sentiment classification: An empirical comparison between SVM and ANN Expert Syst. Appl. 40, 2 p. 621–633.

[13] Nur aeni widiastuti S santosa C supriyanto, 2010 Algoritma Klasifikasi Data Mining Na¨ıve Bayes Berbasis Particle Swarm Optimization Untuk Deteksi Penyakit Jantung Nat. Methods 7, 1 p. 34.