BERT-based Consumer Sentiment Analysis for Personalized Marketing Strategies
Abstract
This study aims to construct an efficient consumer sentiment analysis model and apply it to optimize personalized marketing strategies for enhancing user conversion rates and satisfaction. The yf_amazon dataset and Chinese sentiment classification corpus are selected as foundational data by integrating natural language processing and deep learning technologies. Preprocessing procedures including tokenization, stop word removal, noise filtering, and sentiment annotation, are employed to clean and structure consumer reviews. A sentiment classification model based on Bidirectional Encoder Representations from Transformers (BERT) and Transformer architectures is developed and fine-tuned with parameters including a learning rate of 2e-5 and 4 training epochs. Evaluation metrics encompass accuracy, precision, recall, and F1 score. Experimental results demonstrate that the proposed model achieves 92.5% accuracy and a 0.90 F1 score in sentiment classification tasks. This model outperforms conventional Convolutional Neural Networks (83.6% accuracy, 0.83 F1 score) and Long Short-Term Memory models (86.2% accuracy, 0.85 F1 score). Further segmentation of user sentiment clusters based on analysis results enables the implementation of differentiated recommendation strategies and timelimited marketing campaigns. Ultimately, it increases user conversion rates from 25.0% to 32.7% (a 7.7 percentage point improvement) while significantly enhancing consumer satisfaction with personalized recommendations. These findings indicate that Transformer-based sentiment analysis models hold substantial practical value for advancing personalized marketing applications.References
Alantari, H. J., Currim, I. S., Deng, Y., & Singh, S. (2022). An empirical comparison of machine learning methods for text-based sentiment analysis of online consumer reviews. International Journal of Research in Marketing, 39(1), 1-19.
Rocklage, M. D., He, S., Rucker, D. D., & Nordgren, L. F. (2023). Beyond sentiment: the value and measurement of consumer certainty in language. Journal of Marketing Research, 60(5), 870-888.
Iqbal, A., Amin, R., Iqbal, J., Alroobaea, R., Binmahfoudh, A., & Hussain, M. (2022). Sentiment analysis of consumer reviews using deep learning. Sustainability, 14(17), 10844.
Singh, A., Jenamani, M., Thakkar, J. J., & Rana, N. P. (2022). Quantifying the effect of eWOM embedded consumer perceptions on sales: An integrated aspect-level sentiment analysis and panel data modeling approach. Journal of Business Research, 138, 52-64.
Yuan, Z. (2022). Big data recommendation research based on travel consumer sentiment analysis. Frontiers in Psychology, 13, 857292.
Kaur, G., & Sharma, A. (2023). A deep learning-based model using hybrid feature extraction approach for consumer sentiment analysis. Journal of big data, 10(1), 5.
Hossain, M. S., & Rahman, M. F. (2023). Customer sentiment analysis and prediction of insurance products’ reviews using machine learning approaches. FIIB Business Review, 12(4), 386-402.
Taherdoost, H., & Madanchian, M. (2023). Artificial intelligence and sentiment analysis: A review in competitive research. Computers, 12(2), 37.
Adak, A., Pradhan, B., & Shukla, N. (2022). Sentiment analysis of customer reviews of food delivery services using deep learning and explainable artificial intelligence: Systematic review. Foods, 11(10), 1500.
Shaik Vadla, M. K., Suresh, M. A., & Viswanathan, V. K. (2024). Enhancing product design through AI-driven sentiment analysis of Amazon reviews using BERT. Algorithms, 17(2), 59.
Noorian, A., Harounabadi, A., & Hazratifard, M. (2024). A sequential neural recommendation system exploiting BERT and LSTM on social media posts. Complex & Intelligent Systems, 10(1), 721-744.
Ghobakhloo, M., & Ghobakhloo, M. (2022). Design of a personalized recommender system using sentiment analysis in social media (case study: banking system). Social Network Analysis and Mining, 12(1), 84.
El-Ansari, A., & Beni-Hssane, A. (2023). Sentiment analysis for personalized chatbots in e-commerce applications. Wireless Personal Communications, 129(3), 1623-1644.
Gooljar, V., Issa, T., Hardin-Ramanan, S., & Abu-Salih, B. (2024). Sentiment-based predictive models for online purchases in the era of marketing 5.0: a systematic review. Journal of Big Data, 11(1), 107.
Roumeliotis, K. I., Tselikas, N. D., & Nasiopoulos, D. K. (2024). Leveraging Large Language Models in Tourism: A Comparative Study of the Latest GPT Omni Models and BERT NLP for Customer Review Classification and Sentiment Analysis. Information, 15(12), 792.
Çetinkaya, Y. M., Külah, E., Toroslu, İ. H., & Davulcu, H. (2024). Targeted marketing on social media: utilizing text analysis to create personalized landing pages. Social Network Analysis and Mining, 14(1), 77.
Hung, L. P., & Alias, S. (2023). Beyond sentiment analysis: a review of recent trends in text based sentiment analysis and emotion detection. Journal of Advanced Computational Intelligence and Intelligent Informatics, 27(1), 84-95.
Liu, H. (2024). The role of personalization in modern digital marketing: how tailored experiences drive consumer engagement. Strategic Management Insights, 1(8), 34-40.
Yan, C., Liu, J., Liu, W., & Liu, X. (2022). Research on public opinion sentiment classification based on attention parallel dual-channel deep learning hybrid model. Engineering Applications of Artificial Intelligence, 116, 105448.
Priya, C. S. R., & Deepalakshmi, P. (2023). Sentiment analysis from unstructured hotel reviews data in social network using deep learning techniques. International Journal of Information Technology, 15(7), 3563-3574.
Tan, K. L., Lee, C. P., Anbananthen, K. S. M., & Lim, K. M. (2022). RoBERTa-LSTM: a hybrid model for sentiment analysis with transformer and recurrent neural network. IEEE Access, 10, 21517-21525.
Tran, T. P., van Solt, M., & Zemanek Jr, J. E. (2020). How does personalization affect brand relationship in social commerce? A mediation perspective. Journal of Consumer Marketing, 37(5), 473-486.
Karabila, I., Darraz, N., EL-Ansari, A., Alami, N., & EL Mallahi, M. (2024). BERT-enhanced sentiment analysis for personalized e-commerce recommendations. Multimedia Tools and Applications, 83(19), 56463-56488.
Karbauskaitė, R., Sakalauskas, L., & Dzemyda, G. (2020). Kriging predictor for facial emotion recognition using numerical proximities of human emotions. Informatica, 31(2), 249-275.
Kaminskas, V., & Vidugirienė, A. (2016). A comparison of Hammerstein-type nonlinear models for identification of human response to virtual 3D face stimuli. Informatica, 27(2), 283-297.
Märtin, C., Bissinger, B. C., & Asta, P. (2023). Optimizing the digital customer journey—Improving user experience by exploiting emotions, personas and situations for individualized user interface adaptations. Journal of Consumer Behaviour, 22(5), 1050-1061.
Gao, Y., & Liu, H. (2023). Artificial intelligence-enabled personalization in interactive marketing: a customer journey perspective. Journal of Research in Interactive Marketing, 17(5), 663-680.
DOI:
https://doi.org/10.31449/inf.v49i28.8232Downloads
Published
How to Cite
Issue
Section
License
I assign to Informatica, An International Journal of Computing and Informatics ("Journal") the copyright in the manuscript identified above and any additional material (figures, tables, illustrations, software or other information intended for publication) submitted as part of or as a supplement to the manuscript ("Paper") in all forms and media throughout the world, in all languages, for the full term of copyright, effective when and if the article is accepted for publication. This transfer includes the right to reproduce and/or to distribute the Paper to other journals or digital libraries in electronic and online forms and systems.
I understand that I retain the rights to use the pre-prints, off-prints, accepted manuscript and published journal Paper for personal use, scholarly purposes and internal institutional use.
In certain cases, I can ask for retaining the publishing rights of the Paper. The Journal can permit or deny the request for publishing rights, to which I fully agree.
I declare that the submitted Paper is original, has been written by the stated authors and has not been published elsewhere nor is currently being considered for publication by any other journal and will not be submitted for such review while under review by this Journal. The Paper contains no material that violates proprietary rights of any other person or entity. I have obtained written permission from copyright owners for any excerpts from copyrighted works that are included and have credited the sources in my article. I have informed the co-author(s) of the terms of this publishing agreement.
Copyright © Slovenian Society Informatika







