BERT-based Consumer Sentiment Analysis for Personalized Marketing Strategies
Abstract
This study aims to construct an efficient consumer sentiment analysis model and apply it to optimize personalized marketing strategies for enhancing user conversion rates and satisfaction. The yf_amazon dataset and Chinese sentiment classification corpus are selected as foundational data by integrating natural language processing and deep learning technologies. Preprocessing procedures including tokenization, stop word removal, noise filtering, and sentiment annotation, are employed to clean and structure consumer reviews. A sentiment classification model based on Bidirectional Encoder Representations from Transformers (BERT) and Transformer architectures is developed and fine-tuned with parameters including a learning rate of 2e-5 and 4 training epochs. Evaluation metrics encompass accuracy, precision, recall, and F1 score. Experimental results demonstrate that the proposed model achieves 92.5% accuracy and a 0.90 F1 score in sentiment classification tasks. This model outperforms conventional Convolutional Neural Networks (83.6% accuracy, 0.83 F1 score) and Long Short-Term Memory models (86.2% accuracy, 0.85 F1 score). Further segmentation of user sentiment clusters based on analysis results enables the implementation of differentiated recommendation strategies and timelimited marketing campaigns. Ultimately, it increases user conversion rates from 25.0% to 32.7% (a 7.7 percentage point improvement) while significantly enhancing consumer satisfaction with personalized recommendations. These findings indicate that Transformer-based sentiment analysis models hold substantial practical value for advancing personalized marketing applications.
Full Text:
PDFReferences
Alantari, H. J., Currim, I. S., Deng, Y., & Singh, S. (2022). An empirical comparison of machine learning methods for text-based sentiment analysis of online consumer reviews. International Journal of Research in Marketing, 39(1), 1-19.
Rocklage, M. D., He, S., Rucker, D. D., & Nordgren, L. F. (2023). Beyond sentiment: the value and measurement of consumer certainty in language. Journal of Marketing Research, 60(5), 870-888.
Iqbal, A., Amin, R., Iqbal, J., Alroobaea, R., Binmahfoudh, A., & Hussain, M. (2022). Sentiment analysis of consumer reviews using deep learning. Sustainability, 14(17), 10844.
Singh, A., Jenamani, M., Thakkar, J. J., & Rana, N. P. (2022). Quantifying the effect of eWOM embedded consumer perceptions on sales: An integrated aspect-level sentiment analysis and panel data modeling approach. Journal of Business Research, 138, 52-64.
Yuan, Z. (2022). Big data recommendation research based on travel consumer sentiment analysis. Frontiers in Psychology, 13, 857292.
Kaur, G., & Sharma, A. (2023). A deep learning-based model using hybrid feature extraction approach for consumer sentiment analysis. Journal of big data, 10(1), 5.
Hossain, M. S., & Rahman, M. F. (2023). Customer sentiment analysis and prediction of insurance products’ reviews using machine learning approaches. FIIB Business Review, 12(4), 386-402.
Taherdoost, H., & Madanchian, M. (2023). Artificial intelligence and sentiment analysis: A review in competitive research. Computers, 12(2), 37.
Adak, A., Pradhan, B., & Shukla, N. (2022). Sentiment analysis of customer reviews of food delivery services using deep learning and explainable artificial intelligence: Systematic review. Foods, 11(10), 1500.
Shaik Vadla, M. K., Suresh, M. A., & Viswanathan, V. K. (2024). Enhancing product design through AI-driven sentiment analysis of Amazon reviews using BERT. Algorithms, 17(2), 59.
Noorian, A., Harounabadi, A., & Hazratifard, M. (2024). A sequential neural recommendation system exploiting BERT and LSTM on social media posts. Complex & Intelligent Systems, 10(1), 721-744.
Ghobakhloo, M., & Ghobakhloo, M. (2022). Design of a personalized recommender system using sentiment analysis in social media (case study: banking system). Social Network Analysis and Mining, 12(1), 84.
El-Ansari, A., & Beni-Hssane, A. (2023). Sentiment analysis for personalized chatbots in e-commerce applications. Wireless Personal Communications, 129(3), 1623-1644.
Gooljar, V., Issa, T., Hardin-Ramanan, S., & Abu-Salih, B. (2024). Sentiment-based predictive models for online purchases in the era of marketing 5.0: a systematic review. Journal of Big Data, 11(1), 107.
Roumeliotis, K. I., Tselikas, N. D., & Nasiopoulos, D. K. (2024). Leveraging Large Language Models in Tourism: A Comparative Study of the Latest GPT Omni Models and BERT NLP for Customer Review Classification and Sentiment Analysis. Information, 15(12), 792.
Çetinkaya, Y. M., Külah, E., Toroslu, İ. H., & Davulcu, H. (2024). Targeted marketing on social media: utilizing text analysis to create personalized landing pages. Social Network Analysis and Mining, 14(1), 77.
Hung, L. P., & Alias, S. (2023). Beyond sentiment analysis: a review of recent trends in text based sentiment analysis and emotion detection. Journal of Advanced Computational Intelligence and Intelligent Informatics, 27(1), 84-95.
Liu, H. (2024). The role of personalization in modern digital marketing: how tailored experiences drive consumer engagement. Strategic Management Insights, 1(8), 34-40.
Yan, C., Liu, J., Liu, W., & Liu, X. (2022). Research on public opinion sentiment classification based on attention parallel dual-channel deep learning hybrid model. Engineering Applications of Artificial Intelligence, 116, 105448.
Priya, C. S. R., & Deepalakshmi, P. (2023). Sentiment analysis from unstructured hotel reviews data in social network using deep learning techniques. International Journal of Information Technology, 15(7), 3563-3574.
Tan, K. L., Lee, C. P., Anbananthen, K. S. M., & Lim, K. M. (2022). RoBERTa-LSTM: a hybrid model for sentiment analysis with transformer and recurrent neural network. IEEE Access, 10, 21517-21525.
Tran, T. P., van Solt, M., & Zemanek Jr, J. E. (2020). How does personalization affect brand relationship in social commerce? A mediation perspective. Journal of Consumer Marketing, 37(5), 473-486.
Karabila, I., Darraz, N., EL-Ansari, A., Alami, N., & EL Mallahi, M. (2024). BERT-enhanced sentiment analysis for personalized e-commerce recommendations. Multimedia Tools and Applications, 83(19), 56463-56488.
Karbauskaitė, R., Sakalauskas, L., & Dzemyda, G. (2020). Kriging predictor for facial emotion recognition using numerical proximities of human emotions. Informatica, 31(2), 249-275.
Kaminskas, V., & Vidugirienė, A. (2016). A comparison of Hammerstein-type nonlinear models for identification of human response to virtual 3D face stimuli. Informatica, 27(2), 283-297.
Märtin, C., Bissinger, B. C., & Asta, P. (2023). Optimizing the digital customer journey—Improving user experience by exploiting emotions, personas and situations for individualized user interface adaptations. Journal of Consumer Behaviour, 22(5), 1050-1061.
Gao, Y., & Liu, H. (2023). Artificial intelligence-enabled personalization in interactive marketing: a customer journey perspective. Journal of Research in Interactive Marketing, 17(5), 663-680.
DOI: https://doi.org/10.31449/inf.v49i28.8232

This work is licensed under a Creative Commons Attribution 3.0 License.