Reinforcement Learning-Based Framework for Dynamic Strategy Generation in Personalized Psychological Counseling Using Deep Q-Networks
Abstract
Personalized psychological counseling plays a crucial role in enhancing mental well-being by addressing individual emotional and cognitive needs. This study proposes a Reinforcement Learning-Based Decision Support Framework (RL-DSF) that dynamically generates counseling strategies optimized through a Deep Q-Network (DQN). The model adapts in real-time to users' evolving psychological states by leveraging feedback signals derived from emotional responses, engagement metrics, and counseling effectiveness. The RL-DSF was trained and evaluated using a synthetic therapy conversations dataset, comprising diverse simulated dialogues with annotated emotional cues, designed to mimic real-world mental health scenarios. While no direct clinical patient data was used in training, the system’s effectiveness was assessed on anonymized user sessions collected from a chatbot-based mental health support platform. Experimental results demonstrated that RL-DSF significantly outperformed baseline methods, achieving an average reduction of 1.1 points on PHQ-9 depression scores and 0.6 points on GAD-7 anxiety scores. User engagement increased by 11.1%, satisfaction ratings averaged 4.5 out of 5, and dropout rates were reduced to 5%, validating the framework’s potential to provide adaptive, personalized psychological support in a scalable digital environment.References
O. Oyebode, J. Fowles, D. Steeves, and R. Orji, "Machine Learning Techniques in Adaptive and Personalized Systems for Health and Wellness," International Journal of Human–Computer Interaction, vol. 39, no. 9, pp. 1–25, Jul. 2022, doi: https://doi.org/10.1080/10447318.2022.2089085
C. Halkiopoulos and E. Gkintoni, "The Role of Machine Learning in AR/VR-Based Cognitive Therapies: A Systematic Review for Mental Health Disorders," Electronics, vol. 14, no. 6, p. 1110, Mar. 2025, doi: https://doi.org/10.3390/electronics14061110
Z. S. Chen, P. (Param) Kulkarni, I. R. Galatzer-Levy, B. Bigio, C. Nasca, and Y. Zhang, "Modern views of machine learning for precision psychiatry," Patterns, vol. 3, no. 11, p. 100602, Nov. 2022, doi: https://doi.org/10.1016/j.patter.2022.100602
Abilkaiyrkyzy, A., Laamarti, F., Hamdi, M., & El Saddik, A. (2024). Dialogue system for early mental illness detection: toward a digital twin solution. IEEE Access, 12, 2007-2024. https://doi.org/10.1109/ACCESS.2023.3348783
C. Yu, J. Liu, S. Nemati, and G. Yin, "Reinforcement Learning in Healthcare: A Survey," ACM Computing Surveys, vol. 55, no. 1, pp. 1–36, Jan. 2023, doi: https://doi.org/10.1145/3477600
Nye, A., Delgadillo, J., & Barkham, M. (2023). Efficacy of personalized psychological interventions: A systematic review and meta-analysis. Journal of Consulting and Clinical Psychology, 91(7), 389. https://doi.org/10.1037/ccp0000820
S. Xiong, Y. Zhang, C. Wu, Z. Chen, J. Peng, and M. Zhang, "Energy management strategy of intelligent plug-in split hybrid electric vehicle based on deep reinforcement learning with optimized path planning algorithm," Proceedings of the Institution of Mechanical Engineers, Part D: Journal of Automobile Engineering, vol. 235, no. 14, pp. 3287–3298, Aug. 2021, doi: https://doi.org/10.1177/09544070211036810
N. Akalin and A. Loutfi, "Reinforcement Learning Approaches in Social Robotics," Sensors, vol. 21, no. 4, p. 1292, Feb. 2021, doi: https://doi.org/10.3390/s21041292
Cerniglia, L. (2024). Advancing Personalized Interventions: A Paradigm Shift in Psychological and Health-Related Treatment Strategies. Journal of Clinical Medicine, 13(15), 4353. https://doi.org/10.3390/jcm13154353
M. Nama et al., "Machine learning‐based traffic scheduling techniques for intelligent transportation system: Opportunities and challenges," International Journal of Communication Systems, vol. 34, no. 9, Apr. 2021, doi: https://doi.org/10.1002/dac.4814
H. Majjate, Y. Bellarhmouch, A. Jeghal, A. Yahyaouy, H. Tairi, and K. A. Zidani, "AI-Powered Academic Guidance and Counseling System Based on Student Profile and Interests," Applied System Innovation, vol. 7, no. 1, p 6, Feb. 2024, doi: https://doi.org/10.3390/asi7010006
S. Gönül, T. Namlı, A. Coşar, and İ. H. Toroslu, "A reinforcement learning based algorithm for personalization of digital, just-in-time, adaptive interventions," Artificial Intelligence in Medicine, vol. 115, p. 102062, May 2021, doi: https://doi.org/10.1016/j.artmed.2021.102062
Al Ameen, R., & Al Maktoum, L. (2024). Machine learning algorithms for emotion recognition using audio and text data. PatternIQ Mining, 1(4), 1–11. https://www.doi.org/10.70023/sahd/241101
Y. Ping, "Experience in psychological counseling supported by artificial intelligence technology," Technology and Health Care, vol. 32, no. 6, pp. 1–18, Jun. 2024, doi: https://doi.org/10.3233/thc-230809
Schwartz, B., Cohen, Z. D., Rubel, J. A., Zimmermann, D., Wittmann, W. W., & Lutz, W. (2021). Personalized treatment selection in routine care: Integrating machine learning and statistical algorithms to recommend cognitive behavioral or psychodynamic therapy. Psychotherapy Research, 31(1), 33-51. https://doi.org/10.1080/10503307.2020.1769219
M. Casu, S. Triscari, S. Battiato, L. Guarnera, and P. Caponnetto, "AI chatbots for mental health: A scoping review of effectiveness, feasibility, and applications," Applied Sciences, vol. 14, no. 13, pp. 5889–5889, Jul. 2024, doi: https://doi.org/10.3390/app14135889
C. Chen et al., "Comparison of an AI Chatbot With a Nurse Hotline in Reducing Anxiety and Depression Levels in the General Population: Pilot Randomized Controlled Trial," JMIR Human Factors, vol. 12, pp. e65785–e65785, Mar. 2025, doi: https://doi.org/10.2196/65785
Banumathi, K., Venkatesan, L., Benjamin, L. S., Vijayalakshmi, K., Satchi, N. S., & Satchi IV, N. S. (2025). Reinforcement Learning in Personalized Medicine: A Comprehensive Review of Treatment Optimization Strategies. Cureus, 17(4). https://doi.org/10.7759/cureus.82756
Lutz, W., Deisenhofer, A. K., Rubel, J., Bennemann, B., Giesemann, J., Poster, K., & Schwartz, B. (2022). Prospective evaluation of a clinical decision support system in psychological therapy. Journal of consulting and clinical psychology, 90(1), 90. https://doi.org/10.1037/ccp0000642
Y. He et al., "Mental Health Chatbot for Young Adults With Depressive Symptoms During the COVID-19 Pandemic: Single-Blind, Three-Arm Randomized Controlled Trial," Journal of Medical Internet Research, vol. 24, no. 11, p. e40719, Nov. 2022, doi: https://doi.org/10.2196/40719
S. Ulrich, N. Lienhard, Hansjörg Künzli, and T. Kowatsch, "MISHA – A Chatbot-delivered Stress Management Coaching for Students: Pilot Randomized Controlled Trial (Preprint)," JMIR mhealth and uhealth, vol. 12, pp. e54945–e54945, Jun. 2024, doi: https://doi.org/10.2196/54945
Kolenik, T., Schiepek, G., & Gams, M. (2024). Computational psychotherapy system for mental health prediction and behavior change with a conversational agent. Neuropsychiatric Disease and Treatment, 2465-2498. https://doi.org/10.2147/ndt.s417695
Kolenik, T. (2025). Intelligent Cognitive System for Computational Psychotherapy with a Conversational Agent for Attitude and Behavior Change in Stress, Anxiety, and Depression. Informatica, 49(2). https://doi.org/10.31449/inf.v49i2.8738
Kolenik, T. (2022). Methods in digital mental health: smartphone-based assessment and intervention for stress, anxiety, and depression. In Integrating Artificial Intelligence and IoT for Advanced Health Informatics: AI in the Healthcare Sector (pp. 105-128). Cham: Springer International Publishing. https://doi.org/10.1007/978-3-030-91181-2_7
Kolenik, T., & Gams, M. (2021). Intelligent cognitive assistants for attitude and behavior change support in mental health: state-of-the-art technical review. Electronics, 10(11), 1250. https://doi.org/10.3390/electronics10111250
Kolenik, T., & Gams, M. (2021). Persuasive technology for mental health: One step closer to (mental health care) equality?. IEEE Technology and Society Magazine, 40(1), 80-86. https://doi.org/10.1109/MTS.2021.3056288
https://www.kaggle.com/datasets/thedevastator/synthetic-therapy-conversations-dataset
Tlili, A., & Chikhi, S. (2021). Risks analyzing and management in software project management using fuzzy cognitive maps with reinforcement learning. Informatica, 45(1). https://doi.org/10.31449/inf.v45i1.3104
Wang, L., & Pan, Q. (2025). Game-Theoretic Multi-Agent Reinforcement Learning for Economic Resource Allocation Optimization. Informatica, 49(22). https://doi.org/10.31449/inf.v49i22.8426
DOI:
https://doi.org/10.31449/inf.v49i35.10316Downloads
Published
How to Cite
Issue
Section
License
Authors retain copyright in their work. By submitting to and publishing with Informatica, authors grant the publisher (Slovene Society Informatika) the non-exclusive right to publish, reproduce, and distribute the article and to identify itself as the original publisher.
All articles are published under the Creative Commons Attribution license CC BY 3.0. Under this license, others may share and adapt the work for any purpose, provided appropriate credit is given and changes (if any) are indicated.
Authors may deposit and share the submitted version, accepted manuscript, and published version, provided the original publication in Informatica is properly cited.
