Research on the Recognition of Psychological Emotions in Adults Using Multimodal Fusion
Abstract
Recognition of psychological emotions in adults plays a pivotal role in various fields. In this study, 110 healthy people and 110 depressed people were recruited. Gait, facial, and speech feature data were collected and screened. The obtained features were utilized as multimodal features. Subsequently, attention-bidirectional long short-term memory (BiLSTM) was developed as a method for recognizing adult psychological emotions. It was observed that better recognition results were achieved through multimodal fusion than unimodal approaches. The accuracy of the attention-BiLSTM method was 0.8182, and the F1 value was 0.8125, demonstrating higher recognition accuracy compared to methods such as the recurrent neural network and LSTM. These results verify the reliability of multimodal fusion and the attention-BiLSTM method fo recognizing psychological emotions in adults, and they can be applied in practice.
DOI:
https://doi.org/10.31449/inf.v48i9.5876Downloads
Published
06/10/2024
How to Cite
Zhao, H. (2024). Research on the Recognition of Psychological Emotions in Adults Using Multimodal Fusion. Informatica, 48(9). https://doi.org/10.31449/inf.v48i9.5876
Issue
Section
Online-only
License
Authors retain copyright in their work. By submitting to and publishing with Informatica, authors grant the publisher (Slovene Society Informatika) the non-exclusive right to publish, reproduce, and distribute the article and to identify itself as the original publisher.
All articles are published under the Creative Commons Attribution license CC BY 3.0. Under this license, others may share and adapt the work for any purpose, provided appropriate credit is given and changes (if any) are indicated.
Authors may deposit and share the submitted version, accepted manuscript, and published version, provided the original publication in Informatica is properly cited.
