Multimodal Data Fusion for Enhanced CNN-LSTM Based Intelligent Football Training and Tactical Analysis

Guozheng Zhu, Penghui Yue

Abstract


Existing football training and tactical analysis systems often suffer from inaccurate feedback and biased tactical judgments due to reliance on single-modality data and fragmented information. To address these limitations, this study proposes a deep multimodal fusion framework that integrates Convolutional Neural Networks (CNN) and Long Short-Term Memory (LSTM) networks. Specifically, CNN is employed to extract spatial features from video frames and sensor signals, while LSTM captures temporal dynamics of sequential data. To ensure consistency across heterogeneous data sources, feature normalization and time alignment strategies are applied. An attention mechanism is further introduced to adaptively allocate weights to different modalities, thereby enhancing the representation of critical features. In addition, a multitask learning scheme with dual loss functions—training quality evaluation and tactical behavior classification—guides the model to optimize both action recognition and tactical inference simultaneously. The entire system is constructed in an end-to-end manner, from multimodal data input to training feedback and tactical analysis output. Experimental evaluation demonstrates that the system achieves 91.3% accuracy in action recognition, 89.7% accuracy in tactical classification, and maintains a training feedback error within 2.4%. These results highlight the system’s potential for refined training management and efficient tactical analysis, offering a viable pathway toward intelligent football systems.


Full Text:

PDF

References


References

Wang, Bo. "Use of network technologies in teaching football tactics: cooperation, engagement, creativity." Interactive Learning Environments 32.9 (2024): 5078-5088.

Wang, Jianming, and Jing Chen. "Design and Research of Dynamic Evolution System in Football Tactics Under Computational Intelligence." Mathematical Problems in Engineering 2022.1 (2022): 3772236 - 37722 47 .

Zhao, Kun, and Xueying Guo. "Analysis of the application of virtual reality technology in football training." Journal of Sensors 2022.1 (2022): 1339434 - 13394 41 .

Liao, Shaowei, and Chao Fu. "The optimization of youth football training using deep learning and artificial intelligence." Scientific Reports 15.1 (2025): 8190 - 8 216 .

Zavalishina, Svetlana Yu, Olga N. Makurina, Galina S. Mal , and Elena S. Tkacheva. "Influence of systematic football training on adolescent functional characteristics." Biomedical and Pharmacology Journal 14.2 (2021): 533-540.

Callies, Marcus. "Politics and fan communication in football stadia in Germany–a multimodal linguistic analysis of protest banners." Soccer & Society 24.7 (2023): 958-973.

Graf, Eva-Maria, Marcus Callies, and Melanie Fleischhacker. "The language and discourse (s) of football. Interdisciplinary and cross-modal perspectives: introduction to the thematic issue." Soccer & Society 24.7 (2023): 921-925.

Li, Xingyao, and Rizwan Ullah. "An image classification algorithm for football players' activities using deep neural network." Soft Computing 27.24 (2023): 19317-19337.

Goka, Ryota, Yuya Moroto, Keisuke Maeda, Takahiro Ogawa , and Miki Haseyama. "Multimodal shot prediction based on spatial-temporal interaction between players in soccer videos." Applied Sciences 14.11 (2024): 4847.

Wang, Sheng. "A deep learning algorithm for special action recognition of football." Mobile Information Systems 2022.1 (2022): 6315648 - 63156 56 .

Xue, Ming, and Hongtao Chen. "A football shot action recognition method based on deep learning algorithm." Scientific Programming 2022.1 (2022): 9330798 - 9330 807 .

Chen, Zhaosheng, and Na Chen. "Children's football action recognition based on LSTM and a V-DBN." IEIE Transactions on Smart Processing & Computing 12.4 (2023): 312-322.

Shen, Lechuan, Zhongquan Tan, Zekun Li, Qikun Li , and Guoqin Jiang. "Tactics analysis and evaluation of women's football team based on convolutional neural network." Scientific Reports 14.1 (2024): 255 - 2 68 .

Zhou, Linxi, et al. "Application of Carrera Unified Formulation and Hybrid AI-Composition with CNN and ReliefF feature selection: presenting some useful suggestions for improving the stability of football and sport equipment via advanced nanocomposites." Mechanics of Advanced Materials and Structures (2024): 1-20.

Hegde, Siddhanth U., and Satish B. Basapur. "DistilBERT-CNN-LSTM Model with GloVe for Sentiment Analysis on Football Specific Tweets." IAENG International Journal of Computer Science 49.2 (2022) : 420 .

Orr, Benjamin, Ephraim Pan, and Dah-Jye Lee. "Optimizing Football Formation Analysis via LSTM-Based Event Detection." Electronics 13.20 (2024): 4105.

Wang, Jing, and Baiqing Liu. "Analyzing the feature extraction of football player's offense action using machine vision, big data, and internet of things." Soft Computing 27.15 (2023): 10905-10920.

Liu, Jiatian. "Convolutional neural network-based human movement recognition algorithm in sports analysis." Frontiers in psychology 12 (2021): 663359 - 6633 65 .

Liu, Chengjie, and Hongbing Liu. "The application of artificial intelligence technology in the tactical training of football players." Entertainment Computing 52 (2025): 100913.

Shao, Qiaoqiao. "Virtual reality and ANN-based three-dimensional tactical training model for football players." Soft Computing 28.4 (2024): 3633-3648.

Fang, Lei, Qiang Wei, and Cheng Jian Xu. "Technical and tactical command decision algorithm of football matches based on big data and neural network." Scientific Programming 2021.1 (2021): 5544071 - 554407 9 .

Seebacher, Daniel, Tom Polk, Halldor Janetzko, Daniel A. Keim, Tobias Schreck, and Manuel Stein. "Investigating the Sketchplan: A novel way of identifying tactical behavior in massive soccer datasets." IEEE Transactions on Visualization and Computer Graphics 29.4 (2021): 1920-1936.

Cao, Anqi, Xiao Xie , Mingxu Zhou , Hui Zhang , Mingliang Xu , and Yingcai Wu. "Action-Evaluator: A Visualization Approach for Player Action Evaluation in Soccer." IEEE Transactions on Visualization and Computer Graphics 30.1 (2023): 880-890.

Cao, Anqi, Ji Lan , Xiao Xie , Hongyu Chen , Xiaolong Zhang , and Hui Zhang. "Team-builder: Toward more effective lineup selection in soccer." IEEE Transactions on Visualization and Computer Graphics 29.12 (2022): 5178-5193.

Teixeira, Jose E., Eduardo Maio, Pedro Afonso, Samuel Encarnacao, Guilherme F. Machado, and Ryland Morgans, et al. "Mapping football tactical behavior and collective dynamics with artificial intelligence: a systematic review." Frontiers in Sports and Active Living 7 (2025): 1569155-1569177.

Gao, Yuzhou, and Guoquan Ma. "Human motion recognition based on multimodal characteristics of learning quality in football scene." Mathematical Problems in Engineering 2021.1 (2021): 7963616.

Zhang, Long. "Behaviour detection and recognition of college basketball players based on multimodal sequence matching and deep neural networks." Computational Intelligence and Neuroscience 2022.1 (2022): 7599685-7599695.

Wang, Haiyan. "Multimodal audio-visual robot fusing 3D CNN and CRNN for player behavior recognition and prediction in basketball matches." Frontiers in Neurorobotics 18 (2024): 1284175-1284191.

Malik, Najeeb ur Rehman, Syed Abdul Rahman Abu-Bakar , Usman Ullah Sheikh , Asma Channa , and Nirvana Popescu. "Cascading pose features with CNN-LSTM for multiview human action recognition." Signals 4.1 (2023): 40-55.

Chen, Jing, Jiping Wang , Qun Yuan , and Zhao Yang. "CNN-LSTM model for recognizing video-recorded actions performed in a traditional chinese exercise." IEEE Journal of Translational Engineering in Health and Medicine 11 (2023): 351-359.




DOI: https://doi.org/10.31449/inf.v49i32.10174

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.