Optimizing Deep LSTM Model through Hyperparameter Tuning for Sensor-Based Human Activity Recognition in Smart Home

Mariam El Ghazi, Noura Aknin

Abstract


Human Activity Recognition (HAR) holds significant potential in healthcare, smart homes, sports, and security, mainly benefiting the well-being of elderly individuals and dependents. This research introduces an innovative deep learning-based approach to HAR, using wearable sensors in smart home environments. In this paper, we conduct a comprehensive review of the state of the art, offering insights into existing methods, classification techniques, their performances, hyperparameter tuning strategies, findings, limitations, and future directions. We propose an LSTM-based deep model enriched with batch normalization and perform a hyperparameter tuning using Bayesian Optimization; then, we evaluate the model on the PAMAP2 public dataset. The model outperforms previous studies, achieving remarkable performance metrics, including accuracy at 97.71%, F1 score, precision, and recall, approaching 96.66%, 96.85%, and 96.55%, respectively. We plan to assess the model's generalization capabilities for future work by training it on diverse datasets such as Opportunity and WISDM. Furthermore, we aim to enhance the model by exploring hybrid deep model architectures and alternative hyperparameter tuning approaches. These efforts maximize the model's efficiency and adaptability in real-world scenarios.


Full Text:

PDF

References


S. Zhang et al., “Deep Learning in Human Activity Recognition withWearable Sensors: A Review on Advances,” Sensors, vol. 22, no. 4, p. 1476, Feb. 2022, doi: 10.3390/s22041476.

M. Gochoo, F. Alnajjar, T. H. Tan, and S. Khalid, “Towards privacy‐preserved aging in place: A systematic review,” Sensors, vol. 21, no. 9, p. 3082, Apr. 2021, doi: 10.3390/s21093082.

A. Kristoffersson and M. Lindén, “A systematic review on the use of wearable body sensors for health monitoring: A qualitative synthesis,” Sensors (Switzerland), vol. 20, no. 5, p. 1502, Mar. 2020, doi: 10.3390/s20051502.

M. M. Islam, S. Nooruddin, F. Karray, and G. Muhammad, “Human activity recognition using tools of convolutional neural networks: A state of the art review, data sets, challenges, and future prospects,” Comput. Biol. Med., vol. 149, no. August, p. 106060, Oct. 2022, doi: 10.1016/j.compbiomed.2022.106060.

Y. Zhang, I. D’haeseleer, J. Coelho, V. Vanden Abeele, and B. Vanrumste, “Recognition of bathroom activities in older adults using wearable sensors: A systematic review and recommendations,” Sensors, vol. 21, no. 6, pp. 1–23, Mar. 2021, doi: 10.3390/s21062176.

D. Roggen et al., “Collecting complex activity datasets in highly rich networked sensor environments,” INSS 2010 - 7th Int. Conf. Networked Sens. Syst., pp. 233–240, 2010, doi: 10.1109/INSS.2010.5573462.

J. R. Kwapisz, G. M. Weiss, and S. A. Moore, “Activity Recognition using Cell Phone Accelerometers,” 2010.

“PAMAP2 Physical Activity Monitoring - UCI Machine Learning Repository.”

https://archive.ics.uci.edu/dataset/231/pamap2+physical+activity+monitoring (accessed Jul. 23, 2023).

H. Ma, W. Li, X. Zhang, S. Gao, and S. Lu, “Attnsense: Multi-level attention mechanism for multimodal human activity recognition,” IJCAI Int. Jt. Conf. Artif. Intell., vol. 2019-Augus, pp. 3109–3115, 2019, doi: 10.24963/ijcai.2019/431.

N. Y. Hammerla, S. Halloran, and T. Plötz, “Deep, convolutional, and recurrent models for human activity recognition using wearables,” IJCAI Int. Jt. Conf. Artif. Intell., vol. 2016-Janua, pp. 1533–1540, 2016.

S. Wan, L. Qi, X. Xu, C. Tong, and Z. Gu, “Deep Learning Models for Real-time Human Activity Recognition with Smartphones,” Mob. Networks Appl., vol. 25, no. 2, pp. 743–755, Apr. 2020, doi: 10.1007/S11036-019-01445-X/METRICS.

Y. Xu and L. Zhao, “Inception-LSTM Human Motion Recognition with Channel Attention Mechanism,” Comput. Math. Methods Med., vol. 2022, 2022, doi: 10.1155/2022/9173504.

Q. Teng, K. Wang, L. Zhang, and J. He, “The Layer-Wise Training Convolutional Neural Networks Using Local Loss for Sensor-Based Human Activity Recognition,” IEEE Sens. J., vol. 20, no. 13, pp. 7265–7274, Jul. 2020, doi: 10.1109/JSEN.2020.2978772.

W. Gao, L. Zhang, Q. Teng, J. He, and H. Wu, “DanHAR: Dual Attention Network for multimodal human activity recognition using wearable sensors,” Appl. Soft Comput., vol. 111, pp. 1–11, 2021, doi: 10.1016/j.asoc.2021.107728.

C. Xu, D. Chai, J. He, X. Zhang, and S. Duan, “InnoHAR: A deep neural network for complex human activity recognition,” IEEE Access, vol. 7, no. c, pp. 9893–9902, 2019, doi: 10.1109/ACCESS.2018.2890675.

A. Tehrani, M. Yadollahzadeh-Tabari, A. Zehtab-Salmasi, and R. Enayatifar, “Wearable Sensor-Based Human Activity Recognition System Employing Bi-LSTM Algorithm,” Comput. J., no. April, 2023, doi: 10.1093/comjnl/bxad035.

S. Hochreiter and J. Schmidhuber, “Long Short-Term Memory,” Neural Comput., vol. 9, no. 8, pp. 1735–1780, Nov. 1997, doi: 10.1162/NECO.1997.9.8.1735.

“File:LSTM cell.svg - Wikimedia Commons.” https://commons.wikimedia.org/wiki/File:LSTM_cell.svg (accessed Jul. 23, 2023).

“KerasTuner.” https://keras.io/keras_tuner/ (accessed Jul. 23, 2023).




DOI: https://doi.org/10.31449/inf.v47i10.5268

Creative Commons License
This work is licensed under a Creative Commons Attribution 3.0 License.