Deep learning-based networks for automated recognition and classification of awkward working postures in construction using wearable insole sensor data

Abstract

Among the numerous work-related risk factors, construction workers are often exposed to awkward working postures that may lead them to develop work-related musculoskeletal disorders (WMSDs). To mitigate WMSDs among construction workers, awkward working posture recognition is the first step in proactive WMSD prevention. Several researchers have proposed wearable sensor-based systems and machine learning classifiers for awkward posture recognition. However, these wearable sensor-based systems (e.g., surface electromyography) are either intrusive or require attaching multiple sensors on workers' bodies, which may lead to workers' discomfort and systemic instability, thus, limiting their application on construction sites. In addition, machine learning classifiers are limited to human-specific shallow features which influence model performance. To address these limitations, this study proposes a novel approach by using wearable insole pressure system and recurrent neural network (RNN) models, which automate feature extraction and are widely used for sequential data classification. Therefore, the research objective is to automatically recognize and classify different types of awkward working postures in construction by using deep learning-based networks and wearable insole sensor data. The classification performance of three RNN-based deep learning models, namely: (1) long-short term memory (LSTM), (2) bidirectional LSTM (Bi-LSTM), and (3) gated recurrent units (GRU), was evaluated using plantar pressure data captured by a wearable insole system from workers on construction sites. The experimental results show that GRU model outperforms the other RNN-based deep learning models with a high accuracy of 99.01% and F1-score between 93.19% and 99.39%. These results demonstrate that GRU models can be employed to learn sequential plantar pressure patterns captured by a wearable insole system to recognize and classify different types of awkward working postures. The findings of this study contribute to wearable sensor-based posture-related recognition and classification, thus, enhancing construction workers' health and safety.

Publication DOI: https://doi.org/10.1016/j.autcon.2022.104181
Divisions: College of Engineering & Physical Sciences > School of Infrastructure and Sustainable Engineering > Civil Engineering
College of Engineering & Physical Sciences > School of Informatics and Digital Engineering > Mathematics
College of Engineering & Physical Sciences > Systems analytics research institute (SARI)
College of Engineering & Physical Sciences
Additional Information: © 2022, Elsevier. Licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/ Funding Information: The authors acknowledged two funding supports from (1) Aston Institute for Urban Technology and the Environment (ASTUTE) , Seedcorn Grants Proposal 2020/21 entitled “Wearable Insole Sensor Data and a Deep Learning Network-Based Recognition for Musculoskeletal Disorders Prevention in Construction” and (2) Aston Research and Knowledge Exchange Pump Priming Fund 2021/22, Grant Proposal entitled "Digital Twin-Enabled Wearable Sensing Technologies for Improved Workers' Activity Recognition and Work-Related Risk Assessment".
Uncontrolled Keywords: Awkward working postures,Deep learning networks,Wearable insole pressure system,Work-related musculoskeletal disorders,Work-related risk recognition,Control and Systems Engineering,Civil and Structural Engineering,Building and Construction
Publication ISSN: 0926-5805
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
https://www.sci ... 0541?via%3Dihub (Publisher URL)
PURE Output Type: Article
Published Date: 2022-04
Published Online Date: 2022-03-01
Accepted Date: 2022-02-15
Authors: Antwi-Afari, Maxwell Fordjour (ORCID Profile 0000-0002-6812-7839)
Qarout, Yazan
Herzallah, Randa (ORCID Profile 0000-0001-9128-6814)
Anwer, Shahnawaz
Umer, Waleed
Zhang, Yongcheng
Manu, Patrick

Download

[img]

Version: Accepted Version

Access Restriction: Restricted to Repository staff only until 1 March 2023.

License: Creative Commons Attribution Non-commercial No Derivatives


Export / Share Citation


Statistics

Additional statistics for this record