Antwi-Afari, Maxwell Fordjour, Qarout, Yazan, Herzallah, Randa, Anwer, Shahnawaz, Umer, Waleed, Zhang, Yongcheng and Manu, Patrick (2022). Deep learning-based networks for automated recognition and classification of awkward working postures in construction using wearable insole sensor data. Automation in Construction, 136 ,
Abstract
Among the numerous work-related risk factors, construction workers are often exposed to awkward working postures that may lead them to develop work-related musculoskeletal disorders (WMSDs). To mitigate WMSDs among construction workers, awkward working posture recognition is the first step in proactive WMSD prevention. Several researchers have proposed wearable sensor-based systems and machine learning classifiers for awkward posture recognition. However, these wearable sensor-based systems (e.g., surface electromyography) are either intrusive or require attaching multiple sensors on workers' bodies, which may lead to workers' discomfort and systemic instability, thus, limiting their application on construction sites. In addition, machine learning classifiers are limited to human-specific shallow features which influence model performance. To address these limitations, this study proposes a novel approach by using wearable insole pressure system and recurrent neural network (RNN) models, which automate feature extraction and are widely used for sequential data classification. Therefore, the research objective is to automatically recognize and classify different types of awkward working postures in construction by using deep learning-based networks and wearable insole sensor data. The classification performance of three RNN-based deep learning models, namely: (1) long-short term memory (LSTM), (2) bidirectional LSTM (Bi-LSTM), and (3) gated recurrent units (GRU), was evaluated using plantar pressure data captured by a wearable insole system from workers on construction sites. The experimental results show that GRU model outperforms the other RNN-based deep learning models with a high accuracy of 99.01% and F1-score between 93.19% and 99.39%. These results demonstrate that GRU models can be employed to learn sequential plantar pressure patterns captured by a wearable insole system to recognize and classify different types of awkward working postures. The findings of this study contribute to wearable sensor-based posture-related recognition and classification, thus, enhancing construction workers' health and safety.
Publication DOI: | https://doi.org/10.1016/j.autcon.2022.104181 |
---|---|
Divisions: | College of Engineering & Physical Sciences > School of Infrastructure and Sustainable Engineering > Civil Engineering College of Engineering & Physical Sciences > Systems analytics research institute (SARI) College of Engineering & Physical Sciences |
Funding Information: | The authors acknowledged two funding supports from (1) Aston Institute for Urban Technology and the Environment (ASTUTE) , Seedcorn Grants Proposal 2020/21 entitled “Wearable Insole Sensor Data and a Deep Learning Network-Based Recognition for Musculoskel |
Additional Information: | © 2022, Elsevier. Licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/ Funding Information: The authors acknowledged two funding supports from (1) Aston Institute for Urban Technology and the Environment (ASTUTE) , Seedcorn Grants Proposal 2020/21 entitled “Wearable Insole Sensor Data and a Deep Learning Network-Based Recognition for Musculoskeletal Disorders Prevention in Construction” and (2) Aston Research and Knowledge Exchange Pump Priming Fund 2021/22, Grant Proposal entitled "Digital Twin-Enabled Wearable Sensing Technologies for Improved Workers' Activity Recognition and Work-Related Risk Assessment". |
Uncontrolled Keywords: | Awkward working postures,Deep learning networks,Wearable insole pressure system,Work-related musculoskeletal disorders,Work-related risk recognition,Control and Systems Engineering,Civil and Structural Engineering,Building and Construction |
Publication ISSN: | 0926-5805 |
Last Modified: | 01 Oct 2024 07:31 |
Date Deposited: | 15 Mar 2022 15:57 |
Full Text Link: | |
Related URLs: |
http://www.scop ... tnerID=8YFLogxK
(Scopus URL) https://www.sci ... 0541?via%3Dihub (Publisher URL) |
PURE Output Type: | Article |
Published Date: | 2022-04 |
Published Online Date: | 2022-03-01 |
Accepted Date: | 2022-02-15 |
Authors: |
Antwi-Afari, Maxwell Fordjour
(
0000-0002-6812-7839)
Qarout, Yazan Herzallah, Randa ( 0000-0001-9128-6814) Anwer, Shahnawaz Umer, Waleed Zhang, Yongcheng Manu, Patrick |
Download
Version: Accepted Version
License: Creative Commons Attribution Non-commercial No Derivatives
| Preview