Chakladar, Debashis das, Roy, Partha pratim and Chang, Victor (2024). Integrated Spatio-Temporal Deep Clustering (ISTDC) for cognitive workload assessment. Biomedical Signal Processing and Control, 89 ,
Abstract
Traditional high-dimensional electroencephalography (EEG) features (spectral or temporal) may not always attain satisfactory results in cognitive workload estimation. In contrast, deep representation learning (DRL) transforms high-dimensional data into cluster-friendly low-dimensional feature space. Therefore, this paper proposes an Integrated Spatio-Temporal Deep Clustering (ISTDC) model that uses DRL followed by a clustering method to achieve better clustering performance. The proposed model is illustrated using four Algorithms and Variational Bayesian Gaussian Mixture Model (VBGMM) clustering method. Temporal and spatial Variational Auto Encoder (VAE) models (mentioned in Algorithm 2 and Algorithm 3) learn temporal and spatial latent features from sequence-wise EEG signals and scalp topographical maps using the Long short-term memory and Convolutional Neural Network models. The concatenated spatio-temporal latent feature (mentioned in Algorithm 4) is passed to the VBGMM clustering method to efficiently estimate workload levels of n-back task. For the 0-back vs. 2-back task, the proposed model achieves the maximum mean clustering accuracy of 98.0%, and it improves by 11.0% over the state-of-the-art method. The results also indicate that the proposed multimodal approach outperforms temporal and spatial latent feature-based unimodal models in workload assessment.
Publication DOI: | https://doi.org/10.1016/j.bspc.2023.105703 |
---|---|
Divisions: | College of Business and Social Sciences > Aston Business School College of Business and Social Sciences > Aston Business School > Operations & Information Management |
Funding Information: | Part of Prof Chang’s work is partly supported by VC Research, UK (VCR0000221) |
Additional Information: | © 2023 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/) |
Uncontrolled Keywords: | Cognitive workload,Deep clustering,Electroencephalography,Variational bayesian gaussian mixture model,Signal Processing,Health Informatics,Biomedical Engineering |
Publication ISSN: | 1746-8108 |
Last Modified: | 07 Oct 2024 07:54 |
Date Deposited: | 01 Dec 2023 12:00 |
Full Text Link: | |
Related URLs: |
https://www.sci ... 1369?via%3Dihub
(Publisher URL) http://www.scop ... tnerID=8YFLogxK (Scopus URL) |
PURE Output Type: | Article |
Published Date: | 2024-03-01 |
Published Online Date: | 2023-11-16 |
Accepted Date: | 2023-11-05 |
Authors: |
Chakladar, Debashis das
Roy, Partha pratim Chang, Victor ( 0000-0002-8012-5852) |