Integrated Spatio-Temporal Deep Clustering (ISTDC) for cognitive workload assessment

Abstract

Traditional high-dimensional electroencephalography (EEG) features (spectral or temporal) may not always attain satisfactory results in cognitive workload estimation. In contrast, deep representation learning (DRL) transforms high-dimensional data into cluster-friendly low-dimensional feature space. Therefore, this paper proposes an Integrated Spatio-Temporal Deep Clustering (ISTDC) model that uses DRL followed by a clustering method to achieve better clustering performance. The proposed model is illustrated using four Algorithms and Variational Bayesian Gaussian Mixture Model (VBGMM) clustering method. Temporal and spatial Variational Auto Encoder (VAE) models (mentioned in Algorithm 2 and Algorithm 3) learn temporal and spatial latent features from sequence-wise EEG signals and scalp topographical maps using the Long short-term memory and Convolutional Neural Network models. The concatenated spatio-temporal latent feature (mentioned in Algorithm 4) is passed to the VBGMM clustering method to efficiently estimate workload levels of n-back task. For the 0-back vs. 2-back task, the proposed model achieves the maximum mean clustering accuracy of 98.0%, and it improves by 11.0% over the state-of-the-art method. The results also indicate that the proposed multimodal approach outperforms temporal and spatial latent feature-based unimodal models in workload assessment.

Publication DOI: https://doi.org/10.1016/j.bspc.2023.105703
Divisions: College of Business and Social Sciences > Aston Business School
College of Business and Social Sciences > Aston Business School > Operations & Information Management
Funding Information: Part of Prof Chang’s work is partly supported by VC Research, UK (VCR0000221)
Additional Information: © 2023 The Authors. Published by Elsevier Ltd. This is an open access article under the CC BY license (http://creativecommons.org/licenses/by/4.0/)
Uncontrolled Keywords: Cognitive workload,Deep clustering,Electroencephalography,Variational bayesian gaussian mixture model,Signal Processing,Health Informatics,Biomedical Engineering
Publication ISSN: 1746-8108
Last Modified: 07 Oct 2024 07:54
Date Deposited: 01 Dec 2023 12:00
Full Text Link:
Related URLs: https://www.sci ... 1369?via%3Dihub (Publisher URL)
http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Article
Published Date: 2024-03-01
Published Online Date: 2023-11-16
Accepted Date: 2023-11-05
Authors: Chakladar, Debashis das
Roy, Partha pratim
Chang, Victor (ORCID Profile 0000-0002-8012-5852)

Download

[img]

Version: Published Version

License: Creative Commons Attribution

| Preview

Export / Share Citation


Statistics

Additional statistics for this record