Optimisation of phonetic aware speech recognition through multi-objective evolutionary algorithms

Abstract

Recent advances in the availability of computational resources allow for more sophisticated approaches to speech recognition than ever before. This study considers Artificial Neural Network and Hidden Markov Model methods of classification for Human Speech Recognition through Diphthong Vowel sounds in the English Phonetic Alphabet rather than the classical approach of the classification of whole words and phrases, with a specific focus on both single and multi-objective evolutionary optimisation of bioinspired classification methods. A set of audio clips are recorded by subjects from the United Kingdom and Mexico and the recordings are transformed into a static dataset of statistics by way of their Mel-Frequency Cepstral Coefficients (MFCC) at sliding window length of 200ms as well as a reshaped MFCC timeseries format for forecast-based models. An deep neural network with evolutionary optimised topology achieves 90.77% phoneme classification accuracy in comparison to the best HMM that achieves 86.23% accuracy with 150 hidden units, when only accuracy is considered in a single-objective optimisation approach. The obtained solutions are far more complex than the HMM taking around 248 seconds to train on powerful hardware versus 160 for the HMM. A multi-objective approach is explored due to this. In the multi-objective approaches of scalarisation presented, within which real-time resource usage is also considered towards solution fitness, far more optimal solutions are produced which train far quicker than the forecast approach (69 seconds) with classification ability retained (86.73%). Weightings towards either maximising accuracy or reducing resource usage from 0.1 to 0.9 are suggested depending on the resources available, since many future IoT devices and autonomous robots may have limited access to cloud resources at a premium in comparison to the GPU used in this experiment.

Publication DOI: https://doi.org/10.1016/j.eswa.2020.113402
Divisions: College of Engineering & Physical Sciences
College of Engineering & Physical Sciences > Systems analytics research institute (SARI)
?? 50811700Jl ??
Additional Information: © 2020, Elsevier. Licensed under the Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International http://creativecommons.org/licenses/by-nc-nd/4.0/
Uncontrolled Keywords: Applied hyperheuristics,Multi-objective evolutionary computation,Phoneme classification,Speech recognition,Engineering(all),Computer Science Applications,Artificial Intelligence
Publication ISSN: 1873-6793
Last Modified: 06 Jun 2024 07:15
Date Deposited: 21 Apr 2020 07:13
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
https://www.sci ... 2268?via%3Dihub (Publisher URL)
PURE Output Type: Article
Published Date: 2020-09-01
Published Online Date: 2020-03-24
Accepted Date: 2020-03-21
Authors: Bird, Jordan J. (ORCID Profile 0000-0002-9858-1231)
Wanner, Elizabeth (ORCID Profile 0000-0001-6450-3043)
Ekárt, Anikó (ORCID Profile 0000-0001-6967-5397)
Faria, Diego R. (ORCID Profile 0000-0002-2771-1713)

Export / Share Citation


Statistics

Additional statistics for this record