A modular holistic approach to prosody modelling for Standard Yorùbá speech synthesis

Abstract

This paper presents a novel prosody model in the context of computer text-to-speech synthesis applications for tone languages. We have demonstrated its applicability using the Standard Yorùbá (SY) language. Our approach is motivated by the theory that abstract and realised forms of various prosody dimensions should be modelled within a modular and unified framework [Coleman, J.S., 1994. Polysyllabic words in the YorkTalk synthesis system. In: Keating, P.A. (Ed.), Phonological Structure and Forms: Papers in Laboratory Phonology III, Cambridge University Press, Cambridge, pp. 293–324]. We have implemented this framework using the Relational Tree (R-Tree) technique. R-Tree is a sophisticated data structure for representing a multi-dimensional waveform in the form of a tree. The underlying assumption of this research is that it is possible to develop a practical prosody model by using appropriate computational tools and techniques which combine acoustic data with an encoding of the phonological and phonetic knowledge provided by experts. To implement the intonation dimension, fuzzy logic based rules were developed using speech data from native speakers of Yorùbá. The Fuzzy Decision Tree (FDT) and the Classification and Regression Tree (CART) techniques were tested in modelling the duration dimension. For practical reasons, we have selected the FDT for implementing the duration dimension of our prosody model. To establish the effectiveness of our prosody model, we have also developed a Stem-ML prosody model for SY. We have performed both quantitative and qualitative evaluations on our implemented prosody models. The results suggest that, although the R-Tree model does not predict the numerical speech prosody data as accurately as the Stem-ML model, it produces synthetic speech prosody with better intelligibility and naturalness. The R-Tree model is particularly suitable for speech prosody modelling for languages with limited language resources and expertise, e.g. African languages. Furthermore, the R-Tree model is easy to implement, interpret and analyse.

Publication DOI: https://doi.org/10.1016/j.csl.2007.05.002
Divisions: ?? 50811700Jl ??
Additional Information: NOTICE: this is the author’s version of a work that was accepted for publication in Computer Speech and Language. Changes resulting from the publishing process, such as peer review, editing, corrections, structural formatting, and other quality control mechanisms may not be reflected in this document. Changes may have been made to this work since it was submitted for publication. A definitive version was subsequently published in ?d?´j?bí, ?d?´túnjí A.; Wong, S.H. Sylvia and Beaumont, Anthony J. (2008). A modular holistic approach to prosody modelling for Standard Yorùbá speech synthesis. Computer Speech and Language, 22 (1), pp. 39-68. DOI 10.1016/j.csl.2007.05.002
Uncontrolled Keywords: speech synthesis,prosody modelling,Standard Yorùbá,tone languages,modular holistic model,relational trees,Signal Processing,Electrical and Electronic Engineering,Experimental and Cognitive Psychology,Linguistics and Language
Publication ISSN: 1095-8363
Last Modified: 02 Jan 2024 08:12
Date Deposited: 30 Nov 2012 10:57
Full Text Link:
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Article
Published Date: 2008-01
Authors: Odéjobí, Odétúnjí
Wong, S.H. Sylvia (ORCID Profile 0000-0002-0290-7242)
Beaumont, Anthony J. (ORCID Profile 0000-0002-0105-9683)

Download

[img]

Version: Accepted Version

Access Restriction: Restricted to Repository staff only


Export / Share Citation


Statistics

Additional statistics for this record