A method for generation of Mandarin F0 contours based on tone nucleus model and superpositional model

  • Authors:
  • Qinghua Sun;Keikichi Hirose;Nobuaki Minematsu

  • Affiliations:
  • Graduate School of Engineering, University of Tokyo, Japan;Graduate School of Information Science and Technology, University of Tokyo, Japan;Graduate School of Information Science and Technology, University of Tokyo, Japan

  • Venue:
  • Speech Communication
  • Year:
  • 2012

Quantified Score

Hi-index 0.00

Visualization

Abstract

A new method was proposed for synthesizing sentence fundamental frequency (F"0) contours of Mandarin speech. The method is based on representing a sentence logarithmic F"0 contour as a superposition of tone components on phrase components, as in the case of the generation process model (F"0 model). However, the method is not fully depending on the model in that tone components are generated in a corpus-based way by concatenating F"0 patterns predicted for constituting syllables. Furthermore, the prediction is done only for the stable part of syllable tone component, known as tone nucleus. The entire tone components were obtained by concatenating the predicted patterns. Since effect of tone coarticulation is minor for tone nuclei, as compared to conventional methods of handling full syllable F"0 contours, a better prediction is possible especially when the size of training corpus is limited. While tone components are highly language specific, phrase components are assumed to be more language universal: analogy from a control scheme of phrase components developed for a language may applicable for other languages. Also, phrase components covers a wider range (phrase, clause, etc.) of speech and is tightly related to higher linguistic information (syntax), and, therefore, concatenation of short F"0 contour fragments predicted in a corpus-based method will not be appropriate. Taking these into consideration, rules similar to Japanese were constructed to control phrase commands, from which phrase components were generated with simple mathematical calculations in the framework of the generation process model. There is a tight relation between phrase and tone components, and, therefore, both components cannot be generated independently. To ensure the correct relation be held in the synthesized F"0 contour, a two-step scheme was developed, where information of generated phrase components was utilized for the prediction of tone components. A listening test was conducted for speech synthesized using F"0 contours generated by the developed method. Synthetic speech sounded highly natural, showing the validity of the method. Furthermore, it was shown through an experiment of word emphasis that flexible F"0 control was possible by the proposed method.