Perceptual continuity and naturalness of expressive strength in singing voices based on speech morphing

Authors:
Tomoko Yonezawa;Noriko Suzuki;Shinji Abe;Kenji Mase;Kiyoshi Kogure
Affiliations:
ATR Intelligent Robotics and Communication Laboratories, Keihanna Science City, Kyoto, Japan and Nagoya University, Furo-cho, Chikusa, Nagoya, Japan and ATR Media Information Science Laboratories, ...;National Institute of Information and Communication Technology/ATR Cognitive Information Science Laboratories, Keihanna Science City, Kyoto, Japan;ATR Intelligent Robotics and Communication Laboratories, Keihanna Science City, Kyoto, Japan and ATR Media Information Science Laboratories, Keihanna Science City, Kyoto, Japan;Nagoya University, Furo-cho, Chikusa, Nagoya, Japan and ATR Intelligent Robotics and Communication Laboratories, Keihanna Science City, Kyoto, Japan;ATR Knowledge Science Laboratories, Keihanna Science City, Kyoto, Japan
Venue:
EURASIP Journal on Audio, Speech, and Music Processing
Year:
2007

Citing 3
Cited 0

Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: possible role of a repetitive structure in sounds

Speech Communication
HandySinger: expressive singing voice morphing using personified hand-puppet interface

NIME '05 Proceedings of the 2005 conference on New interfaces for musical expression
Developments in Corpus-Based Speech Synthesis: Approaching Natural Conversational Speech

IEICE - Transactions on Information and Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper experimentally shows the importance of perceptual continuity of the expressive strength in vocal timbre for natural change in vocal expression. In order to synthesize various and continuous expressive strengths with vocal timbre, we investigated gradually changing expressions by applying the STRAIGHT speech morphing algorithm to singing voices. Here, a singing voice without expression is used as the base of morphing, and singing voices with three different expressions are used as the target. Through statistical analyses of perceptual evaluations, we confirmed that the proposed morphing algorithm provides perceptual continuity of vocal timbre. Our results showed the following: (i) gradual strengths in absolute evaluations, and (ii) a perceptually linear strength provided by the calculation of corrected intervals of the morph ratio by the inverse (reciprocal) function of an equation that approximates the perceptual strength. Finally, we concluded that applying continuity was highly effective for achieving perceptual naturalness, judging from the results showing that (iii) our gradual transformation method can perform well for perceived naturalness.