Voice morphing using 3D waveform interpolation surfaces and lossless tube area functions

Authors:
Yizhar Lavner;Gidon Porat
Affiliations:
Department of Computer Science, Tel-Hai Academic College, Upper Galilee, Israel and Signal and Image Processing Lab (SIPL), Department of Electrical Engineering, Technion - Israel Institute of Tec ...;Signal and Image Processing Lab (SIPL), Department of Electrical Engineering, Technion - Israel Institute of Technology, Haifa, Israel
Venue:
EURASIP Journal on Applied Signal Processing
Year:
2005

Citing 8
Cited 0

Speech spectrum conversion based on speaker interpolation and multi-functional representation with weighting by radial basis function networks

Speech Communication - Special issue: voice conversion: state of the art and perspectives
Acoustic characteristics of speaker individuality: control and conversion

Speech Communication - Special issue: voice conversion: state of the art and perspectives
Transformation of formants for voice conversion using artificial neural networks

Speech Communication - Special issue: voice conversion: state of the art and perspectives
Restructuring speech representations using a pitch-adaptive time-frequency smoothing and an instantaneous-frequency-based F0 extraction: possible role of a repetitive structure in sounds

Speech Communication
Speaker transformation algorithm using segmental codebooks (STASC)

Speech Communication
Discrete Time Processing of Speech Signals

Discrete Time Processing of Speech Signals
Automatic audio morphing

ICASSP '96 Proceedings of the Acoustics, Speech, and Signal Processing, 1996. on Conference Proceedings., 1996 IEEE International Conference - Volume 02
Design and evaluation of a voice conversion algorithm based on spectral envelope mapping and residual prediction

ICASSP '01 Proceedings of the Acoustics, Speech, and Signal Processing, 200. on IEEE International Conference - Volume 02

Quantified Score

Hi-index	0.00

Visualization

Abstract

Voice morphing is the process of producing intermediate or hybrid voices between the utterances of two speakers. It can also be defined as the process of gradually transforming the voice of one speaker to that of another. The ability to change the speaker's individual characteristics and to produce high-quality voices can be used in many applications. Examples include multimedia and video entertainment, as well as enrichment of speech databases in text-to-speech systems. In this study we present a new technique which enables production of a given number of intermediate voices or of utterances which gradually change from one voice to another. This technique is based on two components: (1) creation of a 3D prototype waveform interpolation (PWI) surface from the LPC residual signal, to produce an intermediate excitation signal; (2) a representation of the vocal tract by a lossless tube area function, and an interpolation of the parameters of the two speakers. The resulting synthesized signal sounds like a natural voice lying between the two original voices.