JANUS: a speech-to-speech translation system using connectionist and symbolic processing strategies

Authors:
A. Waibel;A. N. Jain;A. E. McNair;H. Saito;A. G. Hauptmann;J. Tebelskis
Affiliations:
Sch. of Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, USA;Sch. of Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, USA;Sch. of Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, USA;Sch. of Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, USA;Sch. of Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, USA;Sch. of Comput. Sci., Carnegie Mellon Univ., Pittsburgh, PA, USA
Venue:
ICASSP '91 Proceedings of the Acoustics, Speech, and Signal Processing, 1991. ICASSP-91., 1991 International Conference
Year:
1991

Citing 0
Cited 16

A Statistical Dialogue Analysis Model Based on Speech Acts for Dialogue Machine Translation

Machine Translation
Review Article: Example-based Machine Translation

Machine Translation
Robustness and Portability Issues in Multilingual Speech Processing

Machine Translation
Speaker Characteristics

Speaker Classification I
An Improved Connectionist Translator between Natural Languages

IBERAMIA '08 Proceedings of the 11th Ibero-American conference on AI: Advances in Artificial Intelligence
Simultaneous translation of lectures and speeches

Machine Translation
Two-Stage Hypotheses Generation for Spoken Language Translation

ACM Transactions on Asian Language Information Processing (TALIP)
An Ensemble Based Translator for Natural Languages

IWANN '09 Proceedings of the 10th International Work-Conference on Artificial Neural Networks: Part II: Distributed Computing, Artificial Intelligence, Bioinformatics, Soft Computing, and Ambient Assisted Living
Challenges of massive parallelism

IJCAI'93 Proceedings of the 13th international joint conference on Artifical intelligence - Volume 1
Incremental speech translation

Incremental speech translation
Computer-supported human-human multilingual communication

50 years of artificial intelligence
PARSEC: a structured connectionist parsing system for spoken language

ICASSP'92 Proceedings of the 1992 IEEE international conference on Acoustics, speech and signal processing - Volume 1
Testing generality in JANUS: a multi-lingual speech translation system

ICASSP'92 Proceedings of the 1992 IEEE international conference on Acoustics, speech and signal processing - Volume 1
Efficient grammar processing for a spoken language translation system

ICASSP'92 Proceedings of the 1992 IEEE international conference on Acoustics, speech and signal processing - Volume 1
Data driven approaches to speech and language processing

Nonlinear Speech Modeling and Applications
Real-time incremental speech-to-speech translation of dialogs

NAACL HLT '12 Proceedings of the 2012 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies

Quantified Score

Hi-index	0.00

Visualization

Abstract

The authors present JANUS, a speech-to-speech translation system that utilizes diverse processing strategies including dynamic programming, stochastic techniques, connectionist learning, and traditional AI knowledge representation approaches. JANUS translates continuously spoken English utterances into Japanese and German speech utterances. The overall system performance on a corpus of conference registration conversations is 87%. Two versions of JANUS are compared: one using a LR parser (JANUS 1) and one using a connectionist parser (JANUS 2). Performance results were mixed, with JANUS 1 deriving benefit from a tighter language model and JANUS 2 benefitting from greater flexibility.