Pause as a phrase demarcator for speech and language processing

  • Authors:
  • Junko Hosaka;Mark Seligman;Harald Singer

  • Affiliations:
  • ATR Interpreting Telephony Research Laboratories, Kyoto, Japan;ATR Interpreting Telephony Research Laboratories, Kyoto, Japan;ATR Interpreting Telephony Research Laboratories, Kyoto, Japan

  • Venue:
  • COLING '94 Proceedings of the 15th conference on Computational linguistics - Volume 2
  • Year:
  • 1994

Quantified Score

Hi-index 0.00

Visualization

Abstract

In spontaneous speech understanding a sophisticated integration of speech recognition and language processing is especially crucial. However, the two modules are traditionally designed independently, with independent linguistic rules. In Japanese speech recognition the bunsetsu phrase is the basic processing unit and in language processing the sentence is the basic unit. This difference has made it impractical to use a unique set of linguistic rules for both types of processing. Further, spontaneous speech contains unexpected utterances other than well formed sentences, while linguistic rules for both speech and language processing expect well-formed sentences. They therefore fail to process everyday spoken language. To bridge the gap between speech and language processing, we propose that pauses be treated as phrase demarcators and that the interpausal phrase be the basic common processing unit. And to treat the linguistic phenomena of spoken language properly, we survey relevant features in spontaneous speech data. We then examine the effect of integrating pausal and spontaneous speech phenomena into syntactic rules for speech recognition, using 118 sentences. Our experiments show that incorporating pausal phenomena as purely syntactic constraints degrades recognition accuracy considerably, while the additional degradation if some further spontaneous speech features are also incorporated.