A weakly supervised learning approach for spoken language understanding

Authors:
Wei-Lin Wu;Ru-Zhan Lu;Jian-Yong Duan;Hui Liu;Feng Gao;Yu-Quan Chen
Affiliations:
Shanghai Jiao Tong University, Shanghai, P. R. China;Shanghai Jiao Tong University, Shanghai, P. R. China;Shanghai Jiao Tong University, Shanghai, P. R. China;Shanghai Jiao Tong University, Shanghai, P. R. China;Shanghai Jiao Tong University, Shanghai, P. R. China;Shanghai Jiao Tong University, Shanghai, P. R. China
Venue:
EMNLP '06 Proceedings of the 2006 Conference on Empirical Methods in Natural Language Processing
Year:
2006

Citing 14
Cited 1

TINA: a natural language system for spoken language applications

Computational Linguistics
Improving Generalization with Active Learning

Machine Learning - Special issue on structured connectionist systems
Combining labeled and unlabeled data with co-training

COLT' 98 Proceedings of the eleventh annual conference on Computational learning theory
Learning Decision Lists

Machine Learning
Less is More: Active Learning with Support Vector Machines

ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
Support Vector Machine Active Learning with Application sto Text Classification

ICML '00 Proceedings of the Seventeenth International Conference on Machine Learning
Employing EM and Pool-Based Active Learning for Text Classification

ICML '98 Proceedings of the Fifteenth International Conference on Machine Learning
Gemini: a natural language system for spoken-language understanding

ACL '93 Proceedings of the 31st annual meeting on Association for Computational Linguistics
Hidden understanding models of natural language

ACL '94 Proceedings of the 32nd annual meeting on Association for Computational Linguistics
Decision lists for lexical ambiguity resolution: application to accent restoration in Spanish and French

ACL '94 Proceedings of the 32nd annual meeting on Association for Computational Linguistics
Active learning for statistical natural language parsing

ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Bootstrapping

ACL '02 Proceedings of the 40th Annual Meeting on Association for Computational Linguistics
Recent improvements in the CMU spoken language understanding system

HLT '94 Proceedings of the workshop on Human Language Technology
A bootstrapping method for learning semantic lexicons using extraction pattern contexts

EMNLP '02 Proceedings of the ACL-02 conference on Empirical methods in natural language processing - Volume 10

Spoken language understanding using weakly supervised learning

Computer Speech and Language

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper, we present a weakly supervised learning approach for spoken language understanding in domain-specific dialogue systems. We model the task of spoken language understanding as a successive classification problem. The first classifier (topic classifier) is used to identify the topic of an input utterance. With the restriction of the recognized target topic, the second classifier (semantic classifier) is trained to extract the corresponding slot-value pairs. It is mainly data-driven and requires only minimally annotated corpus for training whilst retaining the understanding robustness and deepness for spoken language. Most importantly, it allows the employment of weakly supervised strategies for training the two classifiers. We first apply the training strategy of combining active learning and self-training (Tur et al., 2005) for topic classifier. Also, we propose a practical method for bootstrapping the topic-dependent semantic classifiers from a small amount of labeled sentences. Experiments have been conducted in the context of Chinese public transportation information inquiry domain. The experimental results demonstrate the effectiveness of our proposed SLU framework and show the possibility to reduce human labeling efforts significantly.