Towards generation of fluent referring action in multimodal situations

Authors:
Tsuneaki Kato;Yukiko I. Nakano
Affiliations:
NTT Information and Communication Systems Labs., Kanagawa, Japan;NTT Information and Communication Systems Labs., Kanagawa, Japan
Venue:
ReferringPhenomena '97 Referring Phenomena in a Multimedia Context and their Computational Treatment
Year:
1997

Citing 9
Cited 0

Towards a general theory of action and time

Artificial Intelligence
Planning english referring expressions

Artificial Intelligence - Lecture notes in computer science 178
Tool support for the synchronization and presentation of distributed multimedia

Computer Communications
Towards coordinated temporal multimedia presentations

Intelligent multimedia interfaces
Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents

SIGGRAPH '94 Proceedings of the 21st annual conference on Computer graphics and interactive techniques
Negotiation for automated generation of temporal multimedia presentations

MULTIMEDIA '96 Proceedings of the fourth ACM international conference on Multimedia
Referent Identification Requests in Multi-Modal Dialogs

Multimodal Human-Computer Communication, Systems, Techniques, and Experiments
The pragmatics of referring and the modality of communication

Computational Linguistics
Coping with temporal constraints in multimedia presentation planning

AAAI'96 Proceedings of the thirteenth national conference on Artificial intelligence - Volume 1

Quantified Score

Hi-index	0.00

Visualization

Abstract

Referring actions in multimodal situations can be thought of as linguistic expressions well coordinated with several physical actions. In this paper, what patterns of linguistic expressions are commonly used and how physical actions are temporally coordinated to them are reported based on corpus examinations. In particular, by categorizing objects according to two features, visibility and membership, the schematic patterns of referring expressions are derived. The difference between the occurrence frequencies of those patterns in a multimodal situation and a spoken-mode situation explains the findings of our previous research. Implementation based on these results is on going.