Active agent oriented multimodal interface system

Authors:
Osamu Hasegawa;Katsunobu Itou;Takio Kurita;Satoru Hayamizu;Kazuyo Tanaka;Kazuhiko Yamamoto;Nobuyuki Otsu
Affiliations:
Electrotechnical Laboratory, Tsukuba, Ibaraki, Japan;Electrotechnical Laboratory, Tsukuba, Ibaraki, Japan;Electrotechnical Laboratory, Tsukuba, Ibaraki, Japan;Electrotechnical Laboratory, Tsukuba, Ibaraki, Japan;Electrotechnical Laboratory, Tsukuba, Ibaraki, Japan;Electrotechnical Laboratory, Tsukuba, Ibaraki, Japan;Electrotechnical Laboratory, Tsukuba, Ibaraki, Japan
Venue:
IJCAI'95 Proceedings of the 14th international joint conference on Artificial intelligence - Volume 1
Year:
1995

Citing 4
Cited 5

A real-time visual interactive system between finger signs and synthesized human facial images employing a transputer-based parallel computer

CG International '92 Proceedings of the 10th International Conference of the Computer Graphics Society on Visual computing : integrating computer graphics with computer vision: integrating computer graphics with computer vision
Communicative facial displays as a new conversational modality

CHI '93 Proceedings of the INTERACT '93 and CHI '93 Conference on Human Factors in Computing Systems
Agents that reduce work and information overload

Communications of the ACM
Social interaction: multimodal conversation with social agents

AAAI '94 Proceedings of the twelfth national conference on Artificial intelligence (vol. 1)

Integrated natural spoken dialogue system of Jijo-2 mobile robot for office services

AAAI '99/IAAI '99 Proceedings of the sixteenth national conference on Artificial intelligence and the eleventh Innovative applications of artificial intelligence conference innovative applications of artificial intelligence
A multi-agent architecture for process management accommodates unexpected performance

SAC '00 Proceedings of the 2000 ACM symposium on Applied computing - Volume 1
Effect of background knowledge in a task model self-organization method

SAC '00 Proceedings of the 2000 ACM symposium on Applied computing - Volume 1
AgentSalon: facilitating face-to-face knowledge exchange through conversations among personal agents

Proceedings of the fifth international conference on Autonomous agents
Utilization of stereo disparity and optical flow information for the computer analysis of human interactions

Machine Vision and Applications

Quantified Score

Hi-index	0.01

Visualization

Abstract

This paper presents a prototype of an interface system with an active human-like agent. In usual human communication, non-verbal expressions play important roles. They convey emotional information and control timing of interaction as well. This project attempts to introduce multi modality into computer-human interaction. Our human-like agent with its realistic facial expressions identifies the user by sight and interacts actively and individually to each user in spoken language. That is, the agent sees human and visually recognizes who is the person, keeps eye-contacts in its facial display with human, starts spoken language interaction by talking to human first.