Marve: a prototype virtual human interface framework for studying human-virtual human interaction

Authors:
Sabarish Babu;Stephen Schmugge;Raj Inugala;Srinivasa Rao;Tiffany Barnes;Larry F. Hodges
Affiliations:
Department of Computer Science, University of North Carolina at Charlotte, Charlotte, NC;Department of Computer Science, University of North Carolina at Charlotte, Charlotte, NC;Department of Computer Science, University of North Carolina at Charlotte, Charlotte, NC;Department of Computer Science, University of North Carolina at Charlotte, Charlotte, NC;Department of Computer Science, University of North Carolina at Charlotte, Charlotte, NC;Department of Computer Science, University of North Carolina at Charlotte, Charlotte, NC
Venue:
Lecture Notes in Computer Science
Year:
2005

Citing 8
Cited 6

Computers are social actors

CHI '94 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Real-time decision making in multimodal face-to-face communication

AGENTS '98 Proceedings of the second international conference on Autonomous agents
Embodied conversational interface agents

Communications of the ACM
The virtual human as a multimodal interface

AVI '00 Proceedings of the working conference on Advanced visual interfaces
VRPN: a device-independent, network-transparent VR peripheral system

VRST '01 Proceedings of the ACM symposium on Virtual reality software and technology
Jacob - An Animated Instruction Agent in Virtual Reality

ICMI '00 Proceedings of the Third International Conference on Advances in Multimodal Interfaces
Emotion in human-computer interaction

The human-computer interaction handbook
An embedded HMM-based approach for face detection and recognition

ICASSP '99 Proceedings of the Acoustics, Speech, and Signal Processing, 1999. on 1999 IEEE International Conference - Volume 06

Officer Garcia: a virtual human for mediating eyewitness identification

Proceedings of the 2007 ACM symposium on Virtual reality software and technology
Shakespearean karaoke

Proceedings of the 2007 ACM symposium on Virtual reality software and technology
AVARI: animated virtual agent retrieving information

Proceedings of the 47th Annual Southeast Regional Conference
Sammi: a 3-dimensional virtual human information kiosk

Proceedings of the 48th Annual Southeast Regional Conference
Interactive dancing game with real-time recognition of continuous dance moves from 3D human motion capture

Proceedings of the 5th International Conference on Ubiquitous Information Management and Communication
“What would you like to talk about?” an evaluation of social conversations with a virtual receptionist

IVA'06 Proceedings of the 6th international conference on Intelligent Virtual Agents

Quantified Score

Hi-index	0.00

Visualization

Abstract

Human to virtual human interaction is the next frontier in interface design, particularly for tasks that are social or collaborative in nature. Several embodied interface agents have been developed for specific social, place-related tasks, but empirical evaluations of these systems have been rare. In this work, we present Marve (Messaging And Recognition Virtual Entity), our general purpose Virtual Human Interface Framework, which integrates cutting-edge interface technologies into a seamless real-time system, to study human to virtual human interaction. Marve is a prototype of a real-time embodied, interactive, autonomous, virtual human interface agent framework. Marve "lives" next to the primary entrance of the Future Computing Lab. His primary tasks are to greet everyone who enters or leaves the lab, and to take and deliver messages to the students and faculty who work there. Marve uses computer vision techniques for passer-by detection, gaze tracking, and face recognition, and communicates via natural language. We present a preliminary empirical study of the basic elements of Marve, including interaction response times, recognition of friends, and ability to learn to recognize new people.