A multimodal perceptual user interface for collaborative environments

Authors:
Giancarlo Iannizzotto;Francesco La Rosa;Carlo Costanzo;Pietro Lanzafame
Affiliations:
VisiLab, Faculty of Engineering, University of Messina;VisiLab, Faculty of Engineering, University of Messina;VisiLab, Faculty of Engineering, University of Messina;VisiLab, Faculty of Engineering, University of Messina
Venue:
ICIAP'05 Proceedings of the 13th international conference on Image Analysis and Processing
Year:
2005

Citing 7
Cited 1

Recent Advances in Augmented Reality

IEEE Computer Graphics and Applications
Demonstration of an Interactive Multimedia Environment

Computer
Workspace Awareness in Mobile Virtual Teams

WETICE '00 Proceedings of the 9th IEEE International Workshops on Enabling Technologies: Infrastructure for Collaborative Enterprises
Distributed Interaction in Virtual Spaces

DIS-RT '99 Proceedings of the 3rd International Workshop on Distributed Interactive Simulation and Real-Time Applications
VirtualBoard: Real-Time Visual Gesture Recognition for Natural Human-Computer Interaction

IPDPS '03 Proceedings of the 17th International Symposium on Parallel and Distributed Processing
GestureWrist and GesturePad: Unobtrusive Wearable Interaction Devices

ISWC '01 Proceedings of the 5th IEEE International Symposium on Wearable Computers
VICs: a modular vision-based HCI framework

ICVS'03 Proceedings of the 3rd international conference on Computer vision systems

Adaptive context aware attentive interaction in large tiled display

UAHCI'07 Proceedings of the 4th international conference on Universal access in human-computer interaction: ambient interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper a 3D graphics-based remote collaborative environment is introduced. This system is able to provide multiclient and multimedia communication, and exploits a novel multimodal user interaction paradigm based on hand gesture and perceptual user interfaces. The use of machine vision technologies and a user-centered approach produce a highly usable and natural human-computer interface, allowing even untrained users a realistic and relaxing experience for long and demanding tasks. We then note and motivate that such an application can be considered as an Augmented Reality application; according to this view, we describe our platform in terms of long-term usability and comfort of use. The proposed system is expected to be useful in remote interaction with dynamic environments. To illustrate our work, we introduce a proof-of-concept multimodal, bare-hand application and discuss its implementation and the obtained experimental results.