Using Hand Gesture and Speech in a Multimodal Augmented Reality Environment

Authors:
Miguel Sales Dias;Rafael Bastos;João Fernandes;João Tavares;Pedro Santos
Affiliations:
ADETTI Av. das Forças Armadas, Edifício ISCTE, Lisboa, Portugal 1600-082 and MLDC - Microsoft Language Development Center, Edifício Qualidade C1-C2, Porto Salvo, Portugal 2744-010;ADETTI Av. das Forças Armadas, Edifício ISCTE, Lisboa, Portugal 1600-082;ADETTI Av. das Forças Armadas, Edifício ISCTE, Lisboa, Portugal 1600-082;ADETTI Av. das Forças Armadas, Edifício ISCTE, Lisboa, Portugal 1600-082;MLDC - Microsoft Language Development Center, Edifício Qualidade C1-C2, Porto Salvo, Portugal 2744-010
Venue:
Gesture-Based Human-Computer Interaction and Simulation
Year:
2009

Citing 5
Cited 0

Finding all periodic orbits of maps using Newton methods: sizes of basins

Physica D
Charting past, present, and future research in ubiquitous computing

ACM Transactions on Computer-Human Interaction (TOCHI) - Special issue on human-computer interaction in the new millennium, Part 1
Multimodal interfaces

The human-computer interaction handbook
Learning dynamics for exemplar-based gesture recognition

CVPR'03 Proceedings of the 2003 IEEE computer society conference on Computer vision and pattern recognition
O.G.R.E. – open gestures recognition engine, a platform for gesture-based communication and interaction

GW'05 Proceedings of the 6th international conference on Gesture in Human-Computer Interaction and Simulation

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this work we describe a 3D authoring tool which takes advantage of multimodal interfaces such as gestures and speech. This tool allows real-time Augmented Reality aimed to aid the tasks of interior architects and designers. This approach intends to be an alternative to traditional techniques. The main benefit of using a multimodal based augmented reality system is the provision of a more transparent, flexible, efficient and expressive means of human-computer interaction.