Perceptual user interfaces: multimodal interfaces that process what comes naturally
Communications of the ACM
The Interactive Workspaces Project: Experiences with Ubiquitous Computing Rooms
IEEE Pervasive Computing
CT '97 Proceedings of the 2nd International Conference on Cognitive Technology (CT '97)
TOOLS '00 Proceedings of the Technology of Object-Oriented Languages and Systems (TOOLS 33)
Multi-Camera Multi-Person Tracking for EasyLiving
VS '00 Proceedings of the Third IEEE International Workshop on Visual Surveillance (VS'2000)
QuickSet: multimodal interaction for simulation set-up and control
ANLC '97 Proceedings of the fifth conference on Applied natural language processing
DiamondSpin: an extensible toolkit for around-the-table interaction
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
reacTIVision: a computer-vision framework for table-based tangible interaction
Proceedings of the 1st international conference on Tangible and embedded interaction
Extensible middleware framework for multimodal interfaces in distributed environments
Proceedings of the 9th international conference on Multimodal interfaces
The openinterface framework: a tool for multimodal interaction.
CHI '08 Extended Abstracts on Human Factors in Computing Systems
A multitouch software architecture
Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges
A toolkit for peer-to-peer distributed user interfaces: concepts, implementation, and applications
Proceedings of the 1st ACM SIGCHI symposium on Engineering interactive computing systems
Fusion engines for multimodal input: a survey
Proceedings of the 2009 international conference on Multimodal interfaces
PyMT: a post-WIMP multi-touch user interface toolkit
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Extending touch: towards interaction with large-scale surfaces
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Neural network-based head pose estimation and multi-view fusion
CLEAR'06 Proceedings of the 1st international evaluation conference on Classification of events, activities and relationships
Fovea-tablett®: a new paradigm for the interaction with large screens
Proceedings of the 2007 conference on Human interface: Part I
LightTracker: An Open-Source Multitouch Toolkit
Computers in Entertainment (CIE) - Theoretical and Practical Computer Applications in Entertainment
Mudra: a unified multimodal interaction framework
ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Code space: touch + air gesture hybrid interactions for supporting developer meetings
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
The Construction and Application of Multitouch Interactive Platform Based on Touchlib
ICINIS '11 Proceedings of the 2011 4th International Conference on Intelligent Networks and Intelligent Systems
A nested APi structure to simplify cross-device communication
Proceedings of the Sixth International Conference on Tangible, Embedded and Embodied Interaction
| Hi-index | 0.00 |
As new input modalities allow interaction not only in front of a single display, but enable interaction in the whole room, application developers face new challenges. They have to handle many new input modalities, each with its own interface and requirements for pre-processing, deal with multiple displays, and applications that are distributed across multiple machines. We present glueTK, a framework that abstracts from the complexities of these input modalities, allows the design of interfaces for a wide range of display sizes, and makes the distribution across multiple machines transparent to the developer as well as the user. With an example application we demonstrate the wide range of input modalities glueTK can support and the functionality this enables. GlueTK moves away from the focus on point and touch like input modalities, enabling the design of applications tailored towards interactive rooms instead of the traditional desktop environment.