A Middleware Infrastructure for Active Spaces
IEEE Pervasive Computing
An Architecture that Treats Everyday Objects as Communicating Tangible Components
PERCOM '03 Proceedings of the First IEEE International Conference on Pervasive Computing and Communications
Providing architectural support for building context-aware applications
Providing architectural support for building context-aware applications
Information state and dialogue management in the TRINDI dialogue move engine toolkit
Natural Language Engineering
Design and Development of Multidevice User Interfaces through Multiple Logical Descriptions
IEEE Transactions on Software Engineering
Managing Adaptive Versatile Environments
PERCOM '05 Proceedings of the Third IEEE International Conference on Pervasive Computing and Communications
A framework for the intelligent multimodal presentation of information
Signal Processing - Special section: Multimodal human-computer interfaces
The ECORA framework: A hybrid architecture for context-oriented pervasive computing
Pervasive and Mobile Computing
Dynamic context management for pervasive applications
The Knowledge Engineering Review
CoWSAMI: Interface-aware context gathering in ambient intelligence environments
Pervasive and Mobile Computing
Adaptive Dialogue Management in the NIMITEK Prototype System
PIT '08 Proceedings of the 4th IEEE tutorial and research workshop on Perception and Interactive Technologies for Speech-Based Systems: Perception in Multimodal Dialogue Systems
A standard reference model for intelligent multimedia presentation systems
Computer Standards & Interfaces
The easy ADL home: A physical-virtual approach to domestic living
Journal of Ambient Intelligence and Smart Environments
A multitasking approach to adaptive spoken dialogue management
UAHCI'11 Proceedings of the 6th international conference on Universal access in human-computer interaction: applications and services - Volume Part IV
Hi-index | 0.00 |
In this article we describe our approach towards the specification and realization of human-computer interaction within Next Generation Ambient Intelligent Environments (NGAIE). These environments are populated with numerous devices and multiple occupants or users. They exhibit increasingly intelligent behaviour, provide optimized resource usage and support consistent functionality and human-centric operation. In our approach, NGAIEs contain an encoding of local and global knowledge in the form of a set of heterogeneous ontologies, which have to be aligned. This is to provide a uniform and consistent knowledge representation. In NGAIEs humans will interact with their environments seamlessly using multimodal dialogue interaction. To enable such adaptive human-computer interaction we then focus on when and how this knowledge can be modelled and used in order to realize complex, negotiative, and collaborative tasks. The combination of heterogeneous ontologies and ontology matching algorithms allows for semantically rich interaction and information exchange. Based on an agent-based, service-oriented architecture, this combination maximizes the use of available interaction resources, while decoupling interaction specification from interfaces and modalities. We illustrate our approach with a task analysis of a scenario showing the challenges of NGAIEs. Finally, we present ontology prototypes that are required for the implementation of the scenario.