Artificial Intelligence: A Modern Approach
Artificial Intelligence: A Modern Approach
Applications of the self-organising map to reinforcement learning
Neural Networks - New developments in self-organizing maps
Towards a Theory of Context Spaces
PERCOMW '04 Proceedings of the Second IEEE Annual Conference on Pervasive Computing and Communications Workshops
Prediction intelligence in context-aware applications
Proceedings of the 6th international conference on Mobile data management
How smart are our environments? An updated look at the state of the art
Pervasive and Mobile Computing
The ECORA framework: A hybrid architecture for context-oriented pervasive computing
Pervasive and Mobile Computing
A neural-network-based context-aware handoff algorithm for multimedia computing
ACM Transactions on Multimedia Computing, Communications, and Applications (TOMCCAP)
Approximate predictive state representations
Proceedings of the 7th international joint conference on Autonomous agents and multiagent systems - Volume 1
Navigate like a cabbie: probabilistic reasoning from observed context-aware behavior
UbiComp '08 Proceedings of the 10th international conference on Ubiquitous computing
Context-aware system for proactive personalized service based on context history
Expert Systems with Applications: An International Journal
Review: Ambient intelligence: Technologies, applications, and opportunities
Pervasive and Mobile Computing
Extending Context Spaces Theory by Predicting Run-Time Context
NEW2AN '09 and ruSMART '09 Proceedings of the 9th International Conference on Smart Spaces and Next Generation Wired/Wireless Networking and Second Conference on Smart Spaces
Reinforcement learning: a survey
Journal of Artificial Intelligence Research
Context aware life pattern prediction using fuzzy-state Q-learning
ICOST'07 Proceedings of the 5th international conference on Smart homes and health telematics
Prediction of indoor movements using bayesian networks
LoCA'05 Proceedings of the First international conference on Location- and Context-Awareness
The role of prediction algorithms in the MavHome smart home architecture
IEEE Wireless Communications
ECSTRA: distributed context reasoning framework for pervasive computing systems
NEW2AN'11/ruSMART'11 Proceedings of the 11th international conference and 4th international conference on Smart spaces and next generation wired/wireless networking
Event-driven content management system for smart meeting room
NEW2AN'11/ruSMART'11 Proceedings of the 11th international conference and 4th international conference on Smart spaces and next generation wired/wireless networking
| Hi-index | 0.00 |
Context awareness is one of the core features of pervasive computing systems. Pervasive systems can also be improved by smart application of context prediction. This paper addresses subsequent challenge of how to act according to predicted context in order to strengthen the system. Novel reinforcement learning based architecture is proposed to overcome the drawbacks of existing approaches to proactive adaptation. Context spaces theory is used as an example of how existing context awareness systems can be enhanced to achieve proactive adaptation. This recently developed theory addresses problems related to sensors uncertainty and high-level situation reasoning and it can be enhanced to achieve efficient proactive adaptation as well. This article also discusses implementation options and possible testbed to evaluate the solutions.