Spoken dialogue technology: enabling the conversational user interface
ACM Computing Surveys (CSUR)
Authoring scenes for adaptive, interactive performances
AAMAS '03 Proceedings of the second international joint conference on Autonomous agents and multiagent systems
SmartKom: Foundations of Multimodal Dialogue Systems (Cognitive Technologies)
SmartKom: Foundations of Multimodal Dialogue Systems (Cognitive Technologies)
Multimodal human-computer interaction: A survey
Computer Vision and Image Understanding
Multimodal Interfaces: A Survey of Principles, Models and Frameworks
Human Machine Interaction
Proceedings of the 3rd International Convention on Rehabilitation Engineering & Assistive Technology
Fusion engines for multimodal input: a survey
Proceedings of the 2009 international conference on Multimodal interfaces
| Hi-index | 0.00 |
As a result of demographic developments and medical progress, the number of elderly and very old patients with multiple illnesses will increase in all areas of care. After stays at a clinic, it is important that rehabilitation exercises are continued at home. We developed an interactive training system to be installed in the homes of elderly people that should motivate and enhance the training experience at home. In this paper, we describe the simple-to-use multimodal interface of the system which facilitates the interactions with a virtual therapist. During various exercises, an integrated sensor system recognizes the user's movements. The multimodal visual feedback system supports and controls the exercises of the user and rates his performance. The system allows social interaction between the therapist, patient and/or other users via video conference and enables them to discuss problems as they arise. Furthermore, the therapist can remotely make adjustments to the users training protocol based on the monitored performance feedback.