Remote assistance using visual prompts for demented elderly in cooking

Authors:
Sei Ikeda;Zeeshan Asghar;Jaakko Hyry;Petri Pulli;Antti Pitkanen;Hirokazu Kato
Affiliations:
Nara Institute of Science and Technology, Nara, Japan;University of Oulu, Oulu, Finland;University of Oulu, Oulu, Finland;University of Oulu, Oulu, Finland;University of Oulu, Oulu, Finland;Nara Institute of Science and Technology, Nara, Japan
Venue:
Proceedings of the 4th International Symposium on Applied Sciences in Biomedical and Communication Technologies
Year:
2011

Citing 16
Cited 2

Spatial workspace collaboration: a SharedView video support system for remote collaboration capability

CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
GestureCam: a video communication system for sympathetic remote collaboration

CSCW '94 Proceedings of the 1994 ACM conference on Computer supported cooperative work
Collaboration in performance of physical tasks: effects on outcomes and communication

CSCW '96 Proceedings of the 1996 ACM conference on Computer supported cooperative work
Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography

Communications of the ACM
CounterActive: an interactive cookbook for the kitchen counter

CHI '01 Extended Abstracts on Human Factors in Computing Systems
Effects of head-mounted and scene-oriented video systems on remote collaboration on physical tasks

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Telepointer: Hands-Free Completely Self Contained Wearable Visual Augmented Reality without Headwear and without any Infrastructural Reliance

ISWC '00 Proceedings of the 4th IEEE International Symposium on Wearable Computers
Real situations of wearable computers used for video conferencing - and implications for terminal and network design

ISWC '01 Proceedings of the 5th IEEE International Symposium on Wearable Computers
Remote Collaboration using a Shoulder-Worn Active Camera/Laser

ISWC '04 Proceedings of the Eighth International Symposium on Wearable Computers
Augmenting kitchen appliances with a shared context using knowledge about daily events

Proceedings of the 11th international conference on Intelligent user interfaces
The Kitchen as a Graphical User Interface

SIGGRAPH '04 ACM SIGGRAPH 2004 Art gallery
Kitchen stories: sharing recipes with the Living Cookbook

Personal and Ubiquitous Computing
The use of an intelligent prompting system for people with dementia

interactions - Designing for seniors: innovations for graying times
Enabling Calorie-Aware Cooking in a Smart Kitchen

PERSUASIVE '08 Proceedings of the 3rd international conference on Persuasive Technology
Ambient kitchen: designing situated services using a high fidelity prototyping environment

Proceedings of the 2nd International Conference on PErvasive Technologies Related to Assistive Environments
Problems people with dementia have with kitchen tasks: The challenge for pervasive computing

Interacting with Computers

Using compliant robots as projective interfaces in dynamic environments

ICSR'12 Proceedings of the 4th international conference on Social Robotics
MimiCook: a cooking assistant system with situated guidance

Proceedings of the 8th International Conference on Tangible, Embedded and Embodied Interaction

Quantified Score

Hi-index	0.00

Visualization

Abstract

This paper presents a smart kitchen system for supporting demented elderly cooking in a kitchen. In this system, a remote supporter provides a user with verbal and visual prompts manually. As a prompting method for this system projection should be chosen as a priority because it enables direct pointing of targets in a real scene. Even if projection is used as a priority, this system should be designed to solve three practical problems: 1) there are many areas where sharp images cannot be projected in a kitchen, 2) kitchen is a too complex environment to display visual prompts using only a single method, 3) remote supporters do not know the kitchen environment well enough. In this paper we propose a novel system overcoming the above problems as follows, respectively.1) The system first tries indirect projection of circular markers as visual prompts around target objects.2) Proper method is automatically selected from using projector, embedded monitor and illumination devices based on environmental information.3) The system automatically acquires flat surfaces to project on and their reflectance properties as the environmental information. Based on an observation of two elderly suffering from dementia, we discuss the feasibility and concrete problems in displaying visual prompt and how to solve them technically.