Gesture-based interface using baby signs for the elderly and people with mobility impairment in a smart house environment

  • Authors:
  • Tae-Young Lee;Heon-Hui Kim;Kwang-Hyun Park

  • Affiliations:
  • Kwangwoon University, Seoul, Korea;Kwangwoon University, Seoul, Korea;Kwangwoon University, Seoul, Korea

  • Venue:
  • ICOST'10 Proceedings of the Aging friendly technology for health and independence, and 8th international conference on Smart homes and health telematics
  • Year:
  • 2010

Quantified Score

Hi-index 0.00

Visualization

Abstract

We present a development of a gesture-based interface for the elderly and people with mobility impairment in a smart house environment. To reduce a burden of memorizing a variety of gesture commands, we introduce baby signs which are natural and easy-to-remember body signs without special education. The baby signs can be applied not only to communicate with others but also to interact with a computer for people with low level of proficiency in conventional peripherals. To achieve this purpose, we have attempted to create a real application working under illumination change and real-time requirement. The system observes the user's sign by a monitor-mounted camera and color gloves. Introducing a robust hand segmentation method against illumination change and adopting HMMs, our initial result shows 94.33% success rate for 6 sign words.