Motion-path based in car gesture control of the multimedia devices

  • Authors:
  • A.S.M. Mahfujur Rahman;Jamal Saboune;Abdulmotaleb El Saddik

  • Affiliations:
  • University of Ottawa, Ottawa, ON, Canada;University of Ottawa, Ottawa, Canada;University of Ottawa, Ottawa, Canada

  • Venue:
  • Proceedings of the first ACM international symposium on Design and analysis of intelligent vehicular networks and applications
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

The goal of this work is to create a simple and intuitive interaction scheme for the in-car multimedia devices. In fact, we propose a hand gestures control that aims to minimize the users distraction while driving. We devise a set of gesture vocabulary for a the multimedia device interaction. Users hand gestures are recognized by capturing the motion-path while they draw different symbols in the air. In order to capture the motion-path, we use Microsoft Kinect camera's 3D body tracking capability. As the camera tracks user's hands, it produces a sequence of motion-points of the body joints, which are then analyzed syntactically to recognize the intended hand gestures. The recognized gesture is further used to interact with the in-car multimedia devices for accessing various entertainment services. Browsing media playlists, changing the track of the audio player, and playing/pausing the media are few examples for which we have integrated the gesture-based interaction. The interaction scheme devoid of any graphical user interface, rather incorporates haptic and audio modality to provide selection feedbacks to the user. Our experiment shows that the proposed gesture recognition technique is robust and its simplified interaction scheme in the automobile environment is interesting and appealing to the people.