A hand tracking for a human computer interaction system by the modified block matching algorithm

• Authors: Jin Ok Kim
• Venue: ICCS'03 Proceedings of the 1st international conference on Computational science: PartI
• Year: 2003

A GUI (graphical user interface) has been a dominant platform for HCI (human computer interaction). A GUI-based interaction has made computers simpler and easier to use. The GUI-based interaction, however, does not easily support the range of interaction necessary to meet users' needs that are natural, intuitive, and adaptive. In this paper, the modified BMA (block matching algorithm) is proposed to track a hand in a sequence of an image and to recognize it in each video frame in order to replace a mouse with a pointing device for a virtual reality. The HCI system with 30 frames per second is realized in this paper. The modified BMA is proposed to estimate a position of the hand and segmentation with an orientation of motion and a color distribution of the hand region for real-time processing. The experimental result shows that the modified BMA with the YCbCr (luminance Y, component blue, component red) color coordinate guarantees the real-time processing and the recognition rate. The YCbCr color coordinate requires less bits to be coded than the RGB (red, green, blue) color coordinate with omitting the luminance of each pixel color and has less sensitivity to surrounding circumstances. The hand tracking by the modified BMA can be applied to a virtual reality or a game or an HCI system for the disable.