Human-centered fingertip mandarin input system using single camera

  • Authors:

  • Chih-Chang Yu;Hsu-Yung Cheng;Bor-Shenn Jeng;Chien-Cheng Lee;Wei-Tyng Hong

  • Affiliations:

  • Department of Computer Science and Information Engineering, Vanung University, Jhongli City, Taoyuan, Taiwan;Department of Computer Science and Information Engineering, National Central University, Jhongli City, Taoyuan, Taiwan;Department of Communications Engineering, Communication Research Center, Yuan-Ze University, Chung-Li, Taoyuan, Taiwan;Department of Communications Engineering, Communication Research Center, Yuan-Ze University, Chung-Li, Taoyuan, Taiwan;Department of Communications Engineering, Communication Research Center, Yuan-Ze University, Chung-Li, Taoyuan, Taiwan

  • Venue:
  • MMM'11 Proceedings of the 17th international conference on Advances in multimedia modeling - Volume Part II
  • Year:
  • 2011

Quantified Score

Hi-index 0.00

Visualization

Abstract

Designing a user friendly Chinese input system is a challenging task due to the logographic nature of Chinese characters. Using fingertips and cameras to replace pens and touch panels as input devices could reduce the cost and improve ease-of-use and comfort of the computer-human interface. In this work, Chinese character entry is achieved using Mandarin Phonetic Symbol (MPS) recognition via on-line fingertip tracking. In the proposed system, particle filters are applied for robust fingertip tracking. Afterwards, MPS recognition is performed on the tracked fingertip trajectories using Hidden Markov Models. In the proposed system, the challenges of entering, leaving, and virtual strokes caused by video-based fingertip input can be overcome. We conduct experiments to validate that the MPS symbols written by fingertips are successfully and efficiently recognized using the proposed framework.