MouthType: text entry by hand and mouth

Authors:
Michael J. Lyons;Chi-Ho Chan;Nobuji Tetsutani
Affiliations:
ATR Intelligent Robotics and Communications Lab & Media Information Science Lab, Kyoto, Japan;ATR Intelligent Robotics and Communications Lab & Media Information Science Lab, Kyoto, Japan;ATR Intelligent Robotics and Communications Lab & Media Information Science Lab, Kyoto, Japan
Venue:
CHI '04 Extended Abstracts on Human Factors in Computing Systems
Year:
2004

Citing 2
Cited 5

Phrase sets for evaluating text entry techniques

CHI '03 Extended Abstracts on Human Factors in Computing Systems
TiltText: using tilt for text input to mobile phones

Proceedings of the 16th annual ACM symposium on User interface software and technology

Voice activity detection by lip shape tracking using EBGM

Proceedings of the 15th international conference on Multimedia
Text Entry Systems: Mobility, Accessibility, Universality

Text Entry Systems: Mobility, Accessibility, Universality
Mobile interaction design: Integrating individual and organizational perspectives

Information-Knowledge-Systems Management - Enterprise Mobility: Applications, Technologes and Strategies
Analysis of Features for Efficient Japanese Vowel Recognition

IEICE - Transactions on Information and Systems
HCI and the face: towards an art of the soluble

HCI'07 Proceedings of the 12th international conference on Human-computer interaction: interaction design and usability

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we describe a novel text entry method which uses coordinated motor action of hand and mouth. A vision based algorithm is used to gauge shape parameters of the cavity of the open mouth. These are mapped to a discrete set of input states which are combined with keypad input in a factorial manner to allow unambiguous input of a large number of symbols. The method is implemented and tested for an alphabetic writing system (the Roman alphabet) and a syllabic writing system (Japanese hiragana). We report the results of preliminary experiments to measure text entry speed and error rate.