Tilt-Based support for multimodal text entry on touchscreen smartphones: using pitch and roll

Authors:
Sandi Ljubic;Mihael Kukec;Vlado Glavinic
Affiliations:
Faculty of Engineering, University of Rijeka, Rijeka, Croatia;Medimurje University of Applied Sciences in Cakovec, Cakovec, Croatia;Faculty of Electrical Engineering and Computing, University of Zagreb, Zagreb, Croatia
Venue:
UAHCI'13 Proceedings of the 7th international conference on Universal Access in Human-Computer Interaction: applications and services for quality of life - Volume Part III
Year:
2013

Citing 16
Cited 0

Tilting operations for small screen interfaces

Proceedings of the 9th annual ACM symposium on User interface software and technology
Universal usability

Communications of the ACM
Sensing techniques for mobile interaction

UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
TiltType: accelerometer-supported text entry for very small devices

Proceedings of the 15th annual ACM symposium on User interface software and technology
Measuring errors in text entry tasks: an application of the Levenshtein string distance statistic

CHI '01 Extended Abstracts on Human Factors in Computing Systems
Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
KSPC (Keystrokes per Character) as a Characteristic of Text Entry Techniques

Mobile HCI '02 Proceedings of the 4th International Symposium on Mobile Human-Computer Interaction
The Unigesture Approach

Mobile HCI '02 Proceedings of the 4th International Symposium on Mobile Human-Computer Interaction
Phrase sets for evaluating text entry techniques

CHI '03 Extended Abstracts on Human Factors in Computing Systems
TiltText: using tilt for text input to mobile phones

Proceedings of the 16th annual ACM symposium on User interface software and technology
Recent developments in text-entry error rate measurement

CHI '04 Extended Abstracts on Human Factors in Computing Systems
Tilt techniques: investigating the dexterity of wrist-based input

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
GesText: accelerometer-based gestural text-entry systems

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Multi-modal text entry and selection on a mobile device

Proceedings of Graphics Interface 2010
From plastic to pixels: in search of touch-typing touchscreen keyboards

interactions
WalkType: using accelerometer data to accomodate situational impairments in mobile touch screen text entry

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Quantified Score

Hi-index	0.00

Visualization

Abstract

In this paper we proposea multimodal text entry method for touchscreen smartphones, where standard Tap modality can be used in combination with Pitch and Roll movements that change the orientation of the mobile device. Data from the built-in orientation sensors are used as a basis for commands that support character layout changing. Tilting the device in the appropriate direction will cause visual enlargement of the corresponding half of the current keyboard layout, thus enabling easier character selection, and solely sensor-based text entry. The prototype implementation of the proposed interaction method is analyzed and evaluated via usability testing experiments, with special focus on efficiency of text entry. As the proposed method is also applicable on touchscreen tablets, the form factor of mobile devices is reviewed with respect to text entry performance both of supported interaction modalities (tilt-only and tilt-and-tap) and of possible device orientations (portrait and landscape).