On temporal-spatial realism in the virtual reality environment
UIST '91 Proceedings of the 4th annual ACM symposium on User interface software and technology
Sensitivity to haptic-audio asynchrony
Proceedings of the 5th international conference on Multimodal interfaces
Feel what you hear: haptic feedback as an accompaniment to mobile music playback
Proceedings of Interacting with Sound Workshop: Exploring Context-Aware, Local and Social Audio Applications
Playing with tactile feedback latency in touchscreen interaction: two approaches
INTERACT'11 Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part II
Acquisition of dynamically revealed multimodal targets
ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
Using mobile phones to interact with tabletop computers
Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces
Development of a taxonomy to improve human-robot-interaction through multimodal robot feedback
CHI '13 Extended Abstracts on Human Factors in Computing Systems
| Hi-index | 0.00 |
Multimodal interaction is becoming common in many kinds of devices, particularly mobile phones. If care is not taken in design and implementation, there may be latencies in the timing of feedback in the different modalities may have unintended effects on users. This paper introduces an easy to implement multimodal latency measurement tool for touchscreen interaction. It uses off-the-shelf components and free software and is capable of measuring latencies accurately between different interaction events in different modalities. The tool uses a high-speed camera, a mirror, a microphone and an accelerometer to measure the touch, visual, audio and tactile feedback events that occur in touchscreen interaction. The microphone and the accelerometer are both interfaced with a standard PC soundcard that makes the measurement and analysis simple. The latencies are obtained by hand and eye using a slow-motion video player and an audio editor. To validate the tool, we measured four commercial mobile phones. Our results show that there are significant differences in latencies, not only between the devices, but also between different applications and modalities within one device. In this paper the focus is on mobile touchscreen devices, but with minor modifications our tool could be also used in other domains.