A First Investigation into the Effectiveness of Tactons
WHC '05 Proceedings of the First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems
Audio-haptic feedback in mobile phones
CHI '05 Extended Abstracts on Human Factors in Computing Systems
Peopletones: a system for the detection and notification of buddy proximity on mobile phones
Proceedings of the 6th international conference on Mobile systems, applications, and services
Sound-Specific Vibration Interface using Digital Signal Processing
CSSE '08 Proceedings of the 2008 International Conference on Computer Science and Software Engineering - Volume 04
Vibrotactile score: A score metaphor for designing vibrotactile patterns
WHC '09 Proceedings of the World Haptics 2009 - Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems
Designing the Model Human Cochlea: An Ambient Crossmodal Audio-Tactile Display
IEEE Transactions on Haptics
Perceived Vibration Strength in Mobile Devices: The Effect of Weight and Frequency
IEEE Transactions on Haptics
Design of Dynamic Vibrotactile Textures
IEEE Transactions on Haptics
Psychophysical model for vibrotactile rendering in mobile devices
Presence: Teleoperators and Virtual Environments
Consonance perception of vibrotactile chords: a feasibility study
HAID'11 Proceedings of the 6th international conference on Haptic and audio interaction design
Perceptual space and adjective rating of sinusoidal vibrations perceived via mobile device
HAPTIC '10 Proceedings of the 2010 IEEE Haptics Symposium
Saliency-Driven tactile effect authoring for real-time visuotactile feedback
EuroHaptics'12 Proceedings of the 2012 international conference on Haptics: perception, devices, mobility, and communication - Volume Part I
| Hi-index | 0.01 |
In this paper, we propose a real-time perception-level audio-to-vibrotactile translation algorithm. Unlike previous signal-level conversion methods, our algorithm considers only perceptual characteristics, such as loudness and roughness, of audio and tactile stimuli. This perception-level approach allows for designing intuitive and explicit conversion models with clear understandings of their perceptual consequences. Our current implementation is tailored to accurate detection of special sound effects to provide well-synchronized audio-tactile feedback in immersive applications. We also assessed the performance of our translation algorithm in terms of the detection rate of special sound effects, computational performance, and user preference. All the experimental results supported that our algorithm works well as intended with better performance than the signal-level conversion methods, especially for games. Our algorithm can be easily realized in current products, including mobile devices, gaming devices, and 4D home theater systems, for richer user experience.