Embodied user interfaces for really direct manipulation
Communications of the ACM
Embodied User Interfaces: Towards Invisible User Interfaces
Proceedings of the IFIP TC2/TC13 WG2.7/WG13.4 Seventh Working Conference on Engineering for Human-Computer Interaction
Shoogle: excitatory multimodal interaction on mobile devices
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
| Hi-index | 0.00 |
Digital artifacts based on physical metaphors strongly benefit from dynamic, realtime reactive sound feedback. Making use of one integral physical model and digital implementation simultaneously for both, macroscopic, visual object behaviour and sonic feedback allows to realise scenarios not achievable in a conventional approach where sound is triggered or controlled in a one-way fashion from a macroscopic simulation. By careful consideration of possible simplifications such an integrated approach may be feasible in realtime implementation and can allow to reach higher levels of synchronicity and sensory integration.