Shoogle: excitatory multimodal interaction on mobile devices

Authors:
John Williamson;Roderick Murray-Smith;Stephen Hughes
Affiliations:
University of Glasgow, Scotland;University of Glasgow, Scotland and NUI, Maynooth, Ireland;SAMH Engineering Services, Dublin, Ireland
Venue:
Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Year:
2007

Citing 9
Cited 73

Tilting operations for small screen interfaces

Proceedings of the 9th annual ACM symposium on User interface software and technology
Sensing techniques for mobile interaction

UIST '00 Proceedings of the 13th annual ACM symposium on User interface software and technology
A practical model for subsurface light transport

Proceedings of the 28th annual conference on Computer graphics and interactive techniques
Pointing without a pointer

CHI '04 Extended Abstracts on Human Factors in Computing Systems
Foreground and background interaction with sensor-enhanced mobile devices

ACM Transactions on Computer-Human Interaction (TOCHI)
Continuous Sonic Feedback from a Rolling Ball

IEEE MultiMedia
PebbleBox and CrumbleBag: tactile interfaces for granular synthesis

NIME '04 Proceedings of the 2004 conference on New interfaces for musical expression
Improving Contact Realism through Event-Based Haptic Feedback

IEEE Transactions on Visualization and Computer Graphics
Model-Based, multimodal interaction in document browsing

MLMI'06 Proceedings of the Third international conference on Machine Learning for Multimodal Interaction

ActionCube: a tangible mobile gesture interaction tutorial

Proceedings of the 2nd international conference on Tangible and embedded interaction
Stane: synthesized surfaces for tactile input

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Rub the stane

CHI '08 Extended Abstracts on Human Factors in Computing Systems
A novel interface to present emotional tactile sensation to a palm using air pressure

CHI '08 Extended Abstracts on Human Factors in Computing Systems
The openinterface framework: a tool for multimodal interaction.

CHI '08 Extended Abstracts on Human Factors in Computing Systems
Did you feel something? Distracter tasks and the recognition of vibrotactile cues

Interacting with Computers
OIDE: un outil pour la conception et le développement d'interfaces multimodales

UbiMob '08 Proceedings of the 4th French-speaking conference on Mobility and ubiquity computing
HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces

HCI Beyond the GUI: Design for Haptic, Speech, Olfactory, and Other Nontraditional Interfaces
Flutter: directed random browsing of photo collections with a tangible interface

Proceedings of the 7th ACM conference on Designing interactive systems
Point-to-GeoBlog: gestures and sensors to support user generated content creation

Proceedings of the 10th international conference on Human computer interaction with mobile devices and services
Dynamic audiotactile feedback in gesture interaction

Proceedings of the 10th international conference on Human computer interaction with mobile devices and services
T-Bars: towards tactile user interfaces for mobile touchscreens

Proceedings of the 10th international conference on Human computer interaction with mobile devices and services
Vibrotactile feedback as an orientation aid for blind users of mobile guides

Proceedings of the 10th international conference on Human computer interaction with mobile devices and services
Wrist rotation for interaction in mobile contexts

Proceedings of the 10th international conference on Human computer interaction with mobile devices and services
Integrated modelling of sonic vibration and macroscopic object movement: an example of an interactive ball game

Proceedings of the 3rd international conference on Digital Interactive Media in Entertainment and Arts
Presentation of Force-Motion Relationship by Inertial Force Display

EuroHaptics '08 Proceedings of the 6th international conference on Haptics: Perception, Devices and Scenarios
A Model-Based Approach to Supporting Configuration in Ubiquitous Systems

Interactive Systems. Design, Specification, and Verification
An Audio-Haptic Aesthetic Framework Influenced by Visual Theory

HAID '08 Proceedings of the 3rd international workshop on Haptic and Audio Interaction Design
Multimodal slideshow: demonstration of the openinterface interaction development environment

ICMI '08 Proceedings of the 10th international conference on Multimodal interfaces
Rotational Dynamics for Design of Bidirectional Feedback during Manual Interaction

Proceedings of the 2nd International Conference on Fun and Games
Test-Bed for Multimodal Games on Mobile Devices

Proceedings of the 2nd International Conference on Fun and Games
Participatory design workshops to evaluate multimodal applications

Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges
GeoPoke: rotational mechanical systems metaphor for embodied geosocial interaction

Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges
Raising Awareness about Space via Vibro-Tactile Notifications

EuroSSC '08 Proceedings of the 3rd European Conference on Smart Sensing and Context
Rich Tactile Output on Mobile Devices

AmI '08 Proceedings of the European Conference on Ambient Intelligence
Audio or tactile feedback: which modality when?

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Investigating background & foreground interactions using spatial audio cues

CHI '09 Extended Abstracts on Human Factors in Computing Systems
Modèle d'interaction pour les systèmes mixtes

IHM '07 Proceedings of the 19th International Conference of the Association Francophone d'Interaction Homme-Machine
Testing inertial sensor performance as hands-free human-computer interface

WSEAS Transactions on Computers
Mobile Device Interaction with Force Sensing

Pervasive '09 Proceedings of the 7th International Conference on Pervasive Computing
An evaluation of inertial sensor based pointing device using multidirectional point-and-select task

ICAI'09 Proceedings of the 10th WSEAS international conference on Automation & information
Enhancing personal communication with spatial haptics: Two scenario-based experiments on gestural interaction

Journal of Visual Languages and Computing
Transmission of Information through Haptic Interaction

VMR '09 Proceedings of the 3rd International Conference on Virtual and Mixed Reality: Held as Part of HCI International 2009
Head tilting for interaction in mobile contexts

Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
Sweep-Shake: finding digital resources in physical environments

Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
overView: physically-based vibrotactile feedback for temporal information browsing

Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
Gestures all around us: user differences in social acceptability perceptions of gesture based interfaces

Proceedings of the 11th International Conference on Human-Computer Interaction with Mobile Devices and Services
Exploring the Use of Discrete Gestures for Authentication

INTERACT '09 Proceedings of the 12th IFIP TC 13 International Conference on Human-Computer Interaction: Part II
Toward the design and evaluation of continuous sound in tangible interfaces: The Spinotron

International Journal of Human-Computer Studies
Evaluating haptics for information discovery while walking

Proceedings of the 23rd British HCI Group Annual Conference on People and Computers: Celebrating People and Technology
Novel tactile display for emotional tactile experience

Proceedings of the International Conference on Advances in Computer Enterntainment Technology
EgoViz --- A Mobile Based Spatial Interaction System

W2GIS '09 Proceedings of the 9th International Symposium on Web and Wireless Geographical Information Systems
Whack gestures: inexact and inattentive interaction with mobile devices

Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction
valeo: alienation gesture-enhanced tactile pain logging

Proceedings of the fourth international conference on Tangible, embedded, and embodied interaction
Sonic souvenirs: exploring the paradoxes of recorded sound for family remembering

Proceedings of the 2010 ACM conference on Computer supported cooperative work
The exploration of non-visual interaction for social proximity applications in a Taiwanese night market

OZCHI '09 Proceedings of the 21st Annual Conference of the Australian Computer-Human Interaction Special Interest Group: Design: Open 24/7
Crosstrainer: testing the use of multimodal interfaces in situ

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Usable gestures for mobile interfaces: evaluating social acceptability

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Social gravity: a virtual elastic tether for casual, privacy-preserving pedestrian rendezvous

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
FM radio: family interplay with sonic mementos

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Weight-shifting mobiles: two-dimensional gravitational displays in mobile phones

CHI '10 Extended Abstracts on Human Factors in Computing Systems
Pot à musique: tangible interaction with digital media

CHI '10 Extended Abstracts on Human Factors in Computing Systems
Designing eyes-free interaction

HAID'07 Proceedings of the 2nd international conference on Haptic and audio interaction design
Hear it is: enhancing rapid document browsing with sound cues

ECDL'09 Proceedings of the 13th European conference on Research and advanced technology for digital libraries
Virtual hooping: teaching a phone about hula-hooping for fitness, fun and rehabilitation

Proceedings of the 12th international conference on Human computer interaction with mobile devices and services
Inertial force display to represent content inside the box

EuroHaptics'10 Proceedings of the 2010 international conference on Haptics: generating and perceiving tangible sensations, Part I
Touching the void: gestures for auditory interfaces

Proceedings of the fifth international conference on Tangible, embedded, and embodied interaction
Psychophysical model for vibrotactile rendering in mobile devices

Presence: Teleoperators and Virtual Environments
A novel taxonomy for gestural interaction techniques based on accelerometers

Proceedings of the 16th international conference on Intelligent user interfaces
Exploring the possibilities of body motion data for human computer interaction research

USAB'10 Proceedings of the 6th international conference on HCI in work and learning, life and leisure: workgroup human-computer interaction and usability engineering
A haptic wristwatch for eyes-free interactions

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Gaze-directed hands-free interface for mobile interaction

HCII'11 Proceedings of the 14th international conference on Human-computer interaction: interaction techniques and environments - Volume Part II
CornerPen: smart phone is the pen

HCII'11 Proceedings of the 14th international conference on Human-computer interaction: towards mobile and intelligent interaction environments - Volume Part III
Body, movement, gesture & tactility in interaction with mobile devices

Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services
Multimodal mobile interactions: usability studies in real world settings

ICMI '11 Proceedings of the 13th international conference on multimodal interfaces
PicoTales: collaborative authoring of animated stories using handheld projectors

Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work
iFeeling: vibrotactile rendering of human emotions on mobile phones

Mobile Multimedia Processing
Shaking a box to estimate the property of content

EuroHaptics'12 Proceedings of the 2012 international conference on Haptics: perception, devices, mobility, and communication - Volume Part I
Touching the micron: tactile interactions with an optical tweezer

MobileHCI '12 Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services
Exploring casual point-and-tilt interactions for mobile geo-blogging

Personal and Ubiquitous Computing
Tactile perceptions of digital textiles: a design research approach

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Gesture output: eyes-free output using a force feedback touch surface

Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
Peripheral vibro-tactile displays

Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services

Quantified Score

Hi-index	0.01

Visualization

Abstract

Shoogle is a novel, intuitive interface for sensing data withina mobile device, such as presence and properties of textmessages or remaining resources. It is based around activeexploration: devices are shaken, revealing the contents rattlingaround "inside". Vibrotactile display and realistic impactsonification create a compelling system. Inertial sensingis used for completely eyes-free, single-handed interactionthat is entirely natural. Prototypes are described runningboth on a PDA and on a mobile phone with a wireless sensorpack. Scenarios of use are explored where active sensing ismore appropriate than the dominant alert paradigm.